basics of peer review steve mccaw illinois state university
TRANSCRIPT
![Page 1: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/1.jpg)
Basics of peer review
Steve McCawIllinois State University
www.castonline.ilstu.edu/mccaw
![Page 2: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/2.jpg)
Purpose of Peer Review
Improve what is publishedHelp the editor decide what to do with
the manuscriptHelp the author(s) improve the
manuscript
![Page 3: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/3.jpg)
Steps to MSSE review
Manuscript submitted electronicallyEntered into Editorial Manager systemAssigned to Associate Editor
• Steve Messier, Danny Pincivero, Steve McCaw• Identify and distribute to reviewers• Synthesize reviews• Makes a decision
• Accept/revise/reject
![Page 4: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/4.jpg)
Accept/Revise/Reject
Most authors will ultimately be unsatisfied• MSSE acceptance rate (Dr. Andrew Young):
• Goal29%• 2007: 39%• 2006: 31%
• Why a goal for acceptance?• Time to publication• MSSE wants only the highest quality manuscripts
![Page 5: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/5.jpg)
The Initial Contact Receive email request from Associate Editor
• Includes the Abstract and Due Date
• Respond ASAP (within 7 days)• Editorial Manager generated follow up
• Factors affecting taking on the review• Don’t bite off more than you can chew
• Suggest someone else• Do you have the expertise?• Do have the time?
• 2-4 hours for experienced• 8-12 hours for novice
• Is there a conflict of interest?• Real or Perceived
![Page 6: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/6.jpg)
Review Format
Confidential comments to Editor• Suitability for publication
• Worth allowing revisions?
• Possible research misconduct / ethical issues• Is a commentary warranted?
Comments to author• General
• Paraphrase the purpose, methods, results, discussion
• Specific comments (refer to page number and line number)• Major comments• Minor comments
![Page 7: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/7.jpg)
Provide rigorous, detailed and constructive
comments In my opinion, …As shown by Smith et al (2004), …
Utilize 1st person• “I didn’t understand…”, “I’d like more
explanation about…”, “I couldn’t follow…”Avoid 2nd person
• ‘You should …”, “You need to …”
![Page 8: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/8.jpg)
Scientific Quality
Research Question Methods
• Subjects• Design
Results• Tables/figures
Discussion References Title/Abstract
![Page 9: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/9.jpg)
Scientific Quality
Research Question Methods
• Subjects• Design
Results• Tables/figures
Discussion References Title/Abstract
Strengths&
Weaknesses
![Page 10: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/10.jpg)
Research Question
Clearly definedOriginal
• Specify what it adds to existing knowledge • Specify what it replicates
Leads to specific hypotheses Important?
• Clinicians/clinicians? Researchers? Educators? Policy makers? Patients? Athletes?
![Page 11: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/11.jpg)
Scientific Quality
Research Question Methods
• Subjects• Design
Results• Tables/figures
Discussion References Title/Abstract
S & W•Defined populations
•Inclusion/exclusion criteria•Statistical Power•Non-biased treatments (IVs)•# trials•Appropriate Detail
•Instrumentation•Data Reduction
•Clear outcome measures (DVs)•Statistical Analysis
![Page 12: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/12.jpg)
Scientific Quality
Research Question Methods
• Subjects• Design
Results• Tables/figures
Discussion References Title/Abstract
S & W•Appropriate order of presentation•Identify statistical significance•Tables/figures match text?
•No replication•Anything missing?
![Page 13: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/13.jpg)
Scientific Quality
Research Question Methods
• Subjects• Design
Results• Tables/figures
Discussion References Title/Abstract
S & WFive I’s of a good discussion•Integrate•Interpret•Implications•Identify Limitations•Ideas for future research
Casa, 2001
![Page 14: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/14.jpg)
Scientific Quality
Research Question Methods
• Subjects• Design
Results• Tables/figures
Discussion References Title/Abstract
S & W•Thorough?•Up to date?•Original ideas duly noted?
![Page 15: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/15.jpg)
Scientific Quality
Research Question Methods
• Subjects• Design
Results• Tables/figures
Discussion References Title/Abstract
S & W•Fit with the paper•Adequate overview
![Page 16: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/16.jpg)
General Points
You provide advice• Associate Editor makes decision
Be rigorous, courteous and constructive• May not be suitable for MSSE, but most get submitted
elsewhere Mum’s the word Do not use for revenge Declare competing interest Do not copy edit
• No punctuation or spelling (except names)• Does it read well and make sense?
Be timely
![Page 17: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/17.jpg)
Final Points
Everyone contributes to the review of a paper• Some flaws get through
• Write a letter to the editor• Reference in your own work
www.castonline.ilstu.edu/mccaw
![Page 18: Basics of peer review Steve McCaw Illinois State University](https://reader036.vdocuments.net/reader036/viewer/2022083007/56649e2f5503460f94b1fe4d/html5/thumbnails/18.jpg)
Acknowledgements
All who have served as MSSE reviewerBritish Medical Journal
• www.bmj.com/adviceCasa, D. Five I’s of a good discussion, NATA
News, August, 2001), p 56. Writing across the curriculum, UW-Madison