essentials of the manuscript · editors james h. lubowitz, m.d. editor-in-chief michael j. rossi,...

45
CME- 3 AMA PRA Category 1 Credits per review Essentials of the Manuscript

Upload: others

Post on 23-May-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

CME- 3 AMA PRA Category 1 Credits per review

Essentials of the Manuscript

Page 2: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

EditorsJames H. Lubowitz, M.D. Editor-in-Chief

Michael J. Rossi, M.D. Assistant Editor-in-Chief

Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Editorial StaffDeborah VanNoy Managing Editor

Journal Staff

Page 3: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

• Nam-Hong Choi

• Aman Dhawan

• Michael Feldman

• Joshua Harris

• Erik Hohmann

• Tim Jackson

• Jüri Kartus

• Darius Moezzi

• Nikoloas Paschos

• Mark Siegel

• Dan Solomon

• Brian Waterman

• Mark P. Cote, Statistics

• Marty Leland, Technology

Associate Editors

Page 4: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

How to Organize a Manuscript

•Title

•Abstract

• Introduction

•Methods

•Results

•Discussion

•Conclusions

•References

•Tables

•Figures and Legends

Page 5: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Introduction

1. Be brief

2. Identify the Controversy

3. State your Purpose

4. State your Hypothesis

Page 6: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Introduction

•1. Be brief

•2. Identify the Controversy

•3. State your Purpose

•4. State your Hypothesis

•Nothing else!

Page 7: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Introduction

Example

•Controversy: Does double-row rotator cuff improve outcome?

•Purpose: To compare double-row repair with single-row.

•Hypothesis: What you think answer will be before you start the study.

Page 8: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Methods

Should include:

1. Step-by-step description• Reproducible• Like a cookbook

2. Rationale for experimental design

for basic science

3. Statistical methods

4. All methods reflected in results and vice versa

Page 9: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Methods Are Most Important

•Fatal Flaws in Methods •Can not be fixed

•Get advice on Methods BEFORE you start•Prospective

• Before starting study

•Retrospective• Before extracting data

Page 10: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Levels of Evidence

•Clinical: “Therapeutic” Studies Most Common

•Randomized controlled trial = Level I• Rare

•Comparative study = Level II or III• Prospective versus retrospective• Same time/same institution

•Case series (no control group) = Level IV

•Expert opinion = Level V

Page 11: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Bias in Clinical Trials

Prevent “Reporting Bias”Appropriate outcome measures are

- Validated

- Universal (allows comparison to similar studies)

- Condition specific and- General health, and both

- Surgeon reported and- Patient reported

Page 12: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Bias in Clinical Trials

Selection (Allocation) Bias

•Treatment groups have different prognoses.•Apples versus oranges•Meniscus repair plus ACL in younger patients

versus meniscectomy without ACL in older

•Prevent Selection Bias•Randomize•Strict inclusion and exclusion criteria

Page 13: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Bias in Clinical Trials

Prevent Recording Bias

•Don’t influence the patient• Complete forms in private

•Don’t influence the physical exam• Operating surgeon should not perform assessment

•The patient may want to please the surgeon• So take steps to minimize recording bias

Page 14: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Bias in Clinical Trials

Transfer bias•Patients are lost to follow-up.•80% follow-up at 2 years is “gold standard”

Performance bias•Who performs the procedure

• No “right answer”

•Important to consider

Page 15: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Statistics

•Statistics for Authors and Reviewers

What are the common mistakes?

Page 16: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Which Statistical Test Should Be Used?

• Too many possibilities to show

• Writers should consult a statistician

• Reviewers should consult the 2017 Research Pearls Series

• http://www.arthroscopyjournal.org/pearls

Page 17: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Statistical Significance

Page 18: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Statistical Significance

•Statistical significance is only a guide

•Statistical significance cannot address clinical relevance

•Statistical significance is frequently “fragile”

• Different outcomes in a few patients

• Could change results

Page 19: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Clinical Significance

Clinical Significance is more important

•Statistical significance is only a guide

•Consider

• Minimal clinically important differences (MCID)

• Significant clinical benefits (SCB)

• Patient Acceptable Symptomatic States (PASS)

Page 20: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Clinical Significance

Overlapping Confidence Intervals may indicate lack of

Clinical Significance

Page 21: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Confidence Interval

• 95% confidence interval give degree of certainty

• Clinically significant differences

• Confidence Intervals tend not to overlap

More Informative Than a P Value

Page 22: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Reviewing the Statistics

Multiple Statistical Testing•Lots of outcome measures•Researcher will eventually get lucky

• 1/20 chance = 0.05• Results may not be reproducible

•Solution•Choose Primary Outcome Measure

• for hypothesis• and power analysis

Page 23: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Reviewing the Statistics

Results show “No difference”

•RED FLAG!!

•Check the

power analysis

Page 24: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Null Hypothesis

β (beta error)

BE ALERT FOR RED FLAG

•“No difference between groups”

BECAUSE IF

• too few patients

• too small a sample size

• not enough statistical power

RESULTS COULD BE WRONG

Page 25: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Results

•Organize parallel to Methods

• Everything in Methods must be reported… and vice versa

• Put the data in Tables or Figures

• Cite Table and Figures in text – Summarize the highlights in the text

Page 26: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Tables

Concise Results Summary

•Group data logically

•Label columns clearly

•Provide stand alone message• Include N, Mean, and Confidence Interval•Define all abbreviations in each Table

• May use Headers and/or Footers

Page 27: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Discussion

Compare and Contrast Similar Publications

• Try to explain contrasts

Page 28: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Limitations wrap up the Discussion

•Point out weaknesses before the conclusion

•Point out weaknesses before the Reviewer

•Consider bias:•Reporting•Recording•Performance•Transfer•Selection (allocation)

Page 29: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Conclusions

• Is hypothesis supported?• Yes or no?

•Based only on the specific reported results

•Conclusion should be word-for-word identical in the text and abstract

Page 30: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Title

Make the Title extremely interesting

• “Revise the Title and make it sexy”• Einar Eriksson, Founding Editor, KSSTA

• Delete “New” or “Novel”• Let the readers decide

Page 31: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Abstract

Introduction/Methods/Results/Conclusion

•Clinical• Add Level of Evidence

•Basic Science• Add Clinical Relevance

Page 32: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

References

Past 2-5 years plus a few classics

•Weak• the most references

•Strong• the most recent references

Page 33: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Figures

“A Picture is Worth a Thousand Words.”

-Labels and arrows essential

Page 34: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Figure Legends

Provide stand-alone message

Include:

•Side

•patient position

•viewing portal or imaging view

• Labels and/or arrows

•Detailed description

Page 35: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

What’s New?

•SYSTEMATIC REVIEWS• Strict search inclusion and exclusion criteria minimize bias

in article selection• Caveat: “Research waste”? (Lancet, 2015)

Page 36: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

What’s New?

•SYSTEMATIC REVIEWS• Strict search inclusion and exclusion criteria minimize bias

in article selection• AVOID improper pooling • Perform “qualitative” synthesis of

• Low LOE• High ROB• Heterogeneous studies

• AND explore the heterogeneity

•META-ANALYSES• Generally “quantitative” synthesis should be limited to

Randomized Controlled Trials

Page 37: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Arthroscopy on Social Media

@ArthroscopyJ

ArthroscopyJournal

Page 38: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Publish in Arthroscopy Techniques!

• Video-oriented

• Peer-reviewed

• Open access

• PubMed cited

The Open Access article processing charges for published

manuscripts in Arthroscopy Techniques are:

• $600 for AANA members • $900 for non-members

Page 39: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

What’s Out?

•CASE REPORTS• Rare exceptions

• New complications

Page 40: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Become a Top Reviewer

•Confidential comments

• Line-by-line review

•Reviewers are not copy editors

•But Copy editors are not surgeons/scientists• Copy editors correct spelling and grammar• Reviewers correct confusing science

•Merit-based promotion• Best reviewers start young• Best reviewers join Editorial Board• Best Editorial Board reviewers become AEs

Page 41: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Sign up to be a

Reviewer!

You will greatly enjoy

& learn from it!

Essentials of the Manuscript

Visit http://ees.elsevier.com/arth

Page 42: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Get a flash drive

Essentials of the Manuscript

Page 43: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Visit arthroscopyjournal.org

Essentials of the Manuscript

Page 44: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Panel Discussion and Questions

•Common Errors• Writing repetitious • Introduction or Discussion too long• Statistical (but not clinical) significance• Too few patients (no power analysis)• Too short minimum follow-up (< 2 years)• Excessive transfer bias (>20% at 2 years)• Weak inclusion/exclusion criteria (selection bias)• Poor randomization (selection bias)• No control group (Level 4 evidence)• Out of date references

Page 45: Essentials of the Manuscript · Editors James H. Lubowitz, M.D. Editor-in-Chief Michael J. Rossi, M.D. Assistant Editor-in-Chief Jefferson C. Brand, M.D. Assistant Editor-in-Chief

Thank You!

Essentials of the Manuscript