evidence-based practice: what it is and why it matters€¦ · “evidence based medicine is the...
TRANSCRIPT
![Page 1: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/1.jpg)
Center for Surveillance, Epidemiology,and Laboratory Services
Evidence-Based Practice: What It Is and Why It Matters
W. David Dotson, PhDOffice of Public Health GenomicsCenters for Disease Control and Prevention
![Page 2: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/2.jpg)
OUTLINE
What is evidence-based practice? The concept of evidence, and its role in decision making Challenges in assessing evidence in genetics A deeper dive into some tools of the trade Examples of understanding evidence in the “real world” Why does evidence-based practice matter? Resources
![Page 3: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/3.jpg)
What is Evidence-Based Practice?
![Page 4: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/4.jpg)
Evidence-Based Practice (EBP)
“Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients. The practice of evidence based medicine means integrating individual clinical expertise with the best available external clinical evidence from systematic research.” Sackett et al., 1996
http://guides.mclibrary.duke.edu/ebmtutorial/homehttps://www.bmj.com/content/312/7023/71
![Page 5: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/5.jpg)
Fundamental Tenets of Evidence-Based Medicine (EBM)
Evidence hierarchy as a guide in clinical decision making Evidence, on its own, is never sufficient to make a
clinical decision
Guyatt et al. User’s Guides to the Medical Literature. 2nd Edn. 2008
![Page 6: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/6.jpg)
Fundamental Tenets of Evidence-Based Medicine (EBM) cont.
Awareness of best available evidence required for best decision making
EBM helps us understand how trustworthy evidence is Evidence, on its own, is never sufficient to make a
clinical decision
Guyatt et al. User’s Guides to the Medical Literature. 3rd Edn. 2015
![Page 7: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/7.jpg)
Evidence and Decision Making
![Page 8: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/8.jpg)
libraryguides.umassmed.edu/EBM
Evidence Hierarchies
![Page 9: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/9.jpg)
The Randomized Controlled Trial
bmj.com/content/327/7429/1459
![Page 10: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/10.jpg)
A New Hierarchy?
M Hassan Murad et al. Evid Based Med 2016;21:125-127©2016 by BMJ Publishing Group Ltd
![Page 11: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/11.jpg)
Systematic Reviews to Guidelines
nationalacademies.org/hmd/Reports/2011/Clinical-Practice-Guidelines-We-Can-Trust.aspx
![Page 12: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/12.jpg)
Steps in Systematic Review
Identify question(s) Create protocol Define inclusion/exclusion criteria Systematic literature search Select studies for inclusion Extract data Assess quality of evidence Evaluate risk of bias Synthesize results
![Page 13: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/13.jpg)
Systematic Literature Search Flow
ncbi.nlm.nih.gov/pubmed/28295040
![Page 14: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/14.jpg)
Assessing Evidence in Genetics
![Page 15: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/15.jpg)
Organizing the Systematic Review
Design and organization of systematic reviews can be especially challenging for genetic or genomic-based topics
Often need to bring together information on– Analytic validity– Clinical validity– Clinical utility– Ethical, legal, and social implications– Other contextual issues
![Page 16: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/16.jpg)
Analytic Validity
Ability of test to accurately and reliably detect the genotype of interest
journals.lww.com/nutritiontodayonline/Abstract/2011/07000/An_Introduction_to_Assessing_Genomic_Screening_and.4.aspx
![Page 17: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/17.jpg)
Clinical Validity
Ability of test to detect or predict the clinical disorder (or phenotype) of interest
journals.lww.com/nutritiontodayonline/Abstract/2011/07000/An_Introduction_to_Assessing_Genomic_Screening_and.4.aspx
![Page 18: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/18.jpg)
Clinical Utility
Influence of test on health outcomes; risks vs benefits of introducing test in practice
https://www.ncbi.nlm.nih.gov/pubmed/22730450journals.lww.com/nutritiontodayonline/Abstract/2011/07000/An_Introduction_to_Assessing_Genomic_Screening_and.4.aspx
![Page 19: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/19.jpg)
cdc.gov/genomics/gtesting/acce/
ACCE Model
![Page 20: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/20.jpg)
Example Analytic Framework
Overarching Question
Adults, Major Depression,
SSRIs
CYP450 Genotype
Predict Efficacy
Predict Adverse Events
Health Outcomes
Phenotype, Metabolizer
Status
TreatmentDecisions
Analytic Validity Clinical Validity Clinical Utility
Modified from ncbi.nlm.nih.gov/pmc/articles/PMC2743609/
![Page 21: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/21.jpg)
Clinical Utility
Modified from ncbi.nlm.nih.gov/pmc/articles/PMC2743609/
![Page 22: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/22.jpg)
Clinical Validity
Modified from ncbi.nlm.nih.gov/pmc/articles/PMC2743609/
![Page 23: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/23.jpg)
Analytic Validity
Modified from ncbi.nlm.nih.gov/pmc/articles/PMC2743609/
![Page 24: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/24.jpg)
Meta-Analysis
![Page 25: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/25.jpg)
Systematic Review vs Meta-Analysis
![Page 26: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/26.jpg)
Objectives of Meta-Analysis
Summarize results from individual studies Analyze differences in results among studies Overcome small sample sizes of individual studies to detect effects of interest analyze end points that require larger sample sizes Determine if new studies are needed to investigate an
issue Generate new hypotheses for future studies
Modified from: http://www.ccjm.org/uploads/media/media_bfab903_431.pdf
![Page 27: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/27.jpg)
Effect Sizes
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3444174/pdf/i1949-8357-4-3-279.pdf
![Page 28: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/28.jpg)
Forest Plots
A. B. C.
Modified from http://onlinelibrary.wiley.com/doi/10.1111/1469-0691.12489/pdf
![Page 29: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/29.jpg)
Checking for Potential Bias
A. Symmetric Funnel Plot B. Asymmetric Funnel Plot
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3474302/
![Page 30: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/30.jpg)
Sources of Funnel Plot Asymmetry
http://www.ncbi.nlm.nih.gov/pubmed/9310563
![Page 31: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/31.jpg)
Critically Appraising a Meta-Analysis
Are the study results valid? Was a focused and clearly described research question
presented? Was the literature search both systematic and
reproducible? Was there a systematic study selection process? Characteristics of included studies were provided? Was there a quality assessment of included studies?
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3004078/
![Page 32: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/32.jpg)
Critically Appraising a Meta-Analysis (continued)
Statistical methods for combining studies were adequately reported?
How heterogeneous were the pooled studies? Was there an assessment of publication bias? What were the main results of the study? What were the practical significance and statistical
significance of the main results? What is the likelihood that these results were due to chance?
Are the results generalizable? To whom are they applicable?
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3004078/
![Page 33: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/33.jpg)
An Evidence Heuristic
![Page 34: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/34.jpg)
An Evidence Heuristic
ncbi.nlm.nih.gov/pmc/articles/PMC4689130/
![Page 35: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/35.jpg)
Levels of Evidence
Tier 1 –base of synthesized evidence supporting implementation in practice
Tier 2 – synthesized evidence not adequate to support routine implantation in practice; may still be useful in selective use strategies/decision making
Tier 3 – synthesized evidence supporting recommendations against use, or no relevant synthesized evidence
ncbi.nlm.nih.gov/pmc/articles/PMC4689130/
![Page 36: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/36.jpg)
Association Rules
ncbi.nlm.nih.gov/pmc/articles/PMC4689130/
![Page 37: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/37.jpg)
What is Practical in Public Health?
https://phgkb.cdc.gov/PHGKB/topicStartPage.action
![Page 38: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/38.jpg)
Examples
Understanding Evidence in the “Real World”
![Page 39: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/39.jpg)
Example: Importance of Understanding the Questions
ncbi.nlm.nih.gov/pubmed/26979548
![Page 40: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/40.jpg)
Some Limitations
Pooled the results of small studies, with separate meta-analyses for– Diet– Smoking cessation– Physical activity
What about differences between the genetic tests?
geneticexperts.org/dna-tests-dont-motivate-healthy-behavior-finds-review-of-research/
![Page 41: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/41.jpg)
Example: Conflicting Results
Modified from ncbi.nlm.nih.gov/pubmed/23670120
![Page 42: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/42.jpg)
Why Does EBP Matter?
![Page 43: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/43.jpg)
Evidence-Based Practice
Enables evidence-informed, standardized protocols, not “cookbook” health care
Affords transparent pathways to improving – Diagnosis– Treatment– Health outcomes
![Page 44: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/44.jpg)
Some Resources
![Page 45: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/45.jpg)
Sources of Systematic Reviews
Advisory Committee on Heritable Disorders in Newborns and Children
Agency for Healthcare Research & Quality (AHRQ) Cochrane Collaboration Health Technology Assessment International (HTAi)
![Page 46: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/46.jpg)
Sources of Practice Guidelines
American College of Medical Genetics and Genomics (ACMG)
American College of Obstetricians and Gynecologists (ACOG)
National Society of Genetic Counselors (NSGC) US Preventive Services Task Force (USPSTF)
![Page 47: Evidence-Based Practice: What It Is and Why It Matters€¦ · “Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions](https://reader033.vdocuments.net/reader033/viewer/2022042115/5e92e51dbb68a320453276f6/html5/thumbnails/47.jpg)
For more information, contact CDC1-800-CDC-INFO (232-4636)TTY: 1-888-232-6348 www.cdc.gov
The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.
Thank you!W. David Dotson, PhD
Office of Public Health Genomics
Centers for Disease Control and Prevention