systematic reviews
DESCRIPTION
Presented by Luz Letelier at Rio Workshop 2010TRANSCRIPT
![Page 1: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/1.jpg)
4th WorkshopPrática Clinica Baseada em Evidências
Rio de Janeiro, 2010
REVISÕES SISTEMÁTICAS:Como interpretá-las?
SYSTEMATIC REVIEWS:How to interpret them
Luz M. Letelier Associate Professor, Internal Medicine
Faculty of Medicine, Pontificia Universidad Católica de Chile
![Page 2: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/2.jpg)
Navegando pelas RSsSailing arround SRs.....
What is a SR & why are they useful.
How to use / analyze a SR.
Where to find SRs.
![Page 3: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/3.jpg)
Estamos atualizados em relaEstamos atualizados em relação a o a conhecimento médico? conhecimento médico?
AreAre we up-to-date on medical information? we up-to-date on medical information?
• How many articles do you read a month?
• How many should you read?
• How big is the gap?
![Page 4: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/4.jpg)
Informação disponíveis Available information
Medline indexes 1530 new articles each day.
Haynes, ACP 2005
Cochrane Library gathers 20.000 new RCTs a year. (58/day) Haynes ACP 2005
> 6200 SRs in the Cochrane Library (today)
Keeps growing…
![Page 5: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/5.jpg)
EntEntão, tem algum problema?o, tem algum problema?Are we in trouble??Are we in trouble??
• We need to handle large amounts of information in order to deliver the best care to our patients
• We find it difficult to collect and appraise all these information.
•FRUSTRAFRUSTRAÇÇÃOO•FRUSTRATIONFRUSTRATION
![Page 6: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/6.jpg)
Why do we have trouble collecting information?Why do we have trouble collecting information?
• Huge amounts of information• Lack of skills for efficient searches….
![Page 7: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/7.jpg)
You are experts on efficient literature searches. √
CLINICAL SCENARIOYour last patient, a heavy smoker, asks if he should take vitamin A to prevent lung cancer.
During the workshopDuring the workshop
![Page 8: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/8.jpg)
SEARCH FOR EVIDENCESEARCH FOR EVIDENCE
• P: SMOKERS• I: VITAMIN A • C: NO TREATMENT• O: REDUCE LUNG CANCER
![Page 9: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/9.jpg)
Using PubMedUsing PubMed
Search Terms Hits2003
Hits2006
Hits2009
Hits2010
Beta-carotene or vitamin A
33.000 40.065 45.656 48.117
(Beta-carotene or vitamin A) and lung cancer
751 875 1107 1154
![Page 10: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/10.jpg)
At this point....At this point....Use a more efficient searching tool….
Clinical Query: Therapy & specific
99 hits
Let’s quickly screen the titles and abstracts.....
![Page 11: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/11.jpg)
BETA-CAROTENBETA-CAROTENEE ANDAND LUNGLUNG CANCER CANCER PREVENPREVENTTIONION
• NEJM 1994; 330:1029-1035
• The Effect of Vitamin E and Beta Carotene on the Incidence of Lung Cancer and Other Cancers in Male Smokers. Beta Carotene Cancer Prevention Study Group The Alpha-Tocopherol
• CONCLUSION: We found no reduction in the incidence of lung cancer among male smokers after five to eight years of dietary supplementation with alpha-tocopherol or beta carotene. In fact, this trial raises the possibility that these supplements may actually have harmful as well as beneficial effects.
![Page 12: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/12.jpg)
BETA-CAROTENBETA-CAROTENEE ANDAND LUNGLUNG CANCER CANCER PREVENPREVENTTIONION
• N Engl J Med 1996 May 2;334(18):1150-5
• Effects of a Combination of Beta Carotene and Vitamin A on Lung Cancer and Cardiovascular Disease. CARET Study
• CONCLUSION: After an average of four years of supplementation, the combination of beta carotene and vitamin A had no benefit and may have had an adverse effect on the incidence of lung cancer and on the risk of death from lung cancer, cardiovascular disease, and any cause in smokers and workers exposed to asbestos.
![Page 13: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/13.jpg)
BETA-CAROTENBETA-CAROTENEE ANDAND LUNGLUNG CANCER CANCER PREVENPREVENTTIONION
Cancer Causes Control 2000 Aug;11(7):617-26
• Effects of beta-carotene supplementation on cancer incidence by baseline characteristics in the Physicians' Health Study (PHS).
• CONCLUSION: The PHS found no overall effect of beta-carotene on total cancer, or the three most common site-specific cancers. The possibility of risk reduction within
specific subgroups remains.
![Page 14: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/14.jpg)
BETA-CAROTENBETA-CAROTENEE ANDAND LUNGLUNG CANCER CANCER PREVENPREVENTTIONION
Am J Clin Nutr 2000 Oct;72:990-7
Intake of specific carotenoids and risk of lung cancer in 2 prospective US cohorts
CONCLUSION: Data from 2 cohort studies suggest that several carotenoids may reduce the risk of lung cancer.
![Page 15: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/15.jpg)
BETA-CAROTENBETA-CAROTENEE ANDAND LUNGLUNG CANCER PREVEN CANCER PREVENTTIONION
Cancer Epidemiol Biomarkers Prev. 2006 ;15:1562-4.
Lung cancer chemoprevention: a randomized, double-blind trial in Linxian, China.
CONCLUSION: Supplementation with combinations of vitamins and minerals at nutrient-repletion levels for 5.25 years did not reduce lung cancer mortality in this nutrient-inadequate population in Linxian, China.
![Page 16: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/16.jpg)
BETA-CAROTENBETA-CAROTENEE ANDAND LUNGLUNG CANCER CANCER PREVENPREVENTTIONION
Rev Med Suisse. 2010 May 26;6:1046-8, 1050-2.
• Nutrition and physical activity: two targets for cancer prevention.The links between nutrition and cancer onset are now well established by epidemiological studies. The scientific evidence is presented in a report of the World Cancer Research Foundation (WCRF). Protective factors towards overall cancer risk are fruit and vegetable consumption and physical activity. Overweight and obesity, intakes of alcoholic beverage, fat, salt, high temperature cooked and processed red meat, increase cancer risk. In addition, beta-carotene systematic supplementation could increase lung cancer risk in smokers. As optimal controlling of these risk factors can decrease cancer mortality by 25%, nutritional counselling must be integrated in the global strategy of primary and secondary prevention of cancers.
![Page 17: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/17.jpg)
RResumindo (esumindo (Summarizing)Summarizing) BETA-CAROTENBETA-CAROTENEE ANDAND LUNGLUNG CANCER PREVEN CANCER PREVENTTIONION
• These supplements may have harmful as well as beneficial effects. 1994
• Vitamin A had no benefit and may have adverse effect on the incidence of lung cancer 1996
• No overall effect of beta-carotene on total cancer 2000• Several carotenoids may reduce the risk of lung cancer. 2000• Supplementation did not reduce lung cancer mortality 2006• Beta-carotene supplementation could increase lung cancer risk in smokers
2010
QUAIS RESULTADOS EU DEVO APLICAR?WHICH RESULTS SHOULD I APPLY?
![Page 18: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/18.jpg)
QUAIS RESULTADOS EU DEVO APLICAR?WHICH RESULTS SHOULD I APPLY?
a) The last oneb) All of themc) The biggest oned) The one in the best journale) Another solution
Are the studies similar? In their risk of bias (validity) In their results In their applicability
![Page 19: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/19.jpg)
ENTÃO...SO....
Besides handling large amounts of information we need to decide which results to believe....and apply to our patient.
![Page 20: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/20.jpg)
SOLUÇÃO (1)
DESTROY THE EVIDENCE
![Page 21: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/21.jpg)
SOLUÇÃO (2) Collect some information and give your best opinion.
“Narrative Review”or expert opinion
Good solution???
![Page 22: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/22.jpg)
SOLUÇÃO • Gather all available information using explicit,
reproducible and systematic method
REVISÕES SISTEMÁTICAS
SYSTEMATIC REVIEW
![Page 23: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/23.jpg)
DEFINIÇÃOREVISÕES SISTEMÁTICAS
SYSTEMATIC REVIEW
Summary of ALL available information regarding a specific clinical question, using explicit methods towards reducing bias.
Therapy / diagnosis / prognosis questions.
![Page 24: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/24.jpg)
META - ANALYSISStatistical method to summarize the results of a Systematic Review
DEFINIÇÃO
![Page 25: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/25.jpg)
REVISÕES Reviews
Narrative Review a topic in several
different aspects. No explicit method for
searching the evidence. No explicit method for
selecting information. No explicit method for
appraising information Should not have statistical
analysis.
Systematic Answers a specific question. Explicit method for
searching the evidence Explicit method for
selecting information. Explicit method for
appraising information. Might have statistical
analysis (Meta-analysis)
![Page 26: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/26.jpg)
Navegando pelas RSs Sailing arround SRs…next STOP
SRs what are they & why are they useful.
How to use/appraise a SR
Where to find SRs.
![Page 27: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/27.jpg)
Appraising aAppraising a SRSTEP 1
IS THERE A SENSIBLE AND SPECIFIC QUESTION? Any antibiotic for any infection Any macrolide for any respiratory infection Any dose of claritromicine for Community
Acquired Pneumonia (CAP) ATS I&II Claritromicine 250 mg vs 500mg bid for CAP in
patients 20 years old with asthma and allergy to penicillin.
TO REMEMBER: NOT TOO BROAD NOT TOO NARROW
![Page 28: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/28.jpg)
Appraising aAppraising a SRSTEP 2
INCLUSION - EXCLUSION CRITERIA
Explicit and related to the question Easy to apply by different reviewers Applied regardless of studies’s results
![Page 29: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/29.jpg)
Appraising aAppraising a SRSTEP 3
SEARCH FOR ALL AVAILABLE EVIDENCESensitive search strategy:
Several databases.Hand search:
References Grey literature: abstracts from conferences
Ask experts and researchers on the topic, for unpublished data.
AVOID PUBLICATION BIAS
![Page 30: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/30.jpg)
Appraising aAppraising a SRSTEP 4
CRITICAL APPRAISAL OF INCLUDED STUDIES
Very importantAvoid “garbage in” “garbage out”
Could be done:DescriptiveQuantitative: Scores (ie. Jadad score)
![Page 31: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/31.jpg)
COCHRANE COLLABORATION’S APPROACH:Methodological quality summary: review authors’ judgments about each methodological quality item for each included study.
![Page 32: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/32.jpg)
HIERARQY OF EVIDENCE
Clinical Experience or Case ReportsBias +++
Observational StudiesBias ++
Randomized Clinical Trials (RCT)
Bias +
Systematic Review of RCT Bias + Precision ++ Applicability ++
EBM: The judicious use of the best available evidence in clinical decision making
![Page 33: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/33.jpg)
REVISÕES SISTEMÁTICAS SYSTEMATIC REVIEWS
Best evidence only if methods of the SR & of included trials avoid bias.
Should be critically appraised.
![Page 34: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/34.jpg)
Hormonal replacement therapy to reduce coronary events in post-menopausal women
Meta-analysis of observational studies
1992 Annals of Internal Medicine versus
RCTs HERS 1998WHI 2002
![Page 35: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/35.jpg)
Appraising aAppraising a SRSTEP 5
REPRODUCIBILITY OF PROCESS2 independent reviewers:
SelectionInclusionCritical Appraisal
REDUCE BIAS AND RANDOM ERROR
![Page 36: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/36.jpg)
Appraising aAppraising a SRSTEP 6
STATISTICAL ANALYSIS (META – ANALYSIS) Establish a priori possible sources of heterogeneity. Test for heterogeneity:
Q statistic chi square (χ2) I2
Decide whether to pool or not
![Page 37: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/37.jpg)
I2=4,21%
I2=8,45%
![Page 38: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/38.jpg)
![Page 39: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/39.jpg)
O que fazer com esta informação?What would you do with this information?
![Page 40: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/40.jpg)
O que fazer agora?What would you do now?
![Page 41: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/41.jpg)
RememberRemember
Always consider all posible outcomes. Consider patients values or preferences. SRs do not make decisions. SRs inform decisions.
![Page 42: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/42.jpg)
Navegando pelas RSs Sailing arround SRs.....
What are SR & why are they useful.
How to appraise a SR.
Where to find SRs.
![Page 43: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/43.jpg)
Where to find SRs?• Pubmed:
– Clinical Query SR– Límits: publication type: Meta-analysis
• Databases of SR
![Page 44: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/44.jpg)
The Cochrane Database of Systematic Reviews
• S. Reviews: 1.596 (2003) 4.320 (2006)6.200 (2010)
Database of Abstracts of Reviews of Effectiveness
• 3.075 (2004)• 6.019 (2006)• 9.403 (2009)
THE COCHRANE LIBRARY
![Page 45: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/45.jpg)
![Page 46: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/46.jpg)
Back to our question....
Lung cancer prevention and beta-carotene.
Searching the Cochrane Database of Systematic Reviews.
P: SMOKERSI: VITAMIN A C: NO TREATMENTO: REDUCE LUNG CANCER
![Page 47: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/47.jpg)
BETA-CAROTENE AND LUNG CANCER PREVENTION
• Drugs for preventing lung cancer in healthy people. M Caraballoso, M Sacristan, C Serra, X BonfillPublication status and date: Edited (no change to conclusions), published in Issue 4, 2009.
• Review content assessed as up-to-date: 30 January 2003
• Includes beta – carotene• Includes smokers
![Page 48: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/48.jpg)
BETA-CAROTENE AND LUNG CANCER PREVENTION
• Drugs for preventing lung cancer in healthy people M Caraballoso, M Sacristan, C Serra, X Bonfill
The Cochrane Database of Systematic Reviews 2006 Issue 2
Pre-defined method:• 4 RCTs• 109.304 participants • Beta-carotene alone or combined to other
antioxidants• Placebo controlled• Duration of treatment 2 to 12 years• Follow up 2 a 5 years
![Page 49: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/49.jpg)
Drugs for preventing lung cancer in healthy people M Caraballoso, M Sacristan, C Serra, X Bonfill
The Cochrane Database of Systematic Reviews 2006 Issue 2
![Page 50: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/50.jpg)
BETA-CAROTENE AND LUNG CANCER PREVENTION
• Drugs for preventing lung cancer in healthy people M Caraballoso, M Sacristan, C Serra, X Bonfill
The Cochrane Database of Systematic Reviews 2006 Issue 2
• Authors' conclusions• There is currently no evidence to support recommending
vitamins such as alpha-tocopherol, beta-carotene or retinol, alone or in combination, to prevent lung cancer. A harmful effect was found for beta-carotene with retinol at pharmacological doses in people with risk factors for lung cancer (smoking and/or occupational exposure to asbestos). More research from larger trials and with longer follow-up is needed to analyze the effectiveness of other supplements.
![Page 51: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/51.jpg)
MENSAGENS PARA CASAMENSAGENS PARA CASATAKE HOME MESSAGESTAKE HOME MESSAGES
![Page 52: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/52.jpg)
CONCLUSCONCLUSÕESÕESSYSTEMATICS REVIEWS :Summarizes evidence regarding a specific question.Should have explicit methods to minimize bias.Should be critically appraised by consumers (VOCE). If methodologically well done = highest level of
evidence. Important tool to evidence based health care as they
help handling large amounts of information.
![Page 53: Systematic Reviews](https://reader034.vdocuments.net/reader034/viewer/2022051403/568c0f591a28ab955a93c3ed/html5/thumbnails/53.jpg)
OBRIGADA
PERGUNTASCOMMENTSCOMPLAINTS