quantitative bias analysis - dansk selskab for farmakoepidemiologi · 2019-05-03 · 1. given...

76
Quantitative bias analysis Kasper Bruun Kristensen, SDU [email protected]

Upload: others

Post on 19-Jun-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Quantitative bias analysis

Kasper Bruun Kristensen, SDU

[email protected]

Page 2: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Objective: To quantify the magnitude and direction of systematic error (bias)

Quantitative bias analysis

Page 3: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Systematic error Random error

Page 4: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Quantify bias from systematic error

- Confounding

- Selection bias

- Misclassification

Quantitative bias analysis

Page 5: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Quantify bias from systematic error

- Confounding

- Selection bias

- Misclassification

Quantitative bias analysis

Page 6: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Reviewer #2

Page 7: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

‘The authors failed to take into account confounding by _ _ _ _ _ _ _ _ _

Page 8: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Smoking

Alcohol

Frailty

BMI

Education

Exercise

Page 9: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able to adjust for this confounder?

Quantitative bias analysis

Point estimate with bias →Point estimate taking into account bias

Page 10: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able to adjust for this confounder?

Quantitative bias analysis

Page 11: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able to adjust for this confounder?

2. How strong would an unknown confounder have to be to fully explain the observed effect?

Quantitative bias analysis

Page 12: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Quantitative bias analysis

1. Simple bias analysis

2. Probabilistic bias analysis

Page 13: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Quantitative bias analysis

1. Simple bias analysis

2. Probabilistic bias analysis

Page 14: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able to adjust for this confounder?

2. How strong would an unknown confounder have to be to fully explain the observed effect?

Page 15: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able to adjust for this confounder?

2. How strong would an unknown confounder have to be to fully explain the observed effect?

Page 16: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

PC1: Prevalence of confounder among exposedPC0: Prevalence of confounder among unexposedRRCD: Relative risk of confounder associated with outcome

Page 17: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

PC1: Prevalence of confounder among exposedPC0: Prevalence of confounder among unexposedRRCD: Relative risk of confounder associated with outcome

Page 18: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

PC1

PC0

RRCDBias parameters

Page 19: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Example

Does male circumcision protect against HIV infection?

Possible confounder: Being Muslim

RR not adjusted for religion: 0.35 (95% CI 0.28 to 0.44)Tyndall et al., 1996

Page 20: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

PC1

PC0

RRCDBias parameters

Page 21: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 22: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

PC1

PC0

RRCD

0.80.10.65

RR =0.35

0.8 0.65−1 +1

0.1 0.65−1 +1

=0.47

Page 23: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

http://www.drugepi.org/dope-downloads

Page 24: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 25: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 26: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 27: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 28: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 29: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able to adjust for this confounder?

2. How strong would an unknown confounder have to be to fully explain the observed effect?

Page 30: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

2. How strong would an unknown confounder have to be in order to fully explain the observed effect?

RRCD

RRECBias parameters

Page 31: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Example

How strong would confounding be to explain the effect of smoking on lung cancer?

RR 10.73, 95% CI 8.02 to 14.36

Page 32: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

VanderWeele and Ding, 2017

The E-value is the minimum strength of association on the relative risk scale that a confounder would need to have with both the treatment and outcome to explain away the observed association

Page 33: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

https://evalue.hmdc.harvard.edu/

Page 34: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

RR

CD

REEC

Mathur, 2019

Page 35: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 36: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

E-value for point estimate: 7.4

E-value for lower limit of CI: 6.8

Page 37: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

´The observed risk ratio could be explained away by an unmeasured confounder that was associated with both hydrochlorothiazide and skin cancer by a risk ratio of 7.4-fold each.The confidence interval could be moved to the null by an unmeasured confounder associated with both hydrochlorothiazide and skin cancer by a risk-ratio of 6.8-fold’

Page 38: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Quantitative bias analysis

1. Simple bias analysis

2. Probabilistic bias analysis

Page 39: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able to adjust for this confounder?

2. How strong would an unknown confounder have to be to fully explain the observed effect?

Page 40: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Bias parameters →

Probability distribution of bias parameters

Page 41: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 42: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

1. Assign probability distributions to each bias parameter

2. Randomly sample from the bias parameter distributions

3. Use simple bias analysis to correct for the bias

4. Resample, save, and summarize

Page 43: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 44: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 45: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 46: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Example

Does circumcision protect against HIV infection?

Possible confounder: being muslim

RR not adjusted for religion: 0.35 (95% CI 0.28 to 0.44)

Page 47: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Example

1. Assign probability distributions to each bias parameter

2. Randomly sample from the bias parameter distributions

3. Use simple bias analysis to correct for the bias

4. Resample, save, and summarize

Page 48: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Ressoruces for probabilistic bias analysis in Excel and SAS:https://sites.google.com/site/biasanalysis/

Page 49: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 50: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 51: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Example

1. Assign probability distributions to each bias parameter

2. Randomly sample from the bias parameter distributions

3. Use simple bias analysis to correct for the bias

4. Resample, save, and summarize

Page 52: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Stata

Page 53: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 54: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 55: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 56: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

episensi 105 85 527 93, st(cs) reps(10000)

dpunexp(trapezoidal(0.03 0.04 0.07 0.10))

dpexp(trapezoidal(0.7 0.75 0.85 0.9))

drrcd(trapezoidal(0.5 0.6 0.7 0.8))

grarrtot grprior nodot

Page 57: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

episensi 105 85 527 93, st(cs) reps(10000)

dpunexp(trapezoidal(0.03 0.04 0.07 0.10))

dpexp(trapezoidal(0.7 0.75 0.85 0.9))

drrcd(trapezoidal(0.5 0.6 0.7 0.8))

grarrtot grprior nodot

Page 58: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

episensi 105 85 527 93, st(cs) reps(10000)

dpunexp(trapezoidal(0.03 0.04 0.07 0.10))

dpexp(trapezoidal(0.7 0.75 0.85 0.9))

drrcd(trapezoidal(0.5 0.6 0.7 0.8))

grarrtot grprior nodot

Page 59: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

episensi 105 85 527 93, st(cs) reps(10000)

dpunexp(trapezoidal(0.03 0.04 0.07 0.10))

dpexp(trapezoidal(0.7 0.75 0.85 0.9))

drrcd(trapezoidal(0.5 0.6 0.7 0.8))

grarrtot grprior nodot

Page 60: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

episensi 105 85 527 93, st(cs) reps(10000)

dpunexp(trapezoidal(0.03 0.04 0.07 0.10))

dpexp(trapezoidal(0.7 0.75 0.85 0.9))

drrcd(trapezoidal(0.5 0.6 0.7 0.8))

grarrtot grprior nodot

Page 61: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

episensi 105 85 527 93, st(cs) reps(10000)

dpunexp(trapezoidal(0.03 0.04 0.07 0.10))

dpexp(trapezoidal(0.7 0.75 0.85 0.9))

drrcd(trapezoidal(0.5 0.6 0.7 0.8))

grarrtot grprior nodot

Page 62: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 63: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 64: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 65: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

episensi 105 85 527 93, st(cc) reps(1000)

dpunexp(trapezoidal(0.03 0.04 0.07 0.10))

dpexp(trapezoidal(0.7 0.75 0.85 0.9))

drrcd(log-n(-0.43 0.11))

grarrtot grprior nodot

Page 66: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 67: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 68: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 69: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Quantitative bias analysis

1. Simple bias analysis2. Probabilistic bias analysis

- Confounding- Selection bias- Misclassification

Page 70: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

Probabilistic bias analysis

- Confounding

- Selection bias

- Misclassification

Accounting for several biases at the same time: Multiple bias modeling

Page 71: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

http://www.drugepi.org/dope-downloads

Page 72: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able

https://evalue.hmdc.harvard.edu/

Page 73: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 74: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able
Page 75: Quantitative bias analysis - Dansk Selskab for Farmakoepidemiologi · 2019-05-03 · 1. Given confounding by an unmeasured variable, what effect estimate would remain if we were able