mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/es_… · xls file · web view ·...

58
Intro Page 1 Effect Size Determination Program Last Updated 07/25/2001 by David B. Wilson, Ph.D. University of Maryland, College Park Introduction The Effect Size Determination Program is for use with the book Practical Meta- Analysis written by Mark W. Lipsey and David B. Wilson and published by Sage. The creation of this program was supported by HSRI. This program computes standardized mean difference effect sizes (d) and the correlation coefficients (r) from summary statistics, such as means and standard deviations, t-tests, frequencies, etc. It is useful during the coding phase of a meta-analysis for converting reported results into an effect size index. To use, "click" on the "Main Menu" button with the mouse. From the Main Menu, select the desired transformation, again by "clicking" on the approrpiate button. Enter the requested data in all cells that are shaded in yellow. The effect size is computed automatically when all necessary data cells are filled in.

Upload: trankhanh

Post on 29-Mar-2018

232 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Intro

Page 1

Effect Size Determination ProgramLast Updated 07/25/2001byDavid B. Wilson, Ph.D.University of Maryland, College Park

Introduction

The Effect Size Determination Program is for use with the book Practical Meta-Analysis written by Mark W. Lipsey and David B. Wilson and published by Sage. The creation of this program was supported by HSRI.

This program computes standardized mean difference effect sizes (d) and the correlation coefficients (r) from summary statistics, such as means and standard deviations, t-tests, frequencies, etc. It is useful during the coding phase of a meta-analysis for converting reported results into an effect size index.

To use, "click" on the "Main Menu" button with the mouse. From the Main Menu, select the desired transformation, again by "clicking" on the approrpiate button. Enter the requested data in all cells that are shaded in yellow. The effect size is computed automatically when all necessary data cells are filled in.

Page 2: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Intro

Page 2

Page 3: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Intro

Page 3

Page 4: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Intro

Page 4

Page 5: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Menu

Page 5

Main Menu

Page 6: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Menu

Page 6

Page 7: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Menu

Page 7

Page 8: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Means & SDs

Page 8

Means and Standard Deviation, Post-Treatment Scores

Treatment Group Comparison GroupMean = Mean =

SD = SD =n = n =

d = r =

Page 9: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Means & SDs

Page 9

Page 10: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Means & SDs

Page 10

Page 11: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Means & t-test

Page 11

Means and t-test, Post-Treatment Scores

Treatment Group Comparison GroupMean = Mean =

n = n =

t-value = d = r =

Page 12: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Means & t-test

Page 12

Page 13: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Means & t-test

Page 13

Page 14: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Mean Gain Scores

Page 14

Mean Gain Scores and Gain Score Standard Deviation

Treatment Group Comparison GroupMean = Mean =

SD = SD =n = n =

Pre & Post-Test Scores Correlation =

d = r =

Page 15: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Mean Gain Scores

Page 15

Page 16: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Mean Gain Scores

Page 16

Page 17: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

t-test (Independent)

Page 17

Independent t-test, No Means Reported

t-value = d = Treatment n = r =

Comparsion n =

Page 18: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

t-test (Independent)

Page 18

Page 19: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

t-test (Independent)

Page 19

Page 20: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

t-test (p-value only)

Page 20

Independent t-test, p-value only

p-value = d = df = r =

Note: This will always return a positive value

Page 21: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

t-test (p-value only)

Page 21

Page 22: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

t-test (p-value only)

Page 22

Page 23: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

t-test (Dependent)

Page 23

Dependent t-test, No Means Reported

t-value = d = n (pairs) = r =

r for paired values =

Page 24: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

t-test (Dependent)

Page 24

Page 25: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

t-test (Dependent)

Page 25

Page 26: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Proportions1

Page 26

Proportion or Frequency (Dichotomous)

Logit Method Probit MethodFrequency with Positive Outcome d = d =

Treatment Group Successes = r = r = Treatment Group n =

Control Group Successes = Control Group n =

Logit Method Probit MethodProportion with Positive Outcome d = d =

Treatment Group = r = r = Control Group =

Logit = logged odds-ratio

Page 27: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Proportions1

Page 27

Page 28: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Proportions1

Page 28

Page 29: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Proportions2

Page 29

Proportions (Ordinal Polychotomous)

Treatment Group Comparison Group Tx Group n =Values Percent Values Percent

0 0 Comp Grp n =1 12 2 Tx Mean =3 3 Tx SD =4 45 5 Comp Mean =6 6 Comp SD =7 78 8 d = 9 9 r =

Page 30: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Proportions2

Page 30

Page 31: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Proportions2

Page 31

Page 32: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Frequencies

Page 32

Frequencies (Ordinal Polychotomous)

Treatment Group Comparison Group Tx Mean =Values Frequency Values Frequency Tx SD =

0 01 1 Comp Mean =2 2 Comp SD =3 34 4 d = 5 5 r = 6 67 78 89 9

Page 33: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Frequencies

Page 33

Page 34: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Frequencies

Page 34

Page 35: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

F-test (k=2)

Page 35

Oneway ANOVA with Two Groups (k=2)

F-value = d = Treatment n = r =

Comparison n =Note: This will always return a positive value

Page 36: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

F-test (k=2)

Page 36

Page 37: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

F-test (k=2)

Page 37

Page 38: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

F-test (k>2)

Page 38

Oneway ANOVA with Three or More Groups (k>2)

Indicate MSw =Means n Group Type*

Method 1:d = r =

F-value =

Method 2:d = r =

Group Type: 1 = treatment group, -1 = comparison group, 0 = other

Page 39: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

F-test (k>2)

Page 39

Page 40: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

F-test (k>2)

Page 40

Page 41: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Oneway ANCOVA

Page 41

Oneway Analysis of Covariance

Treatment Group Comparison GroupMean = Mean =

MS error = d = df error = r =

r* =

r* = correlation between the covariate and the dependent measure

Page 42: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Oneway ANCOVA

Page 42

Page 43: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Oneway ANCOVA

Page 43

Page 44: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Chi-Square

Page 44

Chi-Square (df=1)

Chi-Square = d = r =

Note: This will always return a positive value

Total N =

Page 45: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Chi-Square

Page 45

Page 46: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Chi-Square

Page 46

Page 47: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Chi-Square (p-value only)

Page 47

Chi-Square, p-value only (df=1)

p-value = d = r =

Note: This will always return a positive value

Total N =

Page 48: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Chi-Square (p-value only)

Page 48

Page 49: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Chi-Square (p-value only)

Page 49

Page 50: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Correlation

Page 50

Correlation and Mean Difference Effect Size Conversion

r = 0.23 d = 0.4727

d = 0.47 r = 0.2288

Page 51: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Correlation

Page 51

Page 52: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Correlation

Page 52

Page 53: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Weighted Mean

Page 53

Weighted Mean

Means n Weighted Mean =

Page 54: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Weighted Mean

Page 54

Page 55: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Weighted Mean

Page 55

Page 56: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Pooled SD

Page 56

Pooled SD

SDs n Pooled SD =

Page 57: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Pooled SD

Page 57

Page 58: mason.gmu.edumason.gmu.edu/~dwilsonb/downloads/ES_… · XLS file · Web view · 2004-07-22Module3 Module2 Module1 Pooled SD Weighted Mean Correlation Chi-Square (p-value only)

Pooled SD

Page 58