understanding the variability of your data: dependent variable
TRANSCRIPT
![Page 1: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/1.jpg)
![Page 2: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/2.jpg)
Understanding the Variability of Your Data:
Dependent Variable
![Page 3: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/3.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Two "Sources" of Variability
![Page 4: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/4.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Two "Sources" of Variability
– Independent (Predictor/Explanatory) Variable(s)
![Page 5: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/5.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Two "Sources" of Variability
– Independent (Predictor/Explanatory) Variable(s)
– Extraneous Variables
![Page 6: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/6.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Two Types of Variability
![Page 7: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/7.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Two Types of Variability
– Unsystematic
![Page 8: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/8.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Two Types of Variability
– Unsystematic
– Systematic
![Page 9: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/9.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
![Page 10: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/10.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Error Variability - unsystematic due to extraneous variables
![Page 11: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/11.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Error Variability - unsystematic due to extraneous variables
• Within conditions variability
![Page 12: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/12.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Error Variability - unsystematic due to extraneous variables
• Within conditions variability• Individuals in same condition affected differently
![Page 13: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/13.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Error Variability - unsystematic due to extraneous variables
• Within conditions variability• Individuals in same condition affected differently• Affects standard deviation, not mean, in long term
![Page 14: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/14.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Error Variability - unsystematic due to extraneous variables
Common sources
individual differences
procedural variations
measurement error
![Page 15: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/15.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Primary Variability – systematic due to independent variable
![Page 16: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/16.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Primary Variability – systematic due to independent variable
• Between conditions variability
![Page 17: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/17.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Primary Variability – systematic due to independent variable
• Between conditions variability• Individuals in same condition affected similarly
![Page 18: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/18.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Primary Variability – systematic due to independent variable
• Between conditions variability• Individuals in same condition affected similarly• Individuals in different conditions affected differently
![Page 19: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/19.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Primary Variability – systematic due to independent variable
• Between conditions variability• Individuals in same condition affected similarly• Individuals in different conditions affected differently• Affects mean, not standard deviation, in long term
![Page 20: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/20.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Secondary Variability – systematic due to extraneous variable
![Page 21: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/21.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Secondary Variability – systematic due to extraneous variable
• Between conditions variability
![Page 22: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/22.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Secondary Variability – systematic due to extraneous variable
• Between conditions variability• Individuals in same condition affected similarly
![Page 23: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/23.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Secondary Variability – systematic due to extraneous variable
• Between conditions variability• Individuals in same condition affected similarly• Individuals in different conditions affected differently
![Page 24: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/24.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Secondary Variability – systematic due to extraneous variable
• Between conditions variability• Individuals in same condition affected similarly• Individuals in different conditions affected differently• Affects mean, not standard deviation, in long term
![Page 25: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/25.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Roles played in the Research Situation
– Error Variability• A nuisance – the ‘noise’ in the research situation
![Page 26: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/26.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Error Variability• A nuisance – the ‘noise’ in the research situation
– Primary Variability• The focus – the potentially meaningful effect
![Page 27: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/27.jpg)
Understanding the Variability of Your Data:
Dependent Variable
• Three "labels" for the variability
– Error Variability• A nuisance – the ‘noise’ in the research situation
– Primary Variability• The focus – the potentially meaningful effect
– Secondary Variability• The ‘evil’ – confounds the results
![Page 28: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/28.jpg)
Example
• Two sections of the same course
![Page 29: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/29.jpg)
Example
• Two sections of the same course
• Individual’s score as combination of ‘sources’
![Page 30: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/30.jpg)
Statistical decision-making
• The logic behind inferential statistics
• Deciding if there is ‘systematic variability’– primary vs. secondary
• What do the data tell us?
• What decisions should we make?
![Page 31: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/31.jpg)
Statistical decision-making
• A Research Example
– Research Hypothesis
– IF students chant the “Statistician’s Mantra” before taking their Methods exam THEN they will earn higher scores on the exam.
![Page 32: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/32.jpg)
Statistical decision-making
• A Research Example
Your Class (M = 80, SD = 15, n = 25) compared to a known population Mean (M = 70) for a
standardized exam
![Page 33: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/33.jpg)
Statistical decision-making
• A Research Example
Can estimate the Sampling Distribution
See if Population mean ‘fits’
Cause effect relationship not clear
![Page 34: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/34.jpg)
Statistical decision-making
• A Research Example using experimental approach
– Research Hypothesis– IF students chant the “Statistician’s Mantra”
(vs. not chanting) before taking their Methods exam THEN they will earn higher scores on the exam.
![Page 35: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/35.jpg)
Statistical decision-making
• Procedure
– Randomly divide class into two groups
• Chanters – are taught the “Statistician’s Chant” and chant together for 5 minutes before the exam
![Page 36: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/36.jpg)
Statistical decision-making
• Procedure
– Randomly divide class into two groups
• Chanters – are taught the “Statistician’s Chant” and chant together for 5 minutes before the exam
• Non-chanters – sing Kumbaya together for 5 minutes before the exam
![Page 37: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/37.jpg)
Statistical decision-making
• Results
– Compute exam scores for all students and organize by ‘condition’ (levels of IV).
![Page 38: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/38.jpg)
Show ‘changing’ distribution
![Page 39: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/39.jpg)
Statistical decision-making
• Results
– Compute exam scores for all students and organize by ‘condition’ (levels of IV).
– Compare Mean Exam Scores for two Conditions
![Page 40: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/40.jpg)
Statistical decision-making
• Results
– Compute exam scores for all students and organize by ‘condition’ (levels of IV).
– Compare Means Exam Scores for two Conditions
– What will you find?
![Page 41: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/41.jpg)
Statistical decision-making
• Research Hypotheses generally imprecise
– Predictions are not specific
– So “testing” the Research Hypothesis, using the available data, not reasonable
![Page 42: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/42.jpg)
Statistical decision-making
• Null Hypothesis – a precise alternative
– Identifies outcome expected when NO systematic variability is present
![Page 43: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/43.jpg)
Statistical decision-making
• Null Hypothesis – a precise alternative
– Identifies outcome expected when NO systematic variability is present
– But still must decide how close to the predicted outcome you must be to ‘believe’ in the Null Hypothesis
![Page 44: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/44.jpg)
Statistical decision-making
• The Null Hypothesis Sampling Distribution
![Page 45: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/45.jpg)
Statistical decision-making
• The Null Hypothesis Sampling Distribution
– All possible outcomes when the Null Hypothesis is true
• (when there is no ‘systematic’ variability present in the data)
![Page 46: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/46.jpg)
Statistical decision-making
• The Null Hypothesis Sampling Distribution
– All possible outcomes when the Null Hypothesis is true
– Finding all the possible outcomes?
![Page 47: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/47.jpg)
Statistical decision-making
• The Null Hypothesis Sampling Distribution
– All possible outcomes when the Null Hypothesis is true
– Finding all the possible outcomes?
– Seeing where your results fit into the Null Hypothesis Sampling Distribution
![Page 48: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/48.jpg)
Statistical decision-making
• Deciding what to conclude based on the ‘fit’
![Page 49: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/49.jpg)
Statistical decision-making
• Deciding what to conclude based on the ‘fit’
“True” State of the World
• Ho True Ho False• Reject Ho Error Correct Rejection
Decision• Not Reject Ho Correct Error• Nonreject
![Page 50: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/50.jpg)
Statistical decision-making
• Deciding what to conclude based on the ‘fit’
“True” State of the World
• Ho True Ho False• Reject Ho Type 1 (p) Correct Rejection
Decision (power = 1 – Type 2)• Not Reject Ho Correct Type 2• Nonrejection• Deciding what confidence you want to have that you
have not made any errors
![Page 51: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/51.jpg)
Statistical decision-making
• Trade-offs between Types of Errors– I believe I can fly?
![Page 52: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/52.jpg)
Statistical decision-making
• Trade-offs between Types of Errors
• Factors affecting Type 2 Errors (Power)– “Real” systematic variability (size of effect)– Choice of Type 1 probability– Precision of estimates (sample size)
![Page 53: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/53.jpg)
Statistical decision-making
• Trade-offs between Types of Errors
• Factors affecting Type 2 Errors (Power)– “Real” systematic variability (size of effect)
• Assume .5 * SD, a moderate size effect is good
– Choice of Type 1 probability• Use traditional .05
– Precision of estimates (sample size)• Sample of 50 (2 groups of 25)
![Page 54: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/54.jpg)
Statistical decision-making
• Factors affecting Type 2 Errors (Power)
– Type 2 error probability = .59– Power = .41
![Page 55: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/55.jpg)
Statistical decision-making
• Each ‘Decision” has an associated ‘error’
• Can only make Type 1 if “Reject”
• Can only make Type 2 if “Not Reject”
![Page 56: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/56.jpg)
Statistical decision-making
Interpreting “Significant” Statistical Results
• Having decided to “reject” the Null Hypothesis you can:– State probability of Type 1 error– State confidence interval for population value– State percent of variability in DV ‘accounted for’
![Page 57: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/57.jpg)
Statistical decision-making
Interpreting “Significant” Statistical Results
• For Chant vs. No Chant example– State probability of Type 1 error
• .05
– State confidence interval for population value• 95% CI is approximately +2 * SE• Point estimate of 10 + 8 (Real difference between 2
and 18)
– State percent of variability in DV ‘accounted for’• Eta2 = .20, or 20%
![Page 58: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/58.jpg)
Statistical decision-making
Interpreting “Significant” Statistical Results
• Statistical Significance vs. Practical Significance
• How unlikely is the event in these circumstance– versus
• How much of an effect was there
![Page 59: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/59.jpg)
Statistical decision-making
Interpreting “Non-significant” Statistical Results
Having decide you cannot reject the Ho
State the estimated ‘power’ of your design
![Page 60: Understanding the Variability of Your Data: Dependent Variable](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c915503460f9494ba10/html5/thumbnails/60.jpg)