week 5 etec 668 quantitative research in educational technology dr. seungoh paek february 12, 2014
TRANSCRIPT
Tonight’s Agenda
Continuing SPSS Introduction to PSPP Introduction to RStudio Introduction to Probability Group Discussion for Research Paper
PSPP
Download PSPP - For Mac, click here. For Window, click here.
R
R is a free software environment for statistical computing and graphics.
RStudio
RStudio is a free and open source integrated development environment (IDE) for R, a programming language for statistical computing and graphics.
Probability, Samples, Bell Curve, z Scores, Hypotheses, Hypothesis Testing, &
significance
Chapter 7 & Chapter 8
Why Probability?
Describe and predict what we don’t know from current data
Basis for the Degree of confidence a Hypothesis is “true”– statistical significance
Examples
• Flip a coin– 2 possible outcomes– Heads or Tails – 50% chance each
• Role a Die – 6 possible outcomes– 1 – 2 – 3 – 4 – 5 – 6 – 16.6% chance each
• Flip 2 coins– How many possible outcomes?– What % chance for each?
• Flip 2 coins– How many possible outcomes?– What % chance for each?
Definitions
Population– The large group to which you would like to
generalize your findings
Sample– The smaller, representative group of the
population used for research.
Characteristics of a sample
Needs to be representative Truly random = representative = unbiased Sampling error – – how well the sample represents the population
Size matters – – larger sample = more representative
Mathematical Symbols
Mean – Population = μ– Sample = X
Standard Deviation– Population = σ
– Sample = SD
Variance- Population = σ2
- Sample = SD2
Number of Cases- Population = N
- Sample = n
About Normal Curve
Almost all scores fall between -3 and +3 SD from mean– 99.74%
Specific percentages between points on x-axis– 2 or more normal curves can be compared
The z Score
The number of standard deviations from the mean
Negative scores are below (left of) the mean
Positive scores are above (right of) the mean
The z Score
Standard Score Allows you to compare apples and
oranges The probability of a score occurring
=
What is a Hypothesis?
An “educated guess” Direct extension of the question Translates problem or research question into a
testable form Two types– Null Hypothesis
– Research Hypothesis
A Good Hypothesis
Declarative statement Expected relationship between variables Reflection of theory/literature Brief, to the point Testable
Why a Null Hypothesis?
No amount of experimentation can ever prove me right; a single experiment can prove me wrong.
~ Albert Einstein
The Null Hypothesis
Statement of no relationship
– Two things are equal
H0 : μA = μB
Refers to Population Indirectly tested
The Research Hypothesis
Definite Statement– Relationship exists between variables
Two types– Nondirectional - H1 : XA ≠ XB
– Directional - H1 : X1 > X2
Refers to sample Directly tested
Hypothesis Testing
All events have a probability associated with them
p = your guess of chancep < .05
– .05 or 5% in Education and Psychology– 5% likelihood of results occurring by chance
alone
Error Table
The Real Situation
(Unknown to investigator)
Investigator’s Decision
H0 is True H0 is False
Reject H0 Type I errorCorrect decision
Do Not reject H0Correct decision
Type II error
Statistical
Based on probability Research was technically successful
H0 was rejected
P value– Education p < .05 = 5% chance
– Medical p < .01 or .001 = 1% or .1% chance
Practical
Does it mean anything to the population?– Is that new treatment worth the cost?– Are my students really doing that much better?
Where are we now?
Identified a problem focus Familiar with the literature Next step – determine specific questions for
your research study Research questions provide the basis for
planning research study – design, materials, data analysis
Can meaningful learning be enhanced by using a computer to personalize math word problems for each student?
Research Questions in Qualitative Research
Preferred when little is known about a phenomenonUsed when previous studies report conflicting resultsUsed to describe phenomena
Research Hypotheses for Quantitative Research
Educated guess or presumption based on literature
States the nature of the relationship between two or more variables
Predicts the research outcome Research study designed to test the
relationship described in the hypothesis
Null Hypotheses
Implicit complementary statement to the research hypothesis
States no relationship/difference exists between variables
Statistical test performed on the null Assumed to be true until support for the
research hypothesis is demonstrated
Alternative Hypotheses
Directional hypothesis– Precise statement indicating the nature and
direction of the relationship/difference between variables
Nondirectional hypothesis– States only that relationship/difference will
occur
Assessing Hypotheses
Simply stated? Single sentence? At least two variables? Variables clearly stated? Is the relationship/difference precisely
stated? Testable?
Types of Variables
Variable – Element that is identified in the hypothesis or
research question– Property or characteristic of people or things
that varies in quality or magnitude – Must be identified as independent or dependent
Independent Variables (IV)
Manipulation or variation of this variable is the cause of change in other variables
Technically, independent variable is the term reserved for experimental studies– Also called antecedent variable, experimental
variable, treatment variable, causal variable, predictor variable
Dependent Variables (DV)
The variable of primary interest Research question/hypothesis describes,
explains, or predicts changes in it The variable that is influenced or changed
by the independent variable– In non-experimental research, also called
criterion variable, outcome variable
Intervening or Mediating Variables
Intervening/Mediating variable– Presumed to explain or provide a link between
independent and dependent variables– Relationship between the IV and DV can only be
explained when the intervening variable is present
– E.g. effect of study prep on test scores– Organization of study ideas into a framework
(intervening/mediating)
Control Variables
Special type of IV that can potentially influence the DV
Use statistical procedures (e.g. analysis covariance) to control for these variables
May be demographic or personal variables that need to be “controlled” so that true influence of IV on DV can be determined
Confounding Variables
Confounding variable– Confuses or obscures the effect of independent
on dependent– Makes it difficult to isolate the effects of the
independent variable – Typically cannot be directly measured or
observed– Researchers comment on the influence after
study is completed
Relationship Between Independent and Dependent Variables
Cannot specify independent variables without specifying dependent variablesNumber of independent and dependent variables depends on the nature and complexity of the studyThe number and type of variables dictates which statistical test will be used
Model for Writing Descriptive Questions & Hypotheses
Identify IV, DV & any intervening/moderating variables
Specify descriptive questions for each IV, DV & intervening variable
Write inferential questions that relate variables or compare groups
Scenario
A researcher wants to study the relationship of critical thinking skills to student achievement in science classes for 8th-graders in a large metropolitan school district. The researcher controls for the effects of prior grades in science classes and parents’ educational attainment.
Step 1: Identify variables
What are the control variables?– Prior grades in science class– Educational attainment of parents
Descriptive Questions
How do the students rate on critical thinking skills?
What are the students’ achievement grades in science classes?
What are the students’ prior grades in science classes?
What is the educational attainment of the parents of the 8th graders?
Inferential Questions
Does critical thinking ability relate to student achievement?
Does critical thinking ability relate to student achievement, controlling for the effects of prior grades in science and the educational attainment of the 8th-graders’ parents?
What to do Week 5
1. Do the required readings for Week 06.– Salkind, N. J. Chapter 16. Redicting Who’ll Win the Super Bowl: Using
Linear Regression– Salkind, N. J. Chapter 20. The Ten (or More) Best Internet Sites for
Statistics Stuff
2. Continue the group discussion on the final research paper, and post the 1) literature review outline and 2) research questions for your paper to the Forum in Laulima (Due by Tuesday, February 18th).