center for technology in learning sri international investigating the cumulative impacts of...
Post on 22-Dec-2015
215 views
TRANSCRIPT
Center For Technology in Learning
SRI International
Investigating the Cumulative Impacts of Educational
TechnologyBarbara Means, Mary Wagner,
Geneva Haertel and Harold Javitz
February 25, 2000
SRI International
2
Center For Technology in Learning
SRI International
Study Rationale
Address over-arching concern of policymakers and the public
Investigate the accumulation of academic and motivational benefits associated with educational uses of technology
Identify the key dimensions of technology use that contribute to better outcomes for students
Describe variations in patterns of technology use in and out of school over time for different kinds of students, schools, and communities
3
Center For Technology in Learning
SRI International
Example Data Collection Timeline
State the purpose of the discussion Identify yourself
4
Center For Technology in Learning
SRI International
Core Features Nationally representative sample of seventh-graders
Secondary sample drawn from high-technology integration schools
Longitudinal (six years)
Student as primary unit of analysis
Incorporates diverse groups and contexts
Repeated measures of a broad set of student outcomes (e.g., basic skills, advanced inquiry and communication skills, engagement) and aspects of technology use (e.g., purpose, grouping, control)
5
Center For Technology in Learning
SRI International
Sample Research Questions To what extent are different approaches to using
technology associated with different student outcomes?
Do the technology dimensions associated with significant gains differ for different types of schools and subgroups?
Are significantly better outcomes obtained in schools that make a concerted effort to integrate technology with instruction?
What patterns of technology use over time make a difference in producing and sustaining outcomes?
7
Center For Technology in Learning
SRI International
Operationalizing Technology Use Classification of practices into idealized “models” not feasible
Data can be collected on multiple dimensions of technology use, e.g.:
Typical grouping for technology use
Typical learning goals
Typical degree of student control
Average frequency and duration
Issues of characterizing technology experiences across classes, in and out of school, across years
8
Center For Technology in Learning
SRI International
Balanced Assessment of Student Learning Outcomes
• Standardized tests of reading and mathematics
• Problem-based assessment of inquiry and communication skills
- Complex context
- On-line and off-line components
- Embedded assessment of technology skills
- Embedded assessment of metacognitive skills
9
Center For Technology in Learning
SRI International
Factors Affecting the Nationally Representative Sample
• Focus on students
• Stratified sample
• Longitudinal
• Multiple data sources
• Multiple analytic purposes
10
Center For Technology in Learning
SRI International
Generating the Nationally Representative Sample
Stage 1: Stratified sample of LEAs
Possible stratifiers
N > 200 to promote design efficiency
Stage 2: Students
Limit clustering within LEAs
N > 10,000
11
Center For Technology in Learning
SRI International
Technology-Intensive Sample
Purposive sample
Start with districts and schools with strong technology infrastructures
Obtain indicators of strong, consistent technology use within these schools
N > 2,000 students
12
Center For Technology in Learning
SRI International
Data Collection Components
School Background Survey Student Survey Parent Survey Student Assessments Teacher Survey Student Transcripts
13
Center For Technology in Learning
SRI International
Example Data Collection Timeline
Year 1
7th grade
Year 2
8th grade
Year 3
9th grade
Year 4
10th grade
Year 5
11th grade
Year 6
12th grade
Parent/youth interviews Student assessment Teacher survey Ž Ž ŽSchool backgroundsurvey
Ž ŽTranscripts Ž Ž
14
Center For Technology in Learning
SRI International
Analytic Issues
Weighting the Data
Analysis of Growth
Integrating Analyses of the Two Samples
Multiple Levels of Data
15
Center For Technology in Learning
SRI International
Putting the Study in Perspective
Major investments in technology for schools
Emergence of the Digital Divide as a key policy issue
Precedent of longitudinal studies of special and compensatory education students
Need to keep pace with a changing world
16
Center For Technology in Learning
SRI International
17
Center For Technology in Learning
SRI International
18
Center For Technology in Learning
SRI International
19
Center For Technology in Learning
SRI International
20
Center For Technology in Learning
SRI International
21
Center For Technology in Learning
SRI International
22
Center For Technology in Learning
SRI International
23
Center For Technology in Learning
SRI International