mid-year gains analysis read 180 & system 44 lodi unified school district results based on...
TRANSCRIPT
Mid-Year Gains AnalysisREAD 180 & System 44
Lodi Unified School DistrictResults Based on Program Data 08/01/2014 – 01/16/15
1
Executive SummaryIn partnership with the district, Scholastic has analyzed data from implementations at 36 sites that have used READ 180 & System 44 reading intervention programs this school year.
Preliminary Analysis Observations• Data were analyzed for 1,390 READ 180 and 1,849 System 44
enrolled students -- producing 996 READ 180 and 1,050 System 44 records for gains analysis.
• At time of export, 70 students were enrolled in both READ 180 & System 44 with sessions on one or both programs; these students are counted in one data set only based upon majority software usage (45 System 44 & 25 READ 180).
• Mid-year February data export indicates evidence of strong growth with strong software use in READ 180 and System 44.
Scholastic Data Services2
Summary SRI Growth Metrics
Scholastic Data Services3
Improved SRI Lexile
Exceeding Annual Growth Goal
Met 2x Annual Growth Goal
Improved SRI CC
Performance Level
0%
20%
40%
60%
80% 79%
37%
13% 16%
70%
18%
2%9%
READ 180 Sample System 44 Sample
1478 Students w/ SRI996 Students w/ SRI
Above reflects students with 2 Scholastic Reading Inventory test administrations at least 8 weeks apart with 10 or more software sessions; System 44 students total does not reflect the complete students with 2 SPI used in subsequent slides but comes from the same data.
Total Students in SRI Sample
Summary Usage DashboardSoftware Sessions
READ 180
System 44
0 40 80120
160
60
56
Minutes per Session
Scholastic Data Services4
READ 180 System 440
5
10
15
20
25
17 16
READ 180 Segments
System 44 Series
0 5 10 15 20 25
10
8
Software Content Units
LOW
GOOD
HIGHMid-Year Ideal =
50+ (Daily, 90 Minute Model)& 20-30 w/ A-B
Schedule (2-3 sessions
per week)
12
Mid-Year Ideal = 5 to 6
End of Year Ideal = 10 to 12 (Daily
Model) or 5+ (A-B Schedule)
READ 180 Results
Scholastic Data Services5
READ 180 Super Stars
Data indicate 343 READ 180 Super Stars with evidence of both strong participation and Lexile Gains. The students with the most growth relative to expectations are displayed above.
To reach “Reading Super Star” status, students must have:
• At least 20 sessions (days) of software usage
• At least 1 Segment completed in the READ 180 software
• An annual growth rate between 1.0 and 4.0
• Pre-Test SRI Lexile score of over 100L.
Scholastic Data Services6
StudentGrade Level
SchoolREAD 180 Segments
Completed
READ 180 Software Sessions
First SRI Test Date
First Lexile Score
Current SRI Test Date
Current Lexile Score
Low End Annual
Goal
High End Annual
Goal
2x Annual Goal
Change in Lexile
Annual Growth
Rate
Student #1 6 Beckman Elementary School 2 31 8/8/2014 687 12/12/2014 893 55 90 110 206 3.7Student #2 7 Henderson Community Day School 9 84 8/1/2014 650 12/11/2014 853 55 90 110 203 3.7Student #3 11 Bear Creek High School 5 68 8/1/2014 848 12/16/2014 1014 45 75 90 166 3.7Student #4 11 Liberty High School 5 61 8/1/2014 844 1/14/2015 1010 45 75 90 166 3.7Student #5 9 Ronald McNair High School 26 73 8/1/2014 707 12/16/2014 854 40 70 80 147 3.7Student #6 7 Morada Middle School 4 52 9/23/2014 751 12/16/2014 909 45 75 90 158 3.5Student #7 9 Bear Creek High School 2 59 8/1/2014 720 12/12/2014 860 40 70 80 140 3.5Student #8 7 Millswood Middle School 4 32 9/3/2014 511 12/10/2014 755 70 115 140 244 3.5Student #9 10 Lodi High School 8 65 8/4/2014 521 12/10/2014 797 80 125 160 276 3.5
Student #10 7 Delta Sierra Middle School 15 70 8/4/2014 730 12/11/2014 885 45 75 90 155 3.4
READ 180 Super Stars By School
7
Elementary Schools Percentage
Clairmont 100%
Lockeford 50%
Beckman 42%
Washington 33%
Lawrence 33%
Oakwood 31%
Creekside 25%
Sutherland 23%
Ansel Adams 22%
Mosher 20%
Borchardt 20%
Wagner Holt 17%
Middle Schools Percentage
Henderson 45%
Delta Sierra 44%
Houston 40%
Millswood 37%
Christa McAuliffe 35%
Lodi 33%
Morada 30%
High Schools Percentage
Lodi 43%
Bear Creek 38%
Plaza Robles 36%
McNair 32%
Liberty 29%
Tokay 25%
READ 180 Mean Lexile Gains by Site
Elementary Schools
Scholastic Data Services8
Students included in this analysis completed at least two SRI tests a minimum of 8 weeks apart. Review the SRI Growth Summary Report for more information. Analysis Note: “Red Bars” report does not reflect sites with fewer than 10 students. 10 sites contained fewer than 10 students. See slide #15
READ 180 Mean Lexile Gains by Site
Middle Schools
Scholastic Data Services9
Students included in this analysis completed at least two SRI tests a minimum of 8 weeks apart. Review the SRI Growth Summary Report for more information.
READ 180 Mean Lexile Gains by Site
High Schools
Scholastic Data Services10
Students included in this analysis completed at least two SRI tests a minimum of 8 weeks apart. Review the SRI Growth Summary Report for more information. Analysis Note: “Red Bars” report does not include Liberty High School as this site contained fewer than 10 students
System 44 Results
Scholastic Data Services11
System 44 Student Progress and Software Use Overview
All Students
Scholastic Data Services12
The chart above indicates the range of content completion for System 44 students. A student’s goal is to complete all 25 Series; students should strive to complete at least 10 Series in a year.
Minimum Progress Goal per Year
Lexile Growth Zone
System 44 Student Progress and Software Use Overview3rd Grade Students
Scholastic Data Services13
The chart above indicates the range of content completion for System 44 3rd grade students.
Minimum Progress Goal per Year
Lexile Growth Zone
System 44 Student Progress and Software Use OverviewGrades 4-6: SPED Students
Scholastic Data Services14
The chart above indicates the range of content completion for System 44 grades 4-6 SPED students..
Minimum Progress Goal per Year
Lexile Growth Zone
System 44 Student Progress and Software Use OverviewRemainder: Excluding 3rd and Grades 4-6 SPED
Scholastic Data Services15
The chart above indicates the range of content completion for System 44 stuents excluding Grade 3 and Grades 4-6 SPED students.
Minimum Progress Goal per Year
Lexile Growth Zone
System 44 Student SPI Results – Total Students by Decoding Level
Scholastic Data Services16
Scholastic recommends that System 44 students complete the SPI three times a year for screening and progress monitoring. Students included in this analysis completed at least two SPI tests. Students should be moving into higher levels of decoding as they progress through the program. Strongest results are typically achieved when students participate in the System 44 Instructional Model daily and when care is taken to ensure a positive testing environment. Compare results between pre-test and post-test to spotlight successes and identify areas that need additional focus. Review the SPI Summary Progress Report for more information.
Analysis Note: Above data reflects ONLY those students with sufficient software usage and SPI test administrations to meet the “Gains Analysis Sample” criteria.
Pre-Decoder
Beginning Developing AdvancingInitial Totals
Pre-Decoder
9 39 11 2 61
Beginning 9 334 186 25 554
Developing 6 70 204 100 380
Advancing 1 15 39 55
Current Totals
24 444 416 166 1050
363 (35%) Students Moved UP586 (56%) Students Stayed in Level101 (10%) Students Moved Down
Initi
al S
PI
Perf
orm
ance
Lev
els
Current SPI Performance Levels
System 44 SPI and SRI Test Results Review
Scholastic Data Services17
Above data indicate that foundational reading skills are improving; foundational skills affect reading comprehension scores like Lexiles.
Meeting Lexile annual growth goal is more likely after A) Students complete Series 20 to 25, B) Students demonstrate Advancing Decoder Status on SPI.
1,050 students with 2+ SPI 1,478 students with 2+ SRI
Analysis Note: Above data reflects ONLY those students with sufficient software usage and SPI &/or SRI test administrations to meet the “Gains Analysis Sample” criteria of 8+ weeks between pre and post-test administration.
0%40%80% 74%
45%16%
70%
18%
System 44 Growth Measures
Lodi Unified School District
Scholastic Data Services18
Results Based on Program Data 08/01/2014 – 02/19/2015
Executive Summary
In partnership with the district iRead reading instructional program’s data has been analyzed from implementation at 8 sites across the district.
Preliminary Analysis Observations
• Students’ data were analyzed 1,754 iRead students Grades Kindergarten – 3rd with complete iRead screeners & software use.
• Mid-year January data export indicates evidence of progress with iRead software: students are averaging 38 completed sessions at 23 minutes in length.
• 424 iRead students have progressed out of their initial content level.
Scholastic Data Services19
Scholastic Data Services20
Key to Understanding iRead Content and Grade Level Equivalence
Topic
Series
Unit
Basic concept(s) in a self-contained Lesson with built-in assessment.
Family of Series that fit together as a content unit. Units each have 1 to 8 Series.
Family of Topics that fit together with a summative assessment. Series each have 5 to 7 Topics.
Level Units fit together to cover the foundational literacy skills that are aligned to each grade level (K-2).
Level A = Units 1-4, Level B = Units 5-11 & Level C = Units 12-15
310 Topics
51 Series
15 Units
3 Levels
iRead Foundational Reading Skills – Initial Student Placement
Scholastic Data Services21
Above indicates how many students were placed in each of the 15 content Units of iRead, with grade level equivalencies and Unit content description indicated for reference.
Unit #Series in
UnitUnit Description Kindergarten 1st Grade 2nd Grade 3rd Grade
1 1-3 Uppercase Letter Recognition 379 318 104 162 4-6 Lowercase Letter Recognition
3 7-12 Letter Sounds 34 169 150 224 13-18 Introduction to Blending & Segmentation 3 46 70 135 19-25 Reactivate CVCs, Read Words With Blends And Final Consonants 74 192 96 26-27 Consonant Digraphs And Multisyllabic Words
7 28-30 Long Vowels (CVe) 8 63 48 31-32 Long Vowels Digraphs
9 33 r-Controlled Vowels
10 34-35 More Multisyllabic Words
11 36 Diphthongs & Variant Vowels
12 37-40 Short Vowels Reactivate & Extend 73 713 41-48 Long Vowels Reactivate & Extend
14 49 Reactivate Diphthongs & Variant Vowels
15 50-51 Reading & Spelling Challenges
Total Students per Grade Level 416 615 652 71
Kindergarten Content (Level A)
1st Grade Content (Level B)
2nd Grade Content (Level C)
Total Students by Initial Placement
Kindergarten iRead Students’ Topic Completion as a Measure of
Progress
Scholastic Data Services22
• Above indicates how student groups in iRead have progressed from their initial level of content mastery to a higher level of understanding.
• By demonstrating fluency in each Topic’s built-in assessment of skills, students demonstrate increases in foundational reading skills.
Level B (1st Grade Content)Level B Topics 104 to 215
Level A Topics 1 to 103
1st Grade iRead Students’ Topic Completion as a Measure of
Progress
Scholastic Data Services23
• Above indicates how student groups in iRead have progressed from their initial level of content mastery to a higher level of understanding.
• By demonstrating fluency in each Topic’s built-in assessment of skills, students demonstrate increases in foundational reading skills.
Level B (1st Grade Content)Level B Topics 104 to 215
Level A Topics 1 to 103
Level C (2nd Grade Content)Level C Topics 216 to 310
2nd Grade iRead Students’ Topic Completion as a Measure of
Progress
Scholastic Data Services24
• Above indicates how student groups in iRead have progressed from their initial level of content mastery to a higher level of understanding.
• By demonstrating fluency in each Topic’s built-in assessment of skills, students demonstrate increases in foundational reading skills.
Level B (1st Grade Content)Level B Topics 104 to 215
Level A Topics 1 to 103
Level C (2nd Grade Content) Level C Topics 216 to 310
iRead Student Progression Through Foundational Reading Skills
Scholastic Data Services25
Above indicates how many students are in each of the 15 content Units of iRead, with grade level equivalencies and Unit content description indicated for reference.
Unit # Out of 15 Units
Series in Unit
Unit Description Kindergarten 1st Grade 2nd Grade
1 1-3 Uppercase Letter Recognition 140 15 102 4-6 Lowercase Letter Recognition 92 27 83 7-12 Letter Sounds 96 50 224 13-18 Introduction to Blending & Segmentation 79 242 1165 19-25 Reactivate CVCs, Read Words With Blends And Final Consonants 8 242 2756 26-27 Consonant Digraphs And Multisyllabic Words 12 287 28-30 Long Vowels (CVe) 1 7 528 31-32 Long Vowels Digraphs 8 279 33 r-Controlled Vowels 2 9
10 34-35 More Multisyllabic Words 6 311 36 Diphthongs & Variant Vowels 1 712 37-40 Short Vowels Reactivate & Extend 3 5513 41-48 Long Vowels Reactivate & Extend 3514 49 Reactivate Diphthongs & Variant Vowels 115 50-51 Reading & Spelling Challenges 4
Total Students per Grade Level 416 615 652
Total Students by Current Unit
Kindergarten Content (Level A)
1st Grade Content (Level B)
2nd Grade Content (Level C)
26
Appendix
27
Implementation Model Affects READ 180 Usage Metrics
* ~45 minutes per day assumes that half a 90 minute model occurs on day 1 then the second half on day 2.
Whole Group
(20 Min)
Independent
Reading
Small Group Instruction
READ 180 Software
Wrap - Up
(10 Min)
Metric Mid-Year @ 45-50 Minutes per Day (Daily)
Mid-Year @ 90 Minutes per Day (Daily)
End of Year @ 45-50 Minutes per Day (Daily)
End of Year @ 90 Minutes per Day (Daily)
Days (Sessions) ~30 ~50 60+ 100+Sessions per Week 2 to 3 3 to 5 2 to 3 3 to 5Minutes per Session 16 to 20 16 to 20 16 to 20 16 to 20Segments 3 5 6 10
Scholastic Data Services
Lexile Annual Growth GoalsUsing Student’s Fall SRI Performance & Grade Level to Set Goals for Students
Scholastic Data Services28
• SRI can be used to set reading goals and to compare students’ response to instruction to growth expectations from fall to spring.
• Monitoring growth helps educators to determine if students are on track to meet achievement standards.
• Expected growth can be determined by fall SRI Lexile and grade level; for more on using fall Lexiles to set growth goals consult the professional paper Growth Expectations – Setting Achievable Goals
• Tier III reading intervention students are unlikely to reach personal growth goals without a firm grasp of phonemic principles.
• Scholastic recommends that System 44 students receive 3 Scholastic Phonics Inventory (SPI) Tests to monitor emerging skills.
• Without knowledge of a student beyond data in the export, Gains Analysts simply assign student records with personal Lexile growth goals derived from tables similar to the one at the right.
2015 Scholastic SRI College and Career
Lexile Proficiency Bands
Scholastic Data Services29
Grade Below Basic
Basic Proficient Advanced
K N/A BR 0 to 279L 280 & Above
1 BR 0L to 189L 190L to 534L 535L & Above
2 BR to 219L 220L to 419L 420L to 654L 655L& Above
3 BR to 329L 330L to 519L 520L to 824L 825L& Above
4 BR to 539L 540L to 739L 740L to 944L 945L& Above
5 BR to 619L 620L to 829L 830L to 1014L 1015L & Above
6 BR to 729L 730L to 924L 925L to 1074L 1075L & Above
7 BR to 769L 770L to 969L 970L to 1124L 1125L & Above
8 BR to 789L 790L to 1009L 1010L to 1189L
1190L & Above
9 BR to 849L 850L to 1049L 1050L to 1264L
1265L & Above
10 BR to 889L 890L to 1079L 1080L to 1339L
1340L & Above
11 / 12 BR to 984L 985L to 1184L 1185L to 1389L
1390L & Above
With the release of SRI College & Career, Scholastic has updated the performance levels (the score ranges that indicate Below Basic, Basic, Proficient, and Advanced performance in each grade) to reflect increased expectations for college and career readiness. This work was done with Meta Metrics, Scholastic’s measurement partner and creator of the Lexile Framework. To establish the new performance levels, Meta Metrics conducted an extensive study of college and career texts. The new score ranges more accurately reflect whether students are on track to comprehend college and career level texts by the end of high school.