mid-year gains analysis read 180 & system 44 lodi unified school district results based on...

29
Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

Upload: audrey-berry

Post on 27-Dec-2015

216 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

Mid-Year Gains AnalysisREAD 180 & System 44

Lodi Unified School DistrictResults Based on Program Data 08/01/2014 – 01/16/15

1

Page 2: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

Executive SummaryIn partnership with the district, Scholastic has analyzed data from implementations at 36 sites that have used READ 180 & System 44 reading intervention programs this school year.

Preliminary Analysis Observations• Data were analyzed for 1,390 READ 180 and 1,849 System 44

enrolled students -- producing 996 READ 180 and 1,050 System 44 records for gains analysis.

• At time of export, 70 students were enrolled in both READ 180 & System 44 with sessions on one or both programs; these students are counted in one data set only based upon majority software usage (45 System 44 & 25 READ 180).

• Mid-year February data export indicates evidence of strong growth with strong software use in READ 180 and System 44.

Scholastic Data Services2

Page 3: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

Summary SRI Growth Metrics

Scholastic Data Services3

Improved SRI Lexile

Exceeding Annual Growth Goal

Met 2x Annual Growth Goal

Improved SRI CC

Performance Level

0%

20%

40%

60%

80% 79%

37%

13% 16%

70%

18%

2%9%

READ 180 Sample System 44 Sample

1478 Students w/ SRI996 Students w/ SRI

Above reflects students with 2 Scholastic Reading Inventory test administrations at least 8 weeks apart with 10 or more software sessions; System 44 students total does not reflect the complete students with 2 SPI used in subsequent slides but comes from the same data.

Total Students in SRI Sample

Page 4: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

Summary Usage DashboardSoftware Sessions

READ 180

System 44

0 40 80120

160

60

56

Minutes per Session

Scholastic Data Services4

READ 180 System 440

5

10

15

20

25

17 16

READ 180 Segments

System 44 Series

0 5 10 15 20 25

10

8

Software Content Units

LOW

GOOD

HIGHMid-Year Ideal =

50+ (Daily, 90 Minute Model)& 20-30 w/ A-B

Schedule (2-3 sessions

per week)

12

Mid-Year Ideal = 5 to 6

End of Year Ideal = 10 to 12 (Daily

Model) or 5+ (A-B Schedule)

Page 5: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

READ 180 Results

Scholastic Data Services5

Page 6: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

READ 180 Super Stars

Data indicate 343 READ 180 Super Stars with evidence of both strong participation and Lexile Gains. The students with the most growth relative to expectations are displayed above.

To reach “Reading Super Star” status, students must have:

• At least 20 sessions (days) of software usage

• At least 1 Segment completed in the READ 180 software

• An annual growth rate between 1.0 and 4.0

• Pre-Test SRI Lexile score of over 100L.

Scholastic Data Services6

StudentGrade Level

SchoolREAD 180 Segments

Completed

READ 180 Software Sessions

First SRI Test Date

First Lexile Score

Current SRI Test Date

Current Lexile Score

Low End Annual

Goal

High End Annual

Goal

2x Annual Goal

Change in Lexile

Annual Growth

Rate

Student #1 6 Beckman Elementary School 2 31 8/8/2014 687 12/12/2014 893 55 90 110 206 3.7Student #2 7 Henderson Community Day School 9 84 8/1/2014 650 12/11/2014 853 55 90 110 203 3.7Student #3 11 Bear Creek High School 5 68 8/1/2014 848 12/16/2014 1014 45 75 90 166 3.7Student #4 11 Liberty High School 5 61 8/1/2014 844 1/14/2015 1010 45 75 90 166 3.7Student #5 9 Ronald McNair High School 26 73 8/1/2014 707 12/16/2014 854 40 70 80 147 3.7Student #6 7 Morada Middle School 4 52 9/23/2014 751 12/16/2014 909 45 75 90 158 3.5Student #7 9 Bear Creek High School 2 59 8/1/2014 720 12/12/2014 860 40 70 80 140 3.5Student #8 7 Millswood Middle School 4 32 9/3/2014 511 12/10/2014 755 70 115 140 244 3.5Student #9 10 Lodi High School 8 65 8/4/2014 521 12/10/2014 797 80 125 160 276 3.5

Student #10 7 Delta Sierra Middle School 15 70 8/4/2014 730 12/11/2014 885 45 75 90 155 3.4

Page 7: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

READ 180 Super Stars By School

7

Elementary Schools Percentage

Clairmont 100%

Lockeford 50%

Beckman 42%

Washington 33%

Lawrence 33%

Oakwood 31%

Creekside 25%

Sutherland 23%

Ansel Adams 22%

Mosher 20%

Borchardt 20%

Wagner Holt 17%

Middle Schools Percentage

Henderson 45%

Delta Sierra 44%

Houston 40%

Millswood 37%

Christa McAuliffe 35%

Lodi 33%

Morada 30%

High Schools Percentage

Lodi 43%

Bear Creek 38%

Plaza Robles 36%

McNair 32%

Liberty 29%

Tokay 25%

Page 8: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

READ 180 Mean Lexile Gains by Site

Elementary Schools

Scholastic Data Services8

Students included in this analysis completed at least two SRI tests a minimum of 8 weeks apart. Review the SRI Growth Summary Report for more information. Analysis Note: “Red Bars” report does not reflect sites with fewer than 10 students. 10 sites contained fewer than 10 students. See slide #15

Page 9: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

READ 180 Mean Lexile Gains by Site

Middle Schools

Scholastic Data Services9

Students included in this analysis completed at least two SRI tests a minimum of 8 weeks apart. Review the SRI Growth Summary Report for more information.

Page 10: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

READ 180 Mean Lexile Gains by Site

High Schools

Scholastic Data Services10

Students included in this analysis completed at least two SRI tests a minimum of 8 weeks apart. Review the SRI Growth Summary Report for more information. Analysis Note: “Red Bars” report does not include Liberty High School as this site contained fewer than 10 students

Page 11: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

System 44 Results

Scholastic Data Services11

Page 12: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

System 44 Student Progress and Software Use Overview

All Students

Scholastic Data Services12

The chart above indicates the range of content completion for System 44 students. A student’s goal is to complete all 25 Series; students should strive to complete at least 10 Series in a year.

Minimum Progress Goal per Year

Lexile Growth Zone

Page 13: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

System 44 Student Progress and Software Use Overview3rd Grade Students

Scholastic Data Services13

The chart above indicates the range of content completion for System 44 3rd grade students.

Minimum Progress Goal per Year

Lexile Growth Zone

Page 14: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

System 44 Student Progress and Software Use OverviewGrades 4-6: SPED Students

Scholastic Data Services14

The chart above indicates the range of content completion for System 44 grades 4-6 SPED students..

Minimum Progress Goal per Year

Lexile Growth Zone

Page 15: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

System 44 Student Progress and Software Use OverviewRemainder: Excluding 3rd and Grades 4-6 SPED

Scholastic Data Services15

The chart above indicates the range of content completion for System 44 stuents excluding Grade 3 and Grades 4-6 SPED students.

Minimum Progress Goal per Year

Lexile Growth Zone

Page 16: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

System 44 Student SPI Results – Total Students by Decoding Level

Scholastic Data Services16

Scholastic recommends that System 44 students complete the SPI three times a year for screening and progress monitoring. Students included in this analysis completed at least two SPI tests. Students should be moving into higher levels of decoding as they progress through the program. Strongest results are typically achieved when students participate in the System 44 Instructional Model daily and when care is taken to ensure a positive testing environment. Compare results between pre-test and post-test to spotlight successes and identify areas that need additional focus. Review the SPI Summary Progress Report for more information.

Analysis Note: Above data reflects ONLY those students with sufficient software usage and SPI test administrations to meet the “Gains Analysis Sample” criteria.

Pre-Decoder

Beginning Developing AdvancingInitial Totals

Pre-Decoder

9 39 11 2 61

Beginning 9 334 186 25 554

Developing 6 70 204 100 380

Advancing 1 15 39 55

Current Totals

24 444 416 166 1050

363 (35%) Students Moved UP586 (56%) Students Stayed in Level101 (10%) Students Moved Down

Initi

al S

PI

Perf

orm

ance

Lev

els

Current SPI Performance Levels

Page 17: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

System 44 SPI and SRI Test Results Review

Scholastic Data Services17

Above data indicate that foundational reading skills are improving; foundational skills affect reading comprehension scores like Lexiles.

Meeting Lexile annual growth goal is more likely after A) Students complete Series 20 to 25, B) Students demonstrate Advancing Decoder Status on SPI.

1,050 students with 2+ SPI 1,478 students with 2+ SRI

Analysis Note: Above data reflects ONLY those students with sufficient software usage and SPI &/or SRI test administrations to meet the “Gains Analysis Sample” criteria of 8+ weeks between pre and post-test administration.

0%40%80% 74%

45%16%

70%

18%

System 44 Growth Measures

Page 18: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

Lodi Unified School District

Scholastic Data Services18

Results Based on Program Data 08/01/2014 – 02/19/2015

Page 19: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

Executive Summary

In partnership with the district iRead reading instructional program’s data has been analyzed from implementation at 8 sites across the district.

Preliminary Analysis Observations

• Students’ data were analyzed 1,754 iRead students Grades Kindergarten – 3rd with complete iRead screeners & software use.

• Mid-year January data export indicates evidence of progress with iRead software: students are averaging 38 completed sessions at 23 minutes in length.

• 424 iRead students have progressed out of their initial content level.

Scholastic Data Services19

Page 20: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

Scholastic Data Services20

Key to Understanding iRead Content and Grade Level Equivalence

Topic

Series

Unit

Basic concept(s) in a self-contained Lesson with built-in assessment.

Family of Series that fit together as a content unit. Units each have 1 to 8 Series.

Family of Topics that fit together with a summative assessment. Series each have 5 to 7 Topics.

Level Units fit together to cover the foundational literacy skills that are aligned to each grade level (K-2).

Level A = Units 1-4, Level B = Units 5-11 & Level C = Units 12-15

310 Topics

51 Series

15 Units

3 Levels

Page 21: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

iRead Foundational Reading Skills – Initial Student Placement

Scholastic Data Services21

Above indicates how many students were placed in each of the 15 content Units of iRead, with grade level equivalencies and Unit content description indicated for reference.

Unit #Series in

UnitUnit Description Kindergarten 1st Grade 2nd Grade 3rd Grade

1 1-3 Uppercase Letter Recognition 379 318 104 162 4-6 Lowercase Letter Recognition

3 7-12 Letter Sounds 34 169 150 224 13-18 Introduction to Blending & Segmentation 3 46 70 135 19-25 Reactivate CVCs, Read Words With Blends And Final Consonants 74 192 96 26-27 Consonant Digraphs And Multisyllabic Words

7 28-30 Long Vowels (CVe) 8 63 48 31-32 Long Vowels Digraphs

9 33 r-Controlled Vowels

10 34-35 More Multisyllabic Words

11 36 Diphthongs & Variant Vowels

12 37-40 Short Vowels Reactivate & Extend 73 713 41-48 Long Vowels Reactivate & Extend

14 49 Reactivate Diphthongs & Variant Vowels

15 50-51 Reading & Spelling Challenges

Total Students per Grade Level 416 615 652 71

Kindergarten Content (Level A)

1st Grade Content (Level B)

2nd Grade Content (Level C)

Total Students by Initial Placement

Page 22: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

Kindergarten iRead Students’ Topic Completion as a Measure of

Progress

Scholastic Data Services22

• Above indicates how student groups in iRead have progressed from their initial level of content mastery to a higher level of understanding.

• By demonstrating fluency in each Topic’s built-in assessment of skills, students demonstrate increases in foundational reading skills.

Level B (1st Grade Content)Level B Topics 104 to 215

Level A Topics 1 to 103

Page 23: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

1st Grade iRead Students’ Topic Completion as a Measure of

Progress

Scholastic Data Services23

• Above indicates how student groups in iRead have progressed from their initial level of content mastery to a higher level of understanding.

• By demonstrating fluency in each Topic’s built-in assessment of skills, students demonstrate increases in foundational reading skills.

Level B (1st Grade Content)Level B Topics 104 to 215

Level A Topics 1 to 103

Level C (2nd Grade Content)Level C Topics 216 to 310

Page 24: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

2nd Grade iRead Students’ Topic Completion as a Measure of

Progress

Scholastic Data Services24

• Above indicates how student groups in iRead have progressed from their initial level of content mastery to a higher level of understanding.

• By demonstrating fluency in each Topic’s built-in assessment of skills, students demonstrate increases in foundational reading skills.

Level B (1st Grade Content)Level B Topics 104 to 215

Level A Topics 1 to 103

Level C (2nd Grade Content) Level C Topics 216 to 310

Page 25: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

iRead Student Progression Through Foundational Reading Skills

Scholastic Data Services25

Above indicates how many students are in each of the 15 content Units of iRead, with grade level equivalencies and Unit content description indicated for reference.

Unit # Out of 15 Units

Series in Unit

Unit Description Kindergarten 1st Grade 2nd Grade

1 1-3 Uppercase Letter Recognition 140 15 102 4-6 Lowercase Letter Recognition 92 27 83 7-12 Letter Sounds 96 50 224 13-18 Introduction to Blending & Segmentation 79 242 1165 19-25 Reactivate CVCs, Read Words With Blends And Final Consonants 8 242 2756 26-27 Consonant Digraphs And Multisyllabic Words 12 287 28-30 Long Vowels (CVe) 1 7 528 31-32 Long Vowels Digraphs 8 279 33 r-Controlled Vowels 2 9

10 34-35 More Multisyllabic Words 6 311 36 Diphthongs & Variant Vowels 1 712 37-40 Short Vowels Reactivate & Extend 3 5513 41-48 Long Vowels Reactivate & Extend 3514 49 Reactivate Diphthongs & Variant Vowels 115 50-51 Reading & Spelling Challenges 4

Total Students per Grade Level 416 615 652

Total Students by Current Unit

Kindergarten Content (Level A)

1st Grade Content (Level B)

2nd Grade Content (Level C)

Page 26: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

26

Appendix

Page 27: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

27

Implementation Model Affects READ 180 Usage Metrics

* ~45 minutes per day assumes that half a 90 minute model occurs on day 1 then the second half on day 2.

Whole Group

(20 Min)

Independent

Reading

Small Group Instruction

READ 180 Software

Wrap - Up

(10 Min)

Metric Mid-Year @ 45-50 Minutes per Day (Daily)

Mid-Year @ 90 Minutes per Day (Daily)

End of Year @ 45-50 Minutes per Day (Daily)

End of Year @ 90 Minutes per Day (Daily)

Days (Sessions) ~30 ~50 60+ 100+Sessions per Week 2 to 3 3 to 5 2 to 3 3 to 5Minutes per Session 16 to 20 16 to 20 16 to 20 16 to 20Segments 3 5 6 10

Scholastic Data Services

Page 28: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

Lexile Annual Growth GoalsUsing Student’s Fall SRI Performance & Grade Level to Set Goals for Students

Scholastic Data Services28

• SRI can be used to set reading goals and to compare students’ response to instruction to growth expectations from fall to spring.

• Monitoring growth helps educators to determine if students are on track to meet achievement standards.

• Expected growth can be determined by fall SRI Lexile and grade level; for more on using fall Lexiles to set growth goals consult the professional paper Growth Expectations – Setting Achievable Goals

• Tier III reading intervention students are unlikely to reach personal growth goals without a firm grasp of phonemic principles.

• Scholastic recommends that System 44 students receive 3 Scholastic Phonics Inventory (SPI) Tests to monitor emerging skills.

• Without knowledge of a student beyond data in the export, Gains Analysts simply assign student records with personal Lexile growth goals derived from tables similar to the one at the right.

Page 29: Mid-Year Gains Analysis READ 180 & System 44 Lodi Unified School District Results Based on Program Data 08/01/2014 – 01/16/15 1

2015 Scholastic SRI College and Career

Lexile Proficiency Bands

Scholastic Data Services29

Grade Below Basic

Basic Proficient Advanced

K N/A BR 0 to 279L 280 & Above

1 BR 0L to 189L 190L to 534L 535L & Above

2 BR to 219L 220L to 419L 420L to 654L 655L& Above

3 BR to 329L 330L to 519L 520L to 824L 825L& Above

4 BR to 539L 540L to 739L 740L to 944L 945L& Above

5 BR to 619L 620L to 829L 830L to 1014L 1015L & Above

6 BR to 729L 730L to 924L 925L to 1074L 1075L & Above

7 BR to 769L 770L to 969L 970L to 1124L 1125L & Above

8 BR to 789L 790L to 1009L 1010L to 1189L

1190L & Above

9 BR to 849L 850L to 1049L 1050L to 1264L

1265L & Above

10 BR to 889L 890L to 1079L 1080L to 1339L

1340L & Above

11 / 12 BR to 984L 985L to 1184L 1185L to 1389L

1390L & Above

With the release of SRI College & Career, Scholastic has updated the performance levels  (the score ranges that indicate Below Basic, Basic, Proficient, and Advanced performance in each grade) to reflect increased expectations for college and career readiness.  This work was done with Meta Metrics, Scholastic’s measurement partner and creator of the Lexile Framework.  To establish the new performance levels, Meta Metrics conducted an extensive study of college and career texts.  The new score ranges more accurately reflect whether students are on track to comprehend college and career level texts by the end of high school.