1

Scantron Measures, Metrics and Cut-Points for Alternative

Education Campuses

Colorado Department of EducationJuly 12, 2012

2

Agenda

• Purpose• Selection of Measures Process & Considerations• Metrics and Cut-Points for Scantron Achievement Results• Metrics and Cut-Points for Scantron Growth Results• Timeline

3

Purpose

• Discuss and propose methodologies to explore for calculating and reporting Scantron assessment results for accountability purposes on the AEC SPF report (metrics and cut-points).

• Provide feedback on how CDE can support districts/schools in the calculation.

4

Selection of Measures Process• AECs submitted the Selection of Measures Form July 2.

– http://www.cde.state.co.us/Accountability/Downloads/AECSelectionOfAccountabilityMeasures.xlsx

• There are a set of state required AEC measures:– Achievement: CSAP/TCAP % proficient/advanced– Growth: CSAP/TCAP Median Growth Percentiles– Postsecondary: Completion rate, Dropout rate, ACT composite– Engagement: Average daily attendance, Truancy rate

• Districts may select additional measures, subject to CDE approval.

5

Considerations for Measures• The three most recent years of data will be included.• AECs will receive indicator ratings similar to the

traditional SPF:– Does not meet, approaching, meets, or exceeds AEC norms

• Each indicator/sub-indicator:– Uses adjusted AEC cut-points relative to each other– Typically uses either normative cuts of 40th/60th/90th percentile

or head counts of 40%/60%/90%• Where there are common measures across districts,

common metrics and cut-points will be used.

6

Considerations for Overall Results

• Based on the indicator ratings, AECs receive an overall point total and plan type.

• AECs engage in the same UIP process as all other schools, and have the same consequences for performance.– Note: There is a modified UIP template for AECs to reflect the

modified performance indicators.

7

Scantron Achievement Results

• Reading, Language Arts, Math, ScienceMetrics Cut-Points

% of students scoring at grade level • Exceeds – at/above 90%

• Meets – below 90% but at/above 60%• Approaching – below 60% but at/above 40%• Does Not Meet – below 40%

% of students increasing at least one grade level

8

Scantron Growth results

• Reading, Language Arts, Math, ScienceMetrics Cut-Points

% of students achieving target growth • Exceeds – at/above 90%

• Meets – below 90% but at/above 60%• Approaching – below 60% but at/above 40%• Does Not Meet – below 40%

9

Calculating Growth Targets for Scantron

Ideally, Scantron growth targets would be:• Student level• Take into consideration the student’s starting scale score• Appropriate for students attending AECs• Account for the length of time the student was receiving

instruction• Indicate whether the student is on-track in terms of observed

and expected growth

10

Calculating Growth Targets for Scantron

Questions for AECs• How are AECs currently assigning growth targets?• Targets provided by Scantron? Or• Targets calculated from the AEC’s prior results?• Are the targets specific to AECs or for traditional schools? • Are the growth targets student level?• Do the targets vary by starting grade equivalent?• How do we know the growth targets are appropriate for this

student population?

11

Calculating Growth Targets for Scantron

•How can AECs giving Scantron come up with meaningful growth targets?

•What support can CDE provide in this process?

12

Completing Selection of Measures Form

• Fill in your AEC’s aggregated percentage of students meeting their target growth• Fill in your AEC’s total number of students with pre- and post-test records (denominator)

13

Assigning a Growth Rating

• CDE will assign a rating to your AEC’s reported Scantron growth.

• This calculation is done separately for each of the three subject areas by comparing the percentage of students meeting their target growth against the following state cut-points:

Cut-Points

• Exceeds – at/above 90%• Meets – below 90% but at/above 60%• Approaching – below 60% but at/above 40%• Does Not Meet – below 40%

14

Process/Timeline

July 25: Scantron Results to CDE

15

Resources• Alyssa Pearson, Executive Director

– pearson_a@cde.state.co.us , 303-866-6855• Marie Huchton

– huchton_m@cde.state.co.us , 303-866-6203• Donna Morganstern

– morganstern_d@cde.state.co.us , 303-866-6209• Somoh Supharukchinda

– supharukchinda_s@cde.state.co.us , 303-866-6778• http://www.cde.state.co.us/Accountability/

StateAccountabilityAECs.asp