slo results analysis - engageny...at the end of this video, you will be able to: engageny.org 1....
TRANSCRIPT
![Page 1: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/1.jpg)
EngageNY.org
SLO Results Analysis
For District Leaders, Principals, and Teachers
![Page 2: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/2.jpg)
2
At the end of this video, you will be able to:
EngageNY.org
1. • Consider systems for scoring summative
assessments used with SLOs.
2. • Use the SLO calculator tool to support the
calculation of HEDI ratings.
3. • Reflect on SLO Results to Inform
Instructional Decisions and Approaches
2
![Page 3: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/3.jpg)
3
Four phases of the SLO Process
1. Preparation
2. Development
3. Implementation
4. Results Analysis
3 EngageNY.org
3
![Page 4: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/4.jpg)
4
SLOs at the end of a school year…
• Thinking strategically about the Results Analysis phase of the
SLO process offers important benefits for instructional
planning.
4
Results Analysis
Close-out
1. Administer the summative assessments.
2. Gather summative assessment results (score and record).
3. Calculate outcomes and translate to HEDI scores.
4. Report results.
Reflection
5. Organize, review, and reflect on data to inform classroom, school-wide,
and district-wide decisions around student academic goals and
instructional decisions.
EngageNY.org
4
![Page 5: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/5.jpg)
5
Scoring Summative Assessments
EngageNY.org 5
![Page 6: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/6.jpg)
6
Close-out: Scoring Summative
Assessments
• Please see Section G of the APPR Guidance for
information regarding the vested interest rule:
http://engageny.org/sites/default/files/resource/attac
hments/appr-field-guidance.pdf
• Remember: Teachers and principals cannot score
assessments in which they have a vested interest.
6 6 6 EngageNY.org 6
![Page 7: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/7.jpg)
7
Close-out: Scoring Summative
Assessments
Sample SLO scoring options:
1. Expert Panel
2. Blind Distribution
3. Strategic Rotation
EngageNY.org 7
![Page 8: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/8.jpg)
8
Close-out: Scoring Summative
Assessments, “Expert Panel”
8
Example of a Review Team:
Teacher from Middle School 1
Teacher from Middle School 2
District Central Office Personnel
Content Expert from BOCES
EngageNY.org 8
![Page 9: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/9.jpg)
9
Close-out: Suggestions for Training
Individuals for “Expert Panels”
• Develop scoring guides, rubrics, and protocols.
• Articulate expectations for submission in
advance (especially important for work products
and “real-time” summative assessments)
• Practice scoring real student work using the
developed materials.
• Arrange for inter-rater agreement and reliability.
EngageNY.org 9
![Page 10: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/10.jpg)
10
Close-out: Scoring Summative
Assessments, “Blind Distribution”
10
Blind Distribution
Random portion of
summative assessments
Random portion of
summative assessments
Random portion of
summative assessments
Random portion of
summative assessments
EngageNY.org 10
![Page 11: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/11.jpg)
11
Close-out: Scoring Summative
Assessments, “Strategic Rotation”
11
Sample rotation
EngageNY.org 11
![Page 12: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/12.jpg)
12
Calculating Outcomes and
Translating Results to HEDI Scores
EngageNY.org 12
![Page 13: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/13.jpg)
13
Close-out: Calculating Outcomes
A: Student
Names
B: Baseline
Scores C: Targets
D:
Summative
Assessment
Scores
E: (D minus
C)
Student U 17 80
Student V 10 70
Student W 12 75
Student X 18
Student Y 14
Student Z 22
13
Student Teacher Course/Period
Code
Student V A 1234
Student W A 1234
Student X A 1234
Student Y A 1234
Student Z A 1234
EngageNY.org 13
![Page 14: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/14.jpg)
14
Close-out: Calculating Outcomes
A: Student
Names
B: Baseline
Scores C: Targets
D:
Summative
Assessment
Scores
E: (D minus
C)
14 EngageNY.org 14
![Page 15: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/15.jpg)
15
Close-out: Calculating Outcomes
A: Student
Names
B: Baseline
Scores C: Targets
D:
Summative
Assessment
Scores
E: (D minus
C)
15 EngageNY.org 15
![Page 16: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/16.jpg)
16
Close-out: Calculating Outcomes
A: Student
Names
B: Baseline
Scores C: Targets
D:
Summative
Assessment
Scores
E: (D minus
C)
Student V 30 70 81 11
Student W 52 75 68 -7
Student X 60 80 94 14
Student Y 48 75 77 2
Student Z 65 80 80 0
4/5 (80%)
16 EngageNY.org 16
![Page 17: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/17.jpg)
17
Close-out: Calculating Outcomes
Weighting Multiple SLOs
Sample teacher with three SLOs:
1.An SLO with 50 students earning 14 points on the district-approved HEDI scale
2.A second SLO which earned 16 points with 39 students, and
3.A third SLO which earned 11 points with 18 students.
17 17 EngageNY.org 17
![Page 18: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/18.jpg)
18
Close-out: Calculating Outcomes
Weighting Multiple SLOs
Sum the number of students.
50+39+18 = 107
Compute proportion of students covered by each SLO.
50/107 =.4673 39/107 =.3645 18/107 =.1682
Multiply the proportion by the HEDI points for three partial
HEDIs that will be added together.
.4673 * 14 = 6.5422 (SLO 1)
.3645 * 16 = 5.832 (SLO 2)
.1682 * 11 = 1.8502 (SLO 3)
Overall HEDI = sum of these partial HEDI values.
6.5422 + 5.832 + 1.8502 = 14.2244 Rounded = 14
(Effective)
Note:
SLO 1 = 14 points with 50 students
SLO 2 = 16 points with 39 students
SLO 3 = 11 points with 18 students
18 EngageNY.org 18
![Page 19: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/19.jpg)
19
Close-out: Weighting Multiple SLOs
EngageNY.org 19
![Page 20: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/20.jpg)
20
Close-out: Weighting Multiple SLOs
EngageNY.org 20
![Page 21: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/21.jpg)
21
Close-out: Weighting Multiple SLOs
EngageNY.org 21
![Page 22: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/22.jpg)
22
Close-out: Weighting Multiple SLOs
EngageNY.org 22
![Page 23: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/23.jpg)
Close-Out: SLO Database
EngageNY.org 23
![Page 24: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/24.jpg)
24
Reflecting on SLO Results to Inform
Instructional Decisions and Approaches
EngageNY.org 24
![Page 25: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/25.jpg)
25
Reflection: Formal
Visit engageny.org for sample agenda items as
you plan for final conferences with educators.
24 EngageNY.org 25
![Page 26: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/26.jpg)
26
Reflection: Organize and Review
0
1
2
3
4
5
6
Arts
Kinderg
arte
n
Grade 1 EL
A
Grade 1 M
ath
Grade 2 EL
A
Grade 2 M
ath
Highly Effective
Effective
Developing
Ineffective
25 EngageNY.org 26
![Page 27: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/27.jpg)
27
Reflection: Formal
Remember to include SLO analysis with teachers
as a part of that final conference.
26 EngageNY.org 27
![Page 28: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/28.jpg)
28
Reflection: Organize and Review
EngageNY.org 28
Standard:
Assessment Item:
![Page 29: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/29.jpg)
29
Four phases of the SLO Process
1. Preparation
2. Development
3. Implementation
4. Results Analysis
28 EngageNY.org 29
![Page 30: SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1. •Consider systems for scoring summative assessments used with SLOs. ... (D minus](https://reader033.vdocuments.net/reader033/viewer/2022060709/6074e814172e6840410636fc/html5/thumbnails/30.jpg)
30
Search: www.engageNY.org
29 EngageNY.org 30