The Basics
What is the Analysis of Student Work (ASW)?
ASW is the process North Carolina has decided to implement in order to obtain a Standard 6 Effectiveness Rating for teachers that do not have an EOG/EOC, NC Final Exam, or some other standardized measure. It is completely based upon growth.
The Basics
The following teachers will be involved:
• Arts Education• Healthful Living• International Baccalaureate • World Languages• Advanced Placement (60% Rule)
5 Rating Categories
1 65432Demonstrate Leadership
Establish Environment
KnowContent
Facilitate Learning
Reflect on Practice
Contribute
to Academic
Success
3 Rating Categories
Not Demonstrated
Developing
Proficient
Accomplished
Distinguished
Effectiveness Status NC Educator Evaluation System
High School Participation
1. If 60% of an educator’s classes* are in ASW subject areas, then the educator must participate in both ASW and any other Standard 6 measure covering the remaining classes.
2. If 60% of an educator’s classes* can be covered by an existing measure of student learning, then the teacher is not required to participate in ASW.
*Please note that locally developed electives that do not follow the standards set forth in the NC Standard Course of Study are not included in the ASW Process.
General Timeline• Teachers will verify schedule on PowerSchool in September - (very important)• The DPI Online Platform will choose classes (October)• Teachers will choose the 5 (2 in Fall, 3 in Spring) Clarifying Objectives from SCOS and decide upon Individual or Whole Class Time-lapse Artifacts. (October - May) •DPI Online Platform Chooses Students in May• Teachers will upload Time-lapse Artifacts to the Online Platform and officially submit in May.• Content Expert Reviewers will evaluate Time-lapse Artifacts for growth.• Teachers will receive their Standard 6 rating when EVAAS Scores are released the following year.
Teacher collects artifacts of student work
Teacher receives category rating for
Standard 6
Teacher uploads Evidence Collection to Online Platform
Reviewers rate Evidence
Collections
Analysis of Student Work Process
Teacher verifies schedule and chooses courses and 5 objectives
How will ASW Function?• Teachers will choose a clarifying objective from the Standard Course of Study. The teacher will then give an assignment with little or no classroom instruction. Then the teacher will give the same assignment or even a more advanced version of the assignment at a later date in order to demonstrate growth on that clarifying objective.
•These assignments are known as Timelapse Artifacts.
•Teachers will do this 5 times throughout the school year with all ASW classes.
• DPI (The Online Platform) will choose classes and students.
Objectives:Using the Strands and Standards guidance charts, the teacher will choose 5 objectives.
Clarifying Objectives
Selecting Objectives
Examples from AP Psychology – History & Approaches
Describe and compare different theoretical approaches in explaining
behavior…
-VS-
Identify major historical figures in psychology…
The Teacher may choose:Option 1 – Individual Student Work SamplesCollect and keep 2 work samples:•for each class member•for a specific objective •at 2 separate points in time
Individual or Group
The Teacher may choose:Option 2 – Whole Class Work Samples2 work samples that represent the entire class•for a specific objective •at 2 separate points in time
Individual or Group
Harvesting Format
• Teachers will need to hold onto Timelapse Artifacts until he/she uploads in December or May (may need storage space).• May need access to technology to record their Timelapse Artifacts (1 minute or less on video).
The Narrative
When uploading Timelapse Artifacts, teachers will have a chance to explain the assignment, how it aligns with the clarifying objective and how the assignment demonstrates growth.
Reshuffling
If a student is chosen that has transferred or was absent when the assignment was given or some other problem, the teacher can choose to Reshuffle. Principals will be notified when a teacher has chosen to reshuffle.
Teachers get 1 reshuffle per student chosen by the DPI Online Platform.
• According to DPI, the main job of the school administrator is to ensure teacher participation in the ASW process.
• To meet with teacher and sign off on the 5 clairfying objectives he/she has chosen.
Timelapse Artifact Option 1 – Individual Student Work Samples
1
2
1
2
1
2
1 Timelapse
Artifact
1 Timelapse
Artifact
Upload Evidence
Timelapse Artifact Option 2 – Whole Class Work Samples 2
1
1 Timelapse Artifact
1 Timelapse Artifact
Upload Evidence
All 5 Timelapse Artifacts will be uploaded to the online platformas the teacher’sEvidence Collectionfor the school year.
TA 3Student
TA 3Student
TA 4Student
TA 4Student
TA 5Whole Class
TA 5Whole Class
TA 1 Student
TA 1 Student
TA 2 Whole Class
TA 2 Whole Class
Upload Evidence
The Evidence Collection will be reviewed by 2 content area specialists.
Reviewer #1 Reviewer #2
Blind Review
ED M
Reviewer #1 Reviewer #2
The platform sends the evidence collection to two reviewers who have been matched to the teacher because of their similar content area expertise.
Blind Review
If the category ratings from each reviewer are the same, then the review process is complete and the Standard 6 rating will be posted for that year.
Category Rating: Meets Expected Growth
Reviewer #1 Reviewer #2
M
Blind Review
M
Reviewer #1 Reviewer #2
If the category ratings from the two reviewers are not the same, the Evidence Collection is automatically sent to a 3rd reviewer for an additional review to get a rating for that year.
M
Reviewer #3
Blind Review
E
D = Does Not Meet Expected Growth M = Meets Expected Growth E = Exceeds Expected Growth
Transfer your rating for each TA from the quality rubric to the table below:
Use this table to determine the overall rating for the evidence collection
Overall Rating for the entire Evidence Collection
Does Not Meet Expected Growth Meets Expected Growth Exceeds Expected Growth
Evidence Collection Rating Form:
TA 1 TA 2 TA 3 TA 4 TA 5
Does Not Meet Meets ExceedsD D D D D M M M M M E E E E ED D D D E M M M M E M E E E ED D D D M D M M M M M M E E ED D D E E M M M E E D E E E ED D D M E D D M M M D M E E ED D D M M D M M M E D D E E E D D M M E D D M E E D M M E E
Overview of the ASW Process
6 6
Contribute to Academic
Success
6Year 1 2014-2015
Does Not Meet Expected Growth
Year 22015-2016Meets
Expected Growth
Year 32016-2017Meets
Expected Growth
Standard
Standard
Standard
Mr. NC’s 3 years of growth data:
2014-15 Does Not Meet (Year 1) 2015-16 Meets (Year 2)+ 2016-17 Meets (Year 3)
Mr. NC’s Standard 6 rating for 2014-2017 Meets Expected Growth
Only for 2014 – 2017: Best 2 out of 3 years of data
Effectiveness Status
Lessons Learned from Pilots
Choose objectives carefully Match teacher’s instruction and assessment Select artifacts that demonstrate:
the objective selected at 2 points in time
Realize not all objectives link easily to ASW process
Resources
NC ASW Wiki Page - http://ncasw.ncdpi.wikispaces.net/ Great Resource: The wiki has training modules, PowerPoints, and a frequently asked questions section.
Training Module 5 is aimed at Administrators and their role in this process (Google – NC DPI ASW Training Modules – Link Below).
http://ncasw.ncdpi.wikispaces.net/TrainingModules