may 3, 2006wv department of education [email protected] annual measurable objectives for...
TRANSCRIPT
May 3, 2006 WV Department of Education [email protected]
Annual Measurable Objectives for Improving the Achievement of LEP Students
Title III AMAOs
May 3, 2006 WV Department of Education [email protected]
September 2003 Submission to US Department of Education
Timeline Proposed Plan Status
Mar-04 West Virginia’s ELP assessment (WESTELL) will be administered to all LEP students
Census-field test completed
Delayed until Summer 2005 Current status complete
Winter 2005
Original AMAO targets implemented, districts notified
Completed
Summer 2004
Standard Setting on new assessment
May 3, 2006 WV Department of Education [email protected]
Annual Objectives
• AMAO 1 specifies annual increases in the number or percentage of students making progress in learning English as demonstrated by WESTELL.
• AMAO 2 specifies annual increases in the number or percentage of children attaining English proficiency as demonstrated by WESTELL.
• AMAO 3 specifies annual increases in the number or percentage of children making AYP as determined by the statewide assessment.
May 3, 2006 WV Department of Education [email protected]
Guiding Principles for Development
• The AMAOs must accurately measure the progress LEAs have made in increasing the proficiency of English learners
• The AMAOs should define rigorous yet achievable objectives
• Reliable and valid data should be used in the definition of the AMAOs
• The accountability system should be kept as simple as possible and be understandable to teachers, students, and parents.
May 3, 2006 WV Department of Education [email protected]
Background
• 2004 WESTELL field test administration – 569 students (grades 3-12) participated– Reports included no student ID#
• 2005 WESTELL operational administration– 734 students (grades 3-12) participated– Reports included Student ID#s – K-2 Field tested
May 3, 2006 WV Department of Education [email protected]
Data Limitations
• Limited by small number of matching scores (274 matching scores)
• Current data includes 2004 Field test data
• Does not include K-2 testing
• Does not include 3 data points
• Student records are not linked by Student ID#s (susceptible to human error)
May 3, 2006 WV Department of Education [email protected]
Prerequisite Definitions for setting AMAO 1 targets
1. Determine “cohort”
2. Define expected annual growth
3. Define English Language Proficiency
• Define starting points and
targets (AMAOs) for making progress
May 3, 2006 WV Department of Education [email protected]
AMAO 1- Making Progress
Definition of “cohort”
Original definition was based on “length of time in program” (September 2003 Consolidated State Application)
Recommended Cohort = All LEP students, K-12, who have two years of WESTELL data
May 3, 2006 WV Department of Education [email protected]
AMAO 1 Making Progress
Definition of “expected annual progress”• Gaining one proficiency level annually for students
who were below Level 3 the prior year• Gaining one proficiency level every two years for
students who the prior year were at Level 3 (requires 3 data points)
• Maintaining the current level of proficiency for students who are at Levels 4 or 5 and have no sub-skill below Level 3
May 3, 2006 WV Department of Education [email protected]
AMAO 1- Making Progress
Definition of “proficient”
Original definition was “Level 5” (September 2003 Consolidated State Application)
Recommended Proficient = Level 4 Composite with all sub-skills at Level 3 or above
May 3, 2006 WV Department of Education [email protected]
Prerequisite Definitions for setting AMAO 1 targets
1. Determine “cohort”
2. Define expected annual growth
3. Define English Language Proficiency
• Define starting points and
targets (AMAOs) for making progress
May 3, 2006 WV Department of Education [email protected]
Table 4Distribution of Data by GradeWESTELL 2005 - 2004 Data
2005
Grade Met Goal* NI** Total % Met3 0 3 3 0.00%4 28 6 34 82.35%5 47 5 52 90.38%6 26 7 33 78.79%7 26 5 31 83.87%8 34 1 35 97.14%9 24 4 28 85.71%10 16 4 20 80.00%11 19 2 21 90.48%12 15 2 17 88.24%State Total 235 39 274 85.77%
May 3, 2006 WV Department of Education [email protected]
Table 3 - Sorted
Distribution of Data by County
ELDA 2005 - 2004 Data
2005
County Met Goal* NI** Total % Met
County A 1 1 2 50.00%County B 3 1 4 75.00%County C 12 4 16 75.00%County D 4 1 5 80.00%County E 8 2 10 80.00%County F 52 13 65 80.00%County G 26 5 31 83.87%County H 32 5 37 86.49%County I 49 6 55 89.09%County J 10 1 11 90.91%County K 1 0 1 100.00%County L 1 0 1 100.00%County M 1 0 1 100.00%County N 1 0 1 100.00%County O 2 0 2 100.00%County P 3 0 3 100.00%County Q 4 0 4 100.00%County R 4 0 4 100.00%County S 5 0 5 100.00%County T 16 0 16 100.00%State Total 235 39 274 85.77%
May 3, 2006 WV Department of Education [email protected]
AMAO 1 Targets
• Starting Point = 75%
• Ending Point =89%
• Targets = 1.7% increase per year
May 3, 2006 WV Department of Education [email protected]
AMAO 1 Targets 2006-2014
65
70
75
80
85
90
95
Pe
rce
nt
of
Stu
de
nts
Me
eti
ng
An
nu
al
Gro
wth
Ob
jec
tiv
es
Series1
Series1 75 76.7 78.4 80.1 81.8 83.5 85.2 86.9 89
2005-06
2006-07
2007-08
2008-09
2009-10
2010-11
2011-12
2012-13
2013-14
May 3, 2006 WV Department of Education [email protected]
Prerequisite Definitions for setting AMAO 2 targets
1. Define English Language Proficiency
2. Determine “cohort”
3. Define expected annual growth
• Define starting points and
targets (AMAOs) for becoming proficient
May 3, 2006 WV Department of Education [email protected]
AMAO 2- Becoming Proficient
Definition of “proficient”
Original definition was “Level 5” (September 2003 Consolidated State Application)
Recommended Proficient = Level 4 Composite with all sub-skills at Level 3 or above
May 3, 2006 WV Department of Education [email protected]
AMAO 2 Becoming Proficient
Definition of “cohort”
LEP students who:
Have been in U.S. schools for 4 or more years
Who have two years of WESTELL data AND
Are at Level 3 or above or who did not reach English proficiency the prior year OR
Were below Level 3 the prior year who met the English proficient level the second year
May 3, 2006 WV Department of Education [email protected]
AMAO 2 Define expected annual growth
• 68 total students in cohort – 2004 were at Level 3 – 2004 were not at Levels 4 or 5– 2004 were at Levels 1 or 2 and were at Levels 4 or 5 above in 2005
• *Could not analyze by length of time in US schools (4 years minimum)
• 5 total students became proficient (2005 were at Level 4 or above)
• 7.35% of cohort became proficient• No County met the “N” size for AMAO 2 Accountability
May 3, 2006 WV Department of Education [email protected]
AMAO 2 Targets
• Starting Point = 6%
• Ending Point =10%
• Targets = .5% increase per year
May 3, 2006 WV Department of Education [email protected]
AMAO 2 Targets 2006-2014
0
2
4
6
8
10
12
Pe
rce
nt
of
Stu
de
nts
Be
co
min
g
Pro
fic
ien
t
Series1
Series1 6 6.5 7 7.5 8 8.5 9 9.5 10
2005-06
2006-07
2007-08
2008-09
2009-10
2010-11
2011-12
2012-13
2013-14
May 3, 2006 WV Department of Education [email protected]
Final Recommendations
• Inadequate Data
• Current AMAOs evaluated in Impact Study
• Conclusions Fall 2007
• Submitted in amendment request to WV’s Consolidated State Application (March 06)
• Pending approval from USDE