quarterly update
DESCRIPTION
Quarterly Update Blue Ribbon Commission’s Recommendations of the 2009 Criterion Referenced Competency Test (CRCT) Erasure Investigation. Dr. Beverly L. Hall Superintendent Atlanta Public Schools . February 14, 2011. Quarterly Update. Agenda. Background Overview - PowerPoint PPT PresentationTRANSCRIPT
Quarterly Update Blue Ribbon Commission’s Recommendations of the 2009 Criterion Referenced Competency Test (CRCT)
Erasure InvestigationDr. Beverly L. HallSuperintendent
Atlanta Public Schools
February 14, 2011
Quarterly UpdateAgenda
▪Background▪Overview▪Update on BRC Recommendations▪Next Steps
2
Background▪Blue Ribbon Commission’s report included 29
recommendations:–Security–Process–Leadership–Comparison
▪Recommendation Owners–Each recommendation was assigned to a division and
individual owner–Each owner is a member of the senior leadership
team with functional responsibility that aligns with the recommendation
3
Overview
▪Twenty-nine recommendations outlined in the BRC report–Each recommendation to date has a status of
one of the following:• Complete• In Progress•On Hold
4
Security Recommendations
▪Security recommendations encompass:–Developing a comprehensive test security
plan that includes best-in-class test administration procedures–Continuing to research and understand the
high number of erasures–Reinforcing and communicating existing
testing policies and any new policies or changes
5
Security Recommendations
6
BRC Security Recommendation 2–Research and identify causes of the unusually high number of
erasures within the district and identify and implement best practices in test preparation across the district
Status: On Hold
Administration’s Update–The district received partial 2009 CRCT erasure data from the
Governor’s Office of Student Achievement (GOSA). This data has been analyzed to the extent possible–APS has received 2010 summary erasure data from GOSA and
will conduct an analysis–The district will continue to implement best practices in test
preparation and administration
Process Recommendations
▪The process recommendations involve:–Following up to ensure immediate assistance
is given to students impacted by testing irregularities–Developing a plan to track implementation of
all of the recommendations–Following up on the results of the
investigation–Enhancing existing protocols for future CRCT
administrations and new audit routines
7
Process Recommendations
8
BRC Process Recommendation 1– Commit publicly to aggressively follow-up on the results of the
investigation by establishing a well-defined plan to consider the findings and recommendations in this report, conduct additional investigations where necessary, and take whatever administrative, legal, and professional action that APS considers appropriate
Status: Complete
Administration’s Update– Presented a response and plan of action to the ABE and public on
August 16, 2010• Presented the first quarterly report on November 1, 2010• Presented the second quarterly report on February 14, 2011
– Full cooperation with investigations conducted by the Governor’s Office
Process Recommendations
9
BRC Process Recommendation 3–Conduct further investigation of the referred
individuals within the Identified Schools and take whatever administrative, legal or professional action APS considers appropriate
Status: On Hold
Administration’s Update– The PSC approved 27 of 108 referred individuals– APS is providing full cooperation with the Governor’s
special investigation team
Process Recommendations
10
BRC Process Recommendation 6–Develop regular internal audit routines for each
administration of the CRCT focused on: test security protocols; test administration; and detailed APS erasure analysis
Status: Complete
Administration’s Update–APS Internal Auditor has developed a plan to conduct
regular audits for each CRCT test administration
Process Recommendations
11
BRC Process Recommendation 7–Document any testing irregularities identified and
specific plans for follow-up and resolution, including referrals to the Georgia Professional Standards Commission and/or Fulton County District Attorney's Office, as appropriate
Status: Complete
Administration’s Update–The cross-divisional process for investigating and
following up on testing irregularities has been documented
Leadership Recommendations
▪Leadership recommendations involve–Driving culture change–Re-assessing current incentive, performance
and evaluation systems–Utilizing new forms of review and feedback–Publishing and addressing any additional
findings related to the 2009 testing period–Reinforcing and communicating existing,
supporting policies
12
Leadership Recommendations
13
BRC Leadership Recommendation 1–Drive culture change throughout the district to create an
environment that effectively balances attention to measurable student outcomes with attention to positive, ethical behavior
Status: In Progress
Administration’s Update–Modified the APS Balanced Scorecard objective of building a
culture of alignment, ethics and accountability– The APS Balanced Scorecard is cascaded to all district leaders who
will align their measures to the district scorecard– Alignment with the Effective Teacher in Every Classroom (ETEC)
and Race to the Top initiatives
Leadership Recommendations
14
BRC Leadership Recommendation 2–Proactively re-assess incentive systems and
performance evaluation processes for all district employees with a focus on achieving this appropriate balance
Status: In Progress
Administration’s Update–Planning for this multi-year phased recommendation
is in progress as part of the Effective Teacher in Every Classroom (ETEC) and Race to the Top initiatives
Leadership Recommendations
15
BRC Leadership Recommendation 3–Establish annual goals and performance plans that
include a significant emphasis on leadership, integrity and ethics
Status: In Progress
Administration’s Update–Modified the APS Balanced Scorecard objective of
building a culture of alignment, ethics and accountability–A communication toolkit containing guides and
resources resulting from the BRC recommendations
Leadership Recommendations
16
BRC Leadership Recommendation 4– Incorporate self-assessment into the annual plan evaluation
processes for leadership (i.e. principals, assistant principals, curriculum leaders, School Reform Team executive directors and central office personnel)
Status: In Progress
Administration’s Update–The district has developed a self-assessment tool based on the
Georgia Department of Education Leader Keys. The feedback will be incorporated into the annual evaluation process for leadership
Leadership Recommendations
17
BRC Leadership Recommendation 5– Incorporate surveys of teachers and support staff into annual
performance planning for principals to provide qualitative evidence on principal performance
Status: In Progress
Administration’s Update–A school climate survey is being developed based on the
Georgia Department of Education School Keys and Georgia Assessment of Performance on School Standards (GAPSS) resources –Feedback from the surveys will be referenced as a data
source for the principal annual performance evaluation and professional development opportunities
Leadership Recommendations
18
BRC Leadership Recommendation 6–Provide observations of principals, which may include
shadowing or other efforts, for assessments of leadership ability compared to the critical skills determined for the position. Incorporate data on observed behaviors into the annual assessment process for leaders to assess their competency relative to those skills deemed to be critical for each position
Status: Complete
Administration’s Update–Observations of principals are conducted by leadership –Data gathered during principal observations are incorporated in
the annual assessment and performance evaluation process
Leadership Recommendations
19
BRC Leadership Recommendation 7– Provide opportunities for regular, anonymous peer and upward
feedback (i.e. teacher-to-teacher, teacher-to-assistant/principal, teacher-to-test coordinator, principal-to-executive director) as well as processes for following through and managing this information
Status: In Progress
Administration’s Update– A school climate survey is being developed based on the Georgia
Department of Education School Keys and Georgia Assessment of Performance on School Standards (GAPSS) resources – A process is being designed to provide anonymous feedback– Anonymous feedback will be referenced as a data source for the
principal annual performance evaluation and professional development opportunities
Leadership Recommendations
20
BRC Leadership Recommendation 8–Conduct principal peer reviews and incorporate this
information into annual evaluation processes
Status: In Progress
Administration’s Update–The 2010-2011 principal peer review schedule is
finalized and observations are underway–Feedback from the principal peer reviews will be
included as a data source for the principal annual performance evaluation
Leadership Recommendations
21
BRC Leadership Recommendation 9–Provide the ABE additional recommendations on
plans to monitor the principals and other leaders of the schools being referred by the BRC
Status: In Progress
Administration’s Update–Reassigned 12 principals–Continuing ongoing monitoring and instructional
support to those schools
Leadership Recommendations
22
BRC Leadership Recommendation 11–Publish additional findings made with respect to
events that may have occurred during the 2009 testing period
Status: In Progress
Administration’s Update–A communication plan has been developed and is
being implemented–The district website is being utilized for regular
updates
Leadership Recommendations
23
BRC Leadership Recommendation 12–Given that the findings relate to events that may have occurred
during the 2009 CRCT and that personnel changes may have occurred since that time period, APS must provide appropriate support for the implementation of recommendations by the current leadership of schools
Status: Complete
Administration’s Update–Leadership and staff have been provided additional professional
development–Category 1 schools continue to receive support as needed–An experienced education specialist retained for the remainder
of the school year
CRCT Comparison Recommendations
24
▪BRC CRCT Comparison recommendations encompass:–Additional recommendations focused on the
findings related to the comparison of the 2009 and 2010 CRCT results
CRCT Comparison Recommendations
25
BRC CRCT Comparison Recommendation 1– Given the high number of declines in Math, the BRC recommends that APS
conduct a broad assessment of Math outcomes to further determine the root causes of the declines. This assessment should include, but not be limited to, a review of the curriculum and schools/teachers where the declines were most dramatic, as well as an assessment of the effectiveness of current teaching methods
Status: Complete
Administration’s Update– Completed the broad assessment and reviewed recommendations – Re-aligned the APS math curriculum to mirror Georgia Department of
Education scope and sequence – Redesigned the professional development model for all schools with
significant declines in mathematics achievement
CRCT Comparison Recommendations
26
BRC CRCT Comparison Recommendation 2– There are 33 schools that demonstrated a significant decline in the
2010 CRCT test results. The BRC computed this number by looking at two factors - - the number of declines in grade/subject combinations, as well as 10% or greater increase in failure rates. The BRC recommends that the District conduct a further in-depth assessment in these schools
Status: In Progress
Administration’s Update– APS has received the initial data and completed an analysis which
informed school improvement plans–District is providing support, progress monitoring and targeted
intervention strategies for the selected schools to improve instructional quality and professional development
Next Steps
▪Remain committed to implementing 100% of recommendations
▪Continue collaborative effort across divisions and departments
▪ Ensure full implementation, continue to utilize:–APS Project Management Methodology–Balanced Scorecard for reporting progress in the various
departments/divisions▫Weekly reports to senior staff▫Quarterly reports to ABE
27
Our highest responsibility is to provide the bestpossible education for our students in everyclassroom and in every school. We will continuethe implementation of the recommendationsfrom the BRC investigative report while stayingfocused on our main purpose – greater studentachievement
Closing
28