classroom diagnostic tools and keystone exams paiucc meeting, september 17, 2010 paiucc meeting...

Classroom Diagnostic Tools and Keystone Exams www.education.state.pa.us

PAIUCC Meeting, September 17, 2010

PAIUCC Meeting

Classroom Diagnostic Tools

and

Keystone Exams

September 17, 2010

Pennsylvania Department of Education



• Introductions• Keystone Exams Overview• Keystone Exams Fall 2010• Keystone Exams Spring 2011 • Keystone Exams Key Dates• Keystone Policy Impacts• Classroom Diagnostic Tool (CDT) Overview• CDT Field Test• CDT Key Dates• CDT Reporting• Fall 2010 Field Test -- Administrative Key Dates• Data Management• Questions

Agenda



Keystone Exams Overview The Keystone Exams are end-of-course assessments designed to assess proficiency in

the subject areas of Algebra I, Algebra II, Geometry, Literature, English Composition, Biology, Chemistry, U.S. History, World History, and Civics and Government.

• One component of Pennsylvania’s high school graduation requirements beginning for the graduating class of 2014-2015

• Taken as an end-of-course exam near the end of course completion that counts for at least one-third of the final course grade• PDE recommends administering the English Composition Keystone Exam at the

end of English 9 and Literature at the end of English 10

• Available to students either online or paper-pencil• Comprised of two (2) modules• Multiple-Choice (MC) and Constructed-Response (CR) items



Keystone Exams Fall 2010

• Field test of Algebra I, Biology, and Literature• Available to mostly students in high school, but may include

middle school students• Online and/or paper-pencil assessment comprised of two

modules• Multiple-Choice (MC) and Constructed-Response (CR) items • Approximately 2-2 ½ hours for each exam, 1-1 ¼ hours per

module• Student should be assigned to an assessment based on course

enrollment in the 2009-2010 school year• Field test results will be provided for participating districts



Keystone Exams Spring 2011

• First operational administrations of Algebra 1, Biology, and Literature

• Field test administrations of Algebra 2, Geometry, and English Composition

• Testing window will be beginning of May 2011 (exact dates not yet finalized)

• Students nearing completion of a course are eligible to take the course-specific Keystone Exam



Keystone Exams Spring 2011

• Online and paper-pencil formats available• Paper/pencil testing materials will arrive in two shipments

1. Administrative materials arrive four weeks prior to the window

2. Secure materials arrive two weeks prior to the window

• Paper-pencil testing materials are returned after each subject is complete

• Preliminary results provided around the end of May• Final results (with performance levels) provided later in

summer (Algebra 1, Biology, and Literature only)



Field Test and Operational Assessments

Field Test OperationalAlgebra I, Biology, Literature

November 1-19, 2010 May 2011

Algebra II, Geometry, English Composition

May 2011 Winter 2011

US History Fall 2012 May 2013

Chemistry, Civics & Govt., World History

May 2015 TBD

Keystone Exams Key Dates



Graduation Policy

Under the new regulation and beginning with the class of 2015, students can meet graduation requirements through any of the following options determined by the district:

1. Successful completion of courses and Keystone Exams

2. Rigorous, independently-validated local assessments

3. AP or International Baccalaureate Exams

OR ANY

COMBINATION



Graduation Policy 2 Phases

Students in the graduating classes of 2015 and 2016 must demonstrate proficiency in:

1. English Composition

2. Literature

3. Algebra I, and

4. Biology



Phase 2- Class of 2017 and beyondStudents must demonstrate proficiency in six

of ten content areas:

• Both English Composition and Literature; • Two of three Mathematics (Algebra I, Algebra II,

or Geometry); • One of two Sciences (Biology or Chemistry); and• One of three Social Studies (American History,

Civics and Government or World History).



Chapter 4 Advisory Committees

Three advisory committees are specified in the regulation:

Performance Level Advisory CommitteeLocal Assessment Advisory CommitteeState Assessment Advisory Committee



District Choice

• Keystone Exams will count for at least 1/3 of the final course grade; or NEW:

• Keystones used as a local assessment and students must score proficient or advanced.

• Locally designed and independently validated assessments



District Choice

Pass Rigorous National Assessments • National assessments are the Advanced Placement

(AP) Exams and the International Baccalaureate (IB) Exams

• PDE will release policy guidance regarding the minimum score on each that is needed to satisfy graduation requirements



Project Based Alternative

• A student who does not score “proficient” on a Keystone Exam after two attempts will be eligible to complete a project-based assessment



Project–Based Assessment

Projects will be:• aligned with the Keystone Exam modules• developed by the department• administered by school staff• scored by regional panels of educators• developed so that points will be added to a student’s

highest Keystone score if his/her performance is judged “satisfactory.”



Eligibility for ProjectsStudents will qualify for projects if he/she:

1. has taken the course.

2. was unsuccessful after two attempts with the Keystone exam.

3. has met the district’s attendance requirements for the course.

4. has participated in supplemental instructional services.



CDT OverviewThe Classroom Diagnostic Tools provide a diagnosis of students’ strengths and

weaknesses to guide instruction and/or remediation.

• Available to students in grades 6 through high school• Online assessments delivered in a Computer

Adaptive Test (CAT) format• Multiple-choice items• Multiple assessments a year• Real-time reporting• Reports dynamically linked to curriculum resources

in SAS



CDT Fall 2010• Field Test Event for Science and Reading

• Available to students in grades 4 through high school• Assesses content in Science and Reading grades 3-8, Biology,

Chemistry, Literature• Multiple-Choice (MC) items• Single assessment – approximately 1 class period (45-60 minutes)• Student should be assigned to an assessment based on course/grade

enrollment in the 2009-2010 school year• Field test results will be provided for participating districts

• Operational Mathematics Available to Schools –

October 18, 2010



Field Test and Operational Assessments

Field Test Operational

Mathematics April 26-May 28, 2010 October 18, 2010

Literature October 4-29, 2010 Winter 2010/2011

Science October 4-29, 2010 Winter 2010/2011

Writing/Composition May 2011 Fall 2011

Social Studies Fall 2012 Winter 2012/2013

CDT Key Dates



CDT Reporting

• Reporting for the CDT will be available on DRC’s eDirect system

• Results will be linked to Materials and Resources on SAS

• Three types of reports will be provided1. Group Diagnostic Map

2. Student Diagnostic Map

3. Learning Progression Map



Group Diagnostic Map – Algebra I

21



Group Diagnostic Map – Mathematics

22

Zoomed In Zoomed Out



Group Diagnostic MapSingle Diagnostic Category

23



Student Diagnostic Map

24



Learning Progression Map

25



Key Dates

Description Date Available

CDT Keystone

PA Online Assessment Software August 23 August 23

PA Online Assessment Test Tutorials September 21 October 4

PA eDIRECT Test Setup System September 13 September 13

PA eDIRECT District Student and Teacher file uploads available

September 13 September 13

CDT User Guide and Directions for Administration (electronically)

September 8

CDT User Guide and Directions for Administration (hardcopy in districts and schools)

September 20

Keystone Handbook, User Guide, and Directions for Administration (electronically)

September 20

Keystone Handbook, User Guide, and Directions for Administration (hardcopy in districts and schools)

October 18

Fall 2010 Field Tests -- Administrative Key Dates



Data Management

• PIMS data was uploaded to DRC’s test setup system (eDIRECT) – Student-level data– Teacher-level data (not required for field test

events)

• School/district personnel will use eDIRECT to set up and manage all online testing



Data Management

• For fall 2010, district personnel will be able to upload student and teacher data directly to eDIRECT

• Any student data updated or uploaded in eDIRECT must also be updated or uploaded in PIMS

• PIMS data and data uploaded into eDIRECT will be used to generate student Precode Labels (paper-pencil Keystone Exams)

classroom diagnostic tools and keystone exams paiucc meeting, september 17, 2010 paiucc meeting...

Documents

keystone exams spring

end of english

field test of algebra

course exam

literature available

school year field test

summer algebra

course assessments