Criteria for Procuring and Evaluating High-Quality Assessments:

A State Perspective

National Conference on Student Assessment New Orleans, Louisiana

June 25, 2014

…can make State Assessment Directors, SEA staff, and educators feel…

anxious uncertain fearful of change and the unknown

Good news: The Criteria can help!

Assessment Transitions…

The Criteria: A “go-to guide” containing characteristics critical to the

development and administration of high-quality assessments aligned to college- and career-ready standards….

Content

• Clearly delineates important components within ELA and Math

• Focus on key areas:

– Rigor and relevance

– Range of cognitive demand

– Depth and breadth of CCR standards

Strengths of the Criteria – Part 1

Supports Indiana’s Priorities• Involvement of Indiana educators

• Aligned assessment system—including formative and summative components

• Focus on interoperability of items

• Test security

• Importance of technical quality

• Attention to evaluation of learning for special populations (Students with Disabilities, English learners)

– Support for sunsetting of the modified assessment

• Data privacy

Strengths of the Criteria – Part 2

Results

• Accurately measure student progress toward college- and career-readiness…on a continuum

• Provide valid, actionable data

• Instructionally valuable—informs teaching and learning

• Easily understood by all audiences: students, parents, educators

– User testing to ensure utility of reports for each intended audience

– Scores and sub-scores support intended interpretations and minimize the possibility of misinterpretation

Strengths of the Criteria – Part 3

RFP• Use to develop a high-quality RFP

– Focused, specific and thorough to clearly communicate Indiana’s needs

Rubric• Use to develop a rubric for evaluation of submitted proposals

– Make informed judgments regarding vendors’ claims of quality

– Examine evidence

PD• Facilitates professional development and training for those

reviewing proposals

• Assists in educating policymakers

Usefulness of the Criteria

QA

• Institute quality assurance and other processes to monitor quality throughout assessment development and administration

Evaluation

• Evaluate evidence periodically to ensure criteria are being met by the vendor

Identifying Best Practices

Thank You

Questions?

Dr. Michele Walker, DirectorOffice of Student Assessment