november 8, 2013 webcast starts at 9 a.m. presenters: michael mcdaniel and dan stanley

2014 Order Management for Paper-based Testing of CSTs for Science;

CMA for Science; CAPA for ELA, Mathematics, and Science; STS for

RLA; and EAP 

November 8, 2013Webcast starts at 9 a.m.

Presenters: Michael McDaniel and Dan Stanley

November 2013

Objectives

Local educational agencies (LEAs) testing coordinators will identify:

• Which paper-based testing materials to order• How to order paper-based testing materials• When to order paper-based testing materials

November 2013 2014 Order Management for Paper-based Testing || Slide 2

AgendaReminders for 2014 ordering• 25-day testing window• Ordering braille versions • Eligibility for tests

− CMA− CAPA− STS

• What can or needs to be ordered? − CST, CMA, CAPA for Science (grades 5, 8, and 10)− CAPA English–Language Arts (ELA) and Mathematics (grades 2–

11)− STS for Reading/Language Arts (RLA) (grades 2–11)− EAP (essay, CST for ELA [Grade 11], CST for Algebra II and/or

CST for Summative H.S. Math)

November 2013 2014 Order Management for Paper-based Testing || Slide 3

Agenda

• Ordering materials− Overview of process

− Ordering options Online ordering Batch file submission

November 2013 2014 Order Management for Paper-based Testing || Slide 4

• Tests that students are required to take in 2014 are as follows:− CSTs for Science for students in grades five, eight,

and ten

− CMA for Science for students in grades five, eight, and ten who meet the CMA’s eligibility requirements

− CAPA for grades 2 to 11 (ELA, Mathematics, Science) for students who meet the CAPA’s eligibility requirements

• These tests are required in 2014.

November 2013

What’s New

2014 Order Management for Paper-based Testing || Slide 5

• Only order EAP materials for students in grade eleven who will participate in the EAP. − EAP essay (ordered separately)− CST for ELA (Grade 11)− Either the CST for Algebra II and/or the CST

for Summative High School Mathematics for eligible students

November 2013

What’s New (cont.)

2014 Order Management for Paper-based Testing || Slide 6

• LEAs may order the STS for RLA for Spanish-speaking English learners (ELs)

• Only students who are coded as Spanish-speaking ELs will receive scores.

November 2013

What’s New (cont.)

2014 Order Management for Paper-based Testing || Slide 7

LEA Preparation Checklist

• Obtain school calendars− Including nonpublic, nonsectarian schools (NPS)

• Obtain warehouse calendar• Identify dependent charter schools• Collect order quantities from test site

coordinators• Identify materials needed for home/hospital

students• Identify NPSs providing special education

services to LEA students.

November 2013 2014 Order Management for Paper-based Testing || Slide 8

• School calendar(s)• Quantity and type of test booklets required

‒ CST for Science (grades 5 and 8); Life Science (grade 10)‒ CMA for Science (grades 5 and 8); Life Science (grade 10)‒ CAPA for ELA, Science, and Mathematics (grades 2–11) ‒ Special versions Large print Braille− Based on mathematics department chair input CST for EAP mathematics (Algebra II and/or Summative High

School Mathematics)

November 2013

Site Preparation Checklist:Give to LEA Testing Coordinator

2014 Order Management for Paper-based Testing || Slide 9

• Quantity and type of test booklets needed (cont.)‒ Based on English learner status

STS for RLA (grades 2–11)

• Number of additional DFAs needed for CST and STS:− CST/STS DFAs calculated 1 per 20 students

• Number of additional DFAs needed for CMA:− CMA DFAs calculated 1 per 10 students

November 2013

Site Preparation Checklist:Give to LEA Testing Coordinator

(cont.)

2014 Order Management for Paper-based Testing || Slide 10

General Rules for Ordering

• Do NOT over-order− LEAs are sent 5% overage

− Schools are sent 10% overage

• Be realistic with quantities− Especially large print and braille

These materials are expensive!

− Mobile populations (county offices) Average prior-year orders, then use “Supplemental

Order” process if necessary

November 2013 2014 Order Management for Paper-based Testing || Slide 11

• Student with significant cognitive disability(s) who has an individualized education program (IEP).

• Student’s IEP must specify CAPA and whether the student should take the grade-assigned CAPA level or CAPA Level I.

Note: Student counts by CAPA level are not necessary during the ordering process.

November 2013

California Alternate Performance Assessment

Who Takes the CAPA?

2014 Order Management for Paper-based Testing || Slide 12

What needs to be ordered? CAPA

• Examiner’s Manual: One for each examiner− Can be used for several students‒ All CAPA levels covered‒ One version available this year

• Answer documents‒ One per student taking the CAPA‒ All CAPA levels covered‒ 10% double-rated (use overage)

Will be discussed in the Pre-Test Workshop

November 2013 2014 Order Management for Paper-based Testing || Slide 13

• Not ordered through ETS• LEAs need to assemble manipulatives• Dependent upon:

− CAPA level Determined by IEP team

» Designate Level I or grade level

• Manipulatives list indicates the following:− Single-use items− Multi-use items

November 2013

CAPA Manipulatives

2014 Order Management for Paper-based Testing || Slide 14

• Available in grades 2–11 − Spanish-speaking ELs− Available for RLA only, not mathematics

Note: Students take STS in addition to any other required CST or CMA

November 2013

Standards-based Tests in SpanishWho takes the STS?

2014 Order Management for Paper-based Testing || Slide 15

What Can or Needs to Be Ordered, What Can or Needs to Be Ordered, by Gradeby Grade

November 2013 2014 Order Management for Paper-based Testing || Slide 16

November 2013 2014 Order Management for Paper-based Testing || Slide 17

What can be ordered?Grade 2

• CAPA, Level I or II• STS grade-level test booklet for each eligible

student (voluntary)− STS for Reading/Language Arts

What can be ordered?Grade 3

• CAPA, Level I or II• STS grade-level test booklet for each eligible

student (voluntary)− STS for Reading/Language Arts

November 2013 2014 Order Management for Paper-based Testing || Slide 18

• CAPA, Level I or III • STS grade-level test booklet for each eligible

student (voluntary)− STS for Reading/Language Arts

November 2013

What can be ordered?Grade 4

2014 Order Management for Paper-based Testing || Slide 19

What needs to be ordered?Grade 5

• CST grade-level test booklet for each student− CST for Science

• CMA grade-level test booklet for each eligible student − CMA for Science

• CAPA, Level I or III (ELA, Mathematics, Science)• STS grade-level test booklet for each eligible

student (voluntary)− STS for Reading/Language Arts

November 2013 2014 Order Management for Paper-based Testing || Slide 20

• CAPA, Level I or IV • STS grade-level test booklet for each eligible

student (voluntary)− STS for Reading/Language Arts

November 2013

What can be ordered?Grade 6

2014 Order Management for Paper-based Testing || Slide 21

What can be ordered?Grade 7

November 2013 2014 Order Management for Paper-based Testing || Slide 22

• CAPA, Level I or IV • STS grade-level test booklet for each eligible

student (voluntary)− STS for Reading/Language Arts

November 2013

What can be ordered?Grade 8

2014 Order Management for Paper-based Testing || Slide 23

• CST grade-level test booklet for each student− CST for Science

• CMA grade-level test booklet for each eligible student − CMA for Science

• CAPA, Level I or IV (ELA, Mathematics, Science)• STS grade-level test booklet for each eligible

student (voluntary)− STS for Reading/Language Arts

What can be ordered?Grade 9

November 2013 2014 Order Management for Paper-based Testing || Slide 24

• CAPA, Level I or V • STS grade-level test booklet for each eligible

student (voluntary)− STS for Reading/Language Arts

What needs to be ordered?Grade 10

November 2013 2014 Order Management for Paper-based Testing || Slide 25

• CST grade-level test booklet for each student− CST for Life Science

• CMA grade-level test booklet for each eligible student − CMA for Life Science

• CAPA, Level I or V (ELA, Mathematics, Science)• STS grade-level test booklet for each eligible

student (voluntary)− STS for Reading/Language Arts

• CST test booklet for each student to be tested for EAP (voluntary)− Order:

EAP Essay test booklet CST for English–Language Arts (Grade 11) Algebra II or Summative High Mathematics

• CAPA, Level I or V • STS grade-level test booklet for each eligible student

(voluntary)

− STS for Reading/Language Arts November 2013

What can be ordered?Grade 11

2014 Order Management for Paper-based Testing || Slide 26

EAP Essay

• Grade 11− Order for all students

− Must be taken in conjunction with additional ELA multiple-choice questions to achieve an exemption from the California State University and participating California Community Colleges.

− Order entered on the Early Assessment Program administration (EP01) .

− Approve order separately.

November 2013 2014 Order Management for Paper-based Testing || Slide 27

Test Administrations

• Multiple-choice− Up to 8 administrations allowed MC01 – MC08 − Each administration should have different date for

“First day of testing”− Each administration’s order needs to be approved

separately Enter orders for ALL administrations before starting

approval process» Report for 2014 provides list of schools without orders» Report generated when each order approved

• Early Assessment Program (EAP) Essay − Administration: EP01

February 3 through March 31− Enter and approve order separately from multiple

choiceNovember 2013 2014 Order Management for Paper-based Testing || Slide 28

Ordering Procedures

1. Set up test administration dates• Manual posted on www.startest.org/sms.html• Or, call your California TAC representative

2. Confirm “Profile” information• Primary Shipping Address• Secondary Shipping Address (optional)

Can be used for Supplemental Order delivery• Report Shipping Address (optional)

Used to deliver Student Reports in summer 2014 Address must be set up before June 1, 2014

November 2013 2014 Order Management for Paper-based Testing || Slide 29

Ordering Procedures

3. Enter order quantities for each multiple-choice and Early Assessment Program administration.

• Screen entryor• Produce file containing order quantities and

upload4. Approve order for each administration.

November 2013 2014 Order Management for Paper-based Testing || Slide 30

Supplemental Orders

• LEA testing coordinators will receive an e-mail confirming a supplemental order and listing the materials and quantities ordered.− An e-mail will automatically be generated and

sent to the designated LEA testing coordinator once the supplemental order has been approved

November 2013 2014 Order Management for Paper-based Testing || Slide 31

1. Verify Profile

2. Enter order online

3. Approve order

Software Demonstration

November 2013 2014 Order Management for Paper-based Testing || Slide 32

November 2013 2014 Order Management for Paper-based Testing || Slide 33

November 2013 2014 Order Management for Paper-based Testing || Slide 34

November 2013 2014 Order Management for Paper-based Testing || Slide 35

November 2013 2014 Order Management for Paper-based Testing || Slide 36

November 2013 2014 Order Management for Paper-based Testing || Slide 37

November 2013 2014 Order Management for Paper-based Testing || Slide 38

November 2013 2014 Order Management for Paper-based Testing || Slide 39

November 2013 2014 Order Management for Paper-based Testing || Slide 40

November 2013 2014 Order Management for Paper-based Testing || Slide 41

November 2013 2014 Order Management for Paper-based Testing || Slide 42

November 2013 2014 Order Management for Paper-based Testing || Slide 43

LEA cannot approve order when errors still exist.November 2013 2014 Order Management for Paper-based Testing || Slide 44

November 2013 2014 Order Management for Paper-based Testing || Slide 45

November 2013 2014 Order Management for Paper-based Testing || Slide 46

Book count warnings

Schools with no orders

LEA can still approve order when warnings exist.November 2013 2014 Order Management for Paper-based Testing || Slide 47

November 2013 2014 Order Management for Paper-based Testing || Slide 48

November 2013 2014 Order Management for Paper-based Testing || Slide 49

November 2013 2014 Order Management for Paper-based Testing || Slide 50

November 2013 2014 Order Management for Paper-based Testing || Slide 51

November 2013 2014 Order Management for Paper-based Testing || Slide 52

STAR Order Management

• File upload option

November 2013 2014 Order Management for Paper-based Testing || Slide 53

Order File Upload Format

• Included in Order Management Manual

• Fixed-length field; text file only

• Orders for one administration only per file

November 2013 2014 Order Management for Paper-based Testing || Slide 54

Review and Approve

• Review orders using− Online screens and/or− Printouts generated by the Test Management

System• Adjust orders where necessary using online

entry to adjust quantities• Approve orders

− All orders entered through “file upload” need to be approved by the LEA testing coordinator

November 2013 2014 Order Management for Paper-based Testing || Slide 55

In Conclusion

November 2013 2014 Order Management for Paper-based Testing || Slide 56

Review

• Set up test administration dates− NPS schedules may be different from LEA

schedules• Enter order quantities for each administration

− Multiple-choice− EAP essay

• Approve orders− Every administration

November 2013 2014 Order Management for Paper-based Testing || Slide 57

Timetable

• Gather orders from sites immediately for CST science, CMA science, CAPA (ELA, mathematics, and science), STS RLA, and EAP.

• Enter orders now through December 1, 2013.• Orders are reviewed by ETS throughout December and

January.• Make adjustments to initial orders up until “Order Sent

for Packaging” date.• If required, place supplemental orders after “Order Sent

for Packaging” date.• Track order status.

November 2013 2014 Order Management for Paper-based Testing || Slide 58

November 2013

Questions?

2014 Order Management for Paper-based Testing || Slide 59

More Questions?

California Technical Assistance Center:California TAC—800-955-2954

For CST, CMA, CAPA, and STS policies: CDE—916-445-8765

For accountability questions:CDE Academic Accountability Unit—916-319-0863

November 2013 2014 Order Management for Paper-based Testing || Slide 60