november 8, 2013 webcast starts at 9 a.m. presenters: michael mcdaniel and dan stanley
DESCRIPTION
2014 Order Management for Paper-based Testing of CSTs for Science; CMA for Science; CAPA for ELA, Mathematics, and Science; STS for RLA; and EAP . November 8, 2013 Webcast starts at 9 a.m. Presenters: Michael McDaniel and Dan Stanley. Objectives. - PowerPoint PPT PresentationTRANSCRIPT
2014 Order Management for Paper-based Testing of CSTs for Science;
CMA for Science; CAPA for ELA, Mathematics, and Science; STS for
RLA; and EAP
November 8, 2013Webcast starts at 9 a.m.
Presenters: Michael McDaniel and Dan Stanley
November 2013
Objectives
Local educational agencies (LEAs) testing coordinators will identify:
• Which paper-based testing materials to order• How to order paper-based testing materials• When to order paper-based testing materials
November 2013 2014 Order Management for Paper-based Testing || Slide 2
AgendaReminders for 2014 ordering• 25-day testing window• Ordering braille versions • Eligibility for tests
− CMA− CAPA− STS
• What can or needs to be ordered? − CST, CMA, CAPA for Science (grades 5, 8, and 10)− CAPA English–Language Arts (ELA) and Mathematics (grades 2–
11)− STS for Reading/Language Arts (RLA) (grades 2–11)− EAP (essay, CST for ELA [Grade 11], CST for Algebra II and/or
CST for Summative H.S. Math)
November 2013 2014 Order Management for Paper-based Testing || Slide 3
Agenda
• Ordering materials− Overview of process
− Ordering options Online ordering Batch file submission
November 2013 2014 Order Management for Paper-based Testing || Slide 4
• Tests that students are required to take in 2014 are as follows:− CSTs for Science for students in grades five, eight,
and ten
− CMA for Science for students in grades five, eight, and ten who meet the CMA’s eligibility requirements
− CAPA for grades 2 to 11 (ELA, Mathematics, Science) for students who meet the CAPA’s eligibility requirements
• These tests are required in 2014.
November 2013
What’s New
2014 Order Management for Paper-based Testing || Slide 5
• Only order EAP materials for students in grade eleven who will participate in the EAP. − EAP essay (ordered separately)− CST for ELA (Grade 11)− Either the CST for Algebra II and/or the CST
for Summative High School Mathematics for eligible students
November 2013
What’s New (cont.)
2014 Order Management for Paper-based Testing || Slide 6
• LEAs may order the STS for RLA for Spanish-speaking English learners (ELs)
• Only students who are coded as Spanish-speaking ELs will receive scores.
November 2013
What’s New (cont.)
2014 Order Management for Paper-based Testing || Slide 7
LEA Preparation Checklist
• Obtain school calendars− Including nonpublic, nonsectarian schools (NPS)
• Obtain warehouse calendar• Identify dependent charter schools• Collect order quantities from test site
coordinators• Identify materials needed for home/hospital
students• Identify NPSs providing special education
services to LEA students.
November 2013 2014 Order Management for Paper-based Testing || Slide 8
• School calendar(s)• Quantity and type of test booklets required
‒ CST for Science (grades 5 and 8); Life Science (grade 10)‒ CMA for Science (grades 5 and 8); Life Science (grade 10)‒ CAPA for ELA, Science, and Mathematics (grades 2–11) ‒ Special versions Large print Braille− Based on mathematics department chair input CST for EAP mathematics (Algebra II and/or Summative High
School Mathematics)
November 2013
Site Preparation Checklist:Give to LEA Testing Coordinator
2014 Order Management for Paper-based Testing || Slide 9
• Quantity and type of test booklets needed (cont.)‒ Based on English learner status
STS for RLA (grades 2–11)
• Number of additional DFAs needed for CST and STS:− CST/STS DFAs calculated 1 per 20 students
• Number of additional DFAs needed for CMA:− CMA DFAs calculated 1 per 10 students
November 2013
Site Preparation Checklist:Give to LEA Testing Coordinator
(cont.)
2014 Order Management for Paper-based Testing || Slide 10
General Rules for Ordering
• Do NOT over-order− LEAs are sent 5% overage
− Schools are sent 10% overage
• Be realistic with quantities− Especially large print and braille
These materials are expensive!
− Mobile populations (county offices) Average prior-year orders, then use “Supplemental
Order” process if necessary
November 2013 2014 Order Management for Paper-based Testing || Slide 11
• Student with significant cognitive disability(s) who has an individualized education program (IEP).
• Student’s IEP must specify CAPA and whether the student should take the grade-assigned CAPA level or CAPA Level I.
Note: Student counts by CAPA level are not necessary during the ordering process.
November 2013
California Alternate Performance Assessment
Who Takes the CAPA?
2014 Order Management for Paper-based Testing || Slide 12
What needs to be ordered? CAPA
• Examiner’s Manual: One for each examiner− Can be used for several students‒ All CAPA levels covered‒ One version available this year
• Answer documents‒ One per student taking the CAPA‒ All CAPA levels covered‒ 10% double-rated (use overage)
Will be discussed in the Pre-Test Workshop
November 2013 2014 Order Management for Paper-based Testing || Slide 13
• Not ordered through ETS• LEAs need to assemble manipulatives• Dependent upon:
− CAPA level Determined by IEP team
» Designate Level I or grade level
• Manipulatives list indicates the following:− Single-use items− Multi-use items
November 2013
CAPA Manipulatives
2014 Order Management for Paper-based Testing || Slide 14
• Available in grades 2–11 − Spanish-speaking ELs− Available for RLA only, not mathematics
Note: Students take STS in addition to any other required CST or CMA
November 2013
Standards-based Tests in SpanishWho takes the STS?
2014 Order Management for Paper-based Testing || Slide 15
What Can or Needs to Be Ordered, What Can or Needs to Be Ordered, by Gradeby Grade
November 2013 2014 Order Management for Paper-based Testing || Slide 16
November 2013 2014 Order Management for Paper-based Testing || Slide 17
What can be ordered?Grade 2
• CAPA, Level I or II• STS grade-level test booklet for each eligible
student (voluntary)− STS for Reading/Language Arts
What can be ordered?Grade 3
• CAPA, Level I or II• STS grade-level test booklet for each eligible
student (voluntary)− STS for Reading/Language Arts
November 2013 2014 Order Management for Paper-based Testing || Slide 18
• CAPA, Level I or III • STS grade-level test booklet for each eligible
student (voluntary)− STS for Reading/Language Arts
November 2013
What can be ordered?Grade 4
2014 Order Management for Paper-based Testing || Slide 19
What needs to be ordered?Grade 5
• CST grade-level test booklet for each student− CST for Science
• CMA grade-level test booklet for each eligible student − CMA for Science
• CAPA, Level I or III (ELA, Mathematics, Science)• STS grade-level test booklet for each eligible
student (voluntary)− STS for Reading/Language Arts
November 2013 2014 Order Management for Paper-based Testing || Slide 20
• CAPA, Level I or IV • STS grade-level test booklet for each eligible
student (voluntary)− STS for Reading/Language Arts
November 2013
What can be ordered?Grade 6
2014 Order Management for Paper-based Testing || Slide 21
What can be ordered?Grade 7
November 2013 2014 Order Management for Paper-based Testing || Slide 22
• CAPA, Level I or IV • STS grade-level test booklet for each eligible
student (voluntary)− STS for Reading/Language Arts
November 2013
What can be ordered?Grade 8
2014 Order Management for Paper-based Testing || Slide 23
• CST grade-level test booklet for each student− CST for Science
• CMA grade-level test booklet for each eligible student − CMA for Science
• CAPA, Level I or IV (ELA, Mathematics, Science)• STS grade-level test booklet for each eligible
student (voluntary)− STS for Reading/Language Arts
What can be ordered?Grade 9
November 2013 2014 Order Management for Paper-based Testing || Slide 24
• CAPA, Level I or V • STS grade-level test booklet for each eligible
student (voluntary)− STS for Reading/Language Arts
What needs to be ordered?Grade 10
November 2013 2014 Order Management for Paper-based Testing || Slide 25
• CST grade-level test booklet for each student− CST for Life Science
• CMA grade-level test booklet for each eligible student − CMA for Life Science
• CAPA, Level I or V (ELA, Mathematics, Science)• STS grade-level test booklet for each eligible
student (voluntary)− STS for Reading/Language Arts
• CST test booklet for each student to be tested for EAP (voluntary)− Order:
EAP Essay test booklet CST for English–Language Arts (Grade 11) Algebra II or Summative High Mathematics
• CAPA, Level I or V • STS grade-level test booklet for each eligible student
(voluntary)
− STS for Reading/Language Arts November 2013
What can be ordered?Grade 11
2014 Order Management for Paper-based Testing || Slide 26
EAP Essay
• Grade 11− Order for all students
− Must be taken in conjunction with additional ELA multiple-choice questions to achieve an exemption from the California State University and participating California Community Colleges.
− Order entered on the Early Assessment Program administration (EP01) .
− Approve order separately.
November 2013 2014 Order Management for Paper-based Testing || Slide 27
Test Administrations
• Multiple-choice− Up to 8 administrations allowed MC01 – MC08 − Each administration should have different date for
“First day of testing”− Each administration’s order needs to be approved
separately Enter orders for ALL administrations before starting
approval process» Report for 2014 provides list of schools without orders» Report generated when each order approved
• Early Assessment Program (EAP) Essay − Administration: EP01
February 3 through March 31− Enter and approve order separately from multiple
choiceNovember 2013 2014 Order Management for Paper-based Testing || Slide 28
Ordering Procedures
1. Set up test administration dates• Manual posted on www.startest.org/sms.html• Or, call your California TAC representative
2. Confirm “Profile” information• Primary Shipping Address• Secondary Shipping Address (optional)
Can be used for Supplemental Order delivery• Report Shipping Address (optional)
Used to deliver Student Reports in summer 2014 Address must be set up before June 1, 2014
November 2013 2014 Order Management for Paper-based Testing || Slide 29
Ordering Procedures
3. Enter order quantities for each multiple-choice and Early Assessment Program administration.
• Screen entryor• Produce file containing order quantities and
upload4. Approve order for each administration.
November 2013 2014 Order Management for Paper-based Testing || Slide 30
Supplemental Orders
• LEA testing coordinators will receive an e-mail confirming a supplemental order and listing the materials and quantities ordered.− An e-mail will automatically be generated and
sent to the designated LEA testing coordinator once the supplemental order has been approved
November 2013 2014 Order Management for Paper-based Testing || Slide 31
1. Verify Profile
2. Enter order online
3. Approve order
Software Demonstration
November 2013 2014 Order Management for Paper-based Testing || Slide 32
November 2013 2014 Order Management for Paper-based Testing || Slide 33
November 2013 2014 Order Management for Paper-based Testing || Slide 34
November 2013 2014 Order Management for Paper-based Testing || Slide 35
November 2013 2014 Order Management for Paper-based Testing || Slide 36
November 2013 2014 Order Management for Paper-based Testing || Slide 37
November 2013 2014 Order Management for Paper-based Testing || Slide 38
November 2013 2014 Order Management for Paper-based Testing || Slide 39
November 2013 2014 Order Management for Paper-based Testing || Slide 40
November 2013 2014 Order Management for Paper-based Testing || Slide 41
November 2013 2014 Order Management for Paper-based Testing || Slide 42
November 2013 2014 Order Management for Paper-based Testing || Slide 43
LEA cannot approve order when errors still exist.November 2013 2014 Order Management for Paper-based Testing || Slide 44
November 2013 2014 Order Management for Paper-based Testing || Slide 45
November 2013 2014 Order Management for Paper-based Testing || Slide 46
Book count warnings
Schools with no orders
LEA can still approve order when warnings exist.November 2013 2014 Order Management for Paper-based Testing || Slide 47
November 2013 2014 Order Management for Paper-based Testing || Slide 48
November 2013 2014 Order Management for Paper-based Testing || Slide 49
November 2013 2014 Order Management for Paper-based Testing || Slide 50
November 2013 2014 Order Management for Paper-based Testing || Slide 51
November 2013 2014 Order Management for Paper-based Testing || Slide 52
STAR Order Management
• File upload option
November 2013 2014 Order Management for Paper-based Testing || Slide 53
Order File Upload Format
• Included in Order Management Manual
• Fixed-length field; text file only
• Orders for one administration only per file
November 2013 2014 Order Management for Paper-based Testing || Slide 54
Review and Approve
• Review orders using− Online screens and/or− Printouts generated by the Test Management
System• Adjust orders where necessary using online
entry to adjust quantities• Approve orders
− All orders entered through “file upload” need to be approved by the LEA testing coordinator
November 2013 2014 Order Management for Paper-based Testing || Slide 55
In Conclusion
November 2013 2014 Order Management for Paper-based Testing || Slide 56
Review
• Set up test administration dates− NPS schedules may be different from LEA
schedules• Enter order quantities for each administration
− Multiple-choice− EAP essay
• Approve orders− Every administration
November 2013 2014 Order Management for Paper-based Testing || Slide 57
Timetable
• Gather orders from sites immediately for CST science, CMA science, CAPA (ELA, mathematics, and science), STS RLA, and EAP.
• Enter orders now through December 1, 2013.• Orders are reviewed by ETS throughout December and
January.• Make adjustments to initial orders up until “Order Sent
for Packaging” date.• If required, place supplemental orders after “Order Sent
for Packaging” date.• Track order status.
November 2013 2014 Order Management for Paper-based Testing || Slide 58
November 2013
Questions?
2014 Order Management for Paper-based Testing || Slide 59
More Questions?
California Technical Assistance Center:California TAC—800-955-2954
For CST, CMA, CAPA, and STS policies: CDE—916-445-8765
For accountability questions:CDE Academic Accountability Unit—916-319-0863
November 2013 2014 Order Management for Paper-based Testing || Slide 60