1

Standardized Testing and Reporting (Legacy STAR)

Pre-Test Workshop2014

February 14, 2014; 8:00-11:00 am; E-116 February 14, 2014; 1:00-4:00 pm; E-116 February 19, 2014; 1:00-4:00 pm; E-116

February 21, 2014; 8:00-11:00 am; E-116February 21, 2014; 1:00-4:00pm; E-116

Cin Rogers, Ed.D.District Coordinator for State Assessments457-3828cin.rogers@fresnounified.org

2

Physical Fitness Test• Required in Grades 5, 7, and 9

• Grade 9 by Graduation Requirement Year 2017• Test Window February 1 to April 25, 2014• Need date PFT testing began.• All schools MUST administer the test, including

Alternative and Charters.• All students in grades 5, 7, and 9 take the tests

whether or not they are enrolled in a PE class.• Individual results are to be given to each student

after testing.• Return completed scanners to REA ATTN: Tami

Whaley by April 25.

3

ObjectivesSTAR coordinators will:• Follow current STAR procedures properly.• Ensure all materials are handled securely and

appropriately.• Train site examiners to conduct testing

consistently.

4

Agenda• Test Dates and Scheduling• STAR Test Site Coordinator responsibilities• Multiple-choice tests

– California Standards Tests (CSTs)– Early Assessment Program (EAP) tests– California Modified Assessment (CMA)

• California Alternate Performance Assessment (CAPA)• After testing

5

CAASPPCalifornia Assessment of Student Performance and Progress

Smarter Balanced Field Test (April 7 – June 6)**

Legacy STAR Program (High Schools = April 22 – May 9)

(Elem & Middle = April 28 – May 16)

ELA/Literacy & MathematicsGrades 3-8, 11

CST/CMA Science

Grades 5, 8, 10

CAPA- ELA, Math, ScienceGrades 2-11

CST for EAP purposes in ELA &

MathematicsGrade 11

** See hand out for assigned CAASPP Test Windows

6

#1 Responsibility—Security• No unauthorized electronic devices used in

classroom during testing• For testing purposes, any electronic device that

is not specifically designated as an accommodation or modification in the student’s IEP or Section 504 plan is unauthorized.

• Security audits to occur

7

Security Audits• At randomly selected schools and district offices• Before, during, or after testing• Are materials secure, accounted for, and

locked up when not in use?• Are correct administrative procedures being followed? For

example:– Instructional materials have been removed or covered.– Students are not being coached through the exams.– Only appropriate accommodations and/or

modifications are being provided, et. al.– No unauthorized electronic devices are being used.

8

#2 Responsibility – Train Test Examiners

• Emphasis on heightened security• New and updated videos• Additions to DFAs• Room sign with reminder of no

electronic devices• To be posted in clear view of students• Included in District Coordinator kit• Available on startest.org• Can be photocopied

9

10

STAR TSC Responsibilities

• READ TSC Manual• Inform parents (Parent Q & A)• Train examiners • Ensure examiners READ and sign affidavits.

– Send copies to REA ATTN: Tami Whaley• Secure test materials.• Plan for accommodations and modifications

11

STAR TSC: Late Labels• To assist schools REA will:

• Send a set of labeled booklets for new students since Pre-ID.• For students whose demographics have changed since Pre-ID

an electronic update to the pre-ID will be done by REA.

• School will:• Pull all “moved” students’ answer docs• Mark moved students’ answer docs “VOID – moved” and put

in non-scorable.

12

STAR TSC: Train Examiners

• READ and sign affidavits – send copies to REA ATTN: Tami Whaley.

• Emphasize NO unauthorized electronic devices.• MAKE SURE CORRECT TESTS ARE GIVEN.• Students who are not testing may not stay in the

classroom where a test is being administered.• If students need to be taken to another room to finish

testing, BE SURE THEY ARE ESCORTED BY SCHOOL DISTRICT STAFF. Do not allow students to walk to another room with test materials by themselves.

13

STAR TSC: Reminders

• Examiners CANNOT: – Review test questions before, during, or

after testing.– Check students’ answers including (but not

limited to):1. Advise students of wrong answer or to check an

answer; or2. Withhold answer docs until students demonstrate

they have the right answers.

After TestingAnswer Documents

• Train examiners to:– Erase NOTHING in answer circles.

15

STAR TSCExaminers shall monitor students throughout testing to make sure students are:

– On correct part – Not going on to other parts or back to a previously

completed part– Not skipping a question on their answer document

(so that they are off by one or more)– Not using unauthorized electronic devices during

testing session

16

STAR TSC• Examiners shall ensure there is

enough time to complete a part before beginning the part.

• Examiners must follow the approved test schedule.

17

Instruction Between Test Parts

• NO instruction in content area between test parts administered in the same day

• For example, no language arts instruction can occur between CST Science Part 1 and CST Science Part 2 if they are administered in the same day.

18

Parent/Guardian Exemptions

• Students whose parents/guardians submit written requests may be exempted from:• All tests• Specific tests or content areas

• Tests taken before a parent/guardian exemption request is received will be scored and reported.

• No separate messages to parents of selected groups of students

19

Accommodations

• Do not change what is being tested• Only for students with IEPs or 504 Plans• Corresponds to what student receives in

daily classroom instruction• Examples for Multiple-Choice:

• Dictated responses to a scribe • Assistive device that does not interfere with

independent work of student• Mark only what student actually uses

20

Modifications

• Does change what is being tested• Only for students with IEPs or 504 Plans• Corresponds to what student receives in daily

classroom instruction• Examples for Multiple-Choice:

• Reading passages read or signed to student• Calculator for math test• Assistive device that does interfere with independent

work of student • Mark only what student actually uses

Accommodations Allowed for CMA

• See Testing Variations, Accommodations, and Modifications matrix in workshop materials• Test questions read aloud to student• Math manipulatives on the math or science tests

21

No Modifications for CMA

• Modifications are not allowed for use on the CMA; the CMA is a modified test. If the IEP team feels further modifications are necessary the IEP team should consider that the student participate in the STAR Program by taking the CSTs with modifications.

22

23

English Learner Testing Variations

• ELs are allowed only the following testing variations (inside back cover of DFA): • Hearing test directions marked with T in SAY boxes• The test examiner is not to translate any oral or written

test questions or directions students are to read to themselves.

• Tested separately with other EL students by school employee. Use only if this is normal procedure for these students.

24

STAR Multiple-Choice Tests

• CST – Grade 10 – Life Science– Grade 11 – ELA and/or Summative High

School Mathematics or Algebra II for purposes of EAP

• CMA– Grade 10 Life Science; Must have IEP and

meet eligibility criteria

25

Before Multiple-Choice Testing

• Receive boxes:– All boxes come in single delivery. – Before signing receipt, check number of boxes.– Compare box contents to packing list within 24 hours.

Report discrepancies to REA.

• Prep answer documents:– 2014 only– No copying of answer documents

26

Before Multiple-Choice Testing

• Confirm which tests each student takes.• Confirm any accommodations or modifications

students will use and where they will be tested.• Prepare materials:

– Test booklets– No. 2 pencils– Signs

27

During Multiple-Choice Testing

• Use Directions for Administration (DFAs) correctly.– Read ALL “SAY” boxes

exactly as written.– Be sure to read and complete

“First Day of Testing” section with students.

– ONLY translate boxes with “T” (NO CST/CMAquestions, prompts, or passages may be translated).

– Grades 9−11 are in single DFAfor each test: CST, CMA.

28

During Multiple-Choice Testing

• Monitor for use of unauthorized electronic devices.

• Give correct test booklets and answer documents to students whose names are on answer documents.

• Make sure students are taking the correct test and marking answers in the correct section of the answer document.

• Ensure students complete all parts of each test.

29

During Multiple-Choice Testing

• Schedule breaks – Ensure there is enough time to complete a part

before beginning the part.– See DFA for more information on breaks.

30

CST for Science• Required grade-level science

– Grades 5, 8, 10: all students shall take the grade-level test.

• Found in grade-level test booklets: no need to order separately.

31

EAP• Grade 11 only• To receive status of ELA, students must complete:

– Writing essay in March; and – CST multiple choice questions; and– Additional EAP multiple choice questions on CST.

• For mathematics, students must complete additional questions on the EOC Algebra II or Summative High School Mathematics

• Students must mark ONLY ONE bubble—REA will not bubble for student

CMA Participation Criteria• Have an IEP• Meet the SBE-adopted eligibility criteria• Previously took CST and scored below basic

or far below basic• Previously took CAPA and scored proficient or

advanced in previous 2 years• See full participation criteria:

– STAR District and Test Site Coordinator Manual– http://www.cde.ca.gov/ta/tg/sr/

participcriteria.asp

CMA Participation Criteria • ANNUALLY, IEP specifies:

– Whether the student takes the CMA or the CST with appropriate accommodations and/or modifications, regardless of previous CMA performance levels

– CMA subject(s)– Variations and/or accommodations

• Check the student’s IEP to see whether and which CMA test the student should take.

CMA Participation• Science• Grades 5, 8, 10 • No additional modifications are allowed.

– If modifications needed, student should take CST with modifications.

CAPA• Performance-based, one-on-one test • For students with significant cognitive

disabilities unable to take the CSTs even with accommodations and/or modifications or the CMA with accommodations

• Student must have an IEP • IEP specifies CAPA and level

36

CAPA• CAPA Training is mandatory.• CAPA Test Examiner Training:

• Regional Instructional Managers (RIM) will train teachers at your site

• Contact Office of Special Education for questions about training

• Packed in separate boxes from other STAR materials• Distribute CAPA directions to Special Education teachers

early to review procedures and instructions• All FUSD schools have one CAPA version (so required

materials are all the same). FUSD has Version 4 for 2014.• 10% are to be double rated at each school and grade.• Lists will be sent to schools for double rating.

CAPA Answer Document

• Use only 2014 answer document.• Ensure correct CAPA Level

is marked in 7a.• Level I only can have 5 as a score.

CAPA Observers

• Districts must double-rate at a minimum of ten percent (10%) of the CAPA students per level, per site (including NPS).

• Double ratings are randomly selected.• Observers must mark Observer and BOTH examiners and

observers must sign their separate answer documents.

Preparing To Administer the CAPAObserver’s Answer Doc

1 – Name, etc.3 – Date of Birth5 – Name6 – Gender7a – CAPA Level7b – Grade11 – Student ID12a – SSID

Use blank from overage.Observers must mark sections

After Testing• Paperwork

– Separate answer docs by grade– Alphabetize answer docs by grade– Complete back of answer document.– Transcribe voided answer documents.– Complete First Day List– Complete SGID (one per grade).– Complete Master File (one per school).

• Pack: scorables vs. nonscorables– Attach correct shipping labels.

After TestingComplete Back of Answer Document

• A1 DO NOT complete without CDE notification• A2 Special Conditions• A3 Accommodations and Modifications

– Part a: mark “IEP” and/or “Section 504 plan” to indicate which program/plan student has, WHETHER USED ACCOMMODATIONS OR MODIFICATIONS OR NOT. Note: IEP is required to take CMA, CAPA.

– Part b, mark codes for all accommodations student used as specified in IEP and/or 504 plan.

• A4 English Learner Test Variations – For each test, what was actually used

• Transcribe – Braille and large print

• Cannot be processed without transcription

• In Section A3 on the back of the answer document mark “G” or “H.”

– Damaged answer documents

• Write VOID onfront of answer document(s) and return with nonscorables.

After Testing

43

Multiple-choice Testing Answer Document

• Use 2014 answer documents only• Do NOT copy answer documents• An answer document must be completed and

submitted with each school’s scorable materials for every student enrolled on the first day of multiple-choice testing. This includes students who:• Complete CST/CMA or CAPA• Are exempted by parent/guardian request• Are absent for the school’s entire testing window

44

Complete after testing

If Applicable:Box A2: Special ConditionsBox A3: Accom/ModsBox A4: EL Test Variations

45

What do you hand-bubble if it is not a Pre-ID answer document?

Required:Box 3: DOBBox 5: NameBox 6: GenderBox 7: GradeBox 8 & 9: Ethnicity/RaceBox 10: Parent ed Box 11: Student ID Box 12a: SSID

46

And on the back page...If Applicable:

Box A2: Special ConditionsBox A3: Accom/ModsBox A4: EL Test Variations

Required:Box 15: Eng Prof EL => Box 17 & 24 RFEP => Box 21 & 22Box 16: Sped SvcsBox 19: Prim LangBox 23: NSLP

16a—Disability Code• If not in Pre-ID, mark after testing.• For CST and STS:

– Mark “000” if no IEP; or– Disability Code from IEP.

• For CMA and CAPA:– Disability code is

REQUIRED.– “000” not valid

for CMA or CAPA.– Also, be sure to mark the “IEP” or

“504 Plan” circle in section A3a even if the student does not use any accommodations or modifications.

48

SGID Sample – What to Bubble

49

School and Grade Identification Sheet (SGID)

Complete the front page of SGID (see manual) Information box – district, school grade, dates,

test coordinator name CST/CMA or CAPA Grade Number of Documents Use one for each grade level tested with

CST/CMA Use one for all CAPA levels and grades

50

Master File Sheet

Complete “Number of SGID’s” column for each grade tested Use one SGID (CAPA) for all CAPA Use one SGID per grade tested with CST/CMA

Complete “Number of Scorable Documents” column for each grade tested If no students tested in grade level, enter “0.”

51

Testing Problems• Examples include, but are not limited to:• Test Administration Errors

• Not following directions• Randomly distributing Pre-ID test booklets• Marking Modifications when they were not used• Not marking correct course-specific test code

• Testing Irregularities• Failure to maintain security• Allowing students to access electronic equipment• Allowing students to take pictures of tests• Information on walls or desks• “Coaching” students in any way• Changing/correcting students’ responses• Allowing students additional materials during testing

• Inform the District Coordinator asap (Cin @ 457-3828)

52

Delivery and Pick-up of STAR Test Materials

• Notify front office staff of expected deliveries and pickups:• Have front office staff notify TSC ASAP of deliveries.• Tell front office staff where deliveries are to be

placed/secured.• Tell front office staff where material to be picked up is

located.• Keep materials secure at all times.

• Will receive an email regarding delivery dates and pick up dates

53

No On-site Inspections• REA will not inspect STAR scorable answer

documents.• Schools are responsible to separate scorable and

nonscorable materials and prepare them for shipping.

• See page 66-68 of STAR manual

54

Packing Scorable Materials

• See Correctly Package Scorable Materials in manual p66

• An answer document for every student enrolled in tested grade on first day of testing.

• Completed SGID sheet by grade (One for CST/CMA per grade, one for CAPA all grades)

• Completed Master File Sheet (ONE per school)• Place Orange label on SCORABLE boxes

55

Packing NON-SCORABLE Materials See Correctly Package Nonscorable Materials in manual p67 Voided answer documents (if responses) marked VOID and

the reason Grade DFAs Unused blank and Pre-ID answer booklets Transcribe Large-print and Braille Booklets Place green labels on NON-SCORABLE boxes

56

Returning STAR Test Materials Return address labels are provided for all testing

materials. EAP Essay

Magenta labels for scorable Yellow labels for non-scorable

Multiple-Choice Answer Documents and CAPA Orange labels for scorable materials Green labels for non-scorable materials

57

Complete Labels Correctly

Leave District Blank

Fill in School

58

How to Get More Test Materials

• REA Website http://rea.fresnounified.org/ • Click on <Requests>• Click on <Request STAR Materials from District

Overage>• Procedures for extra material:

• Non-secure materials can be sent by intra-district mail

• Secure material will be delivered within two working days or can be picked up by TSC

59

Questions? Call the STAR CAASPP Team

Cin Rogers 457-3828

Tami Whaley 457-3851Carlos Ramirez 457-3852; District cell 647-3751