spring test administration training session january/february 2015

114
Spring Test Administration Training Session January/February 2015

Upload: sharleen-walsh

Post on 22-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Spring Test Administration Training Session January/February 2015

Spring TestAdministration Training SessionJanuary/February 2015

Page 2: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

2

Presenters Dan Wiener

Administrator of Inclusive Assessment

Jodie ZalkTest Administration Coordinator

Bob LeeMCAS Chief Data Analyst

Page 3: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

3

Today’s Agenda Review materials posted at

www.doe.mass.edu/mcas/conferencecall

Test security and test administration protocols

Participation requirements Students with disabilities ELL students

Reporting Additional information and orientation

for new principals

Page 4: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

4

Board-Approved Transition Plan Spring 2014: PARCC field test was

administered in randomly selected schools. Spring 2015: MA districts, educational

collaboratives, and approved private schools choose to administer either PARCC or MCAS.

Fall 2015: Board votes on whether to approve PARCC.

Current Competency Determination (CD) requirements in place through class of 2019 Any change after class of 2019 requires future

Board approval.

Page 5: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

5

Spring 2015 Assessment Choice for Districts

# of public districts (incl. charters)

MCAS PARCC

# of districts %

# of students (approx.

)

# of districts %

# of students (approx.

)

Gr. 3–8 362 165 46%207,50

0 197 54%220,00

0PARCC for Gr. 9 and/or 11 (optional)

295 N/A N/A N/A 71 24% N/A

As of October 10, 2014 www.doe.mass.edu/news/news.aspx?id=13541

Page 6: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

6

MCAS and MCAS-Alt, if PARCC Is Adopted Current CD requirements will remain in

place through the class of 2019. Grade 10 MCAS ELA test Grade 10 MCAS Mathematics test High school MCAS Science and Tech/Eng (STE)

tests

MCAS STE tests will continue. Grades 5, 8, and high school

All students designated for alternate assessments will continue to take MCAS-Alt.

Page 7: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

7

PARCC Resources Training Opportunities

Spring 2015 PARCC training sessions Online training modules

PARCC Support CenterWeb: PARCC.pearson.comEmail: [email protected] Telephone: 888-493-9888

Department’s Student Assessment Services Web: www.doe.mass.edu/parccEmail: [email protected] Telephone: 781-338-3625

Page 8: Spring Test Administration Training Session January/February 2015

Test Security

Page 9: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

9

Credit: Roz Chast

Page 10: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

10

Most Common Security Issues

Cell phones Improper coaching Improper use of

the read-aloud accommodation (#26)

Student collaboration

Going back to earlier sessions

Twitter Improper calculator

use Accessing

notes/textbooks Improper dictionary

use Accessing Internet

while using typed response accommodation (#23)

Page 11: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

11

Importance of Leadership Superintendents must review their

principals’ test security plans. Superintendent’s Assurance of Proper Test

Administration (optional form) — PAM page 120

Principals must maintain the security of the testing environment and test materials. PCPA certification — PAM pages 118–119 Train test administrators and others, and

ensure they comply with requirements. Meet with students.

Page 12: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

12

A Secure Testing Environment Plan for

appropriate testing spaces students who may need more time lunch, recess, restrooms

Cover/remove prohibited classroom displays PAM page 26

No unauthorized visitors

Page 13: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

13

Security Requirements for Test Materials Store all test materials in a central location

each day. Locked when tests are not being administered Restricted access

Maintain chain of custody of materials during test administration. Do not remove test materials from school. Do not leave test materials unattended.

Materials must be returned to the central secure storage area and signed in each day.

Page 14: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

14

Confidentiality of Booklets

Do NOT … review test booklets or answer booklets

before, during, or after testing exceptions for certain accommodations

provide students access to tests before testing

duplicate test materials retain, recycle, remove, or destroy test

materials

Page 15: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

15

Train Test Administrators and Others

All individuals involved in test administration must participate in training. See topics in PAM — pages 29–32 Sample quiz on protocols can be used in training:

www.doe.mass.edu/mcas/testadmin/ Forms requiring signoff by test administrators

Participated in training Received their TAMs — see PAM page 125 Signed a nondisclosure agreement if providing

certain accommodations — see PAM page 134

Page 16: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

16

Test Administrator Responsibilities

1. Follow directions in TAMs and read scripts verbatim.

2. Supervise students at all times to prevent cheating.

3. Prevent use of prohibited materials (e.g., cell phones).

4. Focus full attention on the testing room.

5. Do not coach students or alter responses.

Page 17: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

17

Turn & Talk –Training Plan

How are your test administrators trained? Test administrators for

accommodations? How do you evaluate the success of

your training?

Page 18: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

18

Planning for Required and Prohibited Materials New section in PAM (page 26) Principals must develop procedures so that

students receive required materials and do not access prohibited materials.

Principals must inform: Test administrators

whether to read new recommended script or school-developed script

how they will actively monitor the room how to handle a situation if a student is found with

a prohibited item Students Parents/guardians

Page 19: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

19

Clarity of message is important when communicating with students.

Thanks to Mike Barth from Seven Hills Charter School

Page 20: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

20

Give Clear Instructions to Students Before testing, instruct students to

try their best respond directly to the MCAS ELA

Composition prompt TAMs instruct students to

work until end of session (and only in that session)

answer all questions in the session

Page 21: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

21

Test Security Requirements for Students During testing, students must NOT …

preview test materials copy others’ work or communicate with other

students ask for or accept any coaching let someone else answer for them work in a different test session use materials that are prohibited during testing

(e.g., notes, cell phones – post messages online) See PAM page 127 for reasons for invalidation. See PAM page 126 for sample form to

document students’ understanding of requirements.

Page 22: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

22

Results will be invalidated for students who use cell phones or other electronic devices at any time during a session, including after a student turns in his or her test materials, during a break, or during the transition to a test completion area.

Page 23: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

23

What should a principal do if a student takes a picture of a test booklet?

Print a copy of the picture. Have the student delete the picture from

Twitter and from the phone. Determine whether the picture was

disseminated in another way. E.g., email, texting, Facebook

Call the Department immediately.

Page 24: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

24

How to Avoid This Situation Inform students about the cell phone policy,

including consequences for using one during testing.

Plan for end of session: Inform students of appropriate activities at the

end of a session. See PAM page 28 for a list of materials permitted

after a student has turned in test materials. Have test administrators collect test materials

when students are done. Schedule sessions for appropriate lengths of time. Use dismissal waves in scheduling.

Page 25: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

25

Please contact the Department at 781-338-3625

IMMEDIATELY to report testing irregularities.

See PAM pages 6–7 for more information about reporting testing irregularities.

Page 26: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

26

Tips to Maintain Security (Recommended) Use seating charts.

Have an empty seat between students.

Whenever possible, Assign test administrators for other

teachers’ classes OR Have two test administrators in each

room.

Page 27: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

27

Other Tips from Schools

www.doe.mass.edu/mcas/testadmin/schoolsamples/default.html

Sample seating chart Training materials Worksheets for accounting for

materials Tracking accommodations Checklists

Page 28: Spring Test Administration Training Session January/February 2015

Test Administration Protocols

Page 29: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

29

Credit: http://shop.marthastewart.com/Good-Things-with-Martha-Stewart-Living/A/0609805940.htm

Page 30: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

30

Martha Stewart’s Tips for Organizing Your Home Maximize efficiency. Store things where you use them.  Keep like with like. Store your most frequently used items

in the most accessible places.  Declutter yearly.

Source: http://www.marthastewart.com/275490/organizing-your-home/@center/277000/homekeeping-solutions#235241

Page 31: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

31

Stay organized! Important to keep good records

throughout test administration Can be especially challenging for schools

doing PARCC ELA/mathematics and MCAS STE during the same time in May, and for high schools doing PARCC testing

Page 32: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

32

Develop school security planReview with the superintendent:

Staffing plan Training plan How to implement security requirements

Page 33: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

33

Turn & Talk – School Security Plan

What are 2 components in your school’s security plan?

Who is involved in the planning?

How do you know it’s successful?

Page 34: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

34

Determine Logistics Plan school’s testing schedule.

Testing dates and deadlines Daily schedule, including dismissal waves Testing locations and staffing plan (including

special populations) Prepare record of test administrators and

students. Check the Department’s website.

Practice tests – www.doe.mass.edu/mcas/testadmin/practice/

SAS Updates – www.doe.mass.edu/mcas/updates.html

Read the PAM. Student participation guidelines

Page 35: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

35

Review Data for March SIMS Students’ names

changes Demographic information

first-year LEP, IEP, and 504 status Grade levels

Students are reported as absent if they are enrolled but not tested (MCAS or PARCC).

Page 36: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

36

Receive Test Materials Complete forms.

Internal tracking forms Sample in PAM on pages 121–122

Materials Summary Principal’s Certification of Proper Test

Administration (PCPA) – www.mcasservicecenter.com

Order additional materials if necessary. Deadlines listed on PAM pages iii–v

Page 37: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

37

Prepare Materials for Distribution Distribute manuals during training

session. Affix Student ID Labels to answer

booklets. New – There will be separate answer

booklets for Mathematics and STE in grades 5 and 8.

Page 38: Spring Test Administration Training Session January/February 2015

38

Order STE Materials (High Schools Only)

High schools: Order June STE materials March 9–13, 2015 www.mcasservicecenter.com

Massachusetts Department of Elementary and Secondary Education

Page 39: Spring Test Administration Training Session January/February 2015

Be Sure to… Distribute and track test materials. Monitor and coordinate test

administration. Securely store materials between

sessions and after each day of testing. Remind test administrators to read

scripts verbatim. Keep a log of test administrators and

students. 39

Massachusetts Department of Elementary and Secondary Education

Page 40: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

40

Prepare Materials for School Files Retain your school’s test administration

files for three years. Records may be requested in the event

of an investigation. Lists of materials to retain:

PAM pages 54–55, 73–74

Page 41: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

41

Prepare the Scorable Shipment Assign an answer booklet for

students who participated in ANY part of testing students who were absent with medical

documentation first-year ELLs

Transcribe responses if necessary for certain accommodations damaged/defective booklets

Prepare envelopes Return, Special Handling, Void

Packing diagrams and instructions in PAM ELA: PAM pages 50–53 Math and STE: PAM pages 69–71

Page 42: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

42

Before Packing

Confirm there are no secure materials left behind. Students’ used answer booklets Test booklets

Each day after testing, verify that all materials have been returned to you. Two independent counts of test materials

recommended Double-check central storage area.

In the bottom of a bin In between file folders

Page 43: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

43

Complete Forms after Testing

Internal tracking forms Materials Summary PCPA

Signature must match the name of the principal in School/District Profiles (http://profiles.doe.mass.edu).

Page 44: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

44

Options for Returning Materials (March–April and May)

Complete Early Shipment

•Early pickup of all scorable and nonscorable materials

Partial Early Shipment

•Early pickup of used answer booklets for students who tested by certain datesAND•Pickup of remaining scorable and nonscorable materials by deadline

Regular Shipment

•Pickup of all scorable and nonscorable materials as soon as testing has been completed (by deadline)

Page 45: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

45

Schedule Your School’s Pickup Two methods:

Schedule online at mcasservicecenter.com. One day prior, and by 3:00 p.m.

OR Give cartons to your regular UPS driver.

Call to inform the MCAS Service Center (800-737-5103).

Grade 10: Call the Service Center to cancel early pickup if using regular return.

Do not take materials to UPS. Do not leave materials unattended. Use correct UPS labels.

Page 46: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

46

Ship Materials Separately Separate locations and shipping

deadlines for each of the following: MCAS MCAS-Alt PARCC

Page 47: Spring Test Administration Training Session January/February 2015

Questions & Answers

Page 48: Spring Test Administration Training Session January/February 2015

Participation for Students with Disabilities

Page 49: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

49

Updates for 2015 Requirements for the Participation of

Students with Disabilities in MCAS (2014–2015 Update) www.doe.mass.edu/mcas/participation/sped.

pdf PAM Appendix B

Page 50: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

50

Assigning MCAS Accommodations

IEP or 504 plan must specify which accommodations will be used for testing. Include a description of the accommodation,

not just the accommodation number (e.g., accommodation 25: other – slant board).

Accommodations may not be provided if an IEP is not yet signed by the parent/guardian.

Notification of parents is required for 504 plans.

Page 51: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

51

Prohibitions for Test Accommodations

Test administrators must NOT… Provide accommodations not listed in

a student’s IEP or 504 plan (e.g., read-aloud for ELA for student who has this only for Math test)

Appendix B of the PAM Provide a different grade-level test Alter, photocopy, or scan a test booklet Coach or provide clues/assistance

E.g., define words, explain questions, suggest the student write more

Page 52: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

52

Examples of Testing Irregularities due to Prohibited Materials English-language dictionary or thesaurus

Dictionaries are allowed only on the ELA Composition.

Unapproved mathematics reference sheet Calculator on the non-calculator session of

Mathematics test for a student who does not have this listed in an IEP/504 plan

Page 53: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

53

Things to Do Now for MCAS Accommodations

Review IEPs, 504 plans, and PAM Appendix B. Prepare a list or spreadsheet for scheduling:

Order special test editions. E.g., large-print, Braille

Submit graphic organizers and reference sheets to the Department for approval.

Provide training on accommodations to Test administrators Substitutes

Student Name

Gr.

Subject TA Name

Room #

Accommodation(s)

John Ward

5 ELA Reading Comprehension

Mr. Lee

208 11 – large print20 – graphic organizer

Page 54: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

54

Nonstandard Accommodations (NSAs) NSAs may be provided only to a student who:

is virtually unable to decode, calculate, write, or spell; AND

receives ongoing intervention in this area. NSAs may not be provided if student is simply

performing “below grade level.” Score may be invalidated if ineligible student

was provided an NSA. Use of NSAs will be reported with a notation on

Parent/Guardian Reports School and district rosters

Page 55: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

55

MCAS Accommodation 20: Organizers, Checklists, and Individualized Reference Sheets

Mathematics reference sheets must be approved by the Department prior to testing. Can include formulas, word banks, memory

prompts (e.g., mnemonics)

Cannot include graphics, definitions, examples, steps in solving specific problems

Samples are available at www.doe.mass.edu/mcas/participation/?section=all. ELA and STE reference sheets Approval guide for Mathematics Pre-approved ELA graphic organizers

Page 56: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

56

MCAS Accommodation 20: Deadlines for Submission

Use approval cover sheet for approval (all subjects) www.doe.mass.edu/mcas/participation/accommodation20.pdf Only submit/resubmit materials approved in

2013 or earlier.Deadline to Submit

Test

Feb. 6 ELA tests (all grades)

April 2 Mathematics tests (all grades) and STE tests

(gr. 5 & 8)

May 1 High school STE tests

Page 57: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

57

If a Student Refuses an Accommodation

Document the refusal in the student’s file. Sample refusal form — page 137 of the PAM

Continue to make accommodation available for remainder of test administration.

Do not fill in circles on the student’s answer booklet (back cover) for accommodations that were not used.

Notify parent/guardian. Amend IEP/504 plan for future testing.

If appropriate, list accommodation in the IEP/504 plan “as requested by student,” or remove it.

Page 58: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

58

MCAS-Alt General Information IEP team or 504 plan designates students

for MCAS-Alt each year and in each subject. Student must take MCAS-Alt, regardless of

whether the school is doing MCAS or PARCC. MCAS-Alt scores are included for

accountability. Principals should encourage teachers to

attend Department training on portfolios. Increases likelihood of submitting a complete

portfolio

Page 59: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

59

How Principals Can Support Their Teachers Who Conduct the MCAS-Alt

Determine which teachers need support. Appoint one educator as lead contact for

finding answers and giving advice. Encourage teachers to review each other’s

portfolios. Register teachers to attend Department

training and review sessions in Oct., Jan., and March.

Assist teachers by providing time and flexibility to work on compiling portfolios. E.g., scheduling, coverage, substitutes

Page 60: Spring Test Administration Training Session January/February 2015

Participation for ELL Students

Page 61: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

61

MCAS Supports for ELL Students

List of approved bilingual word-to-word dictionaries and glossaries for use on MCAS and PARCC, updated in fall 2014 www.doe.mass.edu/mcas/testadmin/lep-bilingual-di

ctionary.pdf May be used by any student who is or was ELL New languages and resources added Specialized translations (glossaries) for Math and

STE Selected publishers/distributors and online

resources included ELLs with disabilities must also receive test

accommodations, per their IEP/504 plan.

Page 62: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

62

Assigning Testing Spaces for ELLs

Principals may assign students to spaces other than regular classrooms, as long as other conditions and staffing requirements are met.

Do not mark this as an accommodation on a student’s answer booklets unless the student has it in his or her IEP or 504 plan.

Policy on “Stop Testing”

If an ELL student does not seem to be responding to test questions, the test administrator may ask if the student is finished.

If so, collect materials. The student may read a book or sit quietly.

MCAS Test Administration for ELLs

Page 63: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

63

Until February 11

Administer ACCESS for ELLs test

February 12 Deadline to schedule UPS pickup

February 13 Deadline for UPS pickup

ACCESS for ELLs Test Administration Deadlines

Page 64: Spring Test Administration Training Session January/February 2015

Questions & Answers

Page 65: Spring Test Administration Training Session January/February 2015

High School Participation

Page 66: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

66

Review CD Data (High Schools Only)

Check lists of students who are in grade 12 to confirm Who has not been tested? Who still needs to earn a CD?

Check CD report Posted in Edwin Analytics on January 9 Includes November retest results

Check list of students in grade 11 who were in grade 9 the previous school year To be posted in School and District DropBoxes

by February

Page 67: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

67

Highlights of Spring High School MCAS Participation Guidelines

Administration

Who’s eligible? Dates

March ELA retest

Students who have not earned 240/Proficient on the ELA test(Students may participate for EPP purposes.)

March 2–4, 2015

March Mathematics retest

Students who have not earned 220/Needs Improvement on the Mathematics test (Students may not participate for EPP purposes.)

March 5–6, 2015

Page 68: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

68

EPP/MCAS Participation Guidelines

Administration

Who’s eligible? Dates

EPP/MCAS Mathematics test

Students seeking to complete the Mathematics assessment portion of their EPPs

April 27–May 8, 2015

Page 69: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

69

June High School STE ParticipationEligibility Students who … Grade

Required to participate

have not yet earned CD in STE* First attempted score is used to determine Adams Scholarship eligibility.

Gr. 10 (Class of 2017)

Eligible are enrolled in STE course and have not yet earned CD in STE

Gr. 9 (Class of 2018)

have not yet earned CD in STE OR wish to attempt to qualify for Koplik Award

Gr. 11 (Class of 2016)

have not yet earned CD in STE Gr. 12 (Class of 2015)

are attempting to earn CD in STE Adults who exited high school

Not eligible

have earned their CD in STE and are not participating for Koplik Award purposes

All

Page 70: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

70

How to Check CD Data and Use Reports in Edwin Analytics Log in to MassEdu Gateway (formerly

known as the Department’s Security Portal).

Click the Application List. Select Edwin Analytics. Under the student tab, select the CD

report (“PE618”).

Page 71: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

71

Select grades 11 and 12.

Match ANY of the following.

Failing or not tested – did not meet CD in all three subjects

Page 72: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

72

Names and SASIDS redacted

You will then see a roster of all the students in grades 11 and 12 who have not earned their CD – and in which subjects.

Page 73: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

73

New Grade 11 Students Claim them by

Reporting them in SIMS (or SIF) or Using the claiming process

If they have not taken the high school MCAS tests, determine whether they wish to qualify for the Adams Scholarship. If so, schedule them for grade 10 ELA and

Mathematics. If not, schedule them for retests. Administer STE tests in February (Biology) or in

June (all four tests).

Page 74: Spring Test Administration Training Session January/February 2015

Reporting

Page 75: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

75

Reporting Topics Schedule for reporting MCAS results

Discrepancy period Schedule for reporting ACCESS for ELLs

results What’s new on the Department’s reporting

website and with Edwin Analytics? How will PARCC testing impact the release

of MCAS and Accountability results?

Page 76: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

76

March 20 Access February Biology data files and rosters at DropBox Central

April 16 Access March Retest data files and rosters at DropBox Central

April 1–10

ACCESS for ELLs data validation (schools)

May 4 Districts receive February Biology and March Retest Parent/Guardian Reports

Mid-May Schools and districts receive printed ACCESS for ELLs reports and data posted at DropBox Central

Spring 2015 MCAS Reporting Schedule — March–May(all dates tentative)

Results will be available in EDW/Edwin Analytics 3 days after the DropBox release.

Page 77: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

77

Spring 2015 MCAS Reporting Schedule — June

Early June: MCAS-Alt student results and portfolio feedback forms

Before July 4: ELA (preliminary results), Math (multiple-choice only), Grades 5 and 8 STE (multiple-choice only)

Districts access MCAS ELA Compositions at www.mcasservicecenter.com

Page 78: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

78

July 1–July 31 MCAS discrepancy reporting by phone (800-737-5103)

Early August TBD

Districts access preliminary Mathematics and STE MCAS results

• Combined with June ELA

August TBD MCAS discrepancy reporting online (mcasservicecenter.com)

Spring 2015 MCAS Reporting Schedule — July–August(all dates tentative)

Page 79: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

79

Spring 2015 MCAS Official Results Reporting Schedule — Fall (TBD) Districts access official MCAS student,

school, and district results on MassEdu Gateway.

One day later: Districts receive shipment of MCAS and

MCAS-Alt Parent/Guardian Reports. Public release of official school and district

results by the Department

Page 80: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

80

Reporting Notes for High Schools STE scores used for accountability in grade 10

Grade 9 students’ scores are held until grade 10. All high school accountability determinations are

based on grade 10 data. Any student enrolled as a 10th grader from

March through the end of the school year who has never taken an STE test will count against participation rates. This includes first-year ELL students and students

with disabilities.

Page 81: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

81

What’s New in Reporting? MCAS “state” results will not be

based on the entire state. MCAS results may be skewed, since about

half of the state will be taking PARCC instead of MCAS for grades 3–8 in ELA and Mathematics.

MCAS results may be delayed by a week or two from regular schedule due to equating.

Accountability results will be significantly delayed.

Page 82: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

82

What’s New in Edwin Analytics?

New User Interface (MassEdu Gateway) Sub-tabs for report groupings

New Reports and Enhancements Assessments – ACCESS for ELLs EWIS Post-secondary outcomes: Three new reports School Readiness Finance: Five new reports Teacher-level reporting: Five new classroom

reports

Page 83: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

83

Teacher-level Report (“PE520”)

Page 84: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

84

Student Profile Provides all SIMS, MCAS, and Student

Course Schedule (SCS) history for a particular student

If a student transfers into your district, claim the student and have immediate access to his or her ESE data.

Educational responsibility for the student allows for viewing of all data prior to arrival in your district.

Page 85: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

85

Student Profile Report

Page 86: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

86

Accountability Plans in 2015 Schools administering MCAS will be

classified into a level as usual, and will not be “held harmless.”

Schools administering PARCC will have their 2015 accountability and assistance level “held harmless” (i.e., the level will stay the same or improve from 2014, but cannot decline).

Page 87: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

87

Accountability Plans in 2015 – Continued

Accountability levels will not be calculated until PARCC results are available. School percentiles for all MCAS and PARCC

schools will be calculated after PARCC results are available.

PARCC results are not expected to be final until November or December 2015.

For percentile purposes, results from the two assessments will be linked based on large representative samples.

2015 results will be excluded from percentile calculations in future years.

Page 88: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

88MCAS Grade 3 PARCC Grade 3 (simulated)

0

20

40

60

80

100

120

Equipercentile Linking for Percentile Calculations

Level 1 Level 2 Level 3 Level 4 Level 5

~260 (Adv)

~240 (100 CPI)~230 (75 CPI)~220 (50 CPI)~210 (25 CPI)

31% Adv

36% Prof

22% NI

11% W

Representative Sample

Representative Sample

%

Page 89: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

89MCAS Grade 3 PARCC Grade 40

20

40

60

80

100

120

Proposed Transitional Student Growth Percentiles (TSGPs) for Students Taking PARCC

Level 1 Level 2 Level 3 Level 4 Level 5

99th

1st

50th

100s of students scoring ~248

Representative Sample

%

Page 90: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

90

Breakdown of Assessment Choice by Race Grades 3–8 only

7%5%

17%

3%<1%<1%

68%

MCAS Schools

Asian

Black

Hispanic

Mixed

Native Am

Pac Islander

White

6%

11%

17%

3%<1%<1

%

63%

PARCC Schools

Page 91: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

91

Assessment Choice by MCAS Achievement Level – ELA Grades 3–8 only

Page 92: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

92

Assessment Choice by MCAS Achievement Level – Mathematics Grades 3–8 only

Page 93: Spring Test Administration Training Session January/February 2015

Questions & Answers

Page 94: Spring Test Administration Training Session January/February 2015

If you are leaving now, please fax your completed Evaluation Forms posted at (www.doe.mass.edu/mcas/conferencecall) to 781-338-3630.

Thank you for participating.

Page 95: Spring Test Administration Training Session January/February 2015

Additional Information

andOrientation for New Principals

Page 96: Spring Test Administration Training Session January/February 2015

Additional Accommodations Information

Page 97: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

97

Selecting Appropriate Accommodations for Instruction

Adults who work with the student: Gather information on student’s learning

style and preferences. Look at student’s classroom

performance, not just the type of disability.

Try out prospective accommodations during instruction.

Evaluate instructional accommodations and modify as needed.

Page 98: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

98

Designating Accommodations for Assessment

Team bases the selection of test accommodations on those used successfully during instruction.

For each subject, determine whether the accommodation is appropriate and allowed for MCAS testing.

Develop/amend IEP or 504 plan, listing instructional and assessment accommodations separately.

Accommodations must be provided/offered if listed in IEP (signed by parent/guardian) or in 504 plan.

Evaluate the effectiveness of test accommodations.

Page 99: Spring Test Administration Training Session January/February 2015

Additional Details on Test Administration

Page 100: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

100

Additional Information

Forms Materials Summary PCPA Internal tracking form

Completing student information on answer booklet covers

Return shipping instructions Brockton High School video

Page 101: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

101

Materials SummaryBefore testing, compare

“Qty Shipped” to

“Qty Received”

After testing, compare

“Qty Received” to

“Qty Returned”

Then sign and date

Page 102: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

102

PCPA “Materials Received” Section

Page 103: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

103

PCPA “After Testing” Sections

Page 104: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

104

The principal must sign the PCPA.

Page 105: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

105

Internal Tracking Forms Used to determine chain of custody of

materials See samples in PAM (pages 121 and 122)

Page 106: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

106

School-created Internal Tracking Forms

Include the following components: The specific count of materials at the time

of distribution The specific count of materials at the time

of return Signature areas for the test administrator

and the principal or test coordinator to sign the form

Page 107: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

107

Student ID Labels and SIMS

Student ID Labels based on October SIMS Use a label even if there is some incorrect

information as long as the SASID on the label is correct.

Correct the student’s name or date of birth in the next SIMS submission (March or June) by the district SIMS contact (see PAM page ii for instructions on how to find yours).

Page 108: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

108

Completing Student Information

If a student has a label, fill in the following information on the front cover: School name School district Student’s name (Write in the name, but no need

to fill in the circles below.)

If no label, fill in all the information on the front cover and fill in corresponding circles.

See sample front covers of a student answer booklet in the PAM on pages 128 and 129.

Page 109: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

109

What to fill in on the answer booklet front cover if a student does NOT have a label

Page 110: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

110

Returning Answer Booklets – Three Envelopes Return Envelope

Used/assigned standard answer booklets (ABs)

Special Handling Envelope Typed Responses inserted in ABs Large-print ABs with transcribed standard

AB

Void Envelope ABs that were assigned to students but that

should not be scored Fill in “VOID” circle on back cover of the AB.

Page 111: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

111

Pack Return Shipments Use the diagrams in the PAM to pack scorable

and nonscorable shipments. ELA instructions — pages 50–53

Mathematics and STE instructions — pages 69–71

Page 112: Spring Test Administration Training Session January/February 2015

One School’s Perspective on Test AdministrationBrockton High Schoolwww.youtube.com/watch?feature=player_embedded&v=zrpUTFGyUDw

Page 113: Spring Test Administration Training Session January/February 2015

Massachusetts Department of Elementary and Secondary Education

113

Organizing Test Administration(Courtesy of Brockton High School)

1. Preparation in advance of materials arriving at the school

2. Preparation of test administrators3. Preparation of students4. Maintaining security within each

testing room5. Collection and accountability of

materials

Page 114: Spring Test Administration Training Session January/February 2015

Questions & AnswersPlease fax your completed Evaluation Forms posted at (www.doe.mass.edu/mcas/conferencecall) to 781-338-3630.

Thank you for participating.