spring test administration training session january/february 2015
Post on 22-Dec-2015
216 Views
Preview:
TRANSCRIPT
Spring TestAdministration Training SessionJanuary/February 2015
Massachusetts Department of Elementary and Secondary Education
2
Presenters Dan Wiener
Administrator of Inclusive Assessment
Jodie ZalkTest Administration Coordinator
Bob LeeMCAS Chief Data Analyst
Massachusetts Department of Elementary and Secondary Education
3
Today’s Agenda Review materials posted at
www.doe.mass.edu/mcas/conferencecall
Test security and test administration protocols
Participation requirements Students with disabilities ELL students
Reporting Additional information and orientation
for new principals
Massachusetts Department of Elementary and Secondary Education
4
Board-Approved Transition Plan Spring 2014: PARCC field test was
administered in randomly selected schools. Spring 2015: MA districts, educational
collaboratives, and approved private schools choose to administer either PARCC or MCAS.
Fall 2015: Board votes on whether to approve PARCC.
Current Competency Determination (CD) requirements in place through class of 2019 Any change after class of 2019 requires future
Board approval.
Massachusetts Department of Elementary and Secondary Education
5
Spring 2015 Assessment Choice for Districts
# of public districts (incl. charters)
MCAS PARCC
# of districts %
# of students (approx.
)
# of districts %
# of students (approx.
)
Gr. 3–8 362 165 46%207,50
0 197 54%220,00
0PARCC for Gr. 9 and/or 11 (optional)
295 N/A N/A N/A 71 24% N/A
As of October 10, 2014 www.doe.mass.edu/news/news.aspx?id=13541
Massachusetts Department of Elementary and Secondary Education
6
MCAS and MCAS-Alt, if PARCC Is Adopted Current CD requirements will remain in
place through the class of 2019. Grade 10 MCAS ELA test Grade 10 MCAS Mathematics test High school MCAS Science and Tech/Eng (STE)
tests
MCAS STE tests will continue. Grades 5, 8, and high school
All students designated for alternate assessments will continue to take MCAS-Alt.
Massachusetts Department of Elementary and Secondary Education
7
PARCC Resources Training Opportunities
Spring 2015 PARCC training sessions Online training modules
PARCC Support CenterWeb: PARCC.pearson.comEmail: parcc@support.pearson.com Telephone: 888-493-9888
Department’s Student Assessment Services Web: www.doe.mass.edu/parccEmail: parcc@doe.mass.edu Telephone: 781-338-3625
Test Security
Massachusetts Department of Elementary and Secondary Education
9
Credit: Roz Chast
Massachusetts Department of Elementary and Secondary Education
10
Most Common Security Issues
Cell phones Improper coaching Improper use of
the read-aloud accommodation (#26)
Student collaboration
Going back to earlier sessions
Twitter Improper calculator
use Accessing
notes/textbooks Improper dictionary
use Accessing Internet
while using typed response accommodation (#23)
Massachusetts Department of Elementary and Secondary Education
11
Importance of Leadership Superintendents must review their
principals’ test security plans. Superintendent’s Assurance of Proper Test
Administration (optional form) — PAM page 120
Principals must maintain the security of the testing environment and test materials. PCPA certification — PAM pages 118–119 Train test administrators and others, and
ensure they comply with requirements. Meet with students.
Massachusetts Department of Elementary and Secondary Education
12
A Secure Testing Environment Plan for
appropriate testing spaces students who may need more time lunch, recess, restrooms
Cover/remove prohibited classroom displays PAM page 26
No unauthorized visitors
Massachusetts Department of Elementary and Secondary Education
13
Security Requirements for Test Materials Store all test materials in a central location
each day. Locked when tests are not being administered Restricted access
Maintain chain of custody of materials during test administration. Do not remove test materials from school. Do not leave test materials unattended.
Materials must be returned to the central secure storage area and signed in each day.
Massachusetts Department of Elementary and Secondary Education
14
Confidentiality of Booklets
Do NOT … review test booklets or answer booklets
before, during, or after testing exceptions for certain accommodations
provide students access to tests before testing
duplicate test materials retain, recycle, remove, or destroy test
materials
Massachusetts Department of Elementary and Secondary Education
15
Train Test Administrators and Others
All individuals involved in test administration must participate in training. See topics in PAM — pages 29–32 Sample quiz on protocols can be used in training:
www.doe.mass.edu/mcas/testadmin/ Forms requiring signoff by test administrators
Participated in training Received their TAMs — see PAM page 125 Signed a nondisclosure agreement if providing
certain accommodations — see PAM page 134
Massachusetts Department of Elementary and Secondary Education
16
Test Administrator Responsibilities
1. Follow directions in TAMs and read scripts verbatim.
2. Supervise students at all times to prevent cheating.
3. Prevent use of prohibited materials (e.g., cell phones).
4. Focus full attention on the testing room.
5. Do not coach students or alter responses.
Massachusetts Department of Elementary and Secondary Education
17
Turn & Talk –Training Plan
How are your test administrators trained? Test administrators for
accommodations? How do you evaluate the success of
your training?
Massachusetts Department of Elementary and Secondary Education
18
Planning for Required and Prohibited Materials New section in PAM (page 26) Principals must develop procedures so that
students receive required materials and do not access prohibited materials.
Principals must inform: Test administrators
whether to read new recommended script or school-developed script
how they will actively monitor the room how to handle a situation if a student is found with
a prohibited item Students Parents/guardians
Massachusetts Department of Elementary and Secondary Education
19
Clarity of message is important when communicating with students.
Thanks to Mike Barth from Seven Hills Charter School
Massachusetts Department of Elementary and Secondary Education
20
Give Clear Instructions to Students Before testing, instruct students to
try their best respond directly to the MCAS ELA
Composition prompt TAMs instruct students to
work until end of session (and only in that session)
answer all questions in the session
Massachusetts Department of Elementary and Secondary Education
21
Test Security Requirements for Students During testing, students must NOT …
preview test materials copy others’ work or communicate with other
students ask for or accept any coaching let someone else answer for them work in a different test session use materials that are prohibited during testing
(e.g., notes, cell phones – post messages online) See PAM page 127 for reasons for invalidation. See PAM page 126 for sample form to
document students’ understanding of requirements.
Massachusetts Department of Elementary and Secondary Education
22
Results will be invalidated for students who use cell phones or other electronic devices at any time during a session, including after a student turns in his or her test materials, during a break, or during the transition to a test completion area.
Massachusetts Department of Elementary and Secondary Education
23
What should a principal do if a student takes a picture of a test booklet?
Print a copy of the picture. Have the student delete the picture from
Twitter and from the phone. Determine whether the picture was
disseminated in another way. E.g., email, texting, Facebook
Call the Department immediately.
Massachusetts Department of Elementary and Secondary Education
24
How to Avoid This Situation Inform students about the cell phone policy,
including consequences for using one during testing.
Plan for end of session: Inform students of appropriate activities at the
end of a session. See PAM page 28 for a list of materials permitted
after a student has turned in test materials. Have test administrators collect test materials
when students are done. Schedule sessions for appropriate lengths of time. Use dismissal waves in scheduling.
Massachusetts Department of Elementary and Secondary Education
25
Please contact the Department at 781-338-3625
IMMEDIATELY to report testing irregularities.
See PAM pages 6–7 for more information about reporting testing irregularities.
Massachusetts Department of Elementary and Secondary Education
26
Tips to Maintain Security (Recommended) Use seating charts.
Have an empty seat between students.
Whenever possible, Assign test administrators for other
teachers’ classes OR Have two test administrators in each
room.
Massachusetts Department of Elementary and Secondary Education
27
Other Tips from Schools
www.doe.mass.edu/mcas/testadmin/schoolsamples/default.html
Sample seating chart Training materials Worksheets for accounting for
materials Tracking accommodations Checklists
Test Administration Protocols
Massachusetts Department of Elementary and Secondary Education
29
Credit: http://shop.marthastewart.com/Good-Things-with-Martha-Stewart-Living/A/0609805940.htm
Massachusetts Department of Elementary and Secondary Education
30
Martha Stewart’s Tips for Organizing Your Home Maximize efficiency. Store things where you use them. Keep like with like. Store your most frequently used items
in the most accessible places. Declutter yearly.
Source: http://www.marthastewart.com/275490/organizing-your-home/@center/277000/homekeeping-solutions#235241
Massachusetts Department of Elementary and Secondary Education
31
Stay organized! Important to keep good records
throughout test administration Can be especially challenging for schools
doing PARCC ELA/mathematics and MCAS STE during the same time in May, and for high schools doing PARCC testing
Massachusetts Department of Elementary and Secondary Education
32
Develop school security planReview with the superintendent:
Staffing plan Training plan How to implement security requirements
Massachusetts Department of Elementary and Secondary Education
33
Turn & Talk – School Security Plan
What are 2 components in your school’s security plan?
Who is involved in the planning?
How do you know it’s successful?
Massachusetts Department of Elementary and Secondary Education
34
Determine Logistics Plan school’s testing schedule.
Testing dates and deadlines Daily schedule, including dismissal waves Testing locations and staffing plan (including
special populations) Prepare record of test administrators and
students. Check the Department’s website.
Practice tests – www.doe.mass.edu/mcas/testadmin/practice/
SAS Updates – www.doe.mass.edu/mcas/updates.html
Read the PAM. Student participation guidelines
Massachusetts Department of Elementary and Secondary Education
35
Review Data for March SIMS Students’ names
changes Demographic information
first-year LEP, IEP, and 504 status Grade levels
Students are reported as absent if they are enrolled but not tested (MCAS or PARCC).
Massachusetts Department of Elementary and Secondary Education
36
Receive Test Materials Complete forms.
Internal tracking forms Sample in PAM on pages 121–122
Materials Summary Principal’s Certification of Proper Test
Administration (PCPA) – www.mcasservicecenter.com
Order additional materials if necessary. Deadlines listed on PAM pages iii–v
Massachusetts Department of Elementary and Secondary Education
37
Prepare Materials for Distribution Distribute manuals during training
session. Affix Student ID Labels to answer
booklets. New – There will be separate answer
booklets for Mathematics and STE in grades 5 and 8.
38
Order STE Materials (High Schools Only)
High schools: Order June STE materials March 9–13, 2015 www.mcasservicecenter.com
Massachusetts Department of Elementary and Secondary Education
Be Sure to… Distribute and track test materials. Monitor and coordinate test
administration. Securely store materials between
sessions and after each day of testing. Remind test administrators to read
scripts verbatim. Keep a log of test administrators and
students. 39
Massachusetts Department of Elementary and Secondary Education
Massachusetts Department of Elementary and Secondary Education
40
Prepare Materials for School Files Retain your school’s test administration
files for three years. Records may be requested in the event
of an investigation. Lists of materials to retain:
PAM pages 54–55, 73–74
Massachusetts Department of Elementary and Secondary Education
41
Prepare the Scorable Shipment Assign an answer booklet for
students who participated in ANY part of testing students who were absent with medical
documentation first-year ELLs
Transcribe responses if necessary for certain accommodations damaged/defective booklets
Prepare envelopes Return, Special Handling, Void
Packing diagrams and instructions in PAM ELA: PAM pages 50–53 Math and STE: PAM pages 69–71
Massachusetts Department of Elementary and Secondary Education
42
Before Packing
Confirm there are no secure materials left behind. Students’ used answer booklets Test booklets
Each day after testing, verify that all materials have been returned to you. Two independent counts of test materials
recommended Double-check central storage area.
In the bottom of a bin In between file folders
Massachusetts Department of Elementary and Secondary Education
43
Complete Forms after Testing
Internal tracking forms Materials Summary PCPA
Signature must match the name of the principal in School/District Profiles (http://profiles.doe.mass.edu).
Massachusetts Department of Elementary and Secondary Education
44
Options for Returning Materials (March–April and May)
Complete Early Shipment
•Early pickup of all scorable and nonscorable materials
Partial Early Shipment
•Early pickup of used answer booklets for students who tested by certain datesAND•Pickup of remaining scorable and nonscorable materials by deadline
Regular Shipment
•Pickup of all scorable and nonscorable materials as soon as testing has been completed (by deadline)
Massachusetts Department of Elementary and Secondary Education
45
Schedule Your School’s Pickup Two methods:
Schedule online at mcasservicecenter.com. One day prior, and by 3:00 p.m.
OR Give cartons to your regular UPS driver.
Call to inform the MCAS Service Center (800-737-5103).
Grade 10: Call the Service Center to cancel early pickup if using regular return.
Do not take materials to UPS. Do not leave materials unattended. Use correct UPS labels.
Massachusetts Department of Elementary and Secondary Education
46
Ship Materials Separately Separate locations and shipping
deadlines for each of the following: MCAS MCAS-Alt PARCC
Questions & Answers
Participation for Students with Disabilities
Massachusetts Department of Elementary and Secondary Education
49
Updates for 2015 Requirements for the Participation of
Students with Disabilities in MCAS (2014–2015 Update) www.doe.mass.edu/mcas/participation/sped.
pdf PAM Appendix B
Massachusetts Department of Elementary and Secondary Education
50
Assigning MCAS Accommodations
IEP or 504 plan must specify which accommodations will be used for testing. Include a description of the accommodation,
not just the accommodation number (e.g., accommodation 25: other – slant board).
Accommodations may not be provided if an IEP is not yet signed by the parent/guardian.
Notification of parents is required for 504 plans.
Massachusetts Department of Elementary and Secondary Education
51
Prohibitions for Test Accommodations
Test administrators must NOT… Provide accommodations not listed in
a student’s IEP or 504 plan (e.g., read-aloud for ELA for student who has this only for Math test)
Appendix B of the PAM Provide a different grade-level test Alter, photocopy, or scan a test booklet Coach or provide clues/assistance
E.g., define words, explain questions, suggest the student write more
Massachusetts Department of Elementary and Secondary Education
52
Examples of Testing Irregularities due to Prohibited Materials English-language dictionary or thesaurus
Dictionaries are allowed only on the ELA Composition.
Unapproved mathematics reference sheet Calculator on the non-calculator session of
Mathematics test for a student who does not have this listed in an IEP/504 plan
Massachusetts Department of Elementary and Secondary Education
53
Things to Do Now for MCAS Accommodations
Review IEPs, 504 plans, and PAM Appendix B. Prepare a list or spreadsheet for scheduling:
Order special test editions. E.g., large-print, Braille
Submit graphic organizers and reference sheets to the Department for approval.
Provide training on accommodations to Test administrators Substitutes
Student Name
Gr.
Subject TA Name
Room #
Accommodation(s)
John Ward
5 ELA Reading Comprehension
Mr. Lee
208 11 – large print20 – graphic organizer
Massachusetts Department of Elementary and Secondary Education
54
Nonstandard Accommodations (NSAs) NSAs may be provided only to a student who:
is virtually unable to decode, calculate, write, or spell; AND
receives ongoing intervention in this area. NSAs may not be provided if student is simply
performing “below grade level.” Score may be invalidated if ineligible student
was provided an NSA. Use of NSAs will be reported with a notation on
Parent/Guardian Reports School and district rosters
Massachusetts Department of Elementary and Secondary Education
55
MCAS Accommodation 20: Organizers, Checklists, and Individualized Reference Sheets
Mathematics reference sheets must be approved by the Department prior to testing. Can include formulas, word banks, memory
prompts (e.g., mnemonics)
Cannot include graphics, definitions, examples, steps in solving specific problems
Samples are available at www.doe.mass.edu/mcas/participation/?section=all. ELA and STE reference sheets Approval guide for Mathematics Pre-approved ELA graphic organizers
Massachusetts Department of Elementary and Secondary Education
56
MCAS Accommodation 20: Deadlines for Submission
Use approval cover sheet for approval (all subjects) www.doe.mass.edu/mcas/participation/accommodation20.pdf Only submit/resubmit materials approved in
2013 or earlier.Deadline to Submit
Test
Feb. 6 ELA tests (all grades)
April 2 Mathematics tests (all grades) and STE tests
(gr. 5 & 8)
May 1 High school STE tests
Massachusetts Department of Elementary and Secondary Education
57
If a Student Refuses an Accommodation
Document the refusal in the student’s file. Sample refusal form — page 137 of the PAM
Continue to make accommodation available for remainder of test administration.
Do not fill in circles on the student’s answer booklet (back cover) for accommodations that were not used.
Notify parent/guardian. Amend IEP/504 plan for future testing.
If appropriate, list accommodation in the IEP/504 plan “as requested by student,” or remove it.
Massachusetts Department of Elementary and Secondary Education
58
MCAS-Alt General Information IEP team or 504 plan designates students
for MCAS-Alt each year and in each subject. Student must take MCAS-Alt, regardless of
whether the school is doing MCAS or PARCC. MCAS-Alt scores are included for
accountability. Principals should encourage teachers to
attend Department training on portfolios. Increases likelihood of submitting a complete
portfolio
Massachusetts Department of Elementary and Secondary Education
59
How Principals Can Support Their Teachers Who Conduct the MCAS-Alt
Determine which teachers need support. Appoint one educator as lead contact for
finding answers and giving advice. Encourage teachers to review each other’s
portfolios. Register teachers to attend Department
training and review sessions in Oct., Jan., and March.
Assist teachers by providing time and flexibility to work on compiling portfolios. E.g., scheduling, coverage, substitutes
Participation for ELL Students
Massachusetts Department of Elementary and Secondary Education
61
MCAS Supports for ELL Students
List of approved bilingual word-to-word dictionaries and glossaries for use on MCAS and PARCC, updated in fall 2014 www.doe.mass.edu/mcas/testadmin/lep-bilingual-di
ctionary.pdf May be used by any student who is or was ELL New languages and resources added Specialized translations (glossaries) for Math and
STE Selected publishers/distributors and online
resources included ELLs with disabilities must also receive test
accommodations, per their IEP/504 plan.
Massachusetts Department of Elementary and Secondary Education
62
Assigning Testing Spaces for ELLs
Principals may assign students to spaces other than regular classrooms, as long as other conditions and staffing requirements are met.
Do not mark this as an accommodation on a student’s answer booklets unless the student has it in his or her IEP or 504 plan.
Policy on “Stop Testing”
If an ELL student does not seem to be responding to test questions, the test administrator may ask if the student is finished.
If so, collect materials. The student may read a book or sit quietly.
MCAS Test Administration for ELLs
Massachusetts Department of Elementary and Secondary Education
63
Until February 11
Administer ACCESS for ELLs test
February 12 Deadline to schedule UPS pickup
February 13 Deadline for UPS pickup
ACCESS for ELLs Test Administration Deadlines
Questions & Answers
High School Participation
Massachusetts Department of Elementary and Secondary Education
66
Review CD Data (High Schools Only)
Check lists of students who are in grade 12 to confirm Who has not been tested? Who still needs to earn a CD?
Check CD report Posted in Edwin Analytics on January 9 Includes November retest results
Check list of students in grade 11 who were in grade 9 the previous school year To be posted in School and District DropBoxes
by February
Massachusetts Department of Elementary and Secondary Education
67
Highlights of Spring High School MCAS Participation Guidelines
Administration
Who’s eligible? Dates
March ELA retest
Students who have not earned 240/Proficient on the ELA test(Students may participate for EPP purposes.)
March 2–4, 2015
March Mathematics retest
Students who have not earned 220/Needs Improvement on the Mathematics test (Students may not participate for EPP purposes.)
March 5–6, 2015
Massachusetts Department of Elementary and Secondary Education
68
EPP/MCAS Participation Guidelines
Administration
Who’s eligible? Dates
EPP/MCAS Mathematics test
Students seeking to complete the Mathematics assessment portion of their EPPs
April 27–May 8, 2015
Massachusetts Department of Elementary and Secondary Education
69
June High School STE ParticipationEligibility Students who … Grade
Required to participate
have not yet earned CD in STE* First attempted score is used to determine Adams Scholarship eligibility.
Gr. 10 (Class of 2017)
Eligible are enrolled in STE course and have not yet earned CD in STE
Gr. 9 (Class of 2018)
have not yet earned CD in STE OR wish to attempt to qualify for Koplik Award
Gr. 11 (Class of 2016)
have not yet earned CD in STE Gr. 12 (Class of 2015)
are attempting to earn CD in STE Adults who exited high school
Not eligible
have earned their CD in STE and are not participating for Koplik Award purposes
All
Massachusetts Department of Elementary and Secondary Education
70
How to Check CD Data and Use Reports in Edwin Analytics Log in to MassEdu Gateway (formerly
known as the Department’s Security Portal).
Click the Application List. Select Edwin Analytics. Under the student tab, select the CD
report (“PE618”).
Massachusetts Department of Elementary and Secondary Education
71
Select grades 11 and 12.
Match ANY of the following.
Failing or not tested – did not meet CD in all three subjects
Massachusetts Department of Elementary and Secondary Education
72
Names and SASIDS redacted
You will then see a roster of all the students in grades 11 and 12 who have not earned their CD – and in which subjects.
Massachusetts Department of Elementary and Secondary Education
73
New Grade 11 Students Claim them by
Reporting them in SIMS (or SIF) or Using the claiming process
If they have not taken the high school MCAS tests, determine whether they wish to qualify for the Adams Scholarship. If so, schedule them for grade 10 ELA and
Mathematics. If not, schedule them for retests. Administer STE tests in February (Biology) or in
June (all four tests).
Reporting
Massachusetts Department of Elementary and Secondary Education
75
Reporting Topics Schedule for reporting MCAS results
Discrepancy period Schedule for reporting ACCESS for ELLs
results What’s new on the Department’s reporting
website and with Edwin Analytics? How will PARCC testing impact the release
of MCAS and Accountability results?
Massachusetts Department of Elementary and Secondary Education
76
March 20 Access February Biology data files and rosters at DropBox Central
April 16 Access March Retest data files and rosters at DropBox Central
April 1–10
ACCESS for ELLs data validation (schools)
May 4 Districts receive February Biology and March Retest Parent/Guardian Reports
Mid-May Schools and districts receive printed ACCESS for ELLs reports and data posted at DropBox Central
Spring 2015 MCAS Reporting Schedule — March–May(all dates tentative)
Results will be available in EDW/Edwin Analytics 3 days after the DropBox release.
Massachusetts Department of Elementary and Secondary Education
77
Spring 2015 MCAS Reporting Schedule — June
Early June: MCAS-Alt student results and portfolio feedback forms
Before July 4: ELA (preliminary results), Math (multiple-choice only), Grades 5 and 8 STE (multiple-choice only)
Districts access MCAS ELA Compositions at www.mcasservicecenter.com
Massachusetts Department of Elementary and Secondary Education
78
July 1–July 31 MCAS discrepancy reporting by phone (800-737-5103)
Early August TBD
Districts access preliminary Mathematics and STE MCAS results
• Combined with June ELA
August TBD MCAS discrepancy reporting online (mcasservicecenter.com)
Spring 2015 MCAS Reporting Schedule — July–August(all dates tentative)
Massachusetts Department of Elementary and Secondary Education
79
Spring 2015 MCAS Official Results Reporting Schedule — Fall (TBD) Districts access official MCAS student,
school, and district results on MassEdu Gateway.
One day later: Districts receive shipment of MCAS and
MCAS-Alt Parent/Guardian Reports. Public release of official school and district
results by the Department
Massachusetts Department of Elementary and Secondary Education
80
Reporting Notes for High Schools STE scores used for accountability in grade 10
Grade 9 students’ scores are held until grade 10. All high school accountability determinations are
based on grade 10 data. Any student enrolled as a 10th grader from
March through the end of the school year who has never taken an STE test will count against participation rates. This includes first-year ELL students and students
with disabilities.
Massachusetts Department of Elementary and Secondary Education
81
What’s New in Reporting? MCAS “state” results will not be
based on the entire state. MCAS results may be skewed, since about
half of the state will be taking PARCC instead of MCAS for grades 3–8 in ELA and Mathematics.
MCAS results may be delayed by a week or two from regular schedule due to equating.
Accountability results will be significantly delayed.
Massachusetts Department of Elementary and Secondary Education
82
What’s New in Edwin Analytics?
New User Interface (MassEdu Gateway) Sub-tabs for report groupings
New Reports and Enhancements Assessments – ACCESS for ELLs EWIS Post-secondary outcomes: Three new reports School Readiness Finance: Five new reports Teacher-level reporting: Five new classroom
reports
Massachusetts Department of Elementary and Secondary Education
83
Teacher-level Report (“PE520”)
Massachusetts Department of Elementary and Secondary Education
84
Student Profile Provides all SIMS, MCAS, and Student
Course Schedule (SCS) history for a particular student
If a student transfers into your district, claim the student and have immediate access to his or her ESE data.
Educational responsibility for the student allows for viewing of all data prior to arrival in your district.
Massachusetts Department of Elementary and Secondary Education
85
Student Profile Report
Massachusetts Department of Elementary and Secondary Education
86
Accountability Plans in 2015 Schools administering MCAS will be
classified into a level as usual, and will not be “held harmless.”
Schools administering PARCC will have their 2015 accountability and assistance level “held harmless” (i.e., the level will stay the same or improve from 2014, but cannot decline).
Massachusetts Department of Elementary and Secondary Education
87
Accountability Plans in 2015 – Continued
Accountability levels will not be calculated until PARCC results are available. School percentiles for all MCAS and PARCC
schools will be calculated after PARCC results are available.
PARCC results are not expected to be final until November or December 2015.
For percentile purposes, results from the two assessments will be linked based on large representative samples.
2015 results will be excluded from percentile calculations in future years.
Massachusetts Department of Elementary and Secondary Education
88MCAS Grade 3 PARCC Grade 3 (simulated)
0
20
40
60
80
100
120
Equipercentile Linking for Percentile Calculations
Level 1 Level 2 Level 3 Level 4 Level 5
~260 (Adv)
~240 (100 CPI)~230 (75 CPI)~220 (50 CPI)~210 (25 CPI)
31% Adv
36% Prof
22% NI
11% W
Representative Sample
Representative Sample
%
Massachusetts Department of Elementary and Secondary Education
89MCAS Grade 3 PARCC Grade 40
20
40
60
80
100
120
Proposed Transitional Student Growth Percentiles (TSGPs) for Students Taking PARCC
Level 1 Level 2 Level 3 Level 4 Level 5
99th
1st
50th
100s of students scoring ~248
Representative Sample
%
Massachusetts Department of Elementary and Secondary Education
90
Breakdown of Assessment Choice by Race Grades 3–8 only
7%5%
17%
3%<1%<1%
68%
MCAS Schools
Asian
Black
Hispanic
Mixed
Native Am
Pac Islander
White
6%
11%
17%
3%<1%<1
%
63%
PARCC Schools
Massachusetts Department of Elementary and Secondary Education
91
Assessment Choice by MCAS Achievement Level – ELA Grades 3–8 only
Massachusetts Department of Elementary and Secondary Education
92
Assessment Choice by MCAS Achievement Level – Mathematics Grades 3–8 only
Questions & Answers
If you are leaving now, please fax your completed Evaluation Forms posted at (www.doe.mass.edu/mcas/conferencecall) to 781-338-3630.
Thank you for participating.
Additional Information
andOrientation for New Principals
Additional Accommodations Information
Massachusetts Department of Elementary and Secondary Education
97
Selecting Appropriate Accommodations for Instruction
Adults who work with the student: Gather information on student’s learning
style and preferences. Look at student’s classroom
performance, not just the type of disability.
Try out prospective accommodations during instruction.
Evaluate instructional accommodations and modify as needed.
Massachusetts Department of Elementary and Secondary Education
98
Designating Accommodations for Assessment
Team bases the selection of test accommodations on those used successfully during instruction.
For each subject, determine whether the accommodation is appropriate and allowed for MCAS testing.
Develop/amend IEP or 504 plan, listing instructional and assessment accommodations separately.
Accommodations must be provided/offered if listed in IEP (signed by parent/guardian) or in 504 plan.
Evaluate the effectiveness of test accommodations.
Additional Details on Test Administration
Massachusetts Department of Elementary and Secondary Education
100
Additional Information
Forms Materials Summary PCPA Internal tracking form
Completing student information on answer booklet covers
Return shipping instructions Brockton High School video
Massachusetts Department of Elementary and Secondary Education
101
Materials SummaryBefore testing, compare
“Qty Shipped” to
“Qty Received”
After testing, compare
“Qty Received” to
“Qty Returned”
Then sign and date
Massachusetts Department of Elementary and Secondary Education
102
PCPA “Materials Received” Section
Massachusetts Department of Elementary and Secondary Education
103
PCPA “After Testing” Sections
Massachusetts Department of Elementary and Secondary Education
104
The principal must sign the PCPA.
Massachusetts Department of Elementary and Secondary Education
105
Internal Tracking Forms Used to determine chain of custody of
materials See samples in PAM (pages 121 and 122)
Massachusetts Department of Elementary and Secondary Education
106
School-created Internal Tracking Forms
Include the following components: The specific count of materials at the time
of distribution The specific count of materials at the time
of return Signature areas for the test administrator
and the principal or test coordinator to sign the form
Massachusetts Department of Elementary and Secondary Education
107
Student ID Labels and SIMS
Student ID Labels based on October SIMS Use a label even if there is some incorrect
information as long as the SASID on the label is correct.
Correct the student’s name or date of birth in the next SIMS submission (March or June) by the district SIMS contact (see PAM page ii for instructions on how to find yours).
Massachusetts Department of Elementary and Secondary Education
108
Completing Student Information
If a student has a label, fill in the following information on the front cover: School name School district Student’s name (Write in the name, but no need
to fill in the circles below.)
If no label, fill in all the information on the front cover and fill in corresponding circles.
See sample front covers of a student answer booklet in the PAM on pages 128 and 129.
Massachusetts Department of Elementary and Secondary Education
109
What to fill in on the answer booklet front cover if a student does NOT have a label
Massachusetts Department of Elementary and Secondary Education
110
Returning Answer Booklets – Three Envelopes Return Envelope
Used/assigned standard answer booklets (ABs)
Special Handling Envelope Typed Responses inserted in ABs Large-print ABs with transcribed standard
AB
Void Envelope ABs that were assigned to students but that
should not be scored Fill in “VOID” circle on back cover of the AB.
Massachusetts Department of Elementary and Secondary Education
111
Pack Return Shipments Use the diagrams in the PAM to pack scorable
and nonscorable shipments. ELA instructions — pages 50–53
Mathematics and STE instructions — pages 69–71
One School’s Perspective on Test AdministrationBrockton High Schoolwww.youtube.com/watch?feature=player_embedded&v=zrpUTFGyUDw
Massachusetts Department of Elementary and Secondary Education
113
Organizing Test Administration(Courtesy of Brockton High School)
1. Preparation in advance of materials arriving at the school
2. Preparation of test administrators3. Preparation of students4. Maintaining security within each
testing room5. Collection and accountability of
materials
Questions & AnswersPlease fax your completed Evaluation Forms posted at (www.doe.mass.edu/mcas/conferencecall) to 781-338-3630.
Thank you for participating.
top related