south carolina alternate assessment dtc-alt pretest workshop 2014-15 south carolina department of...
TRANSCRIPT
South Carolina Alternate Assessment
DTC-Alt Pretest Workshop 2014-15
South Carolina Department of EducationAmerican Institutes for Research
November 2014
Training Topics
• Review of 2014 Administration Results• SC-Alt 2015 Administration
– Important Testing Procedures– Administration and Scoring Fidelity– Second Rater Administration Update
• SC-Alt Test Administrator Training• New Alternate Assessments• Precode
2
Review of the 2014 Administration
Results
3
Participation
3431 students tested– Increase of 1 student from 2013– 3.4% increase in students with autism– 5.5 % increase in students with mild ID – 1.7% increase in students with LD– 3.3 % decrease in students with moderate ID– 3.2 % decrease in students with severe ID– 9.8 % decrease in students with DD
4
Performance
• ELA 83.5% Proficient (levels 3 and 4) – LD 94.6%– Mild ID 98.4%
• Math 78.6% Proficient (levels 3 and 4)– LD 93%– Mild ID 96.6%
5
One Percent Rule
• 24 districts exceeded the 1% rule– Ranges from 1.2% to 3.2%
6
1% Rule and LD Students
• Most districts 0% of LD students tested with SC-Alt
• One district 8.1% of LD students tested with SC-Alt
• Another district 4.2% of LD students tested with SC-Alt
7
SC-Alt 2015Administration
8
Administration Window
March 2 - April 24Testing materials will arrive in the
districts by February 20
9
Procedural Guidelines
• Test Administration Manual (TAM)
• District Test Coordinator’s Supplement Manual
• Score Report User’s Guide
10
SC-Alt Spring 2015Content to be Assessed
• Science (Elementary and Middle School)
• Social Studies
• Grades 4-8 (all students)
11
for 2015
• SC-Alt Science and Social Studies• 12 tasks
• “Responding Successfully” redefined• Six points instead of three points
• New SC-Alt Test Administrator Fields in Precode
12
Resources
• South Carolina Alternate Assessment Social Studies Instructional and Assessment Guide– South
Carolina Alternate Assessment Social Studies Instructional and Assessment Guide
• South Carolina Alternate Assessment Science Instructional and Assessment Guide– In process
13
SC-Alt Testing Procedures
14
Grade-Band Form Assignments (Elementary and Middle)
• Students are assigned to SC-Alt grade-band forms on the basis of their age as ofSeptember 1, 2014, as pre-coded in the PowerSchool data base.
• For students who do not have a pre-assigned form, refer to the Age and Birth Date Reference Sheet in the 2015 TAM (Appendix B) or on the SCDE website to determine the correct form.
15
Test Security Regulations
SC-Alt is subject to SC Test Security Regulations
– Test books and materials are secure
– Materials must be kept in secure place when not in use
– Test books may not be copied or reproduced
– All Test Administrators and monitors must sign Agreement to Maintain Test Security and Confidentiality
– A copy of the Test Security Regulations is located in Appendix A of the TAM and on the Department website
– Test Security Violations must be reported using the Test Security Violation Action Form in the TAM
16
Secure File Transfer (sFTP)• AIR uses an sFTP site to electronically send secure
materials to the school districts• You will be notified whenever pertinent files or
information are posted on the sFTP site for your access such as: – Second Rater Roster– District Roster of Students Taking SC-Alt– Secure Video Clips for Training– Training Webinar for the District Training – District Data Files– Demographic Correction Forms
17
Packaging of Test Materials
• All test materials for each grade band are bundled into one Test Administrator Kit.
• Test Administrators receive one kit for each grade band that they are assessing.
• Each kit contains a serial number. This number is also included in the ancillary documents packed in the school and district boxes.
18
Test Administrator Kit
• Test Booklets
• Print Manipulatives
• Physical Manipulatives
• Reading Passages
19
Other Items Not Included in the TA Kits
• Test Administrator Security Checklists• Student Rosters• Answer Folders (by grade-band form, color
coded)• Scoring Worksheets• Precoded Bar Code Labels
20
Braille Materials
• Teachers with students who need braille and tactile graphic materials SHOULD use the Braille Order Form in the TAM (Appendix N) to request these materials.– TAs submit the form to the DTC-Alt who forwards it
to AIR.– A list of tasks with braille and/or tactile graphic
materials is in the TAM Appendix Q.– Braille Order Forms are also provided in the district
box.
21
Administration and Scoring Fidelity
• Monitors• Second Raters
22
Monitors• Monitors must be trained
– See TAM pages 6-7 for training requirements
• Observe all assessment sessions and verify the use of proper procedures and authenticity of student responses– Sign the Test Administrator Security Affidavit (TAM
Appendix E)
• Sign Agreement to Maintain Test Security and Confidentiality (TAM Appendix D)– Copies of the agreement will be provided in the
school box 23
Second Rater Procedure• A trained SC-Alt Administrator observes and
independently scores an administration to document administration and scoring fidelity based on a scientific sample.
– All districts are sampled
– Sampling is implemented by teacher and student
– Teachers are sampled according to proportions of students in their district
– Approximately 1/3 of teachers and 10% of students will be sampled
24
Second Rater Selection• Teachers are selected to have a second rater
observe an administration based on the January 2015 Precode file.– Accurate precoding of the SC-Alt Test
Administrator field is important to ensure accurate assignment.
• DTCs-Alt select and assign the second rater to observe the administration.
•Second rater administrations for 2015 will be conducted in social studies only.
25
Second Rater Qualifications
• Must meet the Test Administrator criteria:• Certified teacher
• Administrator (e.g., school administrator, district level special education consultant, or other administrator)
• Related services personnel
• Must participate in District Level Test Administration Training
26
Second Rater TimelineJanuary 29 AIR uploads the roster of all SC-Alt
students and of students selected to have second rater administration to district sFTP sites
January 29-February 20 DTCs-Alt notify AIR Helpdesk of any changes that need to be made
January 30 Second Rater Procedures and Instructions Memorandum to the districts with district training materials
February 20 Second rater kits arrive in district with SC-Alt test materials
27
Second Rater Changes
• Please notify AIR of any changes to the Second Rater roster by Feb. 20.
• If it is necessary to revise your district’s second rater roster, the new test booklets and second rater answer folders will arrive separately from the other test materials.
28
Return Procedures
• Review the DTC-Alt Supplement for return shipping procedures.
• Review the Appendices J and K of the TAM for additional information
29
Return Procedures Helpful Hints
• Make sure all responses have been transferred from the Scoring Worksheet to the Answer Folder.
• Make sure all signatures are on the Test Administrator Security Affidavit.
• Use Student Rosters to verify that all appropriate students were assessed.
• Make sure you have received all TA Kits and that the test booklets and other materials are included. 30
More Helpful Hints• Follow up on any missing materials.
• Review Answer Folders for completeness of coding.
• Do not put sticky notes on answer folders or include other notes about why a student was not tested.
• When a student was not tested, provide documentation on the Students Not Tested Report (Office of Research and Data Management).
31
Clarificationon Non-Valid
Administrations
Students considered “Not Tested”
32
Non-Valid Administrations• Failure to complete Test Administrator
Security Affidavit (all signatures)• Assessment of student with wrong form• Failure to administer all required tasks as
specified in the Directions for Determining the Starting and Concluding Tasks
• Assessment of student beginning with wrong starting task (not following drop back rule if student does not obtain 3 points on the starting task)
• Failure to transfer item scores from the worksheet to the answer folder
33
Test Administrator Training
34
Test Administrator Requirements
• Test Administrators must be trained.
• A Test Administrator must be a certified employee of the district or another individual who meets the criteria specified in the TAM (page 6) and approved by the DTC-Alt.
35
Test Administrator Training• Regional Workshops
– Teachers/Test Administrators who did not administer the SC-Alt in spring 2013 or 2014.
– One additional district representative
• District Level Training– All Teachers/Test Administrators
• Experienced Teachers/Test Administrators who administered SC-Alt in spring 2013 or 2014, and
• Teachers/Test Administrators who attended the regional workshops
– Second raters
36
Regional WorkshopsJanuary 26
January 27
January 28
January 29
January 30
Columbia
Columbia
Greenville
Florence
Charleston
37
District Level Training
• To be conducted by DTC-Alt or Designee
• Training Window- February 2-27
• Approximately two and a half hours
38
Training Materials• Test Administration Manuals (TAMs)
• DTC-Alt Supplement
• Training Tasks
• Participant Sign-in Sheet
• Return Envelope
These materials will be shipped by AIR to arrive in the district by January 30
39
Training Materials (cont.)• Webinar presentation
– Administration procedures– Scoring procedures – Information on downloading the webinar from the your
district’s AIR sFTP site will be provided to DTCs-Alt prior to the training window
• Optional video clips of standards based instruction and test administrations – The video clips will be posted to your district’s sFTP site
for your access
40
Training Materials (cont.)Handouts to Be Downloaded from the SCDE Website
– Training Power Point
– Administration and Scoring Training Acknowledgement Forms
– Agreement to Maintain Test Security and Confidentiality Forms
– Training Evaluation Forms
41
Training Topics• District information and expected communication
procedures
• Procedures for receiving materials
• Importance of immediate review of materials
– Remind TAs to notify the DTC-Alt of missing materials or the need for additional materials
42
Training Topics (cont.)
• Test security regulations– Have the Test Administrators sign the Agreement to
Maintain Test Security
• Use of monitors and any procedures in place in the district for obtaining or assigning monitors
• District second-rater procedures
• Return procedures TAM (Appendices J and K)
43
Training Activities• Administering and Scoring SC-Alt Webinar
– Download from AIR sFTP site
• Scoring Practice– Allow about 15 minutes for teachers to practice in pairs
administering and scoring the sample tasks in the Training Task Booklet
– Facilitate discussion and questions
• Training Videotapes– Examples of actual assessments and instruction linked
to South Carolina State Standards – Download from AIR sFTP site
44
Training
• At the completion of the training have the Test Administrators:
– Sign the Administration and Scoring Training Acknowledgement Form
– Complete the Training Evaluation Form
45
Collect and Maintain in the District
• Agreement to Maintain Test Security and Confidentiality Forms
• Administration and Scoring Training Acknowledgement Forms
• One copy of the Participant Sign-in Sheet
• Scoring Worksheet (destroy after training)
46
Materials to be Returned
Use envelope in training materials shipment to return the following materials to AIR:
• Training Evaluations
• Participant Sign-in Sheets
47
Final Important Dates
• April 24, 2015– Last day of testing
• April 29, 2015– Last day to ship materials to contractor– Shipping the materials on this date
ensures that the materials are received by the contractor on May 1, 2015.
48
New Alternate Assessments
2015
49
New Alternate Assessments
• Alternate ACCESS for English Language Learners (ELLs)
• National Center State Collaborative (NCSC) Alternate Assessment in ELA and Math– Aligned to Common Core State Standards
– Computer delivered
50
Alternate ACCESS
• English Language Proficiency Exam
• ELL students who are eligible for alternate assessment
• Ages commensurate with grades 1-12
• Kindergarten age students take the general ACCESS test
http://www.wida.us/assessment/alternateaccess.aspx
51
Test Dates
February 17- March 30, 2015
52
NCSC Alternate Assessment
• Aligned to the Common Core State Standards in ELA and Math
• Grade level specific
• Online Test Administrator Training
• Computer Delivered
53
NCSC ELA and Math Assessment
Test DatesPilot Test October 20-November 14, 2014
Operational Test March 30- May 14, 2015
54
Purpose of Pilot– Collect data about how students interact with
the items
– Gather information about how the items function
– Examine test administration procedures and conditions
– Evaluate test administration training
– Review item scoring processes and procedures
– Receive input from teachers55
NCSC Instructional Resources
An instructional resources wiki has been created to host materials that educators will need to deliver instruction aligned to the Common Core State Standards (CCSS).
https://wiki.ncscpartners.org/mediawiki/index.php/Main_Page
56
Guidance for IEP Teams on Determining Participation
in theSouth Carolina Alternate
Assessments
• http://ed.sc.gov/agency/programs-services/48/documents/SC-AltParticGuidanceForIEPteams.pdf
57
2014-15SC-Alt Precoding
58
Why Accurate Precoding is So Important
• Precode is used to order and sort test SC-Alt materials and to pre-populate student demographic information.
• Test Administrator’s name determines SC-Alt materials distribution and second rater assignments.– PowerSchool now has fields for the test administrator’s name!
The Home room field is no longer being used for SC-Alt.
• Reduces additional material orders • Reduces errors related to:
– Student demographic coding
– SC-Alt form assignment59
Where to Find the Precode Manual
Precode Training
http://ed.sc.gov/agency/programs-services/46/
60
Importance of the Date of Birth
• The grade level the student tests in is always based on the student’s age as of September 1 of the current school year.
• Focus on the correctness of the date of birth. The state will calculate the age and determine the grade tested. You may use Appendix B in the Precode Manual as a reference sheet to determine the grade the state will assign to the student.
61
Precode Tab in PowerSchool
62
Alternate Assessment EligibilityA new Yes/No field replaces last year’s alternate assessment codes. Select ‘Y’ if the
student is eligible regardless of age or grade designation. (You are no longer
asked to determine the grade. The state will calculate the age and determine the
grade.)
63
Alternate Assessment Test Administrator Name FieldsFor the same test administrator, be consistent across students. Use the same capitalization,
spacing, and punctuation.
64
The new Alternate Assessment Exception field should
be ignored for 2014-15. It will be important for 2015-16.
65
Anne Mruz
803-734-8034
South CarolinaDepartment of Education
Office of Assessment
Suzanne Swaffield
803-734-8274
Jill [email protected]
803-734-804867
