west virginia department of education office of assessment and research 304-558-2546

WV General Summative Assessment2015 Test Administrator

(Examiner) TrainingWest Virginia Department of Education

Office of Assessment and Research304-558-2546

MODULE 1:

EXAMINER CRITERIA

WV General Summative Assessmenttraining is required

annually for all personnel with access to secure

materials

TITLE 126LEGISLATIVE RULE

BOARD OF EDUCATION

SERIES 14WEST VIRGINIA MEASURES OF ACADEMIC PROGRESS (2340)

§126-14-1. General. 1.1. Scope. -- This policy establishes rules governing the administration and operation of the West Virginia Measures of Academic Progress.

1.2. Authority. -- West Virginia Constitution, Article XII, §2; W. Va. Code §§18-2E-1, 18-2E-1a, 18-2E-2, 18-2-5, 18-2E-8(c)(1), 18A-3-6, and Public Law 107-110, Elementary and Secondary Education Act (ESEA).

1.3. Filing Date. -- November 13, 2014. 1.4. Effective Date. -- December 15, 2014.

3.20. Examiner. The person who administers the test. 3.20.a. must be a currently employed educator and/or an approved employee of the state,

district or RESA, or a currently employed educator of a nonpublic school; 3.20.a.1 All nonpublic school educators must be approved by the WVDE. 3.20.b. must hold a valid West Virginia teaching license or certification granted by the Office of Professional Preparation; 3.20.c. must have been trained and must have on file a signed Examiner’s/Scribe’s Secure Materials and Test Procedures Agreement for the purpose of administering or assisting with the administration of an assessment included in the WV-MAP and pilot tests and field tests sanctioned by WVDE; 3.20.d. may be a substitute teacher or an aide serving as an examiner for special needs students when instructionally assigned; 3.20.d.1. All aides must be providing services to the student during instruction and must be approved by the WVDE.

Examiners

Examiners — WV Policy 2340 p.3

► 3.20.a. must be a currently employed educator and/or an approved employee of the state, district or RESA, or a currently employed educator of a nonpublic school;♦ 3.20.a.1 All nonpublic school

educators must be approved by the WVDE.


► 3.20.b. must hold a valid West Virginia teaching license or certification granted by the Office of Professional Preparation;


► 3.20.c. must have been trained and must have on file a signed Examiner’s/Scribe’s Secure Materials and Test Procedures Agreement for the purpose of administering or assisting with the administration of an assessment included in the WV-MAP and pilot tests and field tests sanctioned by WVDE;


► 3.20.d. may be a substitute teacher or an aide serving as an examiner for special needs students when instructionally assigned;♦ 3.20.d.1. All aides

must be providing services to the student during instruction and must be approved by the WVDE.


► 3.20.e. may not be a student teacher; unless he or she is a teacher in residence.♦ 3.20.e.1 Teacher in Residence.

An intensively supervised and mentored residency program for prospective teachers during their senior year that refines professional practice skills and helps them gain the teaching experience needed to demonstrate competence as a prerequisite to certification to teach in West Virginia public schools. (W. Va. Code §18A-3-1.)

Examiners — WV Policy 2340 p.3-4

► 3.20.f. may not administer WV-MAP assessments to family members.

♦ 3.20.f.1 Decisions

regarding other potential

conflicts of interests

involving test administration

will be the responsibility of

the district coordinators.

MODULE 2:

BEFORE TEST ADMINISTRATION

Before Test Administration

126CSR14

Appendix AThe WVBE Testing Code of Ethics addresses special concerns regarding appropriate professional practices within the West Virginia Measures of Academic Progress (WV-MAP), as well as appropriate professional conduct. The WVBE Testing Code of Ethics supplements the practices and procedures set forth by W. Va.126CSR14, WVBE Policy 2340.

ETHICAL TESTING PRACTICES

Test Security

1. District school personnel shall establish and implement procedures to ensure maximum test security and limit access of secure materials to applicable district/school personnel.

2. Apart from the scheduled test administration to students, secure test materials shall be stored in a locked and secured location by the district test coordinator in accordance with the test administration guidelines of each assessment.

3. The district test coordinator shall be responsible for the test booklets/answer sheets received by the district and shall maintain a record of the booklets sent to each school in accordance to the test administration guidelines of each assessment.

TrainingExaminers must be trained on the Testing Code of Ethics and Ethical Testing Practices.


READ EXAMINER’S / SCRIBE’S SECURE MATERIALS & TEST PROCEDURES AGREEMENT


Training

Policy 2340 – pg. 32

1. I will not keep, copy, reproduce, paraphrase, distribute, or review/discuss secure test materials and/or test items.2. I will not use test items, test booklets/answer sheets, or any of the information contained in an assessment to review/prepare students for a test.3. I will not allow access to the test materials or answer keys to any student or any other person not so authorized by the principal.4. I will not alter students’ responses in any manner (indicate answers, point out rationale, prompt, etc.).5. I will not disclose individual student test scores or test performance data to unauthorized persons as set forth in FERPA, the Student Data Accessibility, Transparency, and Accountability Act, found in W. Va. Code §18-2-5h, Policy 4350, the WVDE Data Access and Management Guidance, and Policy 2340.

6. If serving as an examiner for APTA, I will adhere to the prompting hierarchies and document all applicable assistive technology to ensure the accuracy of student responses.

7. If serving as an examiner for students with IEPs, SAT Plans, Section 504 Plans, or ELL Assessment Participation Forms, I will adhere to the accommodations listed therein and monitor using the appropriate process (WV 326).

8. If serving as an examiner for an online assessment, I will not offer technical (accessing dictionary, grammar checks, formatting functions, etc.) assistance that might alter the accuracy of student responses in the web-based assessment before, during, or after the administration of the test.

9. I have read Policy 2340. 10. I understand that if a breach of test security or copyright infringement occurs as a direct result of my actions, my license/certification may be suspended or revoked, or I may be suspended, terminated, or have other action taken.

READ THE EXAMINER’S / SCRIBE’S SECURE MATERIALS AND TEST PROCEDURES AGREEMENT


Training


After they receive training, Examiners must sign the Verification of Training, Appendix I.

This form and a copy are kept on file by the BLC and CTC.

Training


Training

Study the Test Administration Manual


Also —Review the Smarter Balanced Usability, Accessibility, and Accommodations Guidelines.

Additionally, TAs should complete the Test Administrator certification course. All of these resources are available on the West Virginia Assessments portal at http://wv.portal.airast.org.


Study the Manual

►completing WV Summative Assessments administration training (see section 1.4 Training) and reviewing all Smarter Balanced and state policy and administration documents prior to administering any WV Summative assessments;

►viewing student information prior to testing to ensure that the correct student receives the proper test with the appropriate supports. TAs should report any potential data errors to SCs and DCs as appropriate;

►administering the WV Summative Assessments; and

►reporting all potential test security incidents to their SC and DC in a manner consistent with Smarter Balanced, state, and district policies.

Test Administrators are responsible for: For a checklist of activities for TAs to complete, see

Appendix L


Preparing Students

The best preparation for students are the practice and training tests.


The Training TestsThe Training Tests are specifically designed to help students and teachers become familiar with the software interface and the basic format of the Smarter Balanced assessment. These tests will allow students to become comfortable with the various tools and supports available for the field test.

Since the goal of the Training Tests is for students to be at ease with the program, the tests themselves are short and are not grade specific. Students will benefit from taking the Training Tests before attempting the practice tests and the summative assessment.

Preparing Students


The Practice TestsThese tests, which are accessible to students, parents, teachers and the public, focus on the items and evidence they are trying to elicit.

The Practice Tests are grade specific and include performance tasks. These tests allow students to preview the complete test experience, from navigation, to item types, to content.

Preparing Students


Remind parents that students need proper sleep the night before testing.

Be sure students have a meal or snack before testing.

Do not test students immediately after strenuous exercise.

Preparing Students


NEW! For 2015

Math and science reference sheets will be provided online.

Scratch paper may be distributed to students once they are in the testing room, but it MUST be destroyed as soon as testing is completed EXCEPT

After ELA-PT part 1, scratch paper may be kept SECURELY by TA, and re-distributed to students at the beginning of Part 2 of the PT to use on the Long Write.

Headphones should be provided for all students.

Preparing Materials


CALCULATOR USEPreparing Materials

NEW! For 2015 Items that require/allow calculator use have calculators embedded in the item. At grades 3-5 there are no items that require/allow calculator use. (See WV Portal on calculator use for rationale.)

ONLY students with visual impairments may use special handheld (non-embedded) calculators, such braille or talking calculators. The requirement for the special handheld calculator must be documented on their IEPs. The special calculator may on be used only on the calculator allowed portion of the assessment for the item types described above.

Please note there is NO CALCULATOR USAGE in elementary school – regardless of IEP. Appropriate calculators for middle and high school students will be provided online for student use during the calculator portion of the mathematics test.


Be sure to cover any materials that may provide clues to answers. Reflective surfaces, such as mirrors, that might reflect students’ screens should also be covered.

Preparing the testing room


►Arrange seats to minimize student interaction.

►Assure that desks are clear of all books, papers and other materials.

►Provide proper lighting and ventilation.



►Individual, small group, or different class testing may be provided.

►Adaptive furniture may be provided.

►Special lighting/acoustics (e.g. microphone/speakers) may be provided.

Preparing the testing roomOptions to Standardized Setting



Provide an environment free of distractions such as intercoms, cell/smart phones, pagers, gaming devices and watches with alarms.


To ensure students have a quiet testing environment, free from distraction, place a “Do Not Enter – Testing in Progress” sign on your door.



Remind students to bring a quiet activity to do should they complete their test before others. Have activities ready in case a student forgets to provide his/her own.

Preparing students


Refer to West Virginia Guidelines for Participation in State Assessments — 2014-2015 http://wvde.state.wv.us/oaa/pdf/ParticipationGuidelines.pdf

Providing AccommodationsYour principal/building level coordinator will provide you a list of students needing accommodations along with what those accommodations are.


If you are not sure of proper procedures, ask your principal/building level coordinator! All questions regarding test administration should be answered before testing begins.

Understand Procedures

MODULE 3: TEST ADMINISTRATION

Sequencing/Timing

You must follow the testing schedule determined by your county and school.

See the TAM for suggestions on test order and the approximate amount of time needed for each portion of the assessments.

The WV General Summative Assessment is not timed, but the majority of students are able to finish within a class period.

Any students who need more than the class period to finish must be given extra time.

Students who need significantly more time than others should be grouped together to avoid disruptions.

Monitor students to ensure additional time does not give them the chance to study information on a test already started.

Timing

Follow instructions in the Test Administration Manual.

Follow the script.

Follow instructions for text-to-speech and calculators. See WV Portal for detailed documents.

General Instructions

Assistance to students must be limited to…

► clarifying scripted answers

► showing the correct way to select or input their answers

► showing the correct way to use the tools

Read the scripts verbatim.

General Instructions

Special Options ►Text-to-speech

♦ Please refer to the following documents on the WV Portal> Text-to-speech Use

►Read Aloud►Calculators

♦ Please refer to the following documents on the WV Portal

> Assessment Targets and Calculator Use> Calculator and Multiplication Table

Information

►Scribes may be used for short-term medical conditions.

Accommodations

02/04/2014

Non-EmbeddedBreaks, English Dictionary, Scratch Paper, Thesaurus

EmbeddedBreaks, Calculator, Digital Notepad, English Dictionary, English Glossary, Expandable Passages, Global Notes, Highlighter, Keyboard Navigation, Mark for Review, Math Tools, Spell Check, Strikethrough, Writing Tools, Zoom

Universal Tools

EmbeddedColor Contrast, Masking, Text-to-speech, Translated Test Directions, Translations (Glossary), Translations Stacked), Turn off Any Universal Tools

Designated Supports

Non-EmbeddedBilingual Dictionary, Color Contrast, Color Overlay, Magnification, Read Aloud, Scribe, Separate Setting, Translation (Glossary)

EmbeddedAmerican Sign Language, Braille, Closed Captioning, Text-to-speech

Non-EmbeddedAbacus, Alternate Response Options Calculator, Multiplication Table, Print on Demand, Read Aloud, Scribe, Speech-to-text

Accommodations

For details on Accommodations, please see the WV Participation Guidelines on the WV Portal

Test Security

►Table 5 of the Test Administration Manual (TAM) describes security requirements for the test environment during various stages of testing, including what a student can see, hear, or access (including access via technology).

SECURITY OF THE TEST ENVIRONMENT

Test SecurityIf a test security incident occurs that could affect the integrity of the assessments or the data, the Test Administrator/School Coordinator should follow the steps outlined in the Test Administration Manual —

Section 4.0 Responding to Testing Improprieties, Irregularities, and Breaches AND

Section 5.0 Appeals (as necessary)

Also, review the TIDE User Guide located at http://wv.portal.airast.org.

Improprieties, Irregularities, and Breaches

Type DefinitionImpropriety

An unusual circumstance that has a low impact on the individual or group of students who are testing and has a low risk of potentially affecting student performance on the test, test security, or test validity. These circumstances can be corrected and contained at the local level. An impropriety must be reported to the School Coordinator who should report it to the District Coordinator who will enter it into the appeals module of TIDE if required.

IrregularityAn unusual circumstance that impacts an individual or group of students who are testing and may potentially affect student performance on the test, test security, or test validity. These circumstances can be corrected and contained at the local level and submitted in the online appeals system for resolution. An irregularity must be reported to the School Coordinator who should report it to the District Coordinator who will enter it into the appeals module of TIDE if required.

BreachAn event that poses a threat to the validity of the test. Examples may include such situations as a release of secure materials or a security/system risk. These circumstances have external implications for the Consortium and may result in a Consortium decision to remove the test item(s) from the available secure bank. A breach incident must be immediately reported to the School Coordinator who will report it to the District Coordinator who will enter it into the appeals module of TIDE if required.

Table 6: Definitions for Test Security Incidents

Improprieties, Irregularities, and BreachesTest Administrators (TAs) must ensure that the physical conditions in the testing room meet the criteria for a secure test environment. See Section 3.1 Security of the Test Environment of the TAM for more details.

4.2 Reporting Timelines and Activities

Improprieties are escalated in accordance with state policies and procedures, protocols, and/or guidelines within 24 hours of the incident by individual districts via the Test Security Log and the appeals module of TIDE (if appropriate).

The only security incidents that are reported in the appeals module of TIDE are those that involve a student and test, and that require an action for the test such as to reset, reopen, invalidate, or restore a test that a student was taking at the time of the incident. TIDE does not serve as a log for all incidents.

BreaksThere are recommendations for breaks in the TAM.

► Table 9: Assessment Sequence—ELA ► Table 10: Assessment Sequence—Mathematics

REMEMBER

Maintain test security

measures during

breaks

► After a twenty minute pause student is locked out

♦ Must log back in

♦ Will be returned to last page with unanswered questions OR to

a new page if all items on previous page were answered

♦ MAY NOT review/change any previously answered items, even

if they are marked for review

♦ Highlighted text and notes on the digital notepad will not be

saved when a test is paused

♦ In the event of a technical issue (e.g., power outage or network failure), students will need to log in again upon resuming the

test.

Pauses / Time Outs

Test Timeout (inactivity)► after 30 minutes ► For details see TAM

For details See TAM Appendix E: CAT Pause Rules Scenarios

Pause rules/restrictions are for CAT portion ONLY

Students who finish early should work on a quiet activity.

Quiet activities cannot be related to the content of the test you are giving.

Finishing Early

Take up all calculators and reset to factory defaults.

Instruct students not to discuss test items

Colle

ct fo

r Sh

redd

ing

Collect for

Shredding

After TestingCollect scratch paper for shredding. Shred the scratch paper immediately, EXCEPT for scratch paper from the ELA-PT Part 1. This may be saved, SECURELY, for students’ use in ELA-PT Part 2.

Questions?

Please Ask Your Principal/School Coordinator.

Module 4: After Administration

Measures to Maintain Security

►Be sure all students have logged out of test

►Destroy test materials securely

►Printed test items/passages, including embossed braille printouts, and scratch paper must be collected and inventoried at the end of each test session and then immediately shredded.

♦ See TAM, section 3.2, Secure Handling of Printed Materials, for details.

Documenting Testing Irregularities

►Document Testing Irregularities

♦ Document Testing Irregularities per TAM, section 4.2 Reporting Timelines and Activities

♦ For definitions and details of irregularities please refer to TAM, Section 4, re: Responding to Testing Improprieties, Irregularities, and Breaches

Questions?

Ask Your Principal/Building Level Coordinator

west virginia department of education office of assessment and research 304-558-2546

Documents