Winter 2012End-of-Course Assessments

Technology Coordinator Training MaterialsAlgebra 1 EOC AssessmentBiology 1 EOC AssessmentGeometry EOC Assessment

1

Overview

• These training materials are based on the 2012-2013 End-of-Course Assessments Test Administration Manual and are available at www.FLAssessments.com/EOC.

2

OverviewThese training materials highlight important information for computer-based test administrations and the use of paper-based accommodations. Not all information from the test administration manual is included in this presentation, so school staff must read and familiarize themselves with all information in the manual, in addition to using these training materials.

3

Manual

4

One manual (2012-2013 EOC Manual) is provided for the Winter 2012, Spring 2013, and Summer 2013 EOC assessments administrations. Instructions for computer-based (CBT), paper-based (PBT), and accommodated form administrations are included in this manual.

EOC Test AdministrationScheduleScheduling• The Winter EOC test administration window is

November 28–December 19, 2012.

• Subjects must be tested in the following order: – Biology 1 – November 28 – December 5, 2012– Algebra 1 – December 5 – December 12, 2012– Geometry – December 12 – December 19, 2012

• All testing for a single subject must be completed in a district before testing for the next subject may begin.

5

EOC Test AdministrationScheduleScheduling• Since the testing window allows for multiple

test sessions to be scheduled throughout the week, schools may reassign absent students to an existing session scheduled later in the week rather than creating separate make-up sessions.

6

EOC Test AdministrationScheduleTesting Duration• Each Algebra 1, Biology 1, and Geometry EOC

Assessment will be administered in one 160-minute session with a scheduled 10-minute break after 80 minutes. Students are not allowed to talk during the break. Individual restroom breaks are permitted as needed.

• Any student who has not completed the test by the end of the allotted time may continue working; however, testing must be completed within one school day.

• Students may be dismissed from the testing room after the 10-minute break as they complete testing. However, no special incentives should be given to students to encourage them to finish early.

7

What’s New for 2012-2013Testing Rules Acknowledgment• All EOC assessments include a Testing Rules

Acknowledgment that reads, “I understand the testing rules that were just read to me. If I do not follow these rules, my test score may be invalidated.”

• Prior to testing, students must acknowledge the testing rules that the test administrator reads to them by checking a box (in TestNav) or clicking a circle (in TestHear) next to the statement. Students taking a paper-based test will sign below the acknowledgment.

8

What’s New for 2012-2013Electronic Practice Assessment Tools

(ePATs)• The computer-based practice tests, also called Electronic

Practice Assessment Tools or ePATs, and scripts for administering ePATs are posted separately at www.FLAssessments.com/ePATs for school staff, as well as students and their parents/guardians, to access at their convenience. Students should be made aware that they can access ePATs on their own at this location. The ePAT scripts are no longer included in the test administration manual.

• Schools must administer the appropriate practice test(s) to all students to be tested using the ePAT scripts; however, if a student has previously participated in an ePAT for the subject test he or she will take, the student is not required to participate in an ePAT session.

9

What’s New for 2012-2013Technology Coordinator Guide• Information and instructions for technology

coordinators to follow before, during, and after testing are now provided in a separate online Technology Coordinator Guide posted at www.FLAssessments.com/EOC.

• Technology coordinators must familiarize themselves with all information in this guide prior to the beginning of test administration. Test assessment coordinators must ensure that technology coordinators are also familiar with all test security policies and procedures described in the 2012-2013 EOC manual.

10

What’s New for 2012-2013To Be Scored Materials• Due to the amount of time needed to process TO BE SCORED

paper-based test materials, these materials must be returned for scoring on an accelerated schedule that will be announced prior to each administration.

• Student results for paper-based tests returned after the established pickup dates will be included in late reporting.

• If it is not feasible to return materials according to established pickup schedules, school staff may transcribe student responses into CBT forms prior to the end of the administration window and return the test materials with other NOT TO BE SCORED materials.

• CBT transcription instructions will be distributed by FDOE prior to each administration.

11

What’s New for 2012-2013TestHear Software Update• A new version of TestHear was released prior to the

Fall 2012 Retake administration. • Schools that downloaded this updated version of

TestHear do not need to download it again for the Winter EOC administration; however, any schools that did not administer TestHear accommodated forms of the Fall 2012 Retakes will need to download and install the newest version of TestHear prior to administering an accommodated form of any EOC assessment.

• The newest version of TestHear is available at www.FLAssessments.com/downloads.

12

What’s New for 2012-2013Reference Sheets and Periodic Tables• The reference sheet for the Algebra 1 and Geometry EOC

Assessments and the periodic table for the Biology 1 EOC Assessment are provided in an online format only for computer-based testing.

• Schools must provide hardcopy reference sheets or periodic tables to students. Any hardcopy reference sheets or periodic tables must be photocopies of the reference sheet and periodic table in Appendix E of the 2012-2013 EOC Manual (also available at www.FLAssessments.com/EOC).

• Check each copy before distributing to students and follow the instructions in the administration scripts.

• Reference sheets and periodic tables for students with paper-based accommodations are packaged with test materials, and should be distributed to students as indicated in the administration scripts. 13

What’s New for 2012-2013Hand-Held Calculators (Algebra 1 and

Biology 1)• The Algebra 1 and Biology 1 EOC Assessments

include a four-function calculator tool in TestNav only.

• TestHear does not have a calculator tool within the computer-based test (CBT) platform. Students taking an accommodated CBT form of the Algebra 1 or Biology 1 EOC Assessment using TestHear must be provided with a handheld four-function calculator to use during the test, as indicated in the administration script.

14

What’s New for 2012-2013Hand-Held Calculators (Geometry)• The Geometry EOC Assessment includes a scientific

calculator tool in TestNav only. FDOE does not provide handheld scientific calculators for students testing with non-accommodated forms; however, districts may allow students to use handheld scientific calculators, as long as the calculators are included in the approved list of scientific calculators in this manual. The TestHear Geometry EOC Assessment does not include a scientific calculator tool. Handheld scientific calculators will be provided by FDOE for students taking the Geometry EOC Assessment using TestHear accommodated CBT forms.

15

What’s New for 2012-2013Chain of Custody Form• Schools are required to maintain a Test Materials

Chain of Custody Form posted at www.FLAssessments.com/EOC and located in Appendix E.

• Schools must record accurate information on the revised form, including the dates activities are completed, the names of the persons performing activities involving the materials, and information about the locked storage room.

• Schools must retain electronic or hard copies of completed forms for their files after materials are packaged for pickup and email or return the originals to the district assessment coordinator. Due January 7, 2013 16

Reminders• Inappropriate actions by school or district

personnel before, during, or after test administration may result in consequences including test invalidations and/or loss of teaching certification.

• School assessment coordinators must ensure that all school administrators, school assessment coordinators, technology coordinators, test administrators, and proctors receive adequate training prior to test administration.

• All personnel involved in test administration must read and sign a Florida EOC Administration and Security Agreement, provided in Appendix E, and test administrators must sign a Test Administrator Prohibited Activities Agreement, also provided in Appendix E. 17

Reminders• Students may not have any electronic devices

except a four-function calculator at their desks, in their pockets, or anywhere they can reach them during testing, even if they are turned off or they do not use them.

• If a student is found to be in possession of ANY electronic device(s) during testing OR during a break (e.g., restroom breaks, lunch), his or her test must be invalidated in order to successfully enforce this policy.

• Students and parents/guardians must be made aware of this policy prior to testing. 18

Reminders• If a student begins a session and leaves campus

without finishing (due to an appointment, illness, etc.), he or she will NOT be allowed to complete that session.

• No exceptions will be made once the student leaves the school’s campus, so parents/guardians and students must be made aware of this policy.

• If you have concerns about a student, you should not allow the student to begin. Instead, arrange to administer the test to that student in a different test session or on a make-up day.

19

Reminders• The following resources for this administration can

be found at www.FLAssessments.com/EOC: D Test administration manualD Technology coordinator guideD Student tutorialsD Forms to report test irregularities/security breaches and missing materialsD Training materialsD Comment formsD Blank Administration Record/Security ChecklistD Security LogD Test Administrator Prohibited Activities AgreementD Test Materials Chain of Custody FormD Florida EOC Test Administration and Security AgreementD Materials Return ListsD Braille ScriptsD Reference sheet and periodic tableD Parent/guardian letters

20

RemindersSeating Charts• Test administrators are required to maintain an

accurate seating chart for each group of students in their rooms during testing.

• All seating charts must indicate the front and back of the room, as well as the direction students are facing.

• Generic seating chart available on the Research, Evaluation & Accountability Intranet. Can only use this seating chart.

• If students are moved to a different location or

there is a change in the seating configuration during testing, a new seating chart must be created and maintained.

21

RemindersTest Administrators• ALL test administrators must be certified educators.• Test administrators are required to sign a Test

Administrator Prohibited Activities Agreement in addition to a Security Agreement. Test administrators must record their certification numbers on this document. Certification numbers available on the ODMS employee ID Report.

• The Florida EOC Test Administration and Security Agreement and the Test Administrator Prohibited Activities Agreement may be copied together so that double-sided, single-page copies can be distributed to test administrators.

• School assessment coordinators must file the signed forms with their signed security agreements.

22

RemindersVirtual School Students• Districts and schools must make arrangements to

test Florida Virtual School (FLVS) Full-Time public school students, as well as other virtual program students, per Section 1002.45(6)b, Florida Statutes (F.S.).

23

Student Tutorials

Student Tutorials• Student tutorials are available at

www.FLAssessments.com/StudentTutorials.

• These tutorials walk students through the different TestNav features they will encounter during testing, including item types, tools, and exiting/submitting a test.

24

Glossary of Terms

PearsonAccess – www.pearsonaccess.com/fl • A website used for almost all test preparation (e.g., PreID),

setup, administration, and reporting tasks.• Correct test administration must be selected each time you

log in.• Requires a username and password.• Link to support materials:

www.FLAssessments.com/EOC • PearsonAccess will timeout after 14 minutes of

inactivity.

25

Glossary of Terms

• Accessed from the Training Center tab on PearsonAccess home page.

• Provides an opportunity toD practice PearsonAccess tasksD manage the Infrastructure

Trial in preparation for testing• Requires a username and

password.

26

PearsonAccess Training Center

Glossary of Terms

TestNav 6.9 (TestNav)• Platform for Florida’s

FCAT/FCAT 2.0/EOC computer-based statewide assessments.

• Software application installed either on a file server or on each computer that will be used for testing.

27

Glossary of Terms

TestHear• Platform used to deliver accommodated forms (e.g.,

large print, zoom, color contrast, screen reader, assistive devices) for Florida’s FCAT/FCAT 2.0/EOC computer-based statewide assessments.

• Software application installed on each computer that will be used to test students who require computer-based accommodated forms. Email Veronica for instructions on how to download.

• TestHear will operate on Windows PC workstations and on Macintosh workstations that have Mac OS 10.5 or later installed and are running Windows (e.g., via Boot Camp).

28

Glossary of Terms

ePAT• Electronic Practice Assessment Tool• Provides students an opportunity to practice using the

computer-based platform prior to testing. • Available for download at

www.FLAssessments.com/ePATs. • Download ePAT launcher separately from practice test

content.• Accommodated ePATs are also available. Launcher is

bundled with the practice test content for accommodated forms.

• Scripts and instructions for downloading ePATs are under the Resources tab.

• Please remember that ePATs scripts for TestNav and TestHear have been removed from the manual and are posted to www.FLAssessments.com/ePATs under the Resources tab.

29

Pearson Support and PearsonAccessAppendix C in the 2012-2013 EOC Manual provides the following information:• PearsonAccess

DUser accountsDBrowser requirementsDLogging in for the first timeDResetting passwords

• Training CenterDTest Setup Exercise

30

Students to be TestedAlgebra 1The following students will take the Winter 2012 Algebra 1 EOC Assessment:• All students who are enrolled in and completing one of the

following courses:– Algebra 1 – 1200310– Algebra 1 Honors – 1200320– Algebra 1-B – 1200380– Pre-AICE Mathematics 1 – 1209810– IB Middle Years Program/Algebra 1 Honors – 1200390– Algebra 1 for Credit Recovery – 1200315– Algebra 1B for Credit Recovery - 1200385 31

Students to be TestedAlgebra 1 (cont.)

The following students are eligible to participate in the Winter 2012 Algebra 1 EOC Assessment administration:• Students who need to earn a passing score for course

credit• Students who entered 9th grade in the 2010–11 school

year– who have not yet taken the assessment to be averaged as 30% of

their course grade – who are in grade forgiveness programs and wish to retake the

assessment to improve their course grade• Students in a credit acceleration program (CAP) who wish

to take the assessment to earn course credit32

Students to be TestedBiology 1The following students will take the Winter 2012 Biology 1 EOC Assessment:• All students enrolled in and completing one of the following courses:

– Biology 1 – 2000310– Biology 1 Honors – 2000320– Pre-AICE Biology – 2000322– Biology Technology – 2000430– Biology 1 PreIB – 2000800– IB Middle Years Program Biology Honors – 2000850– Integrated Science 3 – 2002440– Integrated Science 3 Honors – 2002450– Biology 1 for Credit Recovery – 2000315– Integrated Science 3 for Credit Recovery - 2002445– AP Biology – 2000340 (if taken to satisfy the high school Biology 1 graduation requirement)

This course was omitted from the list in the manual. 33

Students to be Tested

Biology 1 (cont.)

The following students are eligible to participate in the Winter 2012 Biology 1 EOC Assessment administration:• Students who entered 9th grade in the 2011–12 school

year– who have not yet taken the assessment to be averaged as 30% of

their course grade – who are in grade forgiveness programs and wish to retake the

assessment to improve their course grade• Students in a credit acceleration program (CAP) who wish

to take the assessment to earn course credit34

Students to be TestedGeometry

The following students will take the Winter 2012 Geometry EOC Assessment:• All students enrolled in and completing one of the

following courses:– Geometry – 1206310– Geometry Honors – 1206320– IB Middle Years Program Geometry Honors – 1206810– Pre-AICE Mathematics 2 – 1209820– Geometry for Credit Recovery - 1206315

35

Students to be TestedGeometry (cont.)

The following students are eligible to participate in the Winter 2012 Geometry EOC Assessment administration:• Students who entered 9th grade in the 2011–12 school

year– who have not yet taken the assessment to be averaged as 30% of

their course grade – who are in grade forgiveness programs and wish to retake the

assessment to improve their course grade• Students in a credit acceleration program (CAP) who wish

to take the assessment to earn course credit36

Students to be Tested

Special Program StudentsMake arrangements to test special program students (Home Education, Virtual School, McKay Scholarship, FTC Scholarship).

English Language Learners (ELLs)All ELLs who complete the appropriate courses are expected to participate in EOC assessments no matter how long these students have been receiving services.

37

Students to be Tested

Students with Disabilities• All students with disabilities participate in the statewide

assessment program by taking one of the following: D EOC assessment without accommodations,D EOC assessment with accommodations, orD Florida Alternate Assessment.

• All determinations regarding participation in the statewide assessment program must be documented in the student’s IEP or Section 504 plan.

• See Appendix A of the manual for information regarding accommodations. 38

Test Invalidation• A test MUST be invalidated if either of the following circumstances

occurs:D A student has an electronic device during testingD A student is cheating during testingD A student is given an accommodation not allowed on EOC assessmentsD A student is given an accommodation not indicated on the student’s IEP, Section 504 plan, or ELL plan

D An error occurs in test administration or procedures that could compromise the validity of test results

D A student is given unauthorized help during testing

• A test MAY be invalidated if one of the following circumstances occurs:D A student becomes ill and is unable to finishD A student is not allowed the correct amount of timeD A student was not provided an allowable accommodation indicated on the student’s IEP, Section 504 plan, or ELL plan

D A disruption occurs during testing (e.g., severe weather)D A student is disruptive during testing 39

Test Invalidation• Remember that the purpose of invalidation is to

identify when the validity of test results has been compromised. Contact Angela, Nereida or Veronica as soon as possible to confirm the invalidation.

• More information about test invalidation and instructions for how to invalidate tests may be found on pages 20-21 and 121-122 of the 2012-2013 EOC Manual.

40

Technology CoordinatorBefore, During, and After

Testing

41

Technology Coordinator Before TestingChecklist Read the 2012–2013 End-of-Course Assessments Technology Coordinator

Guide and relevant portions of the test administration manual. Read the Test Administration Policies and Procedures and sign the Florida

EOC Test Administration and Security Agreement. Ensure all workstations meet the minimum requirements posted at

www.FLAssessments.com/MinimumSpecs. Confirm TestNav 6.9 software has been installed on all computers to be

used for testing the night before testing begins and restart computers to ensure all policies have been accepted.

Install TestHear on all computers to be used for testing students requiring accommodated CBT forms. Email Veronica for District IT detailed instructions.

Ensure all student workstations have successfully loaded the Infrastructure Trial.

Meet with the school assessment coordinator to discuss the administration of the computer-based test, to walk through the test administration procedures, and to discuss plans for handling possible technical interruptions during testing. 42

Technology Coordinator Before TestingChecklist

Evaluate the testing locations in the school to ensure availability of sufficient electrical outlets and network jacks.

Ensure appropriate security protocols are used. Ensure the school has a high-speed connection to the Internet

AND the connection is not over-allocated.

43

Technology Coordinator Before TestingChecklist Ensure a printer is available for printing the Student

Authorization Tickets and Session Rosters (color is not required).

Analyze the network to determine whether network bottlenecks exist.

Confirm that student computers and the Proctor Caching computer have not been updated with any additional software and will not be updated before testing begins.

44

Technology Coordinator Before TestingChecklist Verify that the performance of your Internet connection is

consistent with expected levels of performance for computer-based testing.

Verify, as needed, that no high bandwidth network activity other than computer-based testing will be occurring during the computer-based testing window.

45

Technology Coordinator Before TestingChecklist Ensure that each computer station is equipped with a

keyboard and mouse (or other pointing device).

Alert your school to the dates and times for computer-based testing and require students and teachers not testing to refrain from using any streaming media or other high-bandwidth applications while students are testing.

46

Technology Coordinator Before TestingChecklist Ensure that test administrators are familiar with how to access

TestNav and TestHear software from student workstations and how to access the student comment forms. The student comment form will be available at: www.FLAssessments.com/EOCStudentCommentForm.

47

Technology Coordinator Before TestingMonitor Display and Shading

48

• To ensure students will see all of the content in the test, students are asked to confirm that they can see the 15% shading on the Test Group Code screen when they first log into the test.

• If students cannot see the shading, they must exit the test and their monitor settings must be adjusted.

• General instructions for adjusting monitor settings are provided in the 2012-2013 End-of-Course Assessments Technology Coordinator Guide. The steps for changing contrast and brightness settings will vary depending on the manufacturer and model of each individual monitor.

Technology Coordinator Before TestingTestNav• Installation instructions are provided in the 2012-

2013 EOC Technology Coordinator Guide.• Once TestNav has been properly installed and

tested, it should continue to run successfully on student workstations through the test administration, as long as no incompatible software updates are made.

49

Technology Coordinator Before TestingTestHear ePATs

• Students are required to participate in a practice test using the ePAT with the same accommodations that will be provided to them on the operational assessment.

• The accommodated ePATs must be downloaded and installed on the computer workstation that will be used for the practice test.

• TestHear ePATs will only operate on Windows PC workstations and on Macintosh workstations that have Mac OS 10.5 or later installed and are running Windows (e.g., via Boot Camp). TestHear ePATs will not work on Mac OS 10.4 or on Macs that cannot also run Windows.

• Instructions for installing and running TestHear ePATs are provided in the 2013-2013 End-of-Course Assessments Technology Coordinator Guide. 50

Technology Coordinator Before TestingTestHear• TestHear must be installed locally on all computers that

will be used by students requiring accommodated CBT forms (e.g., large print, zoom, screen reader, color contrast, assistive devices).

• Instructions for downloading and installing TestHear are provided in the 2013-2013 End-of-Course Assessments Technology Coordinator Guide.

• TestHear will only operate on Windows PC workstations and on Macintosh workstations that have Mac OS 10.5 or later installed and are running Windows (e.g., via Boot Camp). TestHear will not work on Mac OS 10.4 or on Macs that cannot also run Windows.

• TestHear does not resize the screen resolution, so monitors should be adjusted to 1024 x 768 prior to testing.

51

Technology Coordinator During TestingChecklist Adjust monitors that are not correctly displaying test

items with shading. Monitor each testing room to ensure that there are no

technical issues. Be available during testing to answer questions from test

administrators.

52

Technology Coordinator After TestingChecklist

Complete the Technology Coordinator Comment Form at www.FLAssessments.com/EOC.

53