Computer-Based TestingComputer-Based TestingFCAT/FCAT 2.0/EOCFCAT/FCAT 2.0/EOC

Florida Association of MIS

June 12, 2012

Susie Lee, Director of Test Administration, K-12

Bo Elzie, Project Director,Computer-Based Testing

CertificationDepartment of Education

BackgroundBackground The DOE began a certification process for determining CBT

readiness in 2010-2011 using an online tool. All participating schools certified readiness and 500,000 computer-based assessments were successfully administered.

The certification process continued in 2011-2012, and over one million assessments were successfully administered.

The Department created and has maintained a 15 member Computer-Based Testing (CBT) Advisory Committee which meets regularly via conference call to provide input on all readiness activities for computer-based testing. The committee is comprised of district assessment, MIS, and technology staff.

The Department also maintains an ongoing cross-division communications team that meets regularly to discuss and take action on CBT issues.

 

Background: 4 Certifications in Background: 4 Certifications in 2011-20122011-2012Fall CertificationFCAT Mathematics RetakesFCAT Reading Retakes (CBT optional)FCAT 2.0 Reading RetakesWinter Certification December/January Algebra 1 EOC AssessmentSpring Certification (FCAT and FCAT 2.0)FCAT Mathematics RetakesFCAT Reading Retakes (CBT optional)FCAT 2.0 Reading RetakesGrade 6 FCAT 2.0 ReadingGrade 10 FCAT 2.0 ReadingSpring Certification (EOCs)Algebra 1Biology 1GeometryU.S. History field Test (sampled high schools only)

Spring 2012FCAT/FCAT 2.0

◦FCAT 2.0 Reading Retake: 51,539◦FCAT Mathematics Retake: 32,525◦FCAT Reading Retake: 11,307 ◦FCAT 2.0 Grade 6 Reading: 200,109 ◦FCAT 2.0 Grade 10 Reading: 185,668

◦Total: 481,148

Spring 2012EOC Assessments

◦Algebra 1: 202,146◦Biology 1: 190,687◦Geometry: 188,362◦U.S. History: 54,883◦Total: 636,078

Total Number of Spring CBT Assessments: 1,117,226

Most Common IssuesStudent submits test or is marked

complete early (requires FDOE action)

Student tests using wrong authorization ticket

Technical problems resulting in students getting kicked out of a test◦Local issues – in almost all cases,

problems discovered and resolved quickly

◦Other issues – bad weather, internet service went down, etc.

Summer 2012Algebra 1: July 23 – August 10

(districts select administration week)

No Certification process for summer

Infrastructure Trial is recommended for workstations that will be used for testing

TransitionTransition

2012-13New Computer-based tests:

◦Grade 5 FCAT 2.0 Mathematics◦Grade 7 FCAT 2.0 Reading◦Grade 9 FCAT 2.0 Reading◦Civics Field Test

The FCAT Reading Retake is no longer administered

TestNav 6.9TestNav 6.9 will continue to be

the computer-based testing platform◦Requires software download◦Secure, locked-down browser◦Runs on tablets (except for iPads)

but not recommended◦Fall 2012 - all schools will need to

download updated software

How do we ensure that schools How do we ensure that schools are ready for the continued are ready for the continued transition to CBT?transition to CBT?

Stakeholder feedback indicated that the DOE certification process to determine CBT readiness should continue in 2012-2013 with some modifications.

An infrastructure trial will still be required for each computer that will be used for CBT, and this will be managed locally.

Superintendent certification of CBT readiness will still be required.

2012-2013 Certification 2012-2013 Certification ProcessProcess

Section I (Computer Inventory) , Section II (scheduling) and Section III (Checklist) of the online certification tool will remain essentially the same.However, there will only be two certification periods: fall/winter and spring.

The Fall/Winter Computer-Based Assessments are:

October 8-12, 2012 or October 15-19, 2012 (Districts decide)

FCAT Mathematics Retakes and FCAT 2.0 Reading Retakes

November 28 – December 19, 2012Algebra1, Biology 1, Geometry EOC Assessments

 

The Spring Computer-Based Assessments are:April 8-19, 2013FCAT Mathematics Retakes FCAT 2.0 Reading Retakes

April 15-26, 2013FCAT 2.0 Reading, Grades 6,7,9, and 10FCAT 2.0 Mathematics, Grade 5

April 22-May 10, 2013U.S. History EOC Assessment

April 29-May 17, 2013Algebra 1, Biology 1, and Geometry EOC Assessments

April 29- June 7, 2013Civics EOC Field Test  

2012-2013 Certification Process, Continued

2012-2013 Critical 2012-2013 Critical DatesDates DPS memo goes out

August 6, 2012

Tool opens for fall/winter certificationAugust 27, 2012

Tool closes for fall/winter certificationSeptember 21, 2012

Tool opens for spring certification February 18, 2013

Tool closes for spring certification March 22, 2013

 

Educator Equipment / Hardware

Student Equipment / Hardware

Professional Development

Program Comments

X X X Title I, Part AThese funds may only be used in schools designated as Title I schools. Use of Title I funds for computer-based assessment is more likely to be compliant with federal regulations in school wide programs rather than targeted assistance programs

X Title II, Part A These funds may be used only for professional development in core subject areas

XTitle II, Part B, Math and Science Partnerships

This is a competitive program from the state to the sub-recipients.

X X X

Individuals with Disabilities Education Act (IDEA)

For the most part, these funds can be used only to benefit students with disabilities; so for example, use of these funds for professional development would be limited to educators serving students with disabilities.

X X X

School Improvement Grants (1003a and 1003g)

The extent to which these funds can be used to support computer-based assessment will depend on the state’s approved plans for use of the funds.

X X XRace to the Top (RTTT) State Grant

Funds can be used consistent with approved state/local scopes of work.

X X X

Title VI, Part A, Grants for State Assessments and Related Activities

Generally available for any purpose which supports the development and/or administration of state assessments and standards at the discretion of the state (may include the costs of working in partnerships with other states).

.

The following table delineates several potential federal fund sources for supporting computer-based assessments. In determining applicability to any particular situation, care must be taken to ensure that proposed allocations and expenditures do not violate federal requirements related to supplanting. In particular, note that supplanting is presumed to occur when federal funds are used to implement a state-level requirement or federal funds are use to provide a benefit to an eligible population while non-federal funds are used to provide the same benefit to other populations that are not eligible for the federal program. Each situation must be individually analyzed to determine whether proposed uses of funds are compliant with federal requirements.Note: Title III is not included in this listing because USED has interpreted the supplement/not supplant provision to specifically preclude use of Title III funds for assessment purposes.

Potential Federal Grant Resources for Funding Computer-Based Assessment

General Specifications (Windows/PC and Apple/Macintosh)

Each computer must meet or exceed the following General Specifications in addition to the applicable Operating System Specifications below:

500 MB available disk space

1024x768 screen resolution

Keyboard and mouse (or other pointing device)

High-speed internet connection

Operating System SpecificationsWindows/PC Windows XP

(Service Pack 3)

Pentium III 733 MHz processor

512 MB RAM

Windows (Service Pack 1)

Pentium III 1 GHz processor

1 GB RAM

Windows 7

Pentium III 1 GHz processor

1 GB RAM

Apple/Macintosh Mac OS X 10.4

G3, G4, G5 500 MHz processor

512 MB RAM

Mac OS X 10.5

Intel, G4, G5 867 MHz processor

512 MB RAM

Mac OS X 10.6

Intel processor

1 GB RAM

2012–2013 Computer-Based Testing System Minimum Specifications

Additional Specifications for TestHear (Accommodated Forms) TestHear will operate on Windows PC workstations and on Macintosh workstations that

have Mac OS 10.5 or later installed and are running Windows (e.g., via Boot Camp). TestHear will not work on Mac OS X 10.4 or on Macs that cannot also run Windows.

For students requiring the screen reader, the computer must be equipped with an audio card and headphones.

Updated 9/2/2011

2012–2013 Computer-Based Testing

System Minimum Specifications (Cont’d)

• For an optimal student experience, any computer that takes a noticeably long period of time (e.g., more than 10 seconds) to start and run applications, even computers which meet the requirements above, should not be used for high-stakes computer-based testing, if possible.

• The testing platform does not permit access to other applications during testing. This means that any applications that may automatically launch during testing will interrupt the student’s testing session, logging the student out of the test. Applications such as antivirus updates, power management software (laptops), screen savers, and email with automatic message notifications should be configured so they do not launch during test sessions.

The FutureThe Future “It is a simple fact that access to high-speed broadband

is now as vital a component of K-12 school infrastructure as electricity, air conditioning and heating.” SETDA, 2012

2014-15 Recommendations: An external Internet connection to the ISP – At least 100

Mbps per 1,000 students/staff WAN connections from the district to each school and

among schools – At least 1 Gbps per 1,000 students/staff

2017-18 Recommendations: An external Internet connection to the ISP – At least 1

Gbps per 1,000 students/staff WAN connections from the district to each school and

among schools – At least 10 Gbps per 1,000 students/staff

Questions or Comments?