overview of the 2014–2015 alternate assessments:...

Preparing for the

Administration of the Spring

2015

Dynamic Learning Maps

(DLM) in English Language

Arts and Mathematics February 23, 2015 Version

PART TWO

NJ DLM Winter Training 2015 1

Professional Development Modules DLM developed over forty self-directed professional

development modules to help support the transition to the

new alternate assessment and Common Core State

Standards instruction.

Some of the modules include:

◦ DLM Claims and Conceptual Areas

◦ Composing, Decomposing, and Comparing Numbers

◦ Writing: Text Types and Purposes

The learning modules provide significant information on

the background, purpose, and design of the assessment as

well as guidance on providing instruction on the CCSS, the

DLM conceptual areas, EEs, and nodes.

Viewing the PD modules is optional, though educators will

find the information informative.

2 NJ DLM Winter Training 2015

Assessment Coordinator

Responsibilities Includes but not limited to:

◦ Schedules training for teachers and is the direct liaison for teacher questions

◦ Ensures the correct students are assessed

◦ Assists in scheduling students for testing

◦ Interacts with District Data Steward and Technical Liaison to ensure all tasks are completed

◦ Utilizes DLM website, reviews materials, and disseminates information to staff

◦ Reviews DLM Manual and any other required documents

◦ Contacts DLM help desk when DLM documents do not provide clear answers to district questions

◦ District point of contact for test activities


Sample of Assessment Coordinator

Checklist in Manual


Note:

This page is from

the DLM NJ

website and is for

the Assessment

Coordinator


Data Steward Responsibilities Includes but not limited to:

◦ Interacts with Assessment Coordinator, Technical Liaison, and Teachers as necessary to ensure successful completion of testing

◦ Creates and uploads data files including: the Users file (opens DLM user accounts for testing)

Enrollment file

Class roster files

◦ Assigns roles to users which generates user login IDs

◦ Understand and utilize IT/technical expressions contained in the System Start-Up Manual in order to prepare files correctly according to specifications

◦ Utilize consistent and appropriate naming conventions and provide clean data for data files in order to successfully upload files as outlined by the DLM User Guide for State and District Staff (Data Steward)


◦ Reviews DLM Manual and other applicable documents (e.g. Data Tips, etc.)

◦ Contacts DLM help desk when DLM documents do not provide clear answers to user account issues, data file upload errors, etc.


Sample of Data Steward Checklist in

Manual


Note:

This page is from

the DLM NJ

website and is for

the Data Steward


Recent DLM Email Update

Recent KITE and Educator Portal updates.

Looking for the student Username and Password to access KITE? You’ll find it in the Test Management area of Educator Portal. See the procedure titled View Student Username and Password in the TEST ADMINISTRATION MANUAL.

Up to 6,000 records may be uploaded at a single time using the Enrollment or Roster templates.

Accessibility Profile Data Extract includes new fields for Last Modified Time (with date and time) and Last Modified User.


Technical Liaison Responsibilities

Includes but not limited to:

◦ Is responsible for the infrastructure (network, hardware and devices), software applications and technical support as well as understanding how the hardware, software, policies, and procedures fit together in the big picture of the district’s technology implementation.

◦ Ensures district technology readiness and implementation (IT staff)

◦ Reviews DLM Technical Liaison Manual revised 1/13/2015 and completes all tasks

◦ Interacts with Assessment Coordinator, District Data Steward, and Teachers as necessary to ensure successful completion of testing


◦ Contacts DLM help desk when DLM documents do not provide clear answers to technology issues


Sample of Technical Liaison

Checklist in Manual


Note:

This page is

from the DLM

NJ website and

is for the

Technical Liaison

This is from

the KITE page


Webinars for School and District

Staff Who Monitor Assessment


Webinars for School and District

Staff Who Monitor Assessment

Recorded versions of the webinars will be

available on the DLM website 2 days after

the live session. Staff who could not

participate in a live webinar could use the

recording to learn about the responsibilities

and procedures to monitor assessments.


Classroom Teacher/Test Administrator

Responsibilities Includes but not limited to: ◦ Provide instruction throughout the year related to the

CCSS, EEs, nodes, etc.

◦ Assist in the completion of the First Contact and PNP surveys.

◦ Activate educator portal user ID in KITE

◦ Schedule students for testing and gather needed supports such as manipulatives

◦ Reviews DLM Manual, reviews the accessibility features of the DLM system, completes required training modules, and reviews DLM website for any other required documents/necessary information

◦ Contacts District/School Test Coordinator with any questions or issues


Test Administrator Partial Checklist

from Manual for Teachers


Note:

This page is from

the DLM NJ

website and is for

the teacher who

administers the

DLM


TEST ACCESSIBILITY AND OTHER FEATURES


Online Student Surveys

There are two student surveys that are

completed by the student’s teacher, and who may be assisted by other educators who knows the student well.

The First Contact survey asks questions about the student’s level of skills in ELA and Math. ◦ This survey assists in the selection of the level of test

items (node linkage levels).

The Personal Needs Profile asks questions about the students’ support and accessibility needs during testing. ◦ This survey assists in the selection of the computer

accessibility features and other support needs during testing.


Online Student Surveys

Personal Needs

Profile (PNP)

◦ PNP online survey must be completed for each individual student being tested for DLM.

◦ Once PNP is completed, a summary will be generated.

◦ This profile collects information on the students support needs and current level of instruction, and engages computer accessibility features.

First Contact

◦ Online survey completed by ELA and Math classroom teachers. A copy of the student’s IEP is needed as a reference when answering the questions.

◦ This survey helps identify the student’s academic levels in order to establish a baseline as the system selects test items.


Accessibility Manual

This manual was updated on February 16, 2015.

If the FC and PNP surveys were completed during

field testing, please review them one more time,

then hit submit in order to finalize the survey info.


Accessibility Features

DLM offers a variety of accessibility tools

and supports during assessment.

Some of these are delivered through the

KITE system, which are determined by

responses to the First Contact and

Personal Needs Profile (PNP) survey.

Other supports, such as having the

teacher read the test aloud, is provided by

the school.

22

NJ DLM Winter Training 2015

Accessibility Features

Six Steps to Customize DLM Accessibility Features for Students

Step 1: Include Eligible Students in the DLM Assessment

Step 2: Learn About the DLM Accessibility Features: What Does DLM

Provide?

Step 3: Discuss and Select Appropriate Supports and Tools: Considerations

for IEP Teams

Step 4: Enter Appropriate Supports into the DLM System

Step 5: Prepare for the Assessment: Using the Chosen Accessibility Features

Step 6: Evaluate the Accessibility Features Used After the Assessment

These six steps are explained in detail in the Accessibility Manual for DLM 2014-

2015. Steps 1 through 3 are intended for full IEP teams to determine the

accessibility features for eligible students, and steps 4 through 6 are for the

educator or test administrator to enter, use, and evaluate the effectiveness of

the selected features.


Category 1: Supports provided within DLM via the PNP profile

Online supports include magnification, invert color choice, color contrast,

and overlay color. Descriptions about how to select supports provided by

the PNP are found in Step 4 of the six-step DLM accessibility

customization process.

Computer synthesized

read aloud is no longer

available. Teachers will need

to provide this support if

needed by the student.


Category 2: Supports requiring additional tools or materials

These supports include Braille, switch system preferences, iPad

administration, and use of special equipment and materials. These supports

typically require prior planning and setup. These supports are all recorded in

the PNP even though two-switch system is the only option actually

activated by PNP.


Category 3: Supports provided outside the DLM system

These supports require actions by the test administrator, such

as reading the test, signing or translating, and assisting the

student with entering responses. These supports are recorded

in the PNP even though they are delivered by the test

administrator.


Supports: Braille Test

Please contact the Office of

Assessments if you have a DLM student

that needs a Braille test.

Final information is not yet available.

◦ [email protected]


What Must Be Written in a Student’s

IEP Regarding Accessibility?

Specific instructional supports are usually included, such as

use of communication board, picture symbols, text read

aloud to the student, etc.

For DLM the training materials will describe which

accessibility features, supports, etc. are available.

Select only the DLM accessibility features that are familiar to

the student based on instruction.

◦ It is not necessary for all test accessibility features and supports be

listed in the IEP for DLM. However, it is important to select the

features and supports for testing that students need during instruction.

◦ An accessibility feature may be used by the student even if it is not

explicitly listed in the IEP.

28


General Test Information Practice item testlets are available on the DLM

system and should be administered to the students prior to testing.

Practice testlets relate to various accessibility features the student may use. Select the practice testlets (“demos”) based on the PNP features.

The purpose of using the practice items are to ◦ confirm that the accessibility features engaged are

appropriate for the student. If they are not you may revise the PNP before administering the

test.

◦ give the student experience with the online test experience prior to answering live test questions. This allows the student and teacher to be aware of the

computer features, and helps to determine whether the student or teacher would “drive” (use the computer mouse) during testing.


General Test Information

Prompting is not allowed in the DLM system.

Teachers may repeat a test question and then pause an appropriate amount of time for a student to process the question and select an answer.

◦ If a student does not answer a question the teacher will mark “no response” if listed as one of the student response options.

If a student cannot answer the question, and ‘no response’ is not an option provided by the system, then do not mark a response and continue to the next test item.


Clarification Allowed if Needed

Some test item directions ask the teacher to say “Show me the ….”

◦ If necessary, after stating the phrase “Show me the …,” you may restate the phrase for clarification by saying either of the following:

“Look at the …”

“Point to the …”

“Touch the …”

For example, the teacher may say “Show me the red marker.” Then for clarification say “Point to the red marker.”


Educator Resource Page

Review the DLM web page

http://www.dynamiclearningmaps.org/cont

ent/erp_ye to obtain information on

sample testlets, tested Essential Elements,

familiar texts, and other important

information.

The following slide shows an excerpt

from the DLM math glossary, a summary

of the math terms utilized during testing.

32


http://www.dynamiclearningmaps.org/content/erp_ye

http://www.dynamiclearningmaps.org/content/erp_ye

Section of the Glossary


Manipulatives

The list of math manipulatives needed for each grade level is available on the Educator Portal.

◦ Teachers can login to the portal and access the list of manipulatives needed for any grade.

Once the student ticket is available, click on the Test Management tab in the Educator Portal.

◦ This tab is where the TIPS pages are located, as well as the student test tickets.

◦ The manipulative list associated with the assigned student testlet will be described in the TIPS page.


Testlet Information Page


Manipulatives

Once a teacher reviews the TIPS page and the recommended manipulative list, he/she may make appropriate substitutions if necessary when the original manipulative is not available in the school/district or if substituting a manipulative is best for the student. Consider the attributes of the required manipulative

when selecting a substitute. The substitute manipulative must fulfill the required attributes,. Example: if the original manipulatives were two large red

buttons and one small blue button, you may substitute with two large red markers (exact same markers) and one small blue marker. Do not use red markers that are not the same size, and do not use a blue marker that is the same size as the red markers.


SECURITY INFORMATION


SECURITY PLAN

• Mandatory Turnkey Training

• Technology Problems

• Reporting Breaches & Irregularities

• Chain of Command

• Disruptive or Sick Student


Security Protocols for Computer Based Testing

All computers must have the required software to support

computer-based testing.

KITE is the site used to access testlets.

Educator Portal is used to input and review data,

obtain student test tickets, etc.

All computers have access to broadband and secure

internet connectivity.

Consider whether or not proctor caching is necessary

in each school.


TESTING SITES

• Testing requires a computer or tablet device with the KITE

application

•Testing may be done in the classroom as long as:

•The student can hear and respond to directions and test

questions without loud background noise or noise at a level

that would disturb the testing student.

•Other students and staff cannot view the test questions.

•Testing may be done in a computer center, quiet office, or other

alternate location that offers a secure and quiet environment.

• NO Cell Phones, MP3 Players or Any

Unauthorized Electronics


TEST SECURITY

• Security is a district wide responsibility.

• Absolutely NO reproduction or transmittal by any means of test

items, passages, prompts, or other secure items or materials.

• Security breaches may have:

• Financial consequences for the district

• Professional consequences for staff

• Disciplinary consequences for students

• Inform ALL district & school personnel of security procedures prior

to test administration

• Review the module on test security posted in late March on the

DLM NJ webpage.


Test Security

Information on reporting irregularities and security breaches during testing along with the forms will be posted to the DLM NJ page by the end of March.

The test security agreement for all educators involved in DLM will be posted on the DLM NJ page in March. Teachers administering the DLM will electronically sign a test

security form found on the KITE Educator Portal.

All other educators involved in DLM will sign the New Jersey paper version of the test security agreement and submit it to the District Test Coordinator prior to April 6, 2015. This form will be posted to the DLM NJ page in late March.

DLM test results will be included in the state accountability reports produced by the Title I office.


MORE INFORMATION


Topics Not Included

As information becomes available on scoring and reporting of DLM results, it will be posted on the DLM website.

Standard setting will occur the week of June 15. Educators who are interested in participating in DLM standard setting should contact [email protected]

DLM test results will be included in the state accountability reports produced by the Title I office.


Forms for DLM

Forms for documenting teacher administration observations will be available online by end of March.

These forms are optional, but will help you collect administration information useful for DLM, Office of Assessments, and your school.

Please check the DLM NJ page in late March to review the forms for possible use.


District Communication

Districts must share information among staff, and ensure that all DLM teachers are prepared for instruction and testing.

The Assessment Coordinator must turn key train all administrators involved in testing, and provide copies or web links to the required training materials.

Only the District Assessment Coordinator, Data Steward, and Technical Liaison may contact the DLM help desk or DOE with questions. ◦ Please ask others to communicate their questions to

you clearly with specific error references and/or training material page references so that you might obtain the information.


Where To Get More Information? DLM has various customer support contact information

depending on the issue. It is imperative that:

Only those individuals serving as Assessment Coordinator, Technical Liaison, and Data Steward contact DLM.

Contact DLM support only after reviewing all pertinent manuals, handbooks, and modules.

Use the specific contact info listed in the applicable manual to ensure your question is directed to the correct individuals.

Provide in your email your CDS code (known to DLM as your “Organization”), your name and which of the three positions above you hold, as well as detail the specific issue/error you encountered.

◦ Questions directed to DLM Support, and when necessary NJ DOE, must be from either the Assessment Coordinator, Technical Liaison, or the Data Steward.

Questions from other district staff including teachers must be directed to one of the following individuals noted above.


Where To Get More Information? Questions regarding DLM please contact the Customer Service

Help Desk via PHONE: 1-855-277-9751 (toll free) or Email

[email protected]

Prior to requesting assistance, DLM information must be

reviewed. Specific questions related to the training manuals, KITE,

educator portal, and other DLM topics should be addressed to

the DLM helpline with specific details about the issue. Use

manual page references when applicable, and cite the exact

system error or issue you are experiencing.

DLM and Office of Assessment staff cannot summarize

or provide topic information in place of educator review

of the training materials. Review all DLM materials

prior to contacting the help desk.


mailto:[email protected]



Where To Get More Information? Assessment Coordinators with general questions about test design,

training, accessibility features, scheduling, test administration, etc., contact:

Elizabeth Celentano

Office of Assessments

609-984-0107

[email protected]

Data Stewards with questions about APA and DLM student data file uploads, Pre-ID, SDIF, record changes, score interpretation, and other data file issues etc., contact:

Jo-Lin Liang


609-633-6884

[email protected]

Please contact DLM support for assistance prior to the Office of Assessments in order to facilitate a timely response.




Where To Get More Information?

Technical Liaisons with questions about technology readiness issues contact:

Linda Carmona-Bell


609-292-1414

[email protected]

Joseph Seaman


609-292-8407

[email protected]

Please contact DLM support for assistance prior to the Office of Assessments in order to facilitate a timely response.






Test Coordinators

PARCC 3-5 Orlando Vadel 609-341-3456

PARCC 6-8 Timothy Steele Dadzie 609-777-2087

PARCC HS & HSPA Veronica Orsi 609-292-8739

DLM Technology Joseph Seaman 609-292-8407

DLM Technology Linda Carmona-Bell 609-292-1414

NJBCT & NJASK Science Michael Luke, Interim 609-292-3226

APA & DLM Elizabeth Celentano 609-984-0107

AHSA Faye Ball 609-984-1970

NAEP Tabitha McKinley 609-984-1540

NJDOE Contact Information

www.state.nj.us/education [email protected]


http://www.state.nj.us/education

Office of Assessment - Fax

609-984-6032

NJDOE Measurement Specialists

HSPA & Biology Rob Akins 609-984-1435

DLM/APA Jo-Lin Liang 609-633-6884

PARCC Don White 609-777-2051


Where To Get More Information?

Office of Special Education (general special education questions; please do not send DLM questions to this office)

New Jersey Department of Education

609-292-0147

http://www.nj.gov/education/specialed/

Department of Education website:

www.state.nj.us/education


http://www.nj.gov/education/specialed/

http://www.state.nj.us/education

Final Notes

I hope you have found this information

helpful.

Please check back to the DLM NJ

webpage periodically in March for

additional modules.

Thank you for your time.

NJ DLM Winter Training 2015 54

overview of the 2014–2015 alternate assessments:...

Documents