spring 2017 sage training · 2018-04-26 · o sage summative o online reporting system also: o sage...
TRANSCRIPT
Spring 2017 SAGE
Training
SAGE2017
Provide policy and procedure support for each assessment.
Give specific instructions for tests administration- ensuring a standardized testing environment.
Contains answers to most FAQ’s.
Test Administrator must follow the scripts.
TAMS are not secure.
Separate TAM for Summative and Interim
16-17 TAM now available
http://sageportal.org/wp-content/uploads/SAGE-Spring-Summative-Test-Administration-Manual-2016-2017.pdf
Subject Starting Ending
ELA Writing and Reading,
Math, and Science
March 27, 2017 May 19, 2017
Test Type Window Closes Window Opens
Interim March 3, 2017(All unfinished tests will be forced closed)
Benchmark
Modules
March 3, 2017(All unfinished tests will be forced closed)
March 20th
Summative Window:
All Summative tests have an 8 week testing window.
Other SAGE Windows:
Course Test Administation
Most students
should be
finished
All students should
be finished
Science
MathAll 90 minutes 135 minutes
ELA
Reading, Language, Listening 90 minutes 135 minutes
Writing, First Prompt
Opinion/Argument60 minutes 90 minutes
Writing, Second Prompt
Informative/Explanatory60 minutes 90 minutes
All tests may be split among multiple testing sessions/class
periods
o Student may pause/log out of the test at any time
o Student will NOT be able to change answers on previous day’s work
(except writing)
The proctor who approves students to enter test sessions
within the TA Interface must be in the room with the
students.
“Though these assessments are untimed, it is inappropriate
for the test administrator to allow students to take excessive
time to test.
In rare circumstances a student may need to take longer than
the expected times. These situations must be discussed with
the LEA Assessment Director to ensure that students have an
appropriate opportunity to complete testing.”
- SAGE Spring Summative Test Administration Manual
Every student is tested on the full range and depth of content, but at different levels of difficulty
o Difficulty is determined by actual student performance
Every student has the chance to demonstrate the same range of cognitive skills
• Utilizes grade level content• Science Example:
• 4th weather, 5th chemical reactions, 6th solarsystem• A 5th grade student will not receive questions about the solar
system– but full ability range on chemical reactions
Item difficulty, not cognitive complexity, adjusts to studentperformance
Reading
o Single and Paired Passages
• No text-to-speech for passages, or excerpts from passages in items.
Listening
o Audio only (approx. 1 min) items
o Audio with separate reading passage (with text-to-
speech)items
o ASL video provided for audio (no human interpreter
allowed)
o Embedded audio scrubber so students can find their place
in a passage and not have to start over.
Writingo Student writing will draw on information and evidence from
passages.
o Soft Segment between the two tasks
o Up to 20% of responses will be selected for human scoring
• Algorithm will flag low confidence responses
• No immediate score for these papers. Reported within 5 days.
o Item Response Recovery- Designed to go back to a previous version of essay within the same day.
o Two Compositions (soft segments):• Opinion/Argumentative (1st essay assigned)
• Informative/Explanatory (2nd essay assigned)
o Writing FAQ Page:http://sageportal.org/wp-content/uploads/Writing-FAQ-updated.pdf
Grades 3-5 Calculator NOT allowed
o Is not available on the screen
o Bringing a calculator is a modification and must be marked in TIDE
o Based on the Utah State Standards, student in these grades need
to build basic computation skills and knowledge
o Computation Tables such as multiplication tables or graphic
organizers may not be used
Grades 6: Calculator allowed on certain itemso First Segment: Calculator NOT allowed
o Second Segment: Calculator available ONLY onscreen• Desmos Calculator will be available on the test- can be downloaded and used
during instruction.
• Proctor must advance students to the second segment
• If a student has an IEP accommodation for calculator, a student may use a handheld calculator on the second segment.
• No reference sheet for Secondary Math
• Any item that is appropriate for students to have a formula, will have the formula embedded in the item.
• Desmos Calculator will be available on the test –can be downloaded and used during instruction• Calculator manual available at www.sageportal.org
• Student may bring in and use a calculator that was
used during classroom instruction
• No phone or Internet-capable calculators are permitted
https://www.desmos.com/scientific
The
calculator is
accessed
from the item
by clicking on
the tool in the
upper right
corner if
allowed for
that item.
• All items aligned to a Standard, Objective, and ILO
• DOK 1-4 items spread across all Standards andObjectives
• Simulations allow for in-depth, experiment-like conditions allowing assessment of science skills in a setting approximating authenticity
• Students will see one simulation in Full-Reporting Interim and Spring Summative
• Students may see a simulation in the Class Period Interim
Calculators allowed for all tests• Students may use a calculator they are familiar with
• A scientific calculator will be provided as an on-line tool
• No phone or Internet-capable calculators are permitted
Reference sheets are available for Chemistry and Physics
• Download and use throughout the year
• Chemistry:
• http://sageportal.org/wp-content/uploads/2013/11/Science-Reference- Chemistry.pdf
• Physics:
• http://sageportal.org/wp-content/uploads/2013/11/Science-Reference- Physics.pdf
TIDE shows only the features that are available to the user based on
their role.
The TIDE user interface is designed to reflect the stages of
the testing process: Preparing for Testing and Administering
Tests.
Accounts to SAGE share a common login. This login grants access to:
o TIDE
o SAGE Summative
o Online Reporting System
Also:
o SAGE Formative
o SAGE Interim
Users can subscribe to the portal by clicking on the link in the upper right hand corner of the screen. o Note: This is NOT the same account as used in the rest of the SAGE systems.
o Once the account is set up, an email will be sent when a resource is published to the portal.
The Student Information tab may be used to:
• Search for existing student records
• Export a list of existing student records
• View an existing student record
• View and update student test settings and accommodations
• You cannot add a student in TIDE. They must come through Powerschool.
Student is entered into Powerschool
Powerschool data is submitted to UTREx daily
Valid data is sent from UTREx to TIDE nightly
If all goes well…..
Student data appears in TIDE the next day
No manual addition of students or moving students between classes.
If students aren’t in TIDE…
Check Powerschool and make sure information is correct.o Registrars should be running their error checks regularly.
• Students must be enrolled in the course.
• School enrollment must occur before class enrollment (date errors)
• Section numbers should only be 5 digits long
All test eligibility are drive by course enrollment. Students must complete assessment while enrolled in the course.
1% students never generate SAGE tests regardless of core code
First-year English Learners will generate “optional ELA assessments” in LEA 00.
Home School
o Home school students shall be allowed to participate. They must be
enrolled in a class in your school.
Electronic High School (EHS)
o EHS will work with schools to identify students needing to be tested.
Schools should test students within 30 days of completing their
instruction.
Success Academy- Dixie
o SAD students enrolled in core classes at your school will not be on
your TIDE, but can still login to the assessment.
Focus Center
• Accommodations are practices and procedures that provide
equitable access during instruction and assessments for students
with special needs that do not alter the validity, score
interpretation, reliability, or security of the assessment.
• Accommodations are intended to reduce or even eliminate the
effects of a student’s disability; they do not reduce learning
expectations.
• The accommodations provided to a student should be the same for
classroom instruction, classroom assessments, and LEA and State
assessments, although some accommodations may be appropriate
for instructional use, they may not be appropriate for use on a
standardized assessment.
The five essential steps are:
1. Expect students to participate in grade‐level assessments
and achieve grade‐level academic content standards.
2. Learn about accommodations and resources for instruction
and assessment.
3. Select accommodations and resources for instruction and
assessment as needed for individual students.
4. Ensure that access is provided for accommodations and
resources during instruction and assessment.
5. Evaluate and improve accommodation use for instruction
and assessment.
Accommodation codes must be set in TIDE before a
student starts his or her test.
ACCOMMODATIONS POLICY:
http://www.schools.utah.gov/sars/Assessment/AccommodationsPolicy.aspx
These 7
accommodations must
be set in TIDE under the
tab Student Information
before a student starts
his or her test.
Accommodation SAGE Summative
Braille (tactile graphics for
students who are blind)Allowed
Calculation device and
computation table
6th grade—handheld
allowed during
calculator section
Large print paper Allowed
Scribe Allowed (Notify USBE)
Sign language
Allowed with certified
interpreter (only on
items or content when
TTS is available)
Standard size paperAllowed – “Print on
request”
Visual Representation Allowed
Accessibility Feature/resource SAGE Summative
Alternate location Allowed
Assistive communication devices Allowed
Audio amplification Allowed
Breaks Allowed
Calculation devices and
computation tables
Embedded (grades 7th and
up)
Change order of activities Allowed
Color adjustments Embedded
Descriptive audioEmbedded—must be marked
in TIDE
*Directions—oral translation Allowed for EL
*Directions—rereadEmbedded as a
text‐to‐speech
*Directions—signedAllowed with certified
interpreter
Blank scratch paper and graph
paperAllowed
Spell check Embedded
Strikethrough Embedded
Text‐to‐speech Embedded
Environment change Allowed
Extended time Allowed
Graphic organizer Not allowed
Highlight Embedded
Human reader Not Allowed
Magnification Embedded
Minimize distractions Allowed
*Directions are only non‐item content that appears at the beginning of the test or between testing sessions. It does not refer to “directions,” meaning the item’s stem, directions for answering a specific question, etc.
Allows users to view both system and user created rosters.
System rosters are those generated from the UTREx uploads
Allows users to edit, add, or delete user created rosters.
Manage Rosters allows you to:
• Verify Rosters
• Print Rosters
• Print Tickets
• View Student Settings
Used to describe non-standard administration and to explain why students do not participate.
o Absent- Did not take test
o Student Refuses to test
o Parental Exclusion
o Excused- Medical Emergency
o Course will continue next school year
o Course Instruction not aligned with course code
o Test has already been taken
o USOE Excused- Approval Needed
o Student Transferred before testing window
o Modified
o Accommodated
Special code may be marked anytime during the window and must be correct before the end of the testing window.
Special codes determine which students are included in aggregate results and have specific business rules applied for accountability purposes.
Parental Exclusion is the only code that will prevent a student from being able to log in.
Common examples of Plan and Manage Testing cases:
Which students have not yet tested?
Which students have started but not yet completed their test?
Which students have paused tests?
Did every student in a test session complete their test?
Shows which special codes were marked for students, and their
progress in a test.
Due to the size, please export the Test Status Code Report
Remember: The Parental Exclusion code removes eligibility, so you
will not see tests coded with the Parental Exclusion code on this
report.
Invalidate (Test Coordinator access)
• Invalidation of a test eliminates the test opportunity and the student will not receive a
score.
• It can be submitted by State, LEA, and School Administrators.
• If submitted by a School Administrator, it must be approved by an LEA Administrator
• Example: student started a SAGE assessment and answered questions but needs to take
the UAA test
• Invalidate the test if Parental Exclusion occurs after a student begins/finishes as
assessment.
Reset Test (Test Coordinator access)
o Resetting a student’s test removes that test from the system and enables the student
to start a new test. Questions seen in the new test will be different than questions the
student saw previously.
o It can be submitted by State, LEA, and School Administrators.
o Example: student had the incorrect braille setting and had answered some questions,
or student logged in to another student’s test and answered questions.
Grace Period Extension (Test Coordinator Access)o A Grace Period Extension (GPE) is used in instances where the system’s pause rule prevented a
student from reviewing previously answered questions on a test. Once applied, a GPE allows the student to review all previously answered questions the next time he or she logs into the test.
o It can be submitted by State, LEA, and School Administrators.
o Example: Loss of Internet access, or a fire drill.
Re-open a Test (District Coordinator Access)o A test re-open is used in instances where the student has incorrectly clicked to complete the
test. Once applied, a re-open allows the student to review all previously answered questions the next time he or she logs into the test.
o A test re-open can be submitted by State or LEA Administrators.
o A student may not re-open a test once they have seen their score.
You must start a
test session before
students can log in
to test. All tests
that students will
be taking must be
included. Tests can
be selected by
expanding the tree
and selecting the
correct test.
• Students who are
waiting for entry or exit
approval from a
segment are identified
in their own dedicated
table on the approvals
screen.
• Label for the segment
is displayed above the
new table to help
identify those
students.
The “Students in Your Test Session” table displays each logged in
and approved student.
Click on the [ i ]to get better, more accurate information regarding a student’s test status
This can help troubleshoot issues in the classroom, e.g. if a student claims to have been kicked out of the test
Status Description
ApprovedThe Test Administrator has approved the student for the session, but the student has not yet started or resumed the test.
Started
(#/#)
The student has started testing. The number after this status indicates
how many items the student has answered out of the total number of
items on the test. This number does not indicate which item or item page
the student is actively viewing.
Review
The student has answered all items and is currently reviewing his or her
answers before submitting the test for scoring. Note: A test with a review
status occurs only at the end of the test. A test is not “completed” until
the student submits the test.
CompletedThe student has submitted the test. No additional action can be taken by
the student.
Status Description
SubmittedThe test has been submitted for quality assurance review, validation, and
overall scoring.
DeniedThe Test Administrator denied the student entry into the session. If the
student attempts to enter the session again, this status will change to
“Pending” until the Test Administrator approves or denies the student.
Paused
(#/#)
The student’s test is currently paused. The time listed with this status
indicates how long the student’s test has been in the paused status.
PendingThe student is awaiting Test Administrator approval for a new test
opportunity.
SuspendedThe student is awaiting Test Administrator approval to resume a test
opportunity.
Pausing an individual student’s test will pause only that student’s
test.
o Only that student will be logged out automatically.
o That student can easily resume their test by requesting entry into
the same session again, provided the session is still active.
To stop the session (and pause tests for all
students in the session):o Click the Stop sign to the left of the session code. A box will appear,
requesting verification to end the session and log student out.
o Click OK to continue or Cancel to keep the test session open.
o Stopping a session will automatically pause all students’ tests in
that session, and then student will be logged out automatically. The
students can easily resume their tests once the TA has created a
new session containing the appropriate tests.
• Look up by SSID or advance lookup by student name
Opening sessions
o The proctor who approves students to enter test sessions within the TA
interface must be in the room with the students.
Timeout Rule
o A student’s test will log out after 30 minutes of inactivity.
o Any activity by the student will prevent their test from timing out.
o After the test times out, the pause rule begins.
Pause Rule
o Questions cannot be viewed or modified after test is paused for 20
minutes.
o Proctor can see amount of time paused on TA interface
o When the student logs back in, they will return to their last unanswered
question.
o The writing section of ELA has no pause rule.
If a test is not segmented students must answer a question before they are able to advance to the next question.
If a test is segmented (Math Grade 6 or Writing) students must complete all question in that segment before advancing.
Students may mark items for review and use the past/marked drop-down menu to return to those items, unless the test has been paused for more than 20 minutes and the test is not segmented (only Math Grade 6 and writing are segmented.)
o TAM gives 5 minute warning to go back and review marked items.
Students should only see the articles and prompt once they have logged into their SAGE writing assessment. Students may then pre-write prior to typing their response, however all activities should occur within the lab. No writing may be brought into the lab, or leave the lab.
Reviewing Items in Tests with Segments:
Math Grade 6
Participation Rules
o Responding to 6 or more adaptive questions counts as
participating, though the student will not receive a score.
o Typing any “no blank” character into a writing prompt
o Cautiously mark non-participation codes to explain why a student
did not participate.
• Students will not be able to log-in to the assessment if a Parental
Exclusion code is marked.
Multiple Choice Machine Scored Constructed Response (MSCR)
Single Select Equation Response
Multiple Select Matching
Table Matching
Constructed Response Graphic Response
Short Response Single Word Response
Extended Writing Hot Spot Response
Drag and Drop Response
Table Input
Evidence-based selected response (EBSR)
Not all item types appear on all tests
All students have the ability to:
Highlight text in passages and test questions (persists on constant text if same platform is used from session
to session)
Zoom in and out of test pages (affects all item content)
Mark specific items for review
Strikethrough (cross out answer options)
Use the masking tool to cover an area of the test page to temporarily hide information
Dictionary- ELA only, both sections
Use the Formula Sheet, Notepad, or Calculator depending on the test
Use the Expand button to display a reading passage or a science simulation. Expanded passages can also be collapsed.
Use to Text-to-Speech audio.
View the on-screen scoring guide for the Writing assessment.
View the on-screen Test Instructions and Help.
Adjust audio (volume), rate, and pitch during the test.
View a tutorial about each item type and how to respond.
Available where it does not violate the construct
Spanish translation tool will be provided to all students.
Hard-copy or electronic (no Internet) “direct translation” resource
may be provided in any language for EL students (primarily for
non-Spanish speaking EL students.)
Student who use translation dictionaries for any language during
instruction may use that translation dictionary on the
assessment. (No Internet.)
For Grades 3-5 Reading and
Writing Assessments, unfamiliar
words will have a glossary
drop-down in the text.
* Except for low confidence
papers which will take up to
5 days to be reported.
*
Online Reporting System provides instructional data.
o It is designed to provide educators in Utah with the assessment
data and tools they need to understand the performance of their
students and effectively implement strategies to improve teaching
and learning
No accountability business rules are applied
The magnifying glass icon indicates what data can be
further explored.
All tables can be printed or exported
Users can generate printable reports for parents.
Familiarize students and teachers with the design, format,
procedures, and features of the items found in the SAGE
Summative assessments.
Allow students to identify test setting preference in
advance.
Use the secure browser to certify that local technology
configurations can deliver SAGE Summative assessments
(e.g., network, hardware)
Introduce the features of the SAGE systems and how they
are used throughout the testing window.
Train the Test Administrator/Proctor on creating and running
a Test Session
• Training and Practice tests can be accessed by the public.
Hardware Requirements
http://sageportal.org/technology-coordinators/
Headphones and keyboards are required for all students, all
tests.
Windows, Mac, Linux, iOS, and Chromebooks kiosks and apps
available at sageportal.org/browsers
o Browser 9.0 is the most recent version.
Chromebooks- Must launch app before students log into their
profile.
PRESERVE BANDWIDTH THROUGHOUT TESTING!
Sage Summative tests are highly secure and must be treated as such.
Make sure to:
• Select the correct test in the TA system
• Verify student identity before approving them
• Not allow students to remove any test content
• Secure destroy notes and student work
• Follow administration directions exactly
• (TAMS available now)
• Take down any wall décor in the labs or classrooms during testing that may provide answers to the tests.
Annual Ethics and Security Training must be given to
all staff involved in administering and proctoring
assessments.
http://schools.utah.gov/assessment/Directors/Resources.aspx
Keep all sign-off sheets at school.
Contact Stacie
o 986-5159 (direct line)
o Google Chat- Please go back and send me a test
chat so we know we are set up
Please send over a copy of your testing
schedule when you have it finished.
assessment.washk12.org
Green lights = All good
Yellow lights = Reports of connectivity issues
Red lights= Confirmed outage
If problems arise, as much information as we have will be
posted next to the network status.
Don’t schedule them to exceed their
contract hours.