connecting the dots between the isr and the...

30
Connecting the Dots Between the ISR and the DSR/SSR Yu-Feng Chang [email protected] Sarah Shroyer [email protected]

Upload: others

Post on 04-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Connecting the Dots Between

the ISR and the DSR/SSR

Yu-Feng [email protected]

Sarah [email protected]

Page 2: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Redesigned Individual Student Reports (ISRs)

for MCA & MTAS

• Improved graphics, new format & design

• Grades 5 & 8 on one ISR

• All 3-subjects (R,M,S)

• Grades 3,4,6 & 7 on one ISR

• 2- subjects (R/M)

• ISR for each HS subject/grade

• Updated text describing results

Page 3: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

New and Redesigned ISR Resources

• Full Interpretive Guide with improved format

• More graphics and concise descriptions

• MCA & MTAS ISR Quick Guides

• MCA & MTAS ISR Videos

Page 4: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

New District and School Student

Results File Format (DSR/SSR)

• Updated columns and fields in file

• Updated file format documents for old and new formats

• Two help tabs

• Column definitions and Score label descriptions

• New format has two new Student Groups

• ‘SLIFE’ and ‘Homeless’

• Students with Limited or Interrupted

Formal Education (SLIFE)

• Old DSR/SSR format still available

• Phased out by 9/1/17

Page 5: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

New Results IncludedAdditional fields included for 2015-2016 MCA

• Growth for Grades 4-8

(Low, Medium/Average, High)

• Strand Performance Level Descriptor

(Below Expectations, At or Near Expectations,

Above Expectations)

• Career and College Readiness (CCR) HS indicators

• Redefined Progress Scores for Grades 3-8

Page 6: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

MCA Performance Level and Standards• Example of a 3-subject MCA ISR

• Reading ‘Meets’, Mathematics ‘Exceeds’, Science ‘Meets’

• Description about performance on standards

• A student’s performance described in relation to peers in the state

• Growth level for Reading and Math, but not Science

Page 7: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Results Comparisons

• Scale scores of student vs averages at school, district, and state level

Page 8: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Finding Results on ISR in DSR/SSR

• Student scale score vs averages at school, district, and state.

Page 9: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Finding Results on ISR in DSR/SSR

• Participating students in grades 4-8 Reading and/or Math MCA

• Only growth level is included (based on Minnesota Growth Model)

• Growth level – L (Low), M (Medium/Average), or H (High)

• See page 20 of New DSR/SSR File Format Document for which reports

to find more growth information

Page 10: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Strand Performance Level on ISR

• Strand performance levels are on ISR for MCA Reading G3-

8 & G10, Math G3-8 & G11, and Science G5, G8 & HS

Page 11: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Strand Performance Level on DSR/SSR

Page 12: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

• Strand scale score:

Strand Scale Score and Standard Error of

Measurement (SEM) on DSR/SSR

• SEM of strand scale score:

Page 13: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Strand Performance Level on ISR and

Strand & Substrand Performance Level on DSR/SSR for MCA

Science HS

• Two strand performance levels

on ISR:

• Two strand performance levels

and scale scores on DSR/SSR:

Page 14: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Strand Performance Level on ISR and

Strand & Substrand Performance Level on DSR/SSR for MCA

Science HS

• Seven sub-strand performance levels and scale scores on DSR/SSR:

Page 15: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Calculation for Strand Scale Score and

Strand Performance Level

Scoring Method:

The item parameters and the student's answer pattern

Strand theta score and strand standard error of measuremnt

(SEM) for theta

Strand scale score and SEM for strand scale

score

Using the strand theta score and SEM

for theta to determine the strand

performance level

Page 16: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Determining the Strand Performance Level

• The confidence band (lower & upper confidence limit) using the

strand theta score and SEM of strand theta score is calculated to

determine the strand/substrand performance level.

Page 17: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Determining the Strand Performance Level

• Above Expectations: Lower CI> Target Theta Score

• At or Near Expectations: Lower CI ≤ Target Theta Score ≤ Upper CI

• Below Expectations: Upper CI< Target Theta Score

Page 18: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Performance History and Progress Score for

MCA Math & Reading G3-8 on ISR

• Student Progress Score (Vertical Scale Score)

Page 19: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Progress Score for MCA Math & Reading G3-8 on DSR/SSR

Page 20: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Scoring for Progress Score (Math & Reading G3-8)

• Both the on-grade and off-grade items for G3-8 Reading & Math MCA will be

used to calculate the progress score.

• Off-grade items:

• Any off-grade level items will be no more than two grade levels above

or below a student’s grade.

• EX: Fifth grade students may see items from any of grades 3, 4, 5,

6, 7.

• The exception to this are grades 3 and 8 because there are no items

below grade 3 and no items above grade 8.

• EX: Third grade students may see on-grade items or above-grade

items (4 or 5 grade items) and eighth grade students may see on-

grade items or below-grade items (6 or 7 grade items).

Page 21: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Interpretation for Progress Score (Math & Reading G3-8)

For MCA Math and Reading Grades 3-8:

• If the progress score is at or above the goal progress scores at each grade, it

is projected to be on track for next grade’s coursework.

• If the progress score is below the goal progress scores at each grade, it is not

projected to be on track for next grade’s coursework.

Page 22: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Career and College Readiness (CCR) for MCA

Math G11 and Reading G10 on ISR

• For MCA Reading G10:

• For MCA Math G11:

Page 23: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Interpretation for CCR

(Math G11 & Reading G10)• The CCR Goal Score for Math G11 and Reading G10 is an indicator that

performance is on track to demonstrate career and college readiness on a

college entrance exam at the end of grade 11.

• Student scale scores at or above the CCR Goal Score may indicate

student’s performance is on track to meet career and college

readiness.

• Student scale scores below the CCR Goal Score may indicate student’s

performance is not on track to meet career and college readiness.

Page 24: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Performance History for MCA Science G5 & G8 on ISR

• For MCA Science G8:

• For MCA Science G5:

Page 25: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Goal Progress Score (Math & Reading G3-8) and CCR Goal Score

(Math G11 & Reading G10) on ISR and DSR/SSR

• On the ISR:

Page 26: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Goal Progress Score (Math & Reading G3-8) and CCR Goal Score

(Math G11 & Reading G10) on ISR and DSR/SSR

• DSR/SSR New File Format Information file:

• On the Page 17: • On the Page 18:

Page 27: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Final Page of ISR Information

• Additional information about assessments

Page 28: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

For More Information - ISR

• MCA & MTAS ISR Quick Guides

• Understanding the MCA & MTAS ISR Videos

• MCA & MTAS Sample Individual Student Reports

• http://minnesota.pearsonaccessnext.com/isr/

Page 29: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

For More Information – DSR/SSR

• DSR/SSR information:

• MDE > School Support > Data Submissions >

Assessment Secure Reports

• 2015-2016 OLD District and School Student Results

(DSR and SSR) File Format Information

• 2015-2016 NEW District and School Student Results

(DSR and SSR) File Format Information

Page 30: Connecting the Dots Between the ISR and the DSR/SSRminnesota.pearsonaccessnext.com/resources/resources... · 2016-09-16 · • Reading ‘Meets’, Mathematics ‘Exceeds’, Science

Questions?