![Page 1: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/1.jpg)
Increase the Reliability of the Administration of the MI-Access P/SI Assessments
Angela DalhoeMichigan Department of Education
Assessment for Students with Disabilities Program
![Page 2: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/2.jpg)
Today’s Focus
Help those charged with training Primary Assessment Administrators (PAAs) and Shadow Assessment Administrators (SAAs) learn ways to effectively conduct training for the administration of the Participation and Supported Independence Assessments.
![Page 3: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/3.jpg)
Tools to Assist in Training
Coordinator and Assessment Administrator Manual (CAAM)
Online Learning
Released Items
Item Analysis
EGLCEs and EHSCEs
![Page 4: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/4.jpg)
2007/2008 CAAM Manual
The manual is located online at www.michigan.gov/mi-access
You may want to include portions of the manual in your group or individual training. Picture Card Presentation P/SI Rubric
![Page 5: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/5.jpg)
Picture Card Presentation
Correct presentation of picture cards will assist in obtaining valid results on P/SI Selected Response Items.
An explanation of picture card presentation is provided in the CAAM in Appendix D (a copy is in your binder)
![Page 6: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/6.jpg)
Selecting 1 Word from a Set of 4
Presented with all 4 words visually accessible at one time
Student can select correct word OR Assessed using a “yes/no” response by
presenting each word beginning with an unrelated and moving to a related
![Page 7: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/7.jpg)
Selecting 2 Words from a Set of 4
Presented with all 4 words visually accessible at one time.
Student can select correct words
![Page 8: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/8.jpg)
Selecting 2 Words from a Set of 4
Assessed using a “yes/no” response
Presenting 2 sets of 2 words (one related and one unrelated in each set).
![Page 9: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/9.jpg)
Selecting 3 Words from a Set of 6
Presented with all 6 words visually accessible at one time
Assessed using a “yes/no” response by presenting 3 sets of 2 words (one related and one unrelated in each set).
![Page 10: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/10.jpg)
Scoring Rubric
Knowledge of the scoring rubric is very important for increasing the reliability of the P/SI Assessments. The PAA and SAA work together prior to the
assessment to determine the student’s anticipated response mode.
The PAA and the SAA score the student simultaneously and independently.
Flow Charts for P and SI are located in Appendix E and F in the CAAM (a copy is available in your binder).
![Page 11: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/11.jpg)
Scoring Rubric- Participation
Score Point Definition
3Responds correctly with no assessmentadministrator assistance
2Responds correctly after assessment administrator provides verbal/physical cues
1Responds correctly after assessment administrator provides modeling, short of hand-over-hand assistance
Condition Codes - All condition codes result in no points.A Incorrect responseB Resists/refusesC Assessment administrator provides hand-over-hand assistance
and/or step-by-step directions
![Page 12: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/12.jpg)
Scoring Rubric – Supported Independence
Score Point Definition
2Responds correctly with no assessment administrator assistance
1Responds correctly after assessment administrator provides verbal/physical cues
Condition Codes - All condition codes result in no points.A Incorrect responseB Resists/refusesC Assessment administrator provides hand-over-hand assistance
and/or step-by-step directions
![Page 13: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/13.jpg)
![Page 14: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/14.jpg)
![Page 15: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/15.jpg)
Online Learning
The MI-Access Participation and Supported Independence Scoring Rubrics Online Learning is located at www.mighigan.gov/mi-access under the Professional Development Opportunities section. The online learning is still labeled “pilot” There are 7 modules
![Page 16: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/16.jpg)
![Page 17: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/17.jpg)
![Page 18: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/18.jpg)
![Page 19: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/19.jpg)
![Page 20: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/20.jpg)
![Page 21: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/21.jpg)
![Page 22: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/22.jpg)
![Page 23: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/23.jpg)
![Page 24: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/24.jpg)
![Page 25: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/25.jpg)
![Page 26: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/26.jpg)
![Page 27: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/27.jpg)
![Page 28: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/28.jpg)
![Page 29: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/29.jpg)
![Page 30: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/30.jpg)
![Page 31: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/31.jpg)
![Page 32: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/32.jpg)
![Page 33: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/33.jpg)
Released Items
Released items are useful for PAA and SAA to discuss item formats and practice item administration.
Released item booklets are available online. There is a booklet for each population and
subject and at each level: FI – Grades 3,4,5,6,7,8, and 11 P/SI – Grades 3-5, 6-8, 11
![Page 34: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/34.jpg)
![Page 35: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/35.jpg)
![Page 36: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/36.jpg)
![Page 37: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/37.jpg)
![Page 38: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/38.jpg)
Item Analysis
Item analysis documents allow the PAA and the SAA to observe how released items were scored by both assessment administrators.
Can be used at a district and/or building level to discuss issues of consistency. Differences in item format Differences in standards/strands
![Page 39: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/39.jpg)
![Page 40: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/40.jpg)
![Page 41: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/41.jpg)
EGLCEs and EHSCEs
Becoming familiar with the EGLCEs and EHSCEs will make the PAA and the SAA more likely to consistently recognize the scoring focus when they observe a student and score an assessment item.
www.michigan.gov/mi-access Updated documents are posted on at this site and
available for download
![Page 42: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/42.jpg)
![Page 43: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/43.jpg)
Select EGLCEs or EHSCEs
![Page 44: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/44.jpg)
![Page 45: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/45.jpg)
![Page 46: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/46.jpg)
![Page 47: Increase the Reliability of the Administration of the MI-Access P/SI Assessments](https://reader035.vdocuments.net/reader035/viewer/2022062322/568151cc550346895dc0059f/html5/thumbnails/47.jpg)
Questions?