does%instruc,onal%sensi,vity%+growth%= growth%sensi,vity?% ·...
TRANSCRIPT
![Page 1: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/1.jpg)
Does Instruc,onal Sensi,vity + Growth = Growth Sensi,vity?
Instruc,onal Sensi,vity Conference
November 14, 2013 Stephen Dunbar Catherine Welch
![Page 2: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/2.jpg)
Alternate Title -‐-‐ Is Measuring Growth a Surrogate for Measuring Instruc,onal
Sensi,vity?
![Page 3: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/3.jpg)
Instruc,onal Sensi,vity
Polikoff (2010) defines instruc,onal sensi,vity as a property of an item or test that enables the item or the test to be able to detect differences in instruc,on received by a student.
![Page 4: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/4.jpg)
Instruc,onal Sensi,vity
• Measuring instruc,onal sensi,vity with a large-‐scale assessment poses unique challenges.
• Challenges can be addressed in a variety of ways. – design feature of the item and test development process
– design feature in the establishment of a ver,cal growth scale
![Page 5: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/5.jpg)
Compe,ng Priori,es? A Coherent Assessment System?
Classroom Large Scale
Instruc,onal Sensi,vity
Growth
![Page 6: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/6.jpg)
Item and Test Development
• Items shown to be highly sensi,ve are included in the final test and used to guide further item development.
• Items that are insensi,ve are discarded from test assembly.
• Data from the same students across years is used to validate the sensi,vity.
• Data from the simultaneous administra,on of the same item across years.
![Page 7: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/7.jpg)
Item Design and Development Four friends decided to meet each other at the park. Kate walked ¼ mile. Terry walked 1 ¾ miles. Denny walked ¼ mile. Sondra walked 1 ¾ miles. What is the best estimate of the total miles they walked? A 2 B 4 C 8 D 10
![Page 8: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/8.jpg)
Item Design and Development A total of 80,750 people attended 18 tournament games played. Which gives the average number of fans per game? A 80,750 × 0.18 B 0.18 ÷ 80,750 C 18 ÷ 80,750 D 80,750 ÷ 18
![Page 9: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/9.jpg)
Ver,cal Growth Scale
![Page 10: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/10.jpg)
Growth Assumptions
Learning is a con,nuum
Students start at different
places
Growth expecta,ons vary with the star,ng place
Growth can be measured and reported
![Page 11: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/11.jpg)
3rd grade
4th Grade
5th Grade
Growth Model Assump,ons
Learning is a con,nuum
![Page 12: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/12.jpg)
Growth Model Assump,ons
Students start at different places
275
215
230
300
![Page 13: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/13.jpg)
Growth Model Assump,ons
Growth expecta,ons vary with the star,ng place
![Page 14: Does%Instruc,onal%Sensi,vity%+Growth%= Growth%Sensi,vity?% · Alternate%Title%HH%Is%Measuring%Growth%a Surrogate%for%Measuring%Instruc,onal% Sensi,vity?%% %](https://reader036.vdocuments.net/reader036/viewer/2022062605/5fcf6f0d961dc86b0f2c4446/html5/thumbnails/14.jpg)
Complementary?
Growth Instruc,onal Sensi,vity