peter tymms & christine merrell
DESCRIPTION
iPIPS : An International Study of Children’s Development at the Start of School and Progress in their First Year. Peter Tymms & Christine Merrell. Overview. CEM Challenges of assessing young children The PIPS assessment iPIPS Data quality Reliability Predictive validity - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/1.jpg)
Peter Tymms & Christine Merrell
iPIPS: An International Study of Children’s Development at the Start of School and Progress in their First Year
![Page 2: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/2.jpg)
Overview• CEM• Challenges of assessing young children• The PIPS assessment• iPIPS• Data quality– Reliability – Predictive validity
• What children know and can do• Progress across jurisdictions• Changes over a decade• Monitoring policy changes
![Page 3: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/3.jpg)
![Page 4: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/4.jpg)
Centre for Evaluation & Monitoring
Our Mission
… fundamental aim to improve teaching and learning for children and young people… high quality research information through a scientific and evidence-based approach
![Page 5: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/5.jpg)
• 30 years old• 100 staff• Monitoring systems for children ages 3-18• Process data from 1 million students a year• 1000s schools• Computer adaptive tests with 10,000 in a day • England, Scotland, Australia, New Zealand, the
Netherlands, Abu Dhabi, USA, China, Germany, Russia, Chile & S. Africa
![Page 6: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/6.jpg)
The Challenges of Assessing Young Children
• Many can’t read• Communication issues• Limited time for assessment• Low STM • Content:– The official content?– What best predicts success/difficulty?– What is malleable?
• Mode– Observation or direct questions?
![Page 7: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/7.jpg)
The PIPS Baseline and Follow up
• Translated/adapted into 9 languages• Assessed > 1 million children• Used initially for formative feedback
![Page 8: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/8.jpg)
Content: PIPS Assessment
• Early Reading • Early Maths• Vocabulary• Short term memory• Personal, Social and Emotional Development• Inattentiveness, hyperactivity & impulsivity• Contextual Data• Physical development
![Page 9: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/9.jpg)
Distinctive Nature of PIPS• Very quick• Very reliable• Good prediction• Robust• Broadly based• Can be adapted• Long term follow up data• International • Liked by teachers • Enjoyed by children• Rapid feedback
![Page 10: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/10.jpg)
Compared to Other Assessments
• There are hundreds of baseline assessments• We have reviewed 25• PIPS wins
Microsoft Word Document
![Page 11: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/11.jpg)
A Look at the Assessment
![Page 12: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/12.jpg)
![Page 13: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/13.jpg)
![Page 14: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/14.jpg)
![Page 15: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/15.jpg)
![Page 16: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/16.jpg)
iPIPS
• iPIPS is a international project looking at children starting school around the world and the progress they make in their first school year
![Page 17: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/17.jpg)
iPIPS Vision
Developmental Projects
iPIPS in 6 countries
Scale up to include more countries
Bigger Comparative Study: Every 4 years• Through
governments
3 years:• 2013/2014• 2014/2015• 2015/2016
On-going project
![Page 18: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/18.jpg)
Data Quality (Objective data from England)
• Reliability– Test/retest 0.98
• Does it predict?
![Page 19: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/19.jpg)
An Example of Prediction
Writi
ng
Vocabular
y
Ideas ab
out read
ing
Phonolological
aware
ness
Letters
Word
read
Number idententifica
tion
Sums in
formal
Sums f
ormal
STM
Inattentive
ness
Read su
b-total
Math
s sub-to
tal
Total of s
ub-scale
s
-0.4
-0.2
0
0.2
0.4
0.6
0.8
Age 5 Read-ing
Age 16 GCSE English
![Page 20: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/20.jpg)
What Children Know and Can DoTable 5c: Map of items and pupils for the Total measure in England
TABLE 12.2 SOR England Data v2.sav ZOU083WS.TXT Jan 8 14:33 2014 INPUT: 19504 PERSON 168 ITEM REPORTED: 5440 PERSON 165 ITEM 334 CATS WINSTEPS 3.74.0 ---------------------------------------------------------------------------------------- MEASURE PERSON - MAP - ITEM <more>|<rare> 6 + | M or L 8 more t | M or L 21 more | 5 + M or L 6 less t Sums B half of Sums B 4+11 |T M or L 10 less Sums B 9-6 . | Sums B 15+21 | Sums B 7+3 4 . + . | M or L 3 less t Sums B 42-17 Sums B Sequence . | M or L 3 more t Num 3dig1 Pass Walking t . | Num 3dig2 PV cosmetics PV yacht 3 . + Num 3dig3 Sent Sentences Sums B Sequence . | M or L 2 more t Sent Sentences Sent Story 2 Sums B 12p ora . | IAR full Num 2dig1 Sent Story 1 . |S Num 2dig2 Sent Sentences Sums B 15-4 2 .# T+ IAR capital Num 2dig3 Sent Sentences Sent Sentences Sums A rockets W ball W t ree .## | Sent Sentences W cat W flower W house .## | IAR sentence Num 3dig4 Pass Cats long W car W duck W rabbit .#### | IAR start Num teen2 W dog 1 .##### + Num 3dig5 Num teen1 Num teen3 Sent Sentences Sums B half th W butterfly .####### S| IAR sentence PV microscope Sums A pips .######### | W Writing Lett D Lett Q M or L 1 more t Sums A ice crea .########### | Lett A Lett H Lett J Lett Y Lett t Sums A puppies 0 .############ +M Lett G Lett K PV jewellery PV toadstool Rep observatory Rhy mouse Sum s A bikes Sums B 5p appl .############ M| IAR Letter Lett B Lett V Lett c Lett o Lett u PV pa dlock Rhy bin Rhy dish Sums A rabbits .########### | Lett F Lett n Lett w PV saxophone Rep frigglejang Rhy pan Rhy toes .########## | IAR word Lett L Lett S Lett e Lett r Lett z Num 9 PV cash Rhy cherries Rhy drum Rhy hat Rhy sun Sums B three q -1 .####### + Lett x Num 6 Rep juxtapose Sh hexagon .######## | Lett Name Lette Lett m Num 0 Num 8 R ep riotous Sums A cars .###### S| Count fish here IAM least Lett i Lett p Num 7 Rep denalty .#### | Count fish ther PV pigeon Rep enterprisin Sums A balls -2 #### + IAM shortest Num 3 Num 5 PV bowl PV violin .## |S IAR writing Num 1 Num 2 Num 4 Rep mantle Sh square .# | Count apples th PV windmill Sh triangle .# T| Count apples he PV knife PV pan -3 . + PV cherries Rep stop . | IAM most PV fork PV wasp Sh circle . | IAM tallest IAR someone . | IAM more PV butterfly -4 . + IAR someone PV cupboard . | PV carrots PV kite . | IAM smallest PV turtle . |T PV castle Sh star -5 + IAM biggest . | | . | -6 + | . | | -7 . + <less>|<frequent> EACH "#" IS 41. EACH "." IS 1 TO 40
![Page 21: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/21.jpg)
Reading across Jurisdictions
4-4.25
4.25-4.5
4.5-4.75
4.75-5
5-5.25
5.25-5.5
5.5-5.75
5.75-6
6-6.25
6.25-6.5
6.5-6.75
-3.00
-2.00
-1.00
0.00
1.00
2.00
3.00
EnglandEngland2ScotlandScotland2New ZealandNew Zealand2AustraliaAustralia2
![Page 22: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/22.jpg)
Changes Over a Decade
Example: Pre-school and mathematics at start of school ten years ago:
![Page 23: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/23.jpg)
Monitoring the Impact of a New Policy
• Northern Ireland, UK• New Enriched Curriculum• PIPS Baseline and later PIPS Assessments• Tracked reading and mathematics from start
to end of primary school• No additional benefit for Enriched Curriculum
![Page 24: Peter Tymms & Christine Merrell](https://reader030.vdocuments.net/reader030/viewer/2022032709/56813223550346895d9886f7/html5/thumbnails/24.jpg)
Thank You