impacting literacy outcomes - acadience learning · 2020. 1. 3. · average emergent literacy); and...

54
Presentation to the Division for Early Childhood’s International Conference October 25, 2018 Orlando, FL Ruth A. Kaminski, Ph.D. Kelly Powell-Smith, Ph.D. With Jacob Gray, Ph.D. Roland H. Good, Ph.D. Dynamic Measurement Group [email protected] Impacting Literacy Outcomes: Effectiveness of a Tier 3 Early Literacy Intervention in Preschool

Upload: others

Post on 16-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Presentation to theDivision for Early Childhood’s International Conference

October 25, 2018 Orlando, FL

Ruth A. Kaminski, Ph.D.Kelly Powell-Smith, Ph.D.

With

Jacob Gray, Ph.D.Roland H. Good, Ph.D.

Dynamic Measurement Group

[email protected]

Impacting Literacy Outcomes:Effectiveness of a Tier 3 Early Literacy Intervention in Preschool

Page 2: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Disclosure

• One of the authors of this presentation is a co-owner of Dynamic Measurement Group, Inc (DMG).

• DMG is an educational company that is dedicated to supporting success for children and schools.

• DMG may benefit if the curriculum featured in this presentation is commercially published.

• Additional information about DMG is available at acadiencelearning.org

Page 3: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Acknowledgements

• This work was supported by grant R324C080011, the Center for Response to Intervention in Early Childhood, from the Institute of Education Sciences, U.S. Department of Education, to the University of Kansas, Charles Greenwood and Judith Carta Principal Investigators. The opinions and recommendations presented in this paper are those of the authors alone, and no official endorsement from the Institute of Education Sciences should be inferred.

• Co-principal investigators, Dr. Scott McConnell, Dr. Howard Goldstein

• Research staff at U Kansas, U Minnesota, Ohio State and USF, DMG

• Teachers, families, children who participated in T3 work

Page 4: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Overview

• Introduction– What is Tier 3 Intervention and do we need it in

preschool?– Effective elements of Tier 3 intervention– Tier 3 intervention example

• Study– Sites and participants– Measures– Design– Analysis and Results– Discussion

Page 5: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

What Is Tier 3 Intervention?

• Supplemental instruction/support that is more intensive and individualized than lower levels of instructional support (i.e., Tiers 1 and 2)

• Compared to Tier 2:– smaller group size– more time– more frequent progress monitoring– more frequent use of specialists/special educators for

implementation

Barnett, VanDerHeyden, & Witt, 2007; Connor, Alberto, Compton, & O'Connor, 2014; Jenkins, Schiller, Blackorby, Thayer, & Tilly, 2013

Page 6: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

• Issue: Is Tier 3 Intervention needed in preschool?

Page 7: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

The Issue: Reading Trajectories Start Early

7

0

20

40

60

80

100

1 2 3 4 5 6Grade

Grade 1Cohort

Grade 2Cohort

Grade 3Cohort

Grade 4Cohort

Grade 5Cohort

Wor

ds P

er M

inut

e

Middle10%

Low 10%

Good, R. H., Simmons, D. C., & Smith, S. B. (1998). Effective academic interventions in the United States: Evaluating and enhancing the acquisition of early reading skills. School Psychology Review, 27, 740-753. [Joint publication with Educational and Child Psychology.]

Page 8: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

The Issue: Differences in Precursors to Reading Trajectories Begin Even Earlier (Hart & Risley, 1995)

Hart & Risley, 1995

Page 9: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Patterns in Performance are Stable Across the Preschool Year …

S.Q. Cabell et al. / Early Childhood Research Quarterly 28 (2013) 608– 620 615

303540455055606570

T-sc

ores

(M=

50, SD

= 10

)

123

Oral Language Code -Related Ski lls

Fig. 2. Spring profiles of emergent literacy (N = 369). Profile 1: Highest emergentliteracy (35.0%); Profile 2: Average emergent literacy (46.3%); Profile 3: Lowestemergent literacy (18.7%).

different, the LPA identified five profiles that were identical to thosedescribed previously.

5.1.7. Spring prekindergarten profilesIdentification of the appropriate number of profiles followed the

same procedure in the spring. Six models, each testing a differentnumber of profiles (2 through 7 profiles), were compared for bestfit to the data as indicated by multiple criteria. All criteria indi-cated that a 3-class model was the best fit to the data (BIC = 7367,entropy = .88). Significant improvement in model fit was observedfor the three-class over the two-class model (!2 deviance = 141,p < .001). Three profiles, depicted in Fig. 2 and described below, bestcharacterized the data.

5.1.8. Profile 1: Highest emergent literacy (prevalence = 35%;n = 129)

Profile 1 was characterized by above average skills (between+0.5 and +1 SD) across both oral language and code-relateddomains. Children in this profile on average could name approx-imately 22 uppercase letters of the alphabet and could generallywrite their first names with accuracy.

5.1.9. Profile 2: Average emergent literacy (prevalence = 46.3%;n = 171)

All emergent literacy skills hovered around the mean in thisaverage profile. These children could name approximately 18 let-ters and could write many of the letters in their names or theirnames generally correctly.

5.1.10. Profile 3: Lowest emergent literacy (prevalence = 18.7%;n = 69)

Children in Profile 3 displayed the lowest emergent literacyskills across domains, with oral language skills over −1 SD of themean and code-related skills between −0.5 to −1 SD. On average,children could name approximately 12 letters of the alphabet andcould represent many of the letters of their names in writing.

5.2. Stability of profile membership

Our second research aim was to examine the extent to whichchildren remained stable in their profile membership. Table 4 pro-vides a matrix of fall and spring profile membership. Children whowere members of Profile 1 in the spring (i.e., Highest Emergent Lit-eracy) were primarily members of fall Profiles 1 or 3, which werecharacterized by either high average or highest oral language but

substantially different code-related skills. Children in the springProfile 2 (i.e., Average Emergent Literacy) were primarily membersof fall Profiles 2, 3, or 4, characterized by average oral languagebut differential code-related skills. Children in spring Profile 3 (i.e.,Lowest Emergent Literacy) were primarily members of the leastdesirable fall Profiles 4 or 5, characterized by either low average orlowest oral language with broad code-related weaknesses.

We defined stability as the extent to which children remainedin similar profiles over time. Because fall and spring profiles werenot identical in pattern or number, we first identified the fall andspring profiles that were most similar to one another with regardto mean performance across skills. Consequently, fall Profile 1 wasdeemed similar to spring Profile 1 (i.e., Highest Emergent Literacy);fall Profiles 2, 3, and 4 were considered similar to spring Profile 2(i.e., Average Emergent Literacy); and fall Profile 5 was similar tospring Profile 3 (i.e., Lowest Emergent Literacy). When evaluatingfall-to-spring profile membership, over half of the children (239 of369) were classified into a similar profile across time, resulting inan overall stability estimate of .65.

The extreme profiles, in particular, displayed substantial sta-bility in membership, with 84% (n = 49) of children who weremembers of the most desirable profile in the fall (Profile 1) alsomembers of the most desirable profile in the spring (Profile 1).Similarly, 79% (n = 38) of children in the least desirable fall profile(Profile 5) were also in the least desirable spring profile (Profile 3).Membership shifts from the middle three fall profiles (Profiles 2, 3,& 4) were more variable, with only 58% (n = 152) retaining similarmembership.

Thirty-five percent of the sample (n = 130) demonstrated insta-bility, or change, in profile membership. Of these children, 90 (or24% of the sample) shifted upward to membership in a more desir-able profile: 80 moved from one of the three average fall profiles(Profiles 2, 3, or 4) into the highest spring profile (Profile 1) while10 children moved up from the least desirable fall profile (Profile 5)into the average spring profile (Profile 2). Forty children (or 11% ofthe sample) moved downward into a less desirable profile. Specif-ically, nine children moved downward from the Highest EmergentLiteracy fall profile to the Average Emergent Literacy spring profile;eight children shifted downward from fall Profile 2 to the lowestspring profile; and 23 children shifted membership from fall Pro-file 4 to the lowest spring profile. It is interesting to note that nochild in fall Profile 3 (High Average Oral Language, Weakness inAlphabet Knowledge) was a member of the least desirable springprofile (Lowest Emergent Literacy). It is also noteworthy that allmovement in profile membership was adjacent. That is, no childin the highest fall profile shifted downward to the lowest springprofile and likewise, no child in the lowest fall profile jumped tothe highest spring profile.

5.3. Potential factors explaining changes in profile membership

Our third research aim was to examine the possible fac-tors that may explain children’s changes in profile membershipfrom fall to spring. These factors included children’s initialemergent literacy ability, background characteristics, and schoolexperiences. Three groupings were created based on children’sfall-to-spring movement, representing children who: (1) shiftedupward (n = 90), (2) remained in the same profile (n = 239), and(3) shifted downward (n = 40). Table 5 displays the means andstandard deviations for all emergent literacy skills measured inthe fall based on movement groups, along with significant posthoc comparisons and effect sizes. There were significant differ-ences among movement groups in children’s initial emergentliteracy ability in five of the eight measures across the twodomains of oral language and code-related skills (as measuredin T-units). There were between-group differences favoring the

… unless we DO something (Cabell, Justice, Logan, & Konold, 2013)

Page 10: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Issue: Is Tier 3 Intervention Needed in Preschool?

• Skills with which children enter kindergarten make a significant difference to later academic success.

• Children who start preschool with lower than average early literacy and language levels rarely close initial skill gaps without some type of intensified instruction.

Greenwood et al., 2012; National Early Literacy Panel, 2008

Page 11: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Challenges in Implementing T3

• Identifying children for T3 intervention• Identifying effective T3 interventions• Managing and implement interventions • Monitoring progress

Page 12: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

12

Identifying Children for Tier 3

• Which children need Tier 3 support?

– Children who are significantly behind their peers

in the acquisition of critical early skills (e.g.,

social/behavioral, early literacy, language skills).

• What do we know about these children

– Children are behind in the acquisition of skills for a

variety of reasons (e.g., ELL, lack of exposure

to/experience with print, speech-language delays,

other learning difficulties).

• Pick a reliable and valid screening tool and use it!

Al ‘Otaiba & Fuchs, 2002

Page 13: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Tier 3 Interventions

• The challenge: – What is an effective Tier 3 intervention?

Page 14: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

14

Features of Effective T3 Interventions

• Lowest performing children benefit the most from language and early literacy intervention that is:– More systematic– More explicit– Focused on priority skills– Increases opportunities to respond– More individualized

(e.g., Biemiller & Slonim, 2001; Connor et al., 2014; Foorman & Torgesen, 2001; Justice & Vukelich 2008; Simmons, 2015)

Page 15: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Systematic

• Carefully designed scope and sequence of skills– Prerequisite skills taught first– Complex skills divided into small chunks– Introduces skills in a way to minimize confusion

Page 16: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Explicit

• Directly teaching skills using– Clear and concise language– Explanations and demonstrations of the skill– Guided practice with corrective feedback– Independent practice(I do , we do, you do)

Page 17: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Focus on Prioritized Content

• Children experience greater difficulty in learning when there are too many learning objectives.

• To accelerate progress, focus on teaching the most critical skills in an optimum sequence at an optimum rate.

Page 18: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Increase Opportunities to Respond

• Children with the most intensive instructional needs require numerous opportunities to practice and receive immediate feedback on the skills they are learning.

• Most of the intervention time should be spent practicing the skills taught.

• Provide instruction in smaller groups.

Page 19: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Individualize

• Adapt instruction to children’s strengths and needs• Modify instruction as children progress and needs

change• Options for individualizing include changes in:– Content– Activities– Duration– Pace– Support (e.g., scaffolding)– Teaching to mastery and repeating lessons as necessary

Page 20: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Tier 3 Curriculum Example: Reading Ready

• Reading Ready activities are designed to be implemented in the classroom by a teacher in small groups or 1-1.

20

Page 21: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Tier 3 Early Literacy InterventionSample Materials

Games

Ss...ss

...s ss ...s s s s

. . . . .

...sss...s ss . . . . s s .

. s ...

SS..ssss...SS

...sss...S...SSss

s....

Cc

H h I i

F fE e

Aa

J j

Gg

BbDd

Page 22: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Tier 3 Curriculum Example: Reading Ready

• Focus• Content– Carefully sequenced skills/tasks– Clear objectives– Small learning units

• Strategies– Explicit instruction– Consistent and simple instructional language– Ample opportunities to respond (6-12/minute)– Strategies encouragement and guidance– Strategies for providing support (scaffolding)

22

Page 23: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Tier 3 Intervention: Focus

Early Literacy Intervention– Goal: Understanding of the alphabetic principle• Alphabet knowledge: Familiarity with letters of the

alphabet, recognize and name letters• Phonemic awareness: Recognize and identify first sounds

in words• Understand connection between letter sounds and speech

and relationship to reading

Page 24: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Systematic: Careful sequence of skills

• Concept of a word• Word parts• Initial sounds– /m/– /f/– /b/– /t/– /s/– /p/

• Generalize to new sounds – /l/– /g/– /r/– /k/– /n/– //

Page 25: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Tier 3 Curriculum Example

Reading Ready

83

Lesson 7: Recognize First Sound /m/ in Words

Lesson 7

Lesson 7 Recognize First Sound /m/ in Words

Goal: The child will recognize words with the first sound /m/.

Materials: • L7 Game markers: Mindy Mouse and Mike the Mole• Optional: Picture cards from sets M and MC, generic gameboard

Encouragement and guidance:• When the child selects the correct word, say, Yes! The word map starts with the first sound /m/.

• If the child does not select the correct word, say, The word map starts with the first sound /m/. Listen. Map. Elongate the /m/ sound as yousay the word. Say it with me. Map. Encourage the child to elongate the /m/ sound in the word. Which word starts with the first sound /m/?

If the child has difficulty• Emphasize the first sounds in words by elongating them, for example, mmmoon.

• Be sure that the child says each word before selecting the word that starts with /m/.

• Have the child say the words with you “the slow way,” emphasizing the first sound in the word.

• Have the child say each word multiple times.

Variations• Use picture cards from sets M and MC and play one of the game variations for discriminating first sounds.*

* You may use generic game boards and markers of your choice for any of the variations listed above.

Page 26: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Tier 3 Curriculum Example

Reading Ready

85

Lesson 7: Recognize First Sound /m/ in Words

Lesson 7

1. Review• Last time we learned about the sound /m/. /m/ is the yummy sound. It is the sound we make when we eat something that is yummy.

/mmm/. Rub your stomach as you say the sound.

• /m/ is the first sound in words: my, moose, man. Elongate the /m/ sound as you say the words.

• Let’s practice listening for /m/. I will say some sounds. When I say the yummy sound, /m/, rub your tummy, like this. Rub your stomach as you say the sound. If I say a sound that is not /m/, keep your hands in your lap, like this. Fold your hands together in your lap.

• Say the following sounds: /m/ /f/ /m/ /m/ /r/. Provide encouragement and guidance as needed.

Page 27: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Tier 3 Curriculum Example

Reading Ready

87

Lesson 7: Recognize First Sound /m/ in Words

Lesson 7

2. Introduce• Today we are going listen for the /m/ sound in words. We will say words and pick the one that starts with /m/.

3. Demonstrate• Here are some pictures of words. I will say two words, then I will pick the word that starts with the first sound /m/.

• Point to milk. This is milk. Point to saw. This is a saw. Now I will pick the word that starts with /m/—milk (point) or saw (point). Pause, then point to milk. I pick milk. The first sound in the word milk is /m/. /m/ milk.

• Watch and listen again. Point to fork. This is a fork. Point to map. This is a map. Fork (point). Map (point). I pick map because the first sound in the word map is /m/. /m/ map.

4. Do It Together• Let’s do it together. Point to milk. Say milk. Point to saw. Say saw. Now, let’s say the one that starts with the first sound /m/. Ready?

Pause. Point to milk. Milk. Be sure the child says the word with you. Repeat if necessary.

• Repeat the wording above with the following words. Be sure the child does it with you.

– fork / MAP

– shark / MOON

– MARKER / fairy

– shoe / MAIL

Page 28: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Tier 3 Curriculum Example

Page 29: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Tier 3 Curriculum Example

Reading Ready

89

Lesson 7: Recognize First Sound /m/ in Words

Lesson 7

5. Guided Practice (a)• Let’s play a game. Have the child select a game marker and place it on the green dot.

• Here is a meadow. Let’s help (marker) get to the mountain without getting caught by the marsh hawk. This is the path that (marker) needs to follow. Point and move your finger along the path.

• I will say two words. You pick the word that starts with the first sound /m/ and then (marker) can move to that space.

• Point to moose. This is a moose. Say moose. Point to lion. This is a lion. Say lion . Which word starts with the first sound /m/—moose or lion ? Provide encouragement and guidance as needed.

• After the child responds correctly, either independently or with guidance, say, Yes! the word moose starts with the first sound /m/. /m/ moose. Move the game marker onto the space.

• Repeat the wording above with the following words. Provide encouragement and guidance as needed.

– fire / MOP

– MUFFIN / shovel

– rake / MAT

– MUD / leaf

NOTE: If the child was able to respond correctly on four out of five of the previous words independently, you may move directly to the Checkout. If the child needs more practice, continue with the next game.

Page 30: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Tier 3 Curriculum Example

Page 31: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Tier 3 Curriculum ExampleReading Ready

93

Lesson 7: Recognize First Sound /m/ in Words

Lesson 7

6. CheckoutTo pass the Checkout and move to the next lesson, the child must respond correctly and independently on four out of five words. Do not provide guidance on the Checkout.

• Here are more pictures. Put (marker) here. Point to the green dot.

• I will say two words. You tell me which word has the first sound /m/ and then (marker) can move to that space.

• Say these words after me. Point to log. Log. Point to mitt. Mitt. Which word starts with the first sound /m/—log or mitt? After the child responds, correctly or incorrectly, move the marker to the first space.

• Repeat the wording above with the following words. Move the marker forward one space for each word responded to, whether correct or incorrect.

– sail / MASK

– MOUSE / fan

– shower / MONKEY

– MOTH / rope

NOTE: When the child has passed the Checkout move on to Put in Context.

Page 32: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Tier 3 Curriculum Example

Page 33: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Research on T3 Intervention: Sites

• Early childhood programs in two states including– Head Start– Public School PreK programs– Private nonprofit program serving children with

disabilities

Page 34: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Research on T3 Intervention: Subjects

• 100 Preschool children who met eligibility criteria for T3 intervention– Gate 1: below screening cut point on IGDI Alliteration and

Sound Identification– Gate 2: => 1SD below mean on PA subtest of TOPEL– Pretesting: < K beginning of year cut-point for risk on

DIBELS First Sound Fluency

• Randomly assigned within classroom to Intervention or control group

Page 35: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Research on T3 Intervention: Subjects

GroupIEP Status (N/%) DLL Status (N/%)

IEP Non IEP Unknown DLL Non DLL Total

All 28/28% 65/65% 7/7% 49/49% 51/51% 100

Control 16/33% 30/61% 3/6% 20/41% 29/59% 49

Intervention 12/24% 35/69% 4/7% 29/57% 22/43% 51

Page 36: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Research on T3 Intervention: Measures

• Test of Preschool Early Literacy (TOPEL, Lonigan, Schatschneider, Torgesen, & Rashotte, 2007)– Phonological Awareness

– Print Knowledge

• Preschool Early Literacy Indicators (PELI, Kaminski, Abbott, Aguayo, & Good, 2017)– Alphabet Knowledge

– Phonological Awareness-Word Parts

– Phonological Awareness-First Sounds

– Vocabulary-Oral Language

– Comprehension

• Dynamic Indicators of Basic Early Literacy Skills Next (DIBELS Next, Good & Kaminski et al., 2011)– Letter Naming Fluency

– Word Parts Fluency

– First Sound Fluency

Page 37: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Factor Analysis on Measures

Factor 1: Print Knowledge

Factor 2:Phonological Awareness

Factor 3:LanguageAcquisition

TOPEL PK 0.797431 0.002128 0.049234

PELI Comp -0.025164 -0.032849 0.815462

PELI V-OL 0.027755 0.086005 0.854011

WPF 0.027373 0.783321 0.094461

LNF 0.921364 0.001488 -0.053719

FSF -0.029730 0.677983 -0.101270

PELI AK 0.931767 -0.003023 -0.022699

PELI PA WP 0.009638 0.725374 0.303561

PELI PA FS 0.050534 0.776998 0.069103

Page 38: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Composite Scores for Factors

Measure Mean SD

Pre Print Knowledge Composite .00 .94

Pre Phonological Awareness Composite .00 .83

Pre Language Acquisition Composite .00 .94

Post Print Knowledge Composite .52 1.17

Post Phonological Awareness Composite 1.81 1.96

Post Language Acquisition Composite .11 .87

Z scores based on Pretest scores

Page 39: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Correlations for Factor Composite Scores

Score Pre PK Pre PA Pre LA Post PK Post PA Post LA

Pre PK 1.0000 0.1782 0.0800 0.7878 0.1219 0.0483

Pre PA 0.1782 1.0000 0.3110 0.2107 0.4781 0.2576

Pre LA 0.0800 0.3110 1.0000 0.0743 0.3579 0.7768

Note: PK = Print Knowledge. PA = Phonological Awareness. LA = Language.

Page 40: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Results: Main Effect for Group

Measure Control Intervention F-ratio p-value η2

LanguageAcquisition Difference

.04 .19 1.43 .23 .014

Print Knowledge Difference

.33 .70 7.17 .0087 .067

PhonologicalAwareness Difference

.96 2.63 31.10 <.0001 .237

Note. Degrees of freedom are (1,100) for all effects.

Page 41: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Main Effect for Group

0

0.5

1

1.5

2

2.5

3

Language Composite Print Knowledge Composite Phonological Awareness Composite

Control Intervention

Page 42: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Treatment by IEP Status Interaction

Df1 Df2 F-ratio P-value partial η2

LanguageAcquisitionDifference

1 91 1.30 .26 .014

Print Knowledge Difference

1 91 .19 .66 .0021

PhonologicalAwareness Difference

1 91 1.43 .23 .026

Page 43: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Treatment by DLL Status Interaction

Df1 Df2 F-ratio P-value partial η2

LanguageAcquisitionDifference

1 98 0.01 .93 <.0001

Print Knowledge Difference

1 98 1.34 .25 .014

PhonologicalAwareness Difference

1 98 .34 .56 .0035

Page 44: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Summary

• Evidence of effectiveness of Tier 3 intervention with a group of preschool children identified as needing Tier 3 support

• No interaction effect: Intervention was equally effective with children who were dual-language learners and children who were on IEPs

Page 45: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Future Directions

• Replicate– Different sites– Different populations– Different measures

• Train teachers to implement– Teachers as implementers

Page 46: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Challenges in Implementing T3

• Identifying children for T3 intervention• Identifying effective T3 interventions• Managing and implement interventions • Monitoring progress

Page 47: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Implementing Tier 3 Interventions

• “Thus, the implementation of Tier 3 intervention in preschool not only requires well-designed interventions but careful planning and strategic classroom management. In the preacademic and developmental skill areas (e.g., early literacy, language, math) the most effective interventions are likely to be an integrated approach utilizing both highly focused small group/one-on-one instruction and intentional embedded approaches. Such an integrated approach maximizes effectiveness and efficiency of teaching and learning by providing opportunities for the child to receive the individualized instruction needed to acquire new skills combined with opportunities to practice, apply, and generalize the skills in multiple contexts across the preschool day. ” Kaminski, Powell-Smith, and Aquayo, 2018

Page 48: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Effective Small Group Instruction

Small group instruction is "one of the most underused and ineffectively implemented strategies in early childhood classrooms" (Wasik, 2008).• The classroom needs to be organized to accommodate small

group instruction daily, although all children may not participate in small group instruction daily.

• Assignment of children to small groups needs to be done intentionally based on child needs. All groups do not have to be of equal size.

• A plan for managing the groups is necessary. • The classroom schedule and small group time will change

throughout the year.

Page 49: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Progress Monitoring• A key component of MTSS• Allows for timely decisions about the effectiveness of

the intervention• Should be aligned with and integrated into T3

intervention process• Requires assessment tools designed for progress

monitoring – Sensitive to small changes in children’s skills– Relate to more distal outcomes of school readiness– Technically adequate– Appropriate for young children– Feasible for EC teachers

Page 50: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Tier 3 in Early Childhood: Do We Need It?

Page 51: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

ReferencesBiemiller, A., & Slonim, N. (2001). Estimating root word vocabulary growth in normative and advantages populations: Evidence for a common sequence of vocabulary acquisition. Journal of Educational Psychology, 93(3), 498-520.

Cabell, S.Q., Justice, L.M., Konold, T.R., McGinty, A.S. (2011). Profiles of emergent literacy skills among preschool children who are at risk for academic difficulties. Early Childhood Research Quarterly, 26, 1-14.

Connor, C.M., Alberto, P.A., Compton, D.L., O’Connor, R.E., (2014). Improving reading outcomes for students with or at risk for reading disabilities: A synthesis of the contributions from the Institute of Education Sciences Research Centers (NCSER 2014-3000). Washington, DC: National Center for Special Education Research, Institute of Education Sciences, U.S. Department of Education. available at http://ies.ed.gov/

Foorman, B.R., & Torgesen, J. Critical elements of classroom and small-group instruction promote reading success in all children. Learning Disabilities Research & Practice, 16(4), 203-212.

Jenkins, J.R., Schiller, W., Blackorby, J., Thayer, S.K., Tilly, W.D. (2013). Responsiveness to intervention in reading: Architecture and practices. Learning Disability Quarterly, 36(1), 36-46.

Justice, L.M., & Vukelich, C. (Eds.)(2008) Achieving excellence in preschool literacy instruction. New York, NY: Guilford Press.

Kaminski, R.A., Powell-Smith, K., & Aquayo, K.B. (2018) Creating and providing tier 3 instructional support. In J. Carta & R. Miller Young (Eds.) Multi-tiered systems of support for young children: Driving change in early education. Baltimore, MD: Brookes Publishing Co.

Simmons, D. (2015). Instructional engineering principles to frame the future or reading intervention research and practice. Remedial and Special Education, 36(1), 45-51.

Wasik, B. (2008). When fewer is more: Small groups in early childhood classrooms. Early Childhood Education Journal, 35, 515-521

Page 52: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Resources on Differentiated and Small Group Instruction in EC

Abou-Sayed, Y. (2011). Using small groups and workstations: From chaotic to constructive. Texas Child Care Quarterly, 35(3). www.childcarequarterly.com/pdf/winter11_smallgroups.pdf

Gibson, V. (2014). Classroom management for differentiating instruction and collaborative practice. Austin, TX: Gibson Hasbrouck and Associates. www.gha-pd.com

Purcell, T., & Rosemary, C.A. (2007) Differentiating Instruction in the preschool classroom: bridging emergent literacy instruction and developmentally appropriate practice. In L.M. Justice & C. Vukelich (Eds), Achieving excellence in preschool literacy instruction, New York: Guilford. http://www.stcloudstate.edu//tpi/teachersupport/documents/DifferentiatingInstruction-EarlyChildhood.pdf)

Roskos, K.A., Christie, J.F., & Richgels, D.J. (2003). The essentials of early literacy instruction. Washington DC: National Association for the Education of Young Children. http://www.naeyc.org/yc/pastissues/2003/March

Schickedanz, J.A. (2008). Increasing the power of instruction: Integration of language, literacy, and math across the preschool day. Washington DC: National Association for the Education of Young Children. https://store.naeyc.org/sites/store/files/TOC/239.pdf

Page 53: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Resources on Promoting Language and Early Literacy in EC

Christ, T., & Wang, X.C. (2010). Bridging the vocabulary gap: What the research tells us about vocabulary instruction in early childhood. Young Children, 65(4), 84-91. http://www.naeyc.org/files/yc/file/201009/ChristWangOnline.pdf

Neuman, S.B., & Wright, T.S. (2014). The magic of words: Teaching vocabulary in the early childhood classroom. www.readingrockets.org/research-by-topic/magic-words

Roskos, K.A., Christie, J.F., & Richgels, D.J. (2003). The essentials of early literacy instruction. Washington DC: National Association for the Education of Young Children. http://www.naeyc.org/yc/pastissues/2003/March

Schickedanz, J.A. (2008). Increasing the power of instruction: Integration of language, literacy, and math across the preschool day. Washington DC: National Association for the Education of Young Children. https://store.naeyc.org/sites/store/files/TOC/239.pdf

Whitehurst, G.J. Dialogic reading: An effective way to read to preschoolers. http://www.org/article/dialogic-reading-effective-eay-read-preschoolers/

Page 54: Impacting Literacy Outcomes - Acadience Learning · 2020. 1. 3. · Average Emergent Literacy); and fall Profile 5 was similar to spring Profile 3 (i.e., Lowest Emergent Literacy)

Thank you

Dr. Ruth [email protected]