One Voice – One Plan

Office of Education Improvement and Innovation

MI-CSI: Do StageImplement Plan and Monitor Plan

Introduction

DoImplementMonitorEvaluate

Activity: School Improvement on the Fly

http://media.mivu.org/mvu_pd/micsi/PlanningTime/PlanningTime.html

• Implementation

• Fidelity

• Impact

Do Vocabulary

Implement

DoImplementMonitorEvaluate

The Big Picture

Nothing to it but to do it?

Implementation

Process

Readiness to Implement

Have a shared vision? Understand the need? Concerns have been

addressed? Staff and

administrators are able to integrate this new work with existing work?

Implementation Guide

Essential to implementation

Non-negotiable

Highest level of fidelity

May vary from gold standard

Still true to the research

Not consistent with research

Will not lead to desired results

Key Feature

Sample Strategy Implementation Guide

Strategy: What teachers do in the classroom with the students in the presence of content – Teachers will…. –Math teachers will…. – ELA teachers will…

MDE Definition of Strategy

Activity: What needs to be done so that staff or teams – are ready to implement the strategy – have a plan for implementation of the

strategy– have a plan to monitor and evaluate the

implementation of the strategy and the impact on student achievement

MDE Definition of Activity

Matrix 1 Tool

• How will we ensure readiness for implementation?

• How will we ensure that staff and administrators have the knowledge and skills to implement?

• Professional development around strategy• Purchase materials• -Planning for implementation – Identify

schedule for strategy use, personnel, mechanism for monitoring, rollout, etc.• -Communication vehicles

Activities: Getting Ready to Implement

• How will we ensure successful opportunity for implementation of the strategy?

• Communication – to whom? How?• Ongoing coaching?• Observations?• Instructional technology utilized?*• Activities to support at-risk students

(For Title One students)*• Parent Involvement has been planned

Activities: Implement

• How will we ensure the strategy is implemented with fidelity?

• How will you monitor the program’s impact on student achievement?

• Walkthroughs• PLC/CASL meetings• Documentation of effective

implementation• Documentation of impact (Gather

achievement data)• Demonstration classrooms or lesson

study, videos, self assessments

Activities: Monitor Fidelity of

Implementation

Monitoring of Activity Implementation

Monitor

DoImplementMonitorEvaluate

The Big Picture

Monitoring

Adults are implementing the strategy with fidelity

Impact implementation is having on students

Leadership and Learning Center 2010

Implementation and Impact

Monitoring Implementation

Demographics

Student Outcomes

Perceptions

School Processes

Meeting schedules Meeting minutes

Ongoing Student Data

Walkthrough data

• Collected on adult actions or behaviors

• Based on teacher actions related to set standards – Implementation Guide to

define –What does the strategy look

like and sound like if implemented fully?

• Quantifiable

Implementation Data

• How will we know the strategy is implemented as intended?

• Have we clearly defined expected adult actions?

• How well have we communicate these expectations?

• What data will we collect?– Self-collection– Peer collection– Leader collection

Adult Actions

• Collected on student learning related to a specific outcome or target

• A proficiency level should be set based on pre-determined criteria–Examples:• 70% is considered proficient• 4 out of 6 on rubric

• Quantifiable

Impact Data

• How will we know the strategy is impacting what students learn?

• Have we clearly defined learning expectations?

• What data will we collect?– Formative– Interim– Summative

Student Learning

1. Implementation Guide Sample: Close and Critical Reading

2. Monitoring of Activity Implementation

3. Matrix 1Tool4. Monitoring of Classroom

Strategy Implementation

Tools to support Successful

Implementation

Monitoring of Classroom Strategy Implementation

• What mechanism will we use to determine the interaction between the data collected on adult actions (Implementation data) and student learning (Impact data)? – Format– Frequency– Adjustments

Relationship between implementation and impact

data

Hey, why did we do that Flipped Activity?

• Type of Data: Implementation (Adult Data) versus Impact (Student Data)

• Fidelity Rate: The percentage of adults implementing the strategy the way it was defined.

• Data Narrative: A non-judgemental, factual statement about the data.

• Causal Factors: Factors that led to the fidelity or proficiency rate.

• Action: The steps that will be taken to improve the fidelity or proficiency rate.

Flipped Activity

• Strategy• Fidelity Rate• Percent Proficient

Share out

• Close and Critical Reading• Fidelity Rate 50%• Percent Proficient 38%

Example Shared:

Fidelity Rate compared to Percent Proficient

• 50% Fidelity Rate

• 38% Proficient

Fidelity Rate < 80%

Fidelity Rate compared to Percent Proficient

• 50% Fidelity Rate

• Two staff members did not received adequate training

• Three staff members indicated that they forgot to record their strategies.

• 38% Proficient

Fidelity Rate < 80%

• We will have a follow up training after school on the 28th from 2:30 - 4:00. All are invited.

• All staff members have received the link to the walkthrough tool again and deadlines have been reiterated.

FOCUS ON Implementation Actions

Fidelity Rate < 80%

• Close and Critical Reading• Fidelity Rate 91%• Percent Proficient 73%

Another Example :

Fidelity Rate compared to Percent Proficient

• 91% Fidelity Rate

• 73% Proficient

Fidelity Rate > 80%

Fidelity Rate compared to Percent Proficient

• 91% Fidelity Rate

• Teacher who did not implement had a misunderstanding of how to model and scaffold learning for all students.

• 72% Proficient• 20% of students in

this grade are not reading at or above grade level.

Fidelity Rate > 80%

FOCUS ON actions for both Implementation and Impact

• Observe Peers • Embed Coaching

Support with focus on modeling for two weeks.

• Pull intervention group to support students below grade level.

• Re-test students using  appropriate grade level text.

Fidelity Rate < 80%

You decide: • SI Plan is a compliance document or

SI Plan is a blueprint for increasing student learning in the classroom

• A SI blueprint will include active participation by staff, ongoing data collection and analysis and discussions around causal factors and deliberate actions to increase fidelity and student learning.

So, Where do we go from here?

Conclusion

DoImplement

Monitor

Evaluate