S-RIPCoach Meeting

September 26, 2013

Char RyanLinda Watson

Bob BraunKatie Schmitt

A G E N D A

• Welcome• Introduction to ITV• Introductions among coaches• Coach Role and Responsibilities• Reality testing coaching• Coach Resources – Calendar• Overview of PBIS Assessments• Effective Problem Solving

Outcomes

• Coaches will increase their understanding of the PBIS Coach Role and Responsibility

• Coaches will learn about Coach Resources

• Coaches will learn a model of effective problem solving

ITV Etiquette

taken from SWIS 5

Group Agreements• Stay focused and engaged

(e.g., discussions, activities, active listening, present for entire training)

• Support others by reducing distractions (e.g., technology, side conversations)

• Take care of your personal needs(e.g., restroom, breaks, emergency texts/calls)

Coach to CoachIntroductions

Please tell us your name and what school you are with and what Cohort you are in.

Coach Role& Responsibility

PBIS coaches will:

1. describe and promote features, practices and systems of SW-PBIS among school, district and community audiences2. promote the logic and application of the tiered model of prevention and support3. describe the features of proactive school-wide discipline systems4. teach the strategies for

1. classroom management (consistent with SW-PBIS)2. systematic supervision (non-classroom settings)

5. promote a continuum of behavior support for individual students6. promote implementation of team-led process7. support strategic data-based action planning within the school and district8. provide direction in assessing progress and fidelity9. collection, analysis and use of data in decision-making10. coordination with district, regional and state efforts

Coaches knowledge, Skill & Competencies

KnowledgeGeneral school discipline practices, classroom and individual behavioral managementSW-PBIS concepts and featuresStages of implementation from exploration through sustainabilitySW-PBIS and other data tools, systems and decision-makingSW-PBIS fidelity benchmarksSW-PBIS sustainability features, practices and measures

SkillsAble to communicate verbally, in writing and through technology (all of the above)Able to navigate the SW-PBIS PBISApps.org website, MNPBIS data websiteAble to retrieve, interpret, and analyze data as basis for team problem solvingAble to lead team through problem solving process for action planningAble to facilitate small group meetings and conduct trainingsAble to produce consistent, accurate and effective follow-though with commitments

Competencies Able to seek, identify and create effective contactsAble to generate enthusiasmAble to develop rapport with entire school and district communityAble to listenHas credibility with at least 80% of staff (how do we teach this?)Able to encourage others to find solutionsAble to support and guide others to develop knowledge, experience and expertiseAble to delegateAble to work well with administration and staffAble to handle ambiguity in role and function and in school implementation process

Coaching In general

Coaches develop and use knowledge and skills in order to support and guide schools in their implementation and maintenance of School-wide Positive Behavioral Interventions and

Supports (SW-PBIS).

Coaches work within the context of the school SW-PBIS team

Reality Testing1. You already have many of these skills 2. We have lots of supports for you

• Team Training• Coach Training• SRIP Regional Coaching (phone, email)• Each other-networking• FaceBook PBIS MN, Twitter #pbis_mn• PBIS Summer Institute• State and national websites– www.pbis.org www.pbismn.org • pbisworld.com • Coaches’ calendar

S-RIP Coach Calendar2013-2014

Coach Reality Checkpoint

TALK

• Quick Think & Share—15 minutes:

• What have you learned as a coach?

• Why is it useful?

• What recommendations would you give to a new colleague?

• Share with a neighbor when finished.

Using Data for Problem Solving & Action-Planning

M-RIP Cohort 8 Coach Mtg Oct 23 2012

(1) Are we implementing school-wide PBIS?

Implementation (all features)

Fidelity

(2) If we are, is it making a difference for students?

Outcomes

Tools & RelevanceTool Perspective/Source Method Relevance

TIC 3.1 PBIS Leadership Team Self-report ProgressAction planFidelity

SAS School staff Survey Staff needs/priority

SET Outside Evaluator Observation/Interview/products

Fidelity

ODR Student office referralStaff

Defined Process Measures outcome

Analysis

• Know 3 types of reports – All tools

– Total score - Are we improving? (evaluation question)

– Subscale score What is working & where do we focus next?

– Item report – Action plan

M-RIP Cohort 8 Coach Mtg Oct 23 2012

The TIC & PBIS FeaturesHow the TIC correlates with planning steps 1-8

Planning Steps 1 – 8 Correlated with TIC Subscales Step 1 Establish Leadership team (TIC Subscales 1, items 1-2, Subscale 2, items 3-5)Step 2 Develop a purpose statement (TIC Subscale 2, item 3)Step 3 Identify 3-5 expectations (TIC Subscale 4, items 9-11)Step 4 Develop procedures for teaching (TIC Subscale 4, items 10-12;

school-wide expectations Subscale 5, item 12)Step 5 Develop plans for teaching (TIC Subscale 8, items 15-16)

classroom expectations Step 6 Develop procedures for encouraging behavior (TIC Subscale 6, item 13)Step 7 Develop procedures for discouraging violations (TIC Subscale 7, item 14)Step 8 Develop data-based procedures for (TIC Subscale 3, items 6-8;, monitoring implementation Subscale 9, items 18-19) TIC Subscale 9 Establish information systemsTIC Subscale 10 Build capacity for function –based support tier 2-3 early thoughts

PBISApps• Demonstration

Use your 6 digit School ID#

Lunch

Break

Cutting Edge Researchon Sustaining SW-PBIS

Research shows that schools who are successfully implementing SW-PBIS at fidelity more than three years after starting:

Use data regularly in making decisionsHave teams that work effectivelyAdministrator involvement & support

Improving Decision Making

From

To

People aren’t tired from solving problems – they are tired from solving the same problem over and over.

Steps in Effective Problem solving

• Identify if there is a problem

• Primary to Precision

• Build a Solution

• Create an action Plan

• Implement and Evaluate

Effective problem solving involves implementation & fidelity data as well as outcome data.

2 examples

• 1 example using implementation data

• 1 example using ODR (outcome) data

Identifying Problems/Issues• What data to monitor

– ODR per day per month– OSS, ISS, Attendance, Teacher report– Team Checklist/ (TIC) (Are we doing what we planned to do?)

• What question to answer– Do we have a problem?

• What questions to ask of Level, Trend, Peaks– How do our data compare with last year?– How do our data compare with national/regional norms?– How do our data compare with our preferred/expected status?

• If a problem is identified, then ask– What are the data we need to make a good decision?

Using Data to Refine Problem Statements

• The statement of a problem is important for team-based problem solving.

• Everyone must be working on the same problem with the same assumptions.

• Problems often are framed in a “Primary” form. That form creates concern, but is not useful for problem-solving.

• Frame primary problems based on initial review of data• Use more detailed review of data to build

“Solvable Problem Statements.” = Precise statements

Primary versus Precision Statements

Primary Statements

• Too many referrals

• September has more suspensions than last year

• Gang behavior is increasing

• The cafeteria is out of control

• Student disrespect is out of control

Precision Statements

• There are more ODRs for aggression on the playground than last year. These are most likely to occur during first recess, with a large number of students, and the aggression is related to getting access to the new playground equipment.

Primary versus Precision Statements

– What? More ODRs for aggression.

– Where? On the playground.

– When? First recess.

– Who? A large number of students.

– Why? To get access to the new playground equipment.

Precision Statement:

• There are more ODRs for aggression on the playground than last year. These are most likely to occur during first recess, with a large number of students, and the aggression is related to getting access to the new playground equipment.

Precise or Primary Statement?• Children are using inappropriate language with

a high frequency in the presence of both adults and other children. This is creating a sense of disrespect and incivility in the school.

• ODRs during December are higher than in any other month.

Primary

Primary

Precise or Primary Statement?• James D. is hitting others in the cafeteria

during lunch, and his hitting is maintained by peer attention.

• Boys are engaging in sexual harassment.

• Three 5th grade boys are name calling and touching girls inappropriately during recess in an apparent attempt to obtain attention.

Precise

Primary

Precise

Transforming Data into Information• Look first at your patterns. What is the story the data

tell?– Is it level? – Is there a trend?– Where are the peaks? Where are the valleys?– Match the data to current perceptions

• Compare your data– With the national median. (or established criterion TIC )– With data from last year. (last quarter-TIC)– With what your staff/students/families want.

“An undefined problem has an infinite number of solutions.”

Robert A. Humphrey

Designing Goals

• Define the problem with precision.

• Define the measure of the problem (level, amount).

• Define what would be considered “good.”

• Use the goal to guide the solution.– How can we move from where we are to where we want to

be?

S M A R T Goals • Specific•Measurable•Attainable•Relevant• Timely

Designing GoalsProblem Level Goal

• Many students are leaving garbage in the cafeteria resulting in conflict and ODRs.

• The behavior is maintained because it is easy to do.

• 22 ODRs per month from the cafeteria

• Heidi (café supervisor) rates cafeteria as “1” (low) on a 1-5 scale of cleanliness.

• Less than 5 ODRs per month from the cafeteria.

• Heidi rates cafeteria as greater than 4 for cleanliness two weeks in a row.

Group Activity 5 min

Using the example that follows read the “PreciseProblem Description” of the problem and thelevel.

Discuss possible goals for Phil

Activity-Designing Goals Problem Level Goal

• Phil is engaging in physical/verbal aggression toward three younger students during unstructured times.

• We believe this is maintained by social positives from his peer group and responses from the 3 students.

• Phil has received 4 ODRs this week for bullying, teasing, or aggression.

• ???

Using Data to Develop Solutions• Prevention—how can we avoid the problem context?

– Who? When? Where?– Schedule change, curriculum change, etc.

• Teaching—how can we define, teach, and monitor what we want?– Teach appropriate behavior– Use problem behavior as negative example

• Recognition—how can we build in systematic rewards for positive behavior?

• Extinction—how can we prevent problem behavior from being rewarded?• Consequences—what are efficient, consistent consequences for problem

behavior?• How will we collect and use data to evaluate:

– Implementation fidelity?– Impact on student outcomes?

Solution DevelopmentSolution Component Action Step(s)

Prevention

Teaching

Recognition

Extinction

Corrective Consequence

Data collection• What data will we look at?• Who is responsible for gathering the data?• When/How often will data be gathered?• Where will the data be shared?• Who will see the data?

Example 1Working with Implementation and fidelity data

TIC or SET

Our goal is to implement and sustain all features of School-Wide PBIS with fidelity

So that we achieve important student outcomes

Analysis

• Know 3 types of reports – All tools

– Total score - Are we improving? (evaluation question)

– Subscale score What is working & where do we focus next?

– Item report – Action plan

M-RIP Cohort 8 Coach Mtg Oct 23 2012

TIC Total ScoreAre we improving?

Criteria is 80%

TIC 3.1 Subscale What is working and where do we focus next?

Criteria is 80%

Item Score Build the action plan – look at scores of 0 or 1

Interpreting TIC Data1. What subscale is highest, 2nd highest?

--What are the content areas in that subscale?--What descriptive statement could you make?

2. What subscale is the lowest?-- What are the content areas in that subscale?--What descriptive statement could you make?

3. Consider the context. What year is this school? -What if this is year 1, year 2, year 5 data?

4. What data might you expect for a new school?

SWIS Demo School Year ITIC data summary: primary to precise

Primary Statement• Overall we are making some progress implementing SWPBIS, strong

commitment and function based support. We have developing areas including team, assessment, expectations defined, expectations taught and evaluation systems

Precise Statement:• We have great administrator support and tot least 80% of faculty buy-in. We

also have staff with behavior expertise as well as an existing team for providing individual student function based support. We have developed a team but do not have regularly scheduled meetings and have not integrated activities across committees. We have completed only one self-assessment and will need to complete another TIC, the SAS, and the SET. We have made some progress in defining expectations, creating a matrix. We have not started creating teaching plans for the expectations,, teaching expectations or a consequence system. We have a partial system for monitoring referrals from classrooms but have not done a classroom system analysis.

Activity-Designing Goals ProblemPrecise Level Goal

Solution DevelopmentSolution Component Action Step(s)

Prevention

Teaching

Recognition

Extinction

Corrective Consequence

Data collection• What data will we look at?• Who is responsible for gathering the data?• When/How often will data be gathered?• Where will the data be shared?• Who will see the data?

Action Plan

What are our next steps to achieve our goal to resolve the problem?– Goal– Problem statements– Solution Actions– People assigned for task completion– Timelines assigned to tasks– Evaluation Plan

1. Fidelity (academic & social behavior)2. Student outcomes (academic & social behavior)

Using Precision Problem Statements to Build Solutions, Action & Evaluation Plans

Solutions

Prevention: How can we avoid the problem context? Teaching: How can we define, teach, and monitor what we want? Recognition: How can we build in systematic reward for desired behavior?Extinction: How can we prevent problem behavior from being rewarded?Consequences: What are efficient, consistent consequences for problem behavior?

Action Plan

Who will do each task & when will it be completed?

Evaluation

How will we collect and what data will we use to evaluate: •Implementation fidelity?•Impact on student outcomes?

Evaluation

How will we collect and what data will we use to evaluate: •Implementation fidelity?•Impact on student outcomes?

M-RIP Cohorts 2-8 Coaches' Mtg Oct 1 or 2, 2013

Solution Components

What are the action steps? Who is Responsible? By When? How will fidelity be

measured? Notes/Updates

Prevention

Teaching

Recognition

Extinction

Corrective Consequence

What data will we look at?

Who is responsible for gathering the

data?

When/How often will data be gathered?

Where will data be shared?

Who will see the data?

Data Collection

Precise Problem Statement: ___________________________________________________________________________________________________________Goal: _____________________________________________________________

Example 2Working with student outcome data

(ODR)

Our goal is to implement and sustain all features of School-Wide PBIS with fidelity

So that we achieve important student outcomes

Elementary School 465 students (465/ 100 = 4.6 X .22= 1.0)

Primary Problem StatementWe had peaks of problem behavior in Sept, Oct, & Nov.There has been a decreasing trend since December.Our rate of problem behavior has been above the national median for schools our size every month this year.

Primary Goal Our rate of problem behavior will

be at or below the national median as measured by SWIS,

monthly for the next ‘school year’

NextReview the Big 5 &

custom reports

Defining Precision Elements of the problem What are the problems?

Defining Precision Elements of the problem Where are problems occurring?

Defining Precision Elements of the problemWhen are problem occurring?

9:45

12:45

11:30 1:30

Defining Precision Elements of the problem Who are the students involved?

Refining the Elements via custom reports

3rd, 6th, and 7th graders

Obtain attention

Defining Precision Elements of the problemWhy are problems occurring?

Primary to PrecisePrimary

Last year we had an increasing trend during first 3 months(5-2.2/day above national median) .5-1.0 per day above national median for remainder of school year.

PreciseInappropriate language, disrespect, physicalaggression, harassment, disruption, in class & commonareas (hall, cafe, playground, commons) are takingplace at 9:45, 12:45-1:30, 11:30-12:15 involving many 6th, and 7th graders. Behaviors appear to be driven by a need to gain peer or adult attention.

Using Precision Problem Statements to Build Solutions, Action & Evaluation Plans

Solutions

Prevention: How can we avoid the problem context? Teaching: How can we define, teach, and monitor what we want? Recognition: How can we build in systematic reward for desired behavior?Extinction: How can we prevent problem behavior from being rewarded?Consequences: What are efficient, consistent consequences for problem behavior?

Action Plan

Who will do each task & when will it be completed?

Evaluation

How will we collect and what data will we use to evaluate: • Implementation

fidelity?• Impact on

student outcomes?

Prevent “Trigger”

Define & Teach

Reward/Reinforce

Withhold Reward

Corrective consequence

Other

Safety

62

Example for Precise Behavior Problem Statement6th and 7th graders are engaging in inappropriate language, harassment, disrespect and aggression in two classrooms at 9:45 and 12:45 to get peer and adult attention and to escape the work. There are 175 total instances of problem behavior in 6th and 7th grade classrooms, for 2010-11 school year.

Re-review 6th and 7th graders classroom expectations/Respecting others, daily

Focus on Respect, Re-teach stop-walk routine

Set up “Daily Double”: Class period without problem behavior occurrence receives extra 2 mins, at end of period to talk.Provide specific feedback for using stop-walk routine

Ensure staff use routine for responding to a report when student comes to talk.Use School Defined Process

Solution Components

What are the action steps? Who is Responsible? By When? How will fidelity be

measured? Notes/Updates

Prevention

Teaching

Recognition

Extinction

Corrective Consequence

What data will we look at?

Who is responsible for gathering the

data?

When/How often will data be gathered?

Where will data be shared?

Who will see the data?

Data Collection

Precise Problem Statement: ___________________________________________________________________________________________________________Goal: _____________________________________________________________

Thank you

• Next steps• Examine your data• Adjust your action plan as needed• Practice having your data discussion early in

your team meeting• When using your ODR data practice

developing Precise Statements, drilling down and creating data-based solutions and action plans. Review monthly