Data Inquiry ProcessData Leadership Summit

March 2018

Today’s Slides: https://goo.gl/K8wmr8

Developed and Facilitated byWISExplore Team Members:

Mary Ann Hudziak, CESA 6 Judy K. Sargent, CESA 7

1

Session Outcomes

Awareness about . . .● Student data inquiry process● Practices data inquiry process● Relationship between student and practices data inquiry● Tools and resources for documenting data inquiry

2

Additional Support

• The tools and resources we are sharing with you today were developed by the WISExplore Team

• All resources will eventually be available to everyone in WISElearn

• Each CESA has trained WISEcoaches to help teach the complete data inquiry process from start to finish

3

Process of Inquiry

4

Illumination through Data Inquiry

Data inquiry …● Is a collaborative process● Encompasses all levels of data work● Leads to analysis of root causes and further inquiry● Informs actions for improvement and transformation

5

Data Inquiry. Given a particular question, engaging in a systematic investigation, with analysis and interpretation of the data leading to proposed hypotheses of root causes that inform improvement actions.

Critical Contexts for Data Inquiry

6

Student Data Inquiry4-Step Process

7

Student Data Inquiry Process Steps

• Question• Investigate• Clarify• Hypothesize

8

Question

9

Attainment Growth

To what levels of proficiency have

students achieved?

… currently?… in recent years?

What is the measured progress for these students?

Is the progress adequate to reach

attainment?

Focusing Questions

10

Question FocusBig Picture Questions

All students ● Schoolwide ● By grade level

Equity Gap QuestionsComparisons between student groups● Schoolwide

Content QuestionsComparisons among content skills● Schoolwide ● By grade level

Purposeful QuestioningPurposeful student data inquiry begins with important questions about student performance.

11

Question Focus Attainment Growth

Big Picture QuestionsAll students ● Schoolwide ● By grade level

To what levels of proficiency have students

achieved?

… currently?… in recent years?

What is the measured progress for these

students?

Is the progress adequate to reach attainment?

Equity Gap QuestionsComparisons between student groups● Schoolwide

Content QuestionsComparisons among content skills● Schoolwide ● By grade level

Sample Student Data Questions

12

Inquiry #1: Data Questions about ALL STUDENTS• ATTAINMENT. What are the current achievement levels of our students schoolwide and by

grade? What is the trend in student achievement levels over the past 2+ years schoolwide and for each grade?

• GROWTH. What is the progress of cohorts of students over two or more years? Is the progress adequate to reach our vision?

Inquiry #2: Data Questions about STUDENT GROUP COMPARISONS• ATTAINMENT. What is the current achievement of student groups as compared

to their counterparts? How does achievement of student groups compare to their counterparts in previous years?

• GROWTH. What is the progress of cohorts of student groups as compared to their counterparts over two or more years? Is the progress of the student group adequate to close achievement gaps?

Inquiry #3: CONTENT • ATTAINMENT. What are the current achievement levels of our students within the

content area? What is the trend in student achievement within the content area over the past 2+ years schoolwide and for each grade level?

• GROWTH. What is the progress of cohorts of students over two or more years within the content area?

Investigate

Data sources used are based on the data question and context

13

Summative Data Inquiry

- State Data Sources

- Local Interim & Summative Data Sources

Interim Data Inquiry

- Local Interim Data Sources

Teacher PLC Data Inquiry

- Local Classroom Data Sources

Follow protocols to maintain student privacy with proper access to data.

Find the Just Right Data

• When exploring the data source selected, locate the “just right data” that answers the inquiry question.

• Collaboratively determine whether the data selected helps to answer the inquiry.

14

Big Picture: Data Captures

15

Achievement Gap Data Captures

16

Content Data Captures

17

Clarify: Analyze, Summarize, Prioritize

Analyze the data. Look for …• Metrics

• % of students• Number of students• Percentile ranks

• Patterns• Comparisons• Data range• Distribution

• Trends over time (more than two years)

18

Determining Criticality

19

To determine criticality in data findings, consider…● Persistence in the data pattern● Multiple years showing a decline in student

performance (at least 3 years)● Size of differences (gap) in the numbers (larger

differences more likely to be critical)● Increasing gaps● Impact on students

Determining Criticality

20

Criticality Data Findings for Improvement

Critical data finding:Increasing gap

● In the middle school, for the past three years, the % of EcD students that reach proficiency on the ELA portion of the state assessment has been declining (from 23% in 2012 to 15% in 2015), whereas the % of non-EcD reaching proficiency has been increasing (42% in 2012 to 51% in 2015). The gap is increasing between EcD and non-EcD.

Critical data finding: Consistently

declining math achievement

● We noticed a trend and pattern in our math data. We consistently see 65% of our 3rd grade students reaching proficiency and in each subsequent grade the proficiency levels decline by 5% per year through the 6th grade. The percent of students proficient or advanced in math declined from grade to grade, from 3rd grade to 6th grade in the past four years across three different assessments.

Here are two examples of data findings from our work with schools.

Prioritize Data Findings

21

● What’s the risk for students if we don’t improve this data pattern?

● Will students’ futures be compromised?

● Study all data findings to determine their level of priority.

● Select the most urgent data finding(s) to identify the critical student problem

Propose explanations about practices that may explain the critical student data problem.

22

Hypothesize

Hypotheses about Root CausesGuidelines

23

1. Keep critical student data problem in mind

2. Pose hypotheses that suggest potential reasons for the problem statement. Be sure to use alterable factors, rather than unalterable factors, such as student characteristics.

3. Use the Fishbone process to generate hypotheses of practices in important categories.

Root Cause Worksheet

FISHBONE: Categories of Potential Root Causes

Prioritizing Root Causes

Teams engage in a prioritization process based on the HOPs in the fishbone.

Several methods can be used for prioritization of root causes.1. Voting for highest likelihood causes2. Influencer circle activity3. Other prioritization methods

25 26

Bridge to Practices Inquiry

We enter “Practices Inquiry” from the Hypotheses stage of the Student Data Inquiry.

Practice Inquiry 4-Step Process

27

Practices Inquiry

1. QUESTION. Based on our most likely hypotheses of practices, ask - what evidence do we need about this practice that will inform our next steps?

2. INVESTIGATE. Based on our question(s), study relevant practices within the school, district and in the research to gather evidence.

3. CLARIFY. Identify and summarize findings from your investigation and prioritize practices for future actions.

4. PROPOSE. Propose next steps to plan implementation based on practice priorities. 28

Question

• Investigating a practice is based on the questions we want to ask about that practice.• What is the practice we want to know more about?• Where does it occur? With whom?

• Examples of Practice Inquiry Questions:• What is the extent of co-teaching

occurring in our classrooms?• To what degree are our PLC teams

analyzing and discussing studentdata to make instructional adjustments?

• To what degree are we following ourPBIS implementation plan?

29

Investigate

30

To conduct an investigation into the selected practices, there are three important steps:1. Define the practices clearly through a practice profile.2. Develop an investigation action plan.3. Conduct the investigation and collect the data (evidence).

Clarify

What did we learn from our evidence?How can we clarify and prioritize our findings

from the investigation?

31

Clarifying Data from the Practice InvestigationsWe clarify our data to make sense of all the evidence we’ve collected. Steps for clarifying the data include ...1. Setting the tone.2. Organizing the data.3. Analyzing the data.4. Summarizing the findings.5. Prioritizing the findings.

32

Propose

What actions will we propose to improve and implement our practices?

33

Aims for Improvement

Actions• List the tasks recommended for improvement,

based on practices data findings• Provide details - who, what, when how and with

what resources

Monitoring• Indicate how the actions will be monitored• Provide:

• indicators • timelines • decision-making processes

34

Sample: “Propose” Steps

35

Data Inquiry Process for Continuous Improvement

36

Tools & Resources

37

Documenting Inquiry

It is important to document the process. Documentation provides ...● Evidence of the work for team members ● A means for continuation of the process● A tool for communication with stakeholdersData inquiry can be recorded in online templates, the WISEdash Data Inquiry Journal, or other notes and records

38

Forms in WISEdash for Districts

A tool is available in WISEdash for Districts.• Log into WISEdash for Districts• The down arrow next to the red matrix will reveal three

options • To use the documentation tool, select “Forms Manager”

39

● Follows the steps in the data inquiry process● Available in WISEdash for Districts● The user applications icon (red

matrix), located in the top right sideof WISEdash for Districts providesaccess to the Data Inquiry Journal

● Using the drop down arrow, select “ Forms Manager”● To document your work, open a new journal page (see

below) or add to an existing journal

Data Inquiry Journal

40

Additional Resources Templates to document inquiry

• Use this template to document your All Student inquiry.• Use this template to document your Equity Gaps inquiry.• Use this template to document your Content Analysis inquiry.• Use this template to document your Practices inquiry.

41 42

Thank You!

For additional assistance with the data inquiry process or any of the tools shared with you today, contact your CESA

WISEcoach email contacts