dunlap community unit school district #323 1 2012-13 harris poll stakeholder satisfaction results

Dunlap Community Unit School District #323

1

2012-13 Harris Poll Stakeholder Satisfaction Results

3

Underlying Theory

If you do not measure it, you will not change it

Not all problems are equal. Some have more IMPACT than others

Satisfaction/Motivation are key attitudes which are leading indicators of performance

Attitudes are formed from experience

Identify experiences that relate most to satisfaction

*

4

Two Dimensions of Satisfaction

Frequency of problem–you don’t always want to work on the most common problems

Relevance of the problem–is it affecting satisfaction?

–Prioritization by highlighting (statistically) the problems which frequently occur and cause dissatisfaction when they do occur

–Result is a prioritized list of improvement tasks

5

Harris School Poll Objectives

Measure satisfaction: overall and by specific area

Identify the frequency of specific problems

Statistically define the penalty and impact of problems for each stakeholder group

Establish priorities among opportunities for improvement

Foster data-driven decision making

Provide benchmark, comparative, and tracking data

6

Harris Interactive School Poll Topic Areas

Teachers/Staff

School Atmosphere

Equipment/Facilities

Computer Technology

School Leadership/ Administration

Communications/ Involvement

Parental Support

Career

Students

Other Staff

Other Issues

Parents


School Bus

Computer Technology

School Leadership/ Administration

Communications/ Involvement

Child’s Teachers

Curriculum/Training

Budget

Other Issues

Students

School Atmosphere


School Bus

Computer Technology

Main Teacher/ Teachers (five subjects)

School Leadership

Counselor

Other Staff

Other Issues

7

Sample Survey QuestionsYes No

Are students well-behaved while in school?

Do you feel safe walking to and from school?

Do you feel safe while in school?

Are the rules at your school fair?

Are most other students nice to you?

Harris Interactive Inc.

Please give an overall rating for your SCHOOL ATMOSPHERE by filling in one oval on the A to F scale provided?

A A- B+ B B- C+ C- D+ D D- F

10 9 8 7 6 5 4 3 2 1 0

8

% with IMPACT

ISSUES INFLUENCING OVERALL SATISFACTION Problem Penalty INDEXDo you like the food served in the lunch room? 41% 0.8 18%Do you get extra help when you need it? 24% 1.1 14%Are school bathrooms clean? 58% 0.4 11%Are students well-behaved on your bus? 50% 0.4 11%Is your school too crowded? 39% 0.4 7%Does the school library meet your needs? 24% 0.5 7%Are the rules at your school fair? 28% 0.4 6%Main teacher: Help you want to learn? 11% 1.0 6%Is the temperature in your classrooms usually comfortable? 21% 0.5 5%Main teacher: Ask you to answer questions in class? 18% 0.5 5%Is your classroom teacher prepared to train you on the computer? 16% 0.7 5%Are you well-behaved at school? 10% 0.5 3%Do you participate in class? 6% 0.8 2%

4% 2%

31%

52%

11%

A B C D F

OVERALL SATISFACTION MODEL: ELEMENTARY STUDENTSElementary Students Satisfaction

Rating Distribution

Improvement Possible

7.8

9.9

0

2

4

6

8

10

Satis

fact

ion

Lev

el

Current ScoreMax. Possible Score

Sample

9

4% 2%

31%

52%

11%

A B C D F

This graph shows the distribution of satisfaction scores elementary students provided for the overall satisfaction question.

Elementary Students SatisfactionRating Distribution

Sample

10

Improvement Possible

This graph shows the current overall satisfaction mean rating with the maximum possible score. The gap between them is the opportunity for improvement.

7.8

9.9

0

2

4

6

8

10Sa

tisfa

ctio

n Le

vel

Current ScoreMax. Possible Score

Sample

11

% with IMPACTISSUES INFLUENCING OVERALL SATISFACTION Problem Penalty INDEXDo you like the food served in the lunch room? 41% 0.8 18%Do you get extra help when you need it? 24% 1.1 14%Are school bathrooms clean? 58% 0.4 11%Are students well-behaved on your bus? 50% 0.4 11%Is your school too crowded? 39% 0.4 7%Does the school library meet your needs? 24% 0.5 7%Are the rules at your school fair? 28% 0.4 6%Main teacher: Help you want to learn? 11% 1.0 6%Is the temperature in your classrooms usually comfortable? 21% 0.5 5%Main teacher: Ask you to answer questions in class? 18% 0.5 5%Is your classroom teacher prepared to train you on the computer? 16% 0.7 5%Are you well-behaved at school? 10% 0.5 3%Do you participate in class? 6% 0.8 2%

Impact Index is a combination of the penalty and the % reporting the problem. It represents the percent of potential improvement that can be realized if the occurrence of the problem is reduced to zero.

Penalty is the rise in satisfaction that would occur if the incidence of the problem is reduced to zero.

Sample

12

Stakeholder Response Rates

Surveys were conducted in April 2013

Students in grades 3-12 completed online surveys

Parents completed paper/pencil surveys

All teachers and staff asked to complete an online survey

Response Rates:

–Elementary Students 94%

–Secondary Students 67%

–Teachers/Staff 95%

–Parents 40%

www.harrisinteractive.com

©2005, Harris Interactive Inc. All rights reserved.


Results - Key Overall District Findings

14

Rules of Thumb on Ratings

Above 9.0: Exemplary

8.0-9.0: Strong compared to the nationwide database.

7.0-8.0: Average, in need of continuous improvement

6.0-7.0: In need of a defined focus and improvement plan.

Under 6.0: Sign of a serious issue within the district.

*

15

Overall Satisfaction Ratings- All Groups

A = 10A- = 9B+ = 8B = 7B- = 6C+ = 5C = 4C- = 3D+ = 2D = 1F = 0



Student Satisfaction Survey Results

16

17

Overall Student Satisfaction

A = 10A- = 9B+ = 8B = 7B- = 6C+ = 5C = 4C- = 3D+ = 2D = 1F = 0

18

Elementary Students- 2011 vs. 2013

Elementary Students- Interesting Data

19

Question Dunlap2011

Dunlap2013

Harris

Are students well behaved while in school? 24% 21% 31%

Are most other students nice to you? 11% 14% 18%

Do you feel safe while in school? 3% 4% 5%

Does your teacher like you? 7% 8% 7%

Does your teacher help you want to learn? 9% 8% 7%

Are the rules at your school fair? 10% 12% 17%

Have you been yelled at by an adult at school? 29% 27%

Percent With Problem

Elementary Students Executive SummaryOpportunities for Improvement

Overall satisfaction decreased from 8.4 in 2011 to 8.3 in 2013.

37% reported that their teacher didn’t give interesting homework.

15% of the students said their teacher did not make class fun.

38% said their teacher did not help them outside of class time.

8% of the students stated that their teacher did not like them.

14% of the students said that most other students were not nice to them.

20

Secondary Students- 2011 vs. 2013

21

Secondary Students- Interesting Data

22

Question Dunlap2011

Dunlap2013

Harris

Is there enough time between classes? 43% 45% 53%

Are students well behaved in school? 28% 30% 39%

Is your school too crowded? 48% 48% 34%

Are most other students nice to you? 11% 13% 14%

Do other kids try and get you to use drugs in school?

6% 11% 11%

Do you feel safe while in school? 5% 7% 9%

Does your school principal handle discipline fairly? 25% 25% 23%

Does your school principal treat students with respect?

10% 16% 11%

Have you been yelled at by an adult at school? 45% 41%


Middle School Students Executive SummaryOpportunities for Improvement

Overall satisfaction for middle school students decreased from 8.1 in 2011 to 7.9 in 2013.

77% of the students said that they did not like the food served in the lunchroom.

57% of the students said they do not study with other students before or after school.

21% of the students indicated rules at their school were not fair.

23

High School Students Executive SummaryOpportunities for Improvement

Overall satisfaction for students remained the same at 7.0 from 2011 to 2013

74% said that they did not like the food served in the lunchroom.

36% said that their hallway locker was not in a good location.

12% said there was not extra help available when they needed it.

38% indicated that the rules at school were not fair.

24



Teacher Satisfaction Survey Results

25

26

Overall Teacher Satisfaction

A = 10A- = 9B+ = 8B = 7B- = 6C+ = 5C = 4C- = 3D+ = 2D = 1F = 0

27

Teacher/Staff Satisfaction 2011 vs. 2013

Teacher/Staff Satisfaction 2011 vs. 2013 (Continued)

28

Teachers- Interesting Data

29

Question Dunlap2011

Dunlap2013

Harris

Do you have enough time for planning and grading? 40% 50% 39%

Is your workload too high? 48% 61% 46%

Do you have adequate time for classroom instruction? 15% 25% 18%

Is gossip among teachers a serious problem? 19% 20% 24%

Is student behavior a problem? 22% 21% 48%

Do you feel safe at school? 0% 2% 4%

Is there parental support for the school? 3% 6% 28%

Does the school board show appreciation for your work? 24% 33% 17%

Does the superintendent ask for suggestions/opinions? 11% 21% 18%

Are you involved in the training you receive? 33% 41% 28%

Is your salary fair for the work you do? 31% 49% 49%

Do you enjoy your work? 1% 3% 6%


Teachers/Staff Executive SummaryOpportunities for Improvement

The overall satisfaction rating decreased slightly from 8.0 in 2011 to 7.8 in 2013.

33% said their principal did not reward outstanding performance.

30% felt that the superintendent did not show appreciation for their work.

11% said their principal did not handle student discipline fairly.

14% of the employees identified communication with their principal as an area for improvement.

30



Parent Satisfaction Survey Results

31

32

Overall Parent Satisfaction

A = 10A- = 9B+ = 8B = 7B- = 6C+ = 5C = 4C- = 3D+ = 2D = 1F = 0

33

Parent Satisfaction 2011 vs. 2013

Parents- Interesting Data

34

Question Dunlap2011

Dunlap2013

Harris

Is your child’s school too crowded? 49% 43% 28%

Does the school system include parents views when making decisions?

36% 40% 25%

Are you allowed to be involved in your child’s education?

18% 19% 12%

Do teachers communicate with you when your child has a problem?

25% 22% 19%

Is the homework assigned appropriate? 16% 17% 11%

Are there enough courses for advanced students? 31% 29% 18%

Do your schools give you a good value for your tax dollar?

16% 17% 17%


Parent Satisfaction Themes by Level

35

Elementary Parents

M.S. Parents

H.S. Parents

Elementary Parents Executive SummaryOpportunities for Improvement

Overall increased slightly from 8.3 in 2011 to 8.4 in 2013.

34% said that the District did not do a good job of communicating about the budget.

25% indicated that they were not getting enough feedback on their child's performance.

14% indicated that the school did not do an adequate job of communicating when their child had a problem.

36

Middle School Parents Executive SummaryOpportunities for Improvement

Overall satisfaction decreased slightly from 8.1 in 2011 to 8.0 in 2013.

25% felt that the variety of academic courses available needed improvement.

32% indicated that teachers did not communicate to them when their child had a problem.

20% rated the Board of Education less than satisfactory at improving the overall quality of instruction.

7% felt they were not treated with respect by administrators.

37

High School Parents Executive SummaryOpportunities for Improvement

Overall decreased slightly from 7.6 in 2011 to 7.4 in 2013.

30% rated the Board of Education less than satisfactory at improving the overall quality of instruction.

34% said that the Superintendent/Central Administration needed to improve in responding to the needs and concerns of parents.

9% felt they were not treated with respect by administrators.

12% felt that school did not provide a safe environment for their child.

38

Dunlap Specific Questions

39

Dunlap Specific Questions

% Agree

Students Teachers Parents

EL. M.S. H.S. EL. M.S. H.S. EL. M.S. H.S.

School is welcoming 93% 89% 82% 68% 59% 72% 85% 78% 70%

School is challenging 82% 76% 84% 78% 87% 39% 70% 80% 92%

Struggling learners get help when needed 92% 88% 81% 73% 83% 45% 79% 57% 53%

Discipline is effective 80% 82% 69% 82% 60% 43% 85% 80% 60%

Goal setting and tracking is evident (C.I) 95% 88% 69% 91% 71% 54% 92% 86% 74%

There are opportunities to provide input 86% 78% 59% 92% 75% 62% 74% 57% 52%

I’m proud of my school 89% 81% 63% 91% 77% 49% 94% 91% 80%

There are enough clubs and extra-curricular activities

55% 76% 82%

BLT sets and communicates direction

98% 98% 82%

We practice teamwork, collaboration and shared leadership

98% 94% 93%

Reasonable time to manage initiatives 26% 32% 15%

Adequate communication about my child 88% 72% 52%

I am satisfied with my child’s school 92% 90% 80%

40

Comparative Data

41

Comparative Districts

District # Schools Enrollment Minority F/R Lunch Per Pupil IncomeA 8 3815 49.5% 29.0% $12,943 $76,902B 10 5268 9.1% 8.4% $15,011 $77,166C 15 6040 50.0% 36.0% $12,450 $56,109Dunlap 8 4080 25.0% 8.0% $8,602 $80,146

Comparative Data

Balanced Scorecard!

43

8.4

8.1

7.0

97%

96.4%

94.3%

8.3

7.9

7.0

96%

94.2%

91.6%

Balanced Scorecard!

44

8.0 7.8

98.8% 100%

Balanced Scorecard!

45

8.0

93.1%

7.6

96.7%

8.0

90.6%

7.6

93.5%

Balanced Scorecard!

46

47

Moving Forward with the Data

Survey questions identify the symptoms of the problems

Statistical analysis (Impact Analysis) calculates the relative IMPACT of the symptoms

Focus groups and other techniques translate the symptom into a defined problem

Task teams define solutions

Measurement tracks and documents success

– Do not wait for the next survey

– Develop metrics for success in your own building

– Communicate improvements to your stakeholders

48

Survey Results

The survey results point out “specific areas” where improvement would lead to increased satisfaction.

There are other areas identified as concerns (high % of respondents reporting problems) that do not impact satisfaction.

It is critical that a building focus on the concerns that will make a difference.

The following steps can be taken to process the data and select high priority areas for improvement…

Harris Interactive Inc.

49

As you review your school’s data…

Identify issues of concern

Group like ideas together – issues that could be solved in tandem

Surprises? Confirmation?

Look for areas where your school’s “percent of problem” is most different than the overall district “percent of problem”

Look for common issues across your stakeholders… solving a problem may impact more than one group

Refer to your data tables to look at differences among subgroups

Looking at Your Data

50

Planning Next Steps Document areas of improvement

– Are the areas more commonly received from a particular audience (staff, parents, elementary students, or secondary students)?

– Are there trends in the types of categories that are consistently lower (i.e. leadership, facilities, etc.)?

Document areas of strength and consider whether or not aspects related to those strengths are changing

Pay closer attention to the "Overall Satisfaction" indicators to gauge how important these individual issues are to stakeholder’s general sense of satisfaction

Document areas where the satisfaction ratings are going against expected norms (i.e. gender differences, ethnicity differences, grade trends)

Relate subgroup ratings to survey counts to ensure accurate interpretations

Examine subgroup trends for possible changes for next year (ex. Turnover of staff and effect on demographics)

51

Planning Next Steps Tackle each section one at a time

– For each section, examine the list of issues and determine which one(s) can be addressed for the coming year

– Prioritize the list based on whichever factor your site deems as most important for that issue (percentage of stakeholder affected, magnitude of dissatisfaction, or portion of potential improvement)

Identify trends within individual sections, or more broadly (ex. Is there a discipline issue at the school? A facility issue? A communication issue?)

Prioritize sections in order of importance – is Equipment & Facilities anywhere near as important a section as Curriculum/Training?

Determine how next steps fit into other school improvement plan initiatives

In the back of the binder will be the results by question separated by Students, Teachers/Staff, & Parents

The hard data references the sample size for each individual question, as well as the count responding to entire survey

Use the hard data to add context to issues that were raised to this point

53

Process for Identifying Areas of Improvement School/Department: ________________________________________ Date: _________________ Team Members: ___________________________________________________________________ 1.) What are the key strengths or successes found in the survey results?

a) What are the areas in which the school ratings are higher than the district? b) What are the areas within the school that are rated high?

2.) What are the top key areas of concern or in need of improvement? Focus on the critical few.

a) Look for areas where your school’s “Percent of Problem” is most different than the overall district “Percent of Problem”.

b) Pay attention to issues that have a high “Penalty” and a high “Impact Index” c) Triangulate the data. Look for issues that are common among multiple stakeholder groups. d) Only select areas for improvement that are within your school’s/department’s control or influence. e) Combine similar issues whenever possible. This may provide greater overall results.

Identified Top Concerns (Combine similar issues together when possible)

Stakeholder Group (Group with problem) Within Our

Control? Student Staff Parent

1.)

2.)

3.)


54

2012-13 Harris Poll Stakeholder Satisfaction Results

dunlap community unit school district #323 1 2012-13 harris poll stakeholder satisfaction results

Documents

school bus6

school counselor6

school board6

school fair

elementaryoverall satisfaction

teachersoverall satisfaction

secondaryoverall satisfaction

parentsoverall satisfaction