what worked? what didn’t work? learning through continuous quality improvement
TRANSCRIPT
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
1/49
Prepared and Presented by:
Dr. Cheryl Marshall, President
Keith Wurtz, Dean of Institutional Effectiveness, Research & Planning
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
2/49
Briefly describe Craftons prior accreditation sanctions
Describe a process of systematic continuous
improvement, using cycles of dialogue, repeated
information gathering, sharing, and re-assessment
Provide examples of continuous improvement in
program review, strategic planning, and outcomes
assessment
Discuss the importance of recognizing change as an
aspect of continuous quality improvement
Provide strategies on how to proactively manage change
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
3/49
Integrated Planning
o Ed Master Plan
o Program Review
o District Strategic Plan
o District Program Review
o District Technology Plan
o District HR Plan
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
4/49
Data Reliability and Use
Achieve Proficiency on Outcomes by 2012
Communication and Shared Governance
o
Improve and evaluate Resource Allocation
o Financial Planning and Transparency
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
5/49
Project and Process Champions
FocusWillingness to Prioritize
Managing Change
Continuous Learning and Improvement Committee Work
Systematic and Systemic Approach
Communication, Communication, Communication
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
6/49
1. GatherData /
Assess
Continuous
Quality
Improvement
1. Gather Data /Assess
2. Review,Discuss, &
GatherFeedback
1. Gather Data /Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
1. Gather Data /Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4. CommunicateProgress
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
7/49
Annual surveyadministered tothe programscompleting thefour-year action
plan
Feedback fromindividualsthroughout theyear
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
8/49
Annual surveyadministered tothe programscompleting thefour-year action
plan
Feedback fromindividualsthroughout theyear
Quantitative
Process wasmore clear andthe feedbackmore useful
Qualitative
Streamline thequestions
Providementoring andfeedback
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
9/49
Annual surveyadministered tothe programscompleting thefour-year action
plan
Feedback fromindividualsthroughout theyear
Quantitative
Process wasmore clear andthe feedbackmore useful
Qualitative
Streamline thequestions
Providementoring andfeedback
Questions wererevised andreduced
Created PPRCommitteeContacts toprovide supportand feedback
Addedworkshops andopen meetings
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
10/49
Annual surveyadministered tothe programscompleting thefour-year action
plan
Feedback fromindividualsthroughout theyear
Quantitative
Process wasmore clear andthe feedbackmore useful
Qualitative
Streamline thequestions
Providementoring andfeedback
Questions wererevised andreduced
Created PPRCommitteeContacts toprovide supportand feedback
Addedworkshops andopen meetings
Email
Workshops
CommitteeContacts
At the WaterCooler
In ServiceMeetings withPrograms
MultipleCommitteeMeetings (e.g.:Chairs)
Repeat
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
11/49
Annual surveyadministered tothe programscompleting thefour-year action
plan
Feedback fromindividualsthroughout theyear
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
12/49
Annual surveyadministered tothe programscompleting thefour-year action
plan
Feedback fromindividualsthroughout theyear
Quantitative
Timelines weremore clear
Web Tool is moredifficult to use
Qualitative
Questions were thesame just asked in a
different way
Develop astreamlined reviewfor outcomes
Only provide oneplace whereoutcomes can bereported
Provided a quick
link to PPR
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
13/49
Annual surveyadministered tothe programscompleting thefour-year action
plan
Feedback fromindividualsthroughout theyear
Quantitative
Timelines weremore clear
Web Tool is moredifficult to use
Qualitative
Questions were thesame just asked in a
different way
Develop astreamlined reviewfor outcomes
Only provide oneplace whereoutcomes can bereported
Provided a quick
link to PPR
Questions wererevised andstreamlined
Web Tool is nowonly place wherecampus is required
to report outcomes
Quick Link added toCrafton home page
Improved ObjectivePrioritization aspectof Web Tool to makemore user friendly
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
14/49
Annual surveyadministered tothe programscompleting thefour-year action
plan
Feedback fromindividualsthroughout theyear
Quantitative
Timelines weremore clear
Web Tool is moredifficult to use
Qualitative
Questions were thesame just asked in a
different way
Develop astreamlined reviewfor outcomes
Only provide oneplace whereoutcomes can bereported
Provided a quick
link to PPR
Questions wererevised andstreamlined
Web Tool is nowonly place wherecampus is required
to report outcomes
Quick Link added toCrafton home page
Improved ObjectivePrioritization aspectof Web Tool to makemore user friendly
Email
Workshops
CommitteeContacts
At the WaterCooler
In ServiceMeetings withPrograms
MultipleCommitteeMeetings (e.g.:Chairs)
Repeat
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
15/49
CampusClimate Surveyadministeredevery other Fall
Collaborativelydeveloped andfeedbackellicited fromentire campus
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
16/49
CampusClimate Surveyadministeredevery other Fall
Collaborativelydeveloped andfeedbackellicited fromentire campus
Results sharedwith Campusand Feedback
Gathered
Report
Presentations
Newsletter
Workshops
NumerousCommitteeMeetings
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
http://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Reports/FA2012_CampusClimate.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Presentations/2012FA_CampusClimateSurvey_Final.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Did%20You%20Know/1213_DYK25.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Did%20You%20Know/1213_DYK25.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Presentations/2012FA_CampusClimateSurvey_Final.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Reports/FA2012_CampusClimate.pdf -
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
17/49
CampusClimate Surveyadministeredevery other Fall
Collaborativelydeveloped andfeedbackellicited fromentire campus
Results sharedwith Campusand Feedback
Gathered
Report
PresentationsNewsletter
Workshops
NumerousCommitteeMeetings
Crafton Council
Reviewedfeedback
Selectedstrategies toimplement
Assignedresponsibleperson
MonitoredStatus
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
http://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Reports/FA2012_CampusClimate.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Presentations/2012FA_CampusClimateSurvey_Final.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Did%20You%20Know/1213_DYK25.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Briefs/1213_StudentSuggestedImprovements_Progress2.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Briefs/1213_StudentSuggestedImprovements_Progress2.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Did%20You%20Know/1213_DYK25.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Presentations/2012FA_CampusClimateSurvey_Final.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Reports/FA2012_CampusClimate.pdf -
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
18/49
CampusClimate Surveyadministeredevery other Fall
Collaborativelydeveloped andfeedbackellicited fromentire campus
Results sharedwith Campusand Feedback
Gathered
Report
PresentationsNewsletter
Workshops
NumerousCommitteeMeetings
Crafton Council
Reviewedfeedback
Selectedstrategies toimplement
Assignedresponsibleperson
MonitoredStatus
Email
Workshops
CommitteeContacts
At the WaterCooler
In ServiceMeetings withPrograms
MultipleCommitteeMeetings (e.g.:Chairs)
Repeat
1. GatherData / Assess
2. Review,Discuss, &
GatherFeedback
3. IdentifyStrategies forImprovement
4.Communicate
Progress
http://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Reports/FA2012_CampusClimate.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Presentations/2012FA_CampusClimateSurvey_Final.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Did%20You%20Know/1213_DYK25.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Briefs/1213_StudentSuggestedImprovements_Progress2.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Briefs/1213_StudentSuggestedImprovements_Progress2.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Did%20You%20Know/1213_DYK25.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Presentations/2012FA_CampusClimateSurvey_Final.pdfhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Reports/FA2012_CampusClimate.pdf -
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
19/49
Examples of Progress on Implementing Suggestions
from the Fall 2010 Campus Climate Survey
Suggestion Progress
Make applause cards readily available for
use.
A link to theApplause Cardsis available on
the Navigator Online ResourceWeb Site.
Training for managers on recognition Training occurred on Friday, November 9th,
2012.
Committee chairs should be trained how to
run a committee.
Training occurred on August 22nd, 2012.
Future trainings will occur once every
primary term.
The ability to search the email database by
first name, department, or office.
Contacted DCS in Fall 2012. When click
on To, check More columns and enter
first name.
Bring a friend to committee meetings.
Where the friend can sit in on committee as
a guest.
Piloted in Spring 2012, and did not work
well.
http://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Reports/Other%20Research%20Studies/1112_Brief3_SuggestedImprovements.pdfhttp://www.craftonhills.edu/Faculty_and_Staff/Applause_Form.aspxhttp://www.craftonhills.edu/Faculty_and_Staff/Navigator_Online_Resource.aspxhttp://www.craftonhills.edu/Faculty_and_Staff/Navigator_Online_Resource.aspxhttp://www.craftonhills.edu/Faculty_and_Staff/Applause_Form.aspxhttp://www.craftonhills.edu/~/media/Files/SBCCD/CHC/About%20CHC/Research%20and%20Planning/Research%20Reports/Other%20Research%20Studies/1112_Brief3_SuggestedImprovements.pdf -
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
20/49
58%
63%
49% 52% 50%
81%
60%
86%
78% 81% 76%71%
92%
81%
0%10%20%30%40%50%
60%70%80%90%
100%Fall 2010 Fall 2012
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
21/49
74% 73%
91% 89%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
CHC uses the results from the SLOs toimprove student learning
CHC uses the results from the SLOs toimprove programs and services
%
Agree/Strong
lyAgree
Fall 2010
Fall 2012
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
22/49
Create one central repository for all SLO's. Currently, I havefour locations to which each SLO is recorded.
Right now the procedure for submitting seems to bewhatever you want, however you want, wherever you want.For faculty wanting direction, this is confusing. For anyonewanting to review outcomes for the institution, it is a barrier.
Streamlining outcomes assessment is the most importantpart. As a faculty member, I am always assessing mymethods, and make changes accordingly. The SLOs helpwith that, although they are extra work for the most part.
The outcomes assessment process continues to grow andimprove; however, I think that we can continue to make thereporting process easier.
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
23/49
44%
32%
49%
66%
52%57%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Communication acrosscampus is timely and accurate.
Communication &understanding among the
different employeeconstituency groups at CHC is
sufficient.
Best practices are sharedeffectively at CHC.
%
Agree/Strongl
yAgree
Fall 2010
Fall 2012
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
24/49
Although communication has improved somewhat, there
is still the feeling that any input we may have really isn't
taken into consideration when decisions are being made,
even when the decision directly affects our job. There
are also times when we are told of a decision that wasmade without seeking any input from the person or area
that will be affected the most.
Communication is improving.
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
25/49
One thing that is new is the prevalence of newness, the changingscale and scope of change itself, so that the world alters as we walkin it. ~ Robert Oppenheimer
Today, loving change, tumult, even chaos is a prerequisite for
survival, let alone successchange by everyone requires adramatic increase in the capacity to accept disruption. ~ TomPeters
If you do not change direction, you may end up where you areheading. ~ Lao Tzu
Change will not come if we wait for some other person or someother time. We are the ones we've been waiting for. We are thechange that we seek. ~ Barack Obama
Change is the only constant.
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
26/49
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
27/49
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
28/49
Personal Change: Intentional, purposeful
adoption of new thoughts & behaviors
Organizational Change: Adoption of new ideas
or behavior by an organization in response toopportunities or threats
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
29/49
No sense that it is needed
Short term thinking
Sense of loss
Comfort zones
Personal habits and characteristics
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
30/49
Question Yes No
1. Are you currently using the latest version of software on
your home computer?
2. Have you driven to work using a different route in the
last 3 months?
3. Have you taken a new workshop?
4. Have you tried new food in the past 6 months?
5. Have you changed the arrangement of your furniture?
6. Have you read a new publication the past year?
7. Have you changed your hair style or color?
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
31/49
Activists
Thrill Seeker
Idea Generator
Pot Stirrer
Rivals
Naysayer
Traditionalist
Passive Aggressive
Disengaged
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
32/49
Denial
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
33/49
Awareness
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
34/49
Perceived Need
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
35/49
Resistance
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
36/49
Action
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
37/49
Commitment
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
38/49
Recognize formal and informal leaders
Provide opportunities for participation and
leadership at all levels of the organization
Include and retain students and staff on keycommittees
Provide vision
Communicate, communicate, communicate! Look at both technical and human systems
Celebrate successes
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
39/49
Lack of vision
Lack of understanding
Too much change at ounce
Lack of clear communication
Poor management of resistance
All talk and no action
Internal focusLosing sight of the customer
Not including key people
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
40/49
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
41/49
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
42/49
What Didnt Work? What Worked?
Trying to do everything Hiring a consultant (Relieved workload and helped
with facilitation of process)
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
43/49
What Didnt Work? What Worked?
Trying to do everything Hiring a consultant (Relieved workload and helped
with facilitation of process)
Communicating in only
one format
Communication needs to happen often, occur in
as many formats as possible, and be repeated
over and over again
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
44/49
What Didnt Work? What Worked?
Trying to do everything Hiring a consultant (Relieved workload and helped
with facilitation of process)
Communicating in only
one format
Communication needs to happen often, occur in
as many formats as possible, and be repeated
over and over again
Assuming that people will
notice when their idea was
implemented
Need to specifically credit people for their
suggestions individually and in public whenever
the opportunity presents itself
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
45/49
What Didnt Work? What Worked?
Trying to do everything Hiring a consultant (Relieved workload and helped
with facilitation of process)
Communicating in only
one format
Communication needs to happen often, occur in
as many formats as possible, and be repeated
over and over again
Assuming that people will
notice when their idea was
implemented
Need to specifically credit people for their
suggestions individually and in public whenever
the opportunity presents itself
Looking at only
quantitative information
Qualitative information from open-ended surveys
and workshops is often the most informative
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
46/49
What Didnt Work? What Worked?
Trying to do everything Hiring a consultant (Relieved workload and helped
with facilitation of process)
Communicating in only
one format
Communication needs to happen often, occur in
as many formats as possible, and be repeated
over and over again
Assuming that people will
notice when their idea was
implemented
Need to specifically credit people for their
suggestions individually and in public whenever
the opportunity presents itself
Looking at only
quantitative information
Qualitative information from open-ended surveys
and workshops is often the most informative
Holding open workshops Getting on the agenda at multiple committee
meetings and presenting the same information
multiple times
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
47/49
What Didnt Work? What Worked?
Trying to do everything Hiring a consultant (Relieved workload and helped
with facilitation of process)
Communicating in only
one format
Communication needs to happen often, occur in
as many formats as possible, and be repeated
over and over again
Assuming that people will
notice when their idea was
implemented
Need to specifically credit people for their
suggestions individually and in public whenever
the opportunity presents itself
Looking at only
quantitative information
Qualitative information from open-ended surveys
and workshops is often the most informative
Holding open workshops Getting on the agenda at multiple committee
meetings and presenting the same information
multiple times
Ignoring the challenges
that go along with change
Planning for the challenges that go along with
change and devising strategies prior to change
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
48/49
Managing crises and cultural change take a lot
of work
Be strategic and thoughtful
Keep watch on the organizations pulseHold people accountable
Communication must be systemic and
continuous Include as many people as possible
Pick your battles
Take care of yourself
-
8/13/2019 What Worked? What Didnt Work? Learning through Continuous Quality Improvement
49/49
Keith Wurtz
o Crafton Hills College
o Dean, Institutional Effectiveness, Research & Planning
o 909-389-3206
Cheryl Marshall
o Crafton Hills College
o Presidento 909-389-3200