academic pediatric association quality improvement training: module #1 overview: the model for...
TRANSCRIPT
Academic Pediatric Association
QUALITY
IMPROVEMENT TRAINING: Module #1
Overview: The Model for Overview: The Model for Improvement and Deming’s Improvement and Deming’s
System of Profound Knowledge System of Profound Knowledge
This work is supported by a grant from The Centers for Disease Control & Prevention.
National Partnership for Adolescent Immunization
PI: Peter SzilagyiCoordinators: Christina Albertin, Nui
Dhepyasuwan
Ed Marcuse (communication expert)
Cindy RandJan Schriefer (QI expert)Stanley SchafferJanet SerwintWilliam Stratbucker
Donna D'AlessandroWilliam AtkinsonPaul DardenSharon Humiston
(moderator)Keith Mann (QI
expert)
FACULTY & CONSULTANTS
This is part of the APA series on Quality Improvement. The examples focus on adolescent immunization, but the principles are widely applicable. The series includes:1. Overview: The Model for Improvement and
Deming’s System of Profound Knowledge 2. Improvement cycles and the psychology of
change 3. Initiating a QI project4. More tools to better understand the
system5. How will we know that a change is an
improvement? An introduction to QI measurement
6. Changes we can make that will result in improvement
Module 1 Objectives1. Describe briefly 3 steps you need to take
before starting the actual remedial QI process. These correspond to the modeling processes of Juran’s Diagnostic Journey.
2. Describe briefly the 4 inter-related components of a problem that Dr. Deming argued needed to be understood as part of the conceptual modeling of a problem.
3. Describe briefly 2 aspects of the actual remedial QI process. These correspond to Juran’s Remedial Journey, or the Model for Improvement.
4. Outline how research is different than QI
Importance of a Thoughtful QI ApproachIf you want to improve your clinical setting, what are your options?1. Keep doing what you are doing &
hope for different results (the definition of insanity)
2. Just do something new & hope for the best
Unexpected consequences? Sustainability? Isn’t this approach the root of a
lot of our cynicism?3. A thoughtful QI approach
1. Three steps you need to take before starting the
actual remedial QI
process
Don’t “Just Do It”
Before you start making changes, key steps include:
1.Development of a (general) mission statement
2.Conceptual modeling of the problem
3.Prioritization of possible changes
1) Development of a general mission statement What are you trying to accomplish –
in a general way (e.g., “We want to increase our adolescent immunization rates.”)
At this phase, you probably do not know the specifics (e.g., For which vaccines are your rates low? Are they only low for a subset of patients?)
Development of a more specific Aim Statement is covered in Module 3
2) Conceptual modeling of the problemA. Formal methods –
conceptual flow diagrams, decision flow charts
B. Informal methods – cause & effect diagrams, 5 whys
These tools will be introduced in Module 4.
3) Prioritization of possible changes
(Tools to help you with this are in Module 6 .)
QUESTION #1 Which of the following is NOT a step you need to take before starting the actual remedial QI process?1.Model the problem2.Spread the change to
affiliated clinical sites3.Write a general mission
statement4.Choose a change to test
QUESTION #1 Which of the following is NOT a step you need to take before starting the actual remedial QI process?
2. Fourinter-related components
of a problem
Dr. Deming argued these needed to be understood as part of the conceptual
modeling of a problem .
For complex problems…
Quick fixes True long-term solutions
“Boost teen
immunization
rates!”
Name Meaning Example
System What are the parts of the process and how do they relate to one another?
“Frankly, the doctors don’t know what the nurses have already told the parents about adolescent vaccines, nor do the nurses know what the doctors plan to say.”
Name Meaning Example
System What are the parts of the process and how do they relate to one another?
“Frankly, the doctors don’t know what the nurses have already told the parents about adolescent vaccines, nor do the nurses know what the doctors plan to say.”
Variation How do the outcomes change from time to time? Which of these changes is an inherent part of the process (common cause) and which is not typically part of the process (special cause)?
“During some times of the day our computers are so slow that it would take 5 full minutes to pull up an adolescent’s past immunization record.” (Common cause)
“3 nurses were out sick today so many things did not get done.” (Special cause)
Name Meaning ExampleSystem What are the parts of the
process and how do they relate to one another?
“Frankly, the doctors don’t know what the nurses have already told the parents about adolescent vaccines, nor do the nurses know what the doctors plan to say.”
Variation How do the outcomes change from time to time? Which of these changes is an inherent part of the process (common cause) and which is not typically part of the process (special cause)?
“During some times of the day our computers are so slow that it would take 5 full minutes to pull up an adolescent’s past immunization record.” (Common cause)“3 nurses were out sick today so many things did not get done.” (Special cause)
Theory of knowledge
What do people in the organization view as meaningful information? (This affects their learning and decision-making.)
“I don’t believe the CDC estimates on how many adolescents have sex. At least I don’t think it’s true for our patients.”
Name Meaning Example
System What are the parts of the process and how do they relate to one another?
“Frankly, the doctors don’t know what the nurses have already told the parents about adolescent vaccines, nor do the nurses know what the doctors plan to say.”
Variation How do the outcomes change from time to time? Which of these changes is an inherent part of the process (common cause) and which is not typically part of the process (special cause)?
“During some times of the day our computers are so slow that it would take 5 full minutes to pull up an adolescent’s past immunization record.” (Common cause)“3 nurses were out sick today so many things did not get done.” (Special cause)
Theory of knowledge
What do people in the organization view as meaningful information? (This affects their learning and decision-making.)
“I don’t believe the CDC estimates on how many adolescents have sex. At least I don’t think it’s true for our patients.”
Psychology What is the understanding of the people in the organization on how interpersonal and social structures affect performance of the system or process?
“Boys will be boys, so they are going to be exposed to the HPV virus and my brother’s son had genital warts so I heard about how horrible they can be.”
If you do not know how to ask the right question, you discover nothing.
W.E. Deming
What are the potential beliefs about HPV vaccine clinic held by those within the system?
How could those beliefs impact the success of the QI project
What are barriers to change within the clinic (people / processes)? That is, what are the attitudes to change itself that make change harder.
Questions that help clarify the theory of knowledge & psychological aspects of the problem:
How could the barriers be overcome?
What could we do to motivate the healthcare workers?It is key to recognize that different things motivate different people.
What additional information does this group need and how would you gather that information?
Questions that help clarify the theory of knowledge & psychological aspects of the problem (continued):
Variation:How do the outcomes change
from time to time?
Common cause variationDue to factors inherent in the
system (the noise in the system)
Accounts for most of the variationExample: Some days more
patients show up so everyone is pressured and shots during acute visits do not happen
Special cause variationDue to unexpected factorsAccounts for little of the variationExample: On March 3rd, someone
accidentally locked the room that had the vaccine refrigerator so on that day no one got vaccinated
Variation (continued)
Why do we care about differentiating these causes of variation?Design: Usually, we want our QI
change to address problems inherent to the system, not just blips
Analysis of outcomes: After we put our change in place, when we are analyzing the outcome we want to be sure that improvement is part of the (new) system, not just a blip
QUESTION #2At the QI team’s first meeting, team members report hearing the opinions (shown on the next page) about the office’s low adolescent immunization rates. Which of the 4 aspects of Dr. Deming’s System of Profound Knowledge corresponds to the team members’ concern? (Use each of the 4 only once.)
Your choices areAppreciation for the system, understanding variation, theory of knowledge, & psychology
Your choices areAppreciation for the system, understanding variation, theory of knowledge, & psychology
3. Two aspects of the actual remedial QI
process
Model for Improvement (aka Remedial Journey)1. Answering Nolan’s
3 fundamental questions for improvement
2.Running rapid cycle improvement trials
Nolan’s 3 Fundamental
Questions for Improvement
1. What are we trying to accomplish? Focused aim statement
2. How will we know that a change is an improvement? Measurement system – balanced measures, run charts
3. What changes could we make that might result in improvement?
List of change hypotheses
Rapid Cycle Improvement Trials
(aka PDSA Cycles)Plan a changeDo it in a small testStudy the results
Quantitative data (run charts)Qualitative data (front-line worker
experience)Act
Modify or replace the change hypothesisOR Accept and deploy results
4. What is the difference
between QI and research?
Research or QI?
QI and research?
Institutional Review
Each organization has different policies on having their Institutional Review Board (IRB) decide what is research and what is a QI project.
Be sure to work with your IRB before beginning your project.
Summary1. Before starting the actual remedial QI
process develop a mission statement, model the problem, and prioritize possible changes.
2. 4 inter-related components of a problem you need to understood include the system, variation, knowledge and psychology.
3. The Model for Improvement includes answering 3 essential questions and then doing PDSA cycles iteratively.
4. Research is different than QI; make sure you comply with the policies of your IRB.
The End of Module #1of Module #1