decision making methods and tools - ashnha.com · delphi method is a combination of brainstorming,...

42
Decision Making Methods and Tools CPHQ Preparation Data Analysis Alaska CPHQ 03-22-2017 Linda Michel, WSHA, Director Rural Quality and Performance Improvement

Upload: others

Post on 17-Mar-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Decision Making Methods and Tools

CPHQ PreparationData Analysis

Alaska CPHQ 03-22-2017

Linda Michel, WSHA, Director Rural Quality and Performance Improvement

Page 2: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Perception

Finished files are the resultof years of scientific study

combined with the experienceof years...

Alaska CPHQ 03-22-2017

Page 3: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Finished files are the resultof years of scientific study

combined with the experienceof years...

Perception

Alaska CPHQ 03-22-2017

Page 4: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Perception

Alaska CPHQ 03-22-2017

Page 5: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Decision-Making Methods

Brainstorming –Use when a list of possible ideas are needed.

• Free flowing ideas• No censoring, • Explaining, • Discussion,• No dollars attached,• Judgement of ideas as they are generated.

• Team can build upon the ideas of others.• Discussion of ideas comes at a later point in the process.

Good tools to use with this are Cause and Effect Diagram and the Tree Diagram.

Alaska CPHQ 03-22-2017

Page 6: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Six Steps of Brainstorming

1. Definition of the subject and direction of the session.

2. Allowing time for initial and individual thought.

3. Establishing a time limit for the entire session.

4. Requesting ideas, according to the predetermined structure.

5. Keep circling the issues until all ideas are recorded.

Alaska CPHQ 03-22-2017

Page 7: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Decision-Making Methods

Multivoting

Use after a brainstorming session to identify the key focus items for the team by:

• Looking at the list and combining similar items (renumber).• Having each team member list the items he/she thinks are

the most important.• Tallying votes.• Eliminating lowest scores.• Repeating process until list has a appropriate number for the

team to handle and the top priority is identified.

Alaska CPHQ 03-22-2017

Page 8: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Decision-Making Methods

Nominal Group Technique (Brainstorming on Paper)

Use for a controversial topic by:• Posing the question to be answered (written for all to see) and

clarify as needed.• Having group write down their ideas individually.• Listing all items with no discussion as you list them.• Clarifying the ideas one at a time, and discuss as needed.• Having sticky notes or cards for each team member and have them

write one selection of their choice on each and rate them from the highest to the lowest (ex: if instructed to list 5, then #5 is the most important).

• Collecting cards and tally votes, marking each item with the value on the card.

The item with the largest number becomes the team priority.Alaska CPHQ 03-22-2017

Page 9: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Let’s Brainstorm

I have been asked to plan a meal room service program for my facility. My first objective is to brainstorm with the team I have assembled to decide what all we must consider before designing the program.

Room Service

Hours

Staffing

Customers

Menu

Equipment

Ordering

Delivery

Meaning who receives room service meals?

Family or other Care Providers ?

ER Patients

Providers

In Patients

What conditions?

After how many hours of stay?

Alaska CPHQ 03-22-2017

Page 10: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Delphi Method (Combo)

Delphi method is a combination of brainstorming, multivoting, and nominal group techniques.

• Used for face to face or remote meetings (by email or mail)

• After each step of the process, one person receives all the data, votes, suggestions etc., compiles it, and sends it out for the next round, etc., until consensus is reached.

Alaska CPHQ 03-22-2017

Page 11: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

How Delphi Works

To reach team consensus concerning a goal or task:• You can with start a questionnaire, or a list of possible options

can be drafted by the team or team leader.• Distributed to team members with a request for comments,

questions, objectives, criteria etc. as appropriate.• Could include a requirement to vote, concerning the team goal,

task, or project.• The questionnaire, or option list is circulated anonymously,

during, before, after or in place of the team meeting.• Each time the list is revised and recirculated it includes a request

for comments, questions, objectives, criteria etc. as appropriate. • After each round, the questionnaire or option list is revised and

recirculated until consensus is reached. • Verbal discussion is used at each team meeting to review the

results and gain consensus.Alaska CPHQ 03-22-2017

Page 12: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Flow Charting

The flow chart is sometimes called the process flow chart.

A graphical display of a process as it is know by the authors, owners, and users of the process.

Outlines the sequence and relationship associated with the process until the team comes to a common understanding and knowledge about how the process works.

Beginning and End Question Actions

Alaska CPHQ 03-22-2017

Page 13: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Flow Charting

Finding an Event Venue Venue

Right Size No Keep

Looking

Yes

Date Available

Yes

No Keep Looking

Right Amenities No Keep

LookingYesReserve

Alaska CPHQ 03-22-2017

Page 14: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Cause and Effect

Use to:

• Identify and organize possible causes of problems,

• Identify factors that will lead to success, and/or

• As part of a root cause analysis.

Alaska CPHQ 03-22-2017

Page 15: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Cause and Effect

Causes Effects

Eliminate Bathroom Falls

Also known as Ishikawa or Fishbone Diagram

EnvironmentGrab Bars Location

Floors Wet

Toilet Paper Holder

Door SticksLighting

Alaska CPHQ 03-22-2017

Page 16: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Ethnicity not in computer

Cause and Effect (Fishbone)

Scenario:There is a lack of data in your facility on Race and Ethnicity of the patients you serve. You need to analyze the reasons this data might not be getting recorded in order for improvement to occur.

Stigma about ethnicity

Patients

Don’t like to be asked

Equipment

Location – Lack of privacy

Hard to enter data

Limited access to translators

Clerks also answer phones

Language Barriers

Can’t read

Procedures

Computer program too complicated

Staff

New staff not properly oriented

Too busy for extra questions

Do not like to ask question

Causes Effects

Record Ethnicity and Race

Alaska CPHQ 03-22-2017

Page 17: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Tree Diagram

Use when:

• It is crucial that a step/task not be overlooked,

• A specific task has become the focus, but it is a complicated task to complete, and/or

• There have been numerous roadblocks to implementation.

Alaska CPHQ 03-22-2017

Page 18: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Tree Diagram

100% Employee Influenza Immunization

Before Meeting

Choose Appropriate

Team

Send out Meeting Notice

Send Out Agenda

Book Meeting Space

Notify C-Suite of Meeting

Set Time Frame for Reporting

Back

During Meeting

Reasons For

Reasons Against

Possible Exclusions

Draw Up Draft Policy

Make Decision

After Meeting

Forward Draft Policy to C-Suite

Plan for roll out of policy

Plan for giving immunizations

Wait for revisions or

okay

Distribute Policy

Alaska CPHQ 03-22-2017

Page 19: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Prioritization Matrix

A tool used to select one option from a group of alternatives.

A Likert Scale (1=lowest significance/importance, 5 = highest significance/importance) is typically used for this matrix.

Example: “You need to improve access to the clinic for patients.”

Steps:1. Determine options, problems or solutions. This could be

done through brainstorming and/or multi-voting.2. Determine the criteria to be utilized to help make a decision

regarding the priority order. This criteria should all be phrased either positively or negatively so that rating is consistent.

Alaska CPHQ 03-22-2017

Page 20: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Quality Impact Criteria

Prioritization Matrix

Clinic Access Options

Safety Patient Outcome

Patient Satisfaction

Cost Total Score

Toll Free # 1 3 5 2 11

Longer Hours 3 5 4 4 16

Physicians Numbers

5 5 1 2 13

3. Each column must be scored vertically. For instance you would rate safety should be rated for all 3 options, then patient outcome, patient satisfaction etc.

4. You can do this ranking with the entire team brainstorming together to determine who goes in each box, or have each team member submit their specific numbers to the team leader, who then combines the numbers into the final sheet.

Alaska CPHQ 03-22-2017

Page 21: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

An Activity Network Diagram is a good way to identify the sequence and timelines of tasks.

You could use this diagram when you have a complex task, or when simultaneous implementation of several tasks must be coordinated.

You make an activity network diagram by:

• Listing all necessary tasks, one per sticky note or card, needed to complete the project from start to finish.

• Put the sticky notes (or cards) in sequence needed for the project to reach completion.

• Identify places in the paths where there are connections to other tasks and can not be initiated until a point in another path is reached (example: you can not put the roof on before you have the supporting framework constructed).

Activity Network Diagram

Alaska CPHQ 03-22-2017

Page 22: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Activity Network Diagram

Example: “My facility is buying a “new state of the art” CT for a brand new space that is shelled in but not finished. The project needs to be coordinated so the machine is up and running on time in order to minimize loss of revenue. I am asking my team to help me make an activity network diagram.”

Pick Vendor6-15-16

Final Plan Design8-1-16

State Approval

9-1-16

Electrical9-30-16

Plumbing9-30-16

H-Vac10-2-16

Lead lined sheetrock10-12-16

Paint and flooring

10-20-16

Installation10-21-16

Choose Arch/Build

6-30-16

Alaska CPHQ 03-22-2017

Page 23: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Deployment Chart (Planning Grid)

Helps organize key steps in the project to reach goal(s).

Schedules for complex tasks and subtasks.

Used for a task for which the time for completion is known.

Used to determine who has responsibility for the parts of a plan or project.

Responsible Task BudgetCost

Due Date

Linda Review vendors quotes 0.00 8-15-16

Robert Take plans to state office for approval

120.00 8-28-16

Gloria Coordinate contractors 560,000 9-6-16

Alaska CPHQ 03-22-2017

Page 24: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Stratification

A way of analyzing whether a problem does or does not exist, or to identify patterns.

It breaks the whole down into parts. For instance, you could stratify UTI’s by organisms, catheterizations, surgical procedures, and by nursing units.

Example: “Let’s look at the patients on unit two who are complaining their dinner is cold.”

Unit 1 Unit 2

Food cooked 4:40 pm 4:40 pm

Food plated 4:55 pm 4:55 pm

Food delivered 5:00 pm 5:15 pm

Alaska CPHQ 03-22-2017

Page 25: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

4:40

4:50

5:15

4:19

4:26

4:33

4:40

4:48

4:55

5:02

5:09

5:16

5:24

Cooked Plated Presented

Patients Dinner Meal

Unit A Unit B

5:00

Stratified Chart

Alaska CPHQ 03-22-2017

Page 26: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

A Run Chart is just that. It shows a running record of a process over time, and can be used for any type of data.

May also be referred to as a Line Graph or a Trend Chart.

Can be used for a comparison in one group or a comparison between two groups.

It is the tool of choice for continuous or measured data.

It is best used for:• Problem identification• Data analysis• Outcome evaluation

It can include a horizontal mean or medial line.

Run Chart

Alaska CPHQ 03-22-2017

Page 27: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Run Chart

Example: With summer here and accidents in rural areas on the rise, we want to see the variation in patients reaching the ED in that 1st Critical Hour. We plan to record by month so must keep data on each accident arrival.

We have developed criteria forwhat level of injury we will measure that is most importantto that 1st Critical Hour, and we will extract the data in a joint effort with the EMS Service in the areas.

Alaska CPHQ 03-22-2017

Page 28: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Month Average Minutes PatientsJanuary 51 154 3

February 62 370 6

March 45 90 2

April 31 95 3

May 21 330 7

June 65 260 4

July 45 45 1

August 38 150 4

September 78 390 5

October 38 75 2

November

December

Run Chart

We have data for 10 months of the year, and as received will add to the data.

We divided the total number of minutes to arrival in the ER from time of accident by how many patients we had that met the established criteria.

We know we are interested in the 60 minute mark, so that will be the benchmark.

Alaska CPHQ 03-22-2017

Page 29: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

51

62

45

31

21

65

45

38

78

38

0

10

20

30

40

50

60

70

80

90Average Minutes to ED Arrival After Major Accident by Month

Run Chart

Alaska CPHQ 03-22-2017

Page 30: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Display of comparisons between different groups.

For example. You have been asked to display surgery volumes of Gallbladder, Hysterectomies and Ortho for the last 6 months.

Bar Chart

GB’s Hyster. Ortho

14 12 19

2

4

6

8

10

1

2

14

1

6

18

2

0

Gallbladder Hysterectomies Ortho

14

12

19

0

Quality Leaders 06-16-2016 Alaska CPHQ 03-22-2017

Page 31: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Histogram (Type of Bar Chart)

Histogram shows the frequency of “one” continuous variable, and summarize groups of data.

Plotting the frequency of each interval reveals the pattern of the data, showing spread and outliers.

The grouping of the x axis should be equal sized, for example, with ranges defined.

The difference between a Histogram and a Bar Chart is the ranges on the Histograms where the Bar Chart has separate groups on each bar, such as, for example, nurses, aides, providers.

Example: “You want to know the correlation of the HIPAA test given to staff that have been employed 1-5 years, and the average scores dependent on years employed.”

Alaska CPHQ 03-22-2017

Page 32: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Histogram (Type of Bar Chart)

1-2 yr 2-3 yrs 3-4 yrs 4-5 yrs 5+ yrs

70 88 76 82 97

60

70

80

90

100

70

76

82

88

97

1-2 yr. 3-4 yrs. 4-5 yrs.2-3 yrs. 5 + yrs.

Aver

age

Scor

e

Years Employed Alaska CPHQ 03-22-2017

Page 33: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Pareto Chart

A simple Pareto Chart can be utilized to determine where to begin improvement efforts on a particular strategy.

Example: “The radiology patients keep complaining about the wait time for their procedures, so you want to know why that is happening. You brainstorm the possible factors and then study how often they happen.”

Brainstorming resulted in these possible factors:• No notification that the patient has arrived (Communication)• Not enough staff due to call ins (Staff Call-ins)• Not enough staff due to trauma in ER (Trauma)• Not enough staff due to unknown surgery case needing x-ray (Surgery)• Not an appropriate x-ray room available for particular exam

(Equipment)

The team decides to study these factors for 1 month. There were 84 delays during the month.

Alaska CPHQ 03-22-2017

Page 34: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Pareto Chart

Communication Staff Call-ins Trauma Surgery Equipment

57 7 5 3 12

60

50

40

30

20

10

57

12

75 3

Communication

0

Staff Call-insEquipment Trauma Surgery

Wai

t Tim

e in

Min

utes

DelaysAlaska CPHQ 03-22-2017

Page 35: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

So now you know it is communication, but are not exactly sure where the communication failure is happening. You want to study this further, so you might use an advanced Pareto Chart.

20% of the whole represents 80% of the problem is the theory behind this charting. So you brainstorm again and come up with:

• Communication between admitting and radiology• Communication between lead and technologist• Communication to patient about reasons for delays• Communication between technologist and radiologist• Unclear procedure communication from provider• Confusion by patient about scheduled procedure time• Lack of communication regarding patient prep

Advanced Pareto Chart

Alaska CPHQ 03-22-2017

Page 36: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Advanced Pareto Chart

Admitting Lead/Tech Delays Tech/Rad Provider Time Prep

16 4 1 2 3 30 1

0

5

101520

25

30

35

40

45

50

30

16

4 3 2 1 10%

20%

40%

60%

80%

100%

80%

60

Time Admitting Lead/Tech Provider Tech/Rad Delays Prep

85%90%

95%5598.5%

60%

Alaska CPHQ 03-22-2017

Page 37: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Scatter or Plot Diagram

Used when you want to determine the extent to which two variables are related to one another (for instance quality and process).

Example: “There is a perception that the heart measured by the monitor is not correct, and the nurse taking the heart rate manually is more accurate.”

The staff will have to duplicate and do the heart rate both by monitor and manually for at least 25 data points.

Alaska CPHQ 03-22-2017

Page 38: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Scatter (or Plot) Diagram

Manual Monitor

80 80

60 60

100 100

70 72

92 92

60 62

75 75

65 65

70 70

85 85

90 90

75 75

100 100

110

90

70

50

40

100

80

60

40 50 60 70 80 90 100 110

Positive correlation – both methods are accurate

Man

ual

Monitor

Alaska CPHQ 03-22-2017

Page 39: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

RN Tenure ADE’s

1 yr 5

2 yrs 3

3 yrs 7

4 yrs 1

5 yrs 6

6 yrs 2

7 yrs 4

8 yrs 1

9 yrs 9

10 yrs 3

11 yrs 5

12 yrs 7

Scatter (or Plot) Diagram

Measured over a 2 year period

ADE’

s

Tenure

1 2 3 4 5 6 7 8 9 10 11 12

1

2

3

4

5

6

7

8

9

0

No correlation between RN Tenure and ADE’sAlaska CPHQ 03-22-2017

Page 40: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

Quality Methods and Tools

Problem Identification

Data Analysis

Solution Planning

Outcome Evaluation

Flow Chart X X X

Run Chart X X X

Cause and Effect (Fishbone) X X X

Bar Chart/Histogram X X

Pareto Chart X X X

Scatter Diagram X X

Brainstorming X X X X

Nominal Group Technique X

Multi-voting X X X

Delphi Method X

Tree Diagram X

Activity Network Diagrams X X

Prioritization Matrix X X

Tool

Alaska CPHQ 03-22-2017

Page 41: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

What to Use?

1. You need ideas for a new sleep lab? After assembling the team, what method would you use to get started?

2. Some in the group will not speak up, what kind of voting would you use to get their opinions?

3. Good ideas have come up and, you have reduced them to 4 major tasks, but those tasks seem overwhelming. What would you use to prioritize the work?

4. Snow storm of the century! Been snowing consistently for 3 days and police have instructed non vital personnel to stay home. They have informed you that it will take another 4 days to get the streets plowed. Thank goodness you still have power and internet connectivity. You must continue on with planning your project. What method could you use?

5. You have identified the problems but need to know where exactly the real problems lie. What would show you 80% of the problem?

Alaska CPHQ 03-22-2017

Page 42: Decision Making Methods and Tools - ashnha.com · Delphi method is a combination of brainstorming, multivoting, and nominal group techniques. • Used for face to face or remote meetings

6. It seems that somedays the ER admits take longer to process and get to their rooms, but ER says no, everyone gets processed and to the floor within the 45 time limit. What could you chart to show them the average times on a daily basis?

7. What need to analyze volumes of surgical procedures in 2014 as compared to 2015 in orthopedics and gynecological cases. What chart would you use to display the data?

8. The night shift says the heat runs cold during their shift and the day shift says it runs hot during their shift. Maintenance says it runs the same temperature all the time. What could you do once you have collected the data to see if the correlation really exist?

9. What are two diagrams you can use when up against a time line or multi-step project?

10. You need to begin an Root Cause Analysis on an adverse event. You have assembled the needed team. What would be a good way to display their thoughts on what issues may have contributed to this event?

What to Use?

Alaska CPHQ 03-22-2017