praxophy at palisade regional risk conference in dc

58
Heart, Head, and Hands A small non-profit uses PraXophy Management System (PxMS) and Palisade’s @RISK to tackle its existential questions, and thrive

Upload: praxophy

Post on 14-Jul-2015

239 views

Category:

Data & Analytics


11 download

TRANSCRIPT

Page 1: Praxophy at Palisade Regional Risk Conference in DC

Heart, Head, and Hands

A small non-profit uses PraXophy Management System (PxMS) and Palisade’s @RISK to tackle its

existential questions, and thrive

Page 2: Praxophy at Palisade Regional Risk Conference in DC

Case Study Situation

• Landscape– Plenty of Big Box, Wizard-Behind-Curtain solutions—but how well do they really work?

– Looking to market Blue Collar, Kitchen Table consulting: practical, facilitated, valued, transparent, and owned

• Client’s decision opportunity– On the order of $2M, based on annual income from donations and rents of about $150K

– Client not aware of latest in decision analysis and not loaded with cash—sound typical?

• Important considerations– Soft skills. Anne Robinson, past President of INFORMS pointed out that while we have

distinguished ourselves on the analytics front (CAP), as a profession we are weak in soft skills.

– Context. Prof. Eric Davis wrote “10 Myths about the Crisis in Iraq.” He stressed the important role of context in implementing productive policy. Myths distort the crisis and mislead policy-makers.

2PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Page 3: Praxophy at Palisade Regional Risk Conference in DC

Desired Outcomes for This Presentation

• Describe the context for the case study

– What is the opportunity we’re working on?

– What hypotheses are we testing? What data are needed?

– What is the overall scope of the effort?

• Explain the methodology

– What is PraXophy Management System (PxMS)?

– How does it work? Why is it useful? What can we do with it?

– Some benefit and effort considerations of PxMS

• Discuss Status of the Case Study with some technical details

– What are the expected outcomes of this application of PxMS?

– How might PxMS be applied to other opportunities?

– WIIFM? What’s next? Way Ahead?

• Make some new friends

3PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Page 4: Praxophy at Palisade Regional Risk Conference in DC

Follow-up / Contact

PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 4

• https://www.facebook.com/PraXophy• [email protected]• https://www.linkedin.com/in/davedoane

• https://twitter.com/PraXophy @PraXophy• http://www.slideshare.net

• https://todaysmeet.com/PraXophy

6/29/2014

c8wrbq7v

Page 5: Praxophy at Palisade Regional Risk Conference in DC

PraXophy Management System (PxMS)

PraXophy means “Practical Wisdom.” The PraXophy Management System (PxMS) was created for

• strategic-level organizational learning and communication (value),

• enterprise performance management (quality), and

• project selection and portfolio management for continuous process improvement (utility)

Applied Management & Decision SciencesPxMS is a unique, simple, yet powerful extension of several decision analysis concepts:

• Checkland (1981) Systems Thinking

• Keeney (1992) Value-Focused Thinking

• Kaplan & Norton (1996) The Balanced Scorecard

• Kirkwood (1996) Multi-objective Decision Analysis with Spreadsheets

• Parnell (2003) Future Value Analysis

• George (2007) Lean Six Sigma

• Monte Carlo Simulation with @RISK plug-in for MS Excel by Palisade

Page 6: Praxophy at Palisade Regional Risk Conference in DC

Drucker: “All business is either marketing or innovation.”

PxMS Methodology Outline

6

Step 0: Marketing

1. Describe Context

2. Build the Qualitative Value Model

3. Quantify the Evaluation Measures

4. Develop the Problem Statement

5. Generate Alternative Strategies

6. Use QVM for Future Value Analysis

7. TransitionPraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Demonstrate the benefits multi-objective decision analysis• Systematic process with well-developed analysis

techniques and computer software tools• Appropriate for quantifying values and uncertainties• Strong professional society and technical literature

Engage the stakeholders and decision makers• Incorporate information from functional experts (inside)

and interested stakeholders (outside)• Provide insight to decision-makers faced with hard

problems.• Present objective, traceable, and robust analysis

support.

Page 7: Praxophy at Palisade Regional Risk Conference in DC

Initial Assessment of the Client’s Situation

• Leadership not engaged in D-M process; they commission a Strategic Planning Team (SPT) to confirm a pre-determined “correct” answer

• SPT produces detailed Pro-Con analysis of alternatives, but the criteria were different for each alternative—comparing apples and oranges and bananas and…

• Alternative Focused vs. Value-Focused

– Where’s the context? Not modeled

– Where’s the Fundamental Objective or overarching raison d'ê·tre?

– Where’s the yardstick? Lots of data, but no metrics, no measuring system, and no score

• Where are the value gaps? Is the SPT addressing the most pressing?

• Where is the Alternative Generation Table? How to compare and express preferences across many options?

• When to take action? Conditions-based decision points?

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 7

Page 8: Praxophy at Palisade Regional Risk Conference in DC

Alternatives vs. Values

Alternative Focused Thinking

• Solve problems—reaction

• Bias for self-reliance

• Generate alternatives

• Rack and stack

• Choose based on weighted selection criteria

Value-Focused Thinking

• Qualitative, Value-focused framework—PROACTIVE

• Bias for collaborative action, continuous process improvement

• Generate value gaps

• Supports a systems view

• Launch L6S projects to fill the value gaps and optimize portfolio

Keeney, R.L. (1992). Value Focused Thinking.

8PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Page 9: Praxophy at Palisade Regional Risk Conference in DC

Issues and Potential Pitfalls• Time and energy to construct the model

– Collecting meaningful, reliable data

– Maintaining the model to keep it relevant and useful

• Organizational culture– Goal setting / Performance evaluation

– Decision making styles:

• Transparent and participating? OR

• Close-hold and secretive?

– Communication needs

• Setting and managing thresholds– Confidence in data

– Grading on a curve

• Collaboration– Tracking trends

– Making resource allocation decisions

• Transition – Training

– Documentation

– Maintenance

9PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014 Cave

Cabin

Condo

Castle

Page 10: Praxophy at Palisade Regional Risk Conference in DC

PxMS Methodology Outline

10

Step 0: Marketing

1. Describe Context

2. Build the Qualitative Value Model

3. Quantify the Evaluation Measures

4. Develop the Problem Statement

5. Generate Alternative Strategies

6. Use QVM for Future Value Analysis

7. TransitionPraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

• Weltanschauung: the Client’s worldview, in particular, external forces impacting the competitive landscape

• Milieu: the aggregation of cultural norms to the corporate level—the way we do things around here

• Tao: the Way, that is, the philosophical approach of the senior leader. This is similar to a Target Audience Profile

• Est: the Ground Truth. All of our best analysis is but a shadow of reality

Page 11: Praxophy at Palisade Regional Risk Conference in DC

PxMS OverviewDecisions take place in a system of nested environments

Weltanschauung, or worldview

Milieu, or culture

Tao, or “The Way”

Est, or what is

11PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Page 12: Praxophy at Palisade Regional Risk Conference in DC

Interview QuestionsTarget Audience Profile

1. What could go wrong with our current strategy?

2. Where are we most seriously under-resourced?

3. Which of the stakeholder’s questions can only you answer?

4. What keeps you up at night?

5. If we do this right what would it be like in 5 years?

Thank you for your participation!

12PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Page 13: Praxophy at Palisade Regional Risk Conference in DC

EstUnderstanding the essence of what is really real

Organizational culture is “the way we do things around here.” –E. Schein

“If you want to improve the world, the place to begin is in your own heart, and head, and hands.” –author R. Pirsig“Essentially, all models are

wrong, but some are useful.” –statistician G.E.P. Box

"For a flow system to persist in time (to survive) it must evolve in such a way that it provides easier and easier access to the currents that flow through it." --scientist Adrian Bejan

"Not everything that counts can be counted, and not everything that can be counted counts." --Albert Einstein, from a sign he kept in his office

"The aim of education is tolerance." --Helen Keller

"Watch your thoughts, for they become words. Watch your words, for they become actions. Watch your actions, for they become habits. Watch your habits, for they become character. Watch your character, for it becomes your destiny." — Unknown

13PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Page 14: Praxophy at Palisade Regional Risk Conference in DC

PxMS Methodology Outline

14

Step 0: Marketing

1. Describe Context

2. Build the Qualitative Value Model

3. Quantify the Evaluation Measures

4. Develop the Problem Statement

5. Generate Alternative Strategies

6. Use QVM for Future Value Analysis

7. TransitionPraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

• Fundamental Objective• Objective Functions• Means Objectives• Evaluation Measures• Value Functions

Page 15: Praxophy at Palisade Regional Risk Conference in DC

Structure of a Generic Qualitative Value Model1

Clear and concise

description of

Purpose, e.g.,

Win the War

Calculate

and display

the System

Score

67

Objective

Functions

(not scored)

Max or Min Functions,

i.e., "stretch goals"

that go beyond

describing how to

achieve the FO.

Ends

0.40 0.35 0.25

Means Objective 1 Means Objective 2 Means Objective 3

55 73 78

0.25 0.33 0.25

Evaluation Measure

1.1

Evaluation Measure

2.1

Evaluation Measure

3.1

65 87 57

0.25 0.33 0.25

Evaluation Measure

1.2

Evaluation Measure

2.2

Evaluation Measure

3.2

43 85 87

0.25 0.33 0.25

Evaluation Measure

1.3

Evaluation Measure

2.3

Evaluation Measure

3.3

92 48 78

0.25 0.25

Evaluation Measure

1.4

Evaluation Measure

3.4

19 90

Low Color High

100 Reassess 101

90 Target 99

75 Satisfactory 89

40 Warning 74

1 Unsatisfactory 39

-1 Regroup 0

Value Function

Thresholds

Evaluation

Measures

Fundamental

Objective

Means Objectives Means

Ways

Data in,

scores out

15PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Page 16: Praxophy at Palisade Regional Risk Conference in DC

1

Clear and concise

description of

Purpose, e.g.,

Win the War

Calculate

and display

the System

Score

67

Objective

Functions

(not scored)

Max or Min Functions,

i.e., "stretch goals"

that go beyond

describing how to

achieve the FO.

Ends

0.40 0.35 0.25

Means Objective 1 Means Objective 2 Means Objective 3

55 73 78

0.25 0.33 0.25

Evaluation Measure

1.1

Evaluation Measure

2.1

Evaluation Measure

3.1

65 87 57

0.25 0.33 0.25

Evaluation Measure

1.2

Evaluation Measure

2.2

Evaluation Measure

3.2

43 85 87

0.25 0.33 0.25

Evaluation Measure

1.3

Evaluation Measure

2.3

Evaluation Measure

3.3

92 48 78

0.25 0.25

Evaluation Measure

1.4

Evaluation Measure

3.4

19 90

Low Color High

100 Reassess 101

90 Target 99

75 Satisfactory 89

40 Warning 74

1 Unsatisfactory 39

-1 Regroup 0

Value Function

Thresholds

Evaluation

Measures

Fundamental

Objective

Means Objectives Means

Ways

Data in,

scores out

16PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making

1

Clear and concise

description of

Purpose, e.g.,

Win the War

Calculate

and display

the System

Score

67

Objective

Functions

(not scored)

Max or Min Functions,

i.e., "stretch goals"

that go beyond

describing how to

achieve the FO.

Ends

0.40 0.35 0.25

Means Objective 1 Means Objective 2 Means Objective 3

55 73 78

0.25 0.33 0.25

Evaluation Measure

1.1

Evaluation Measure

2.1

Evaluation Measure

3.1

65 87 57

0.25 0.33 0.25

Evaluation Measure

1.2

Evaluation Measure

2.2

Evaluation Measure

3.2

43 85 87

0.25 0.33 0.25

Evaluation Measure

1.3

Evaluation Measure

2.3

Evaluation Measure

3.3

92 48 78

0.25 0.25

Evaluation Measure

1.4

Evaluation Measure

3.4

19 90

Low Color High

100 Reassess 101

90 Target 99

75 Satisfactory 89

40 Warning 74

1 Unsatisfactory 39

-1 Regroup 0

Value Function

Thresholds

Evaluation

Measures

Fundamental

Objective

Means Objectives Means

Ways

Data in,

scores out

1

Clear and concise

description of

Purpose, e.g.,

Win the War

Calculate

and display

the System

Score

67

Objective

Functions

(not scored)

Max or Min Functions,

i.e., "stretch goals"

that go beyond

describing how to

achieve the FO.

Ends

0.40 0.35 0.25

Means Objective 1 Means Objective 2 Means Objective 3

55 73 78

0.25 0.33 0.25

Evaluation Measure

1.1

Evaluation Measure

2.1

Evaluation Measure

3.1

65 87 57

0.25 0.33 0.25

Evaluation Measure

1.2

Evaluation Measure

2.2

Evaluation Measure

3.2

43 85 87

0.25 0.33 0.25

Evaluation Measure

1.3

Evaluation Measure

2.3

Evaluation Measure

3.3

92 48 78

0.25 0.25

Evaluation Measure

1.4

Evaluation Measure

3.4

19 90

Low Color High

100 Reassess 101

90 Target 99

75 Satisfactory 89

40 Warning 74

1 Unsatisfactory 39

-1 Regroup 0

Value Function

Thresholds

Evaluation

Measures

Fundamental

Objective

Means Objectives Means

Ways

Data in,

scores out

1

Clear and concise

description of

Purpose, e.g.,

Win the War

Calculate

and display

the System

Score

67

Objective

Functions

(not scored)

Max or Min Functions,

i.e., "stretch goals"

that go beyond

describing how to

achieve the FO.

Ends

0.40 0.35 0.25

Means Objective 1 Means Objective 2 Means Objective 3

55 73 78

0.25 0.33 0.25

Evaluation Measure

1.1

Evaluation Measure

2.1

Evaluation Measure

3.1

65 87 57

0.25 0.33 0.25

Evaluation Measure

1.2

Evaluation Measure

2.2

Evaluation Measure

3.2

43 85 87

0.25 0.33 0.25

Evaluation Measure

1.3

Evaluation Measure

2.3

Evaluation Measure

3.3

92 48 78

0.25 0.25

Evaluation Measure

1.4

Evaluation Measure

3.4

19 90

Low Color High

100 Reassess 101

90 Target 99

75 Satisfactory 89

40 Warning 74

1 Unsatisfactory 39

-1 Regroup 0

Value Function

Thresholds

Evaluation

Measures

Fundamental

Objective

Means Objectives Means

Ways

Data in,

scores out

1

Clear and concise

description of

Purpose, e.g.,

Win the War

Calculate

and display

the System

Score

67

Objective

Functions

(not scored)

Max or Min Functions,

i.e., "stretch goals"

that go beyond

describing how to

achieve the FO.

Ends

0.40 0.35 0.25

Means Objective 1 Means Objective 2 Means Objective 3

55 73 78

0.25 0.33 0.25

Evaluation Measure

1.1

Evaluation Measure

2.1

Evaluation Measure

3.1

65 87 57

0.25 0.33 0.25

Evaluation Measure

1.2

Evaluation Measure

2.2

Evaluation Measure

3.2

43 85 87

0.25 0.33 0.25

Evaluation Measure

1.3

Evaluation Measure

2.3

Evaluation Measure

3.3

92 48 78

0.25 0.25

Evaluation Measure

1.4

Evaluation Measure

3.4

19 90

Low Color High

100 Reassess 101

90 Target 99

75 Satisfactory 89

40 Warning 74

1 Unsatisfactory 39

-1 Regroup 0

Value Function

Thresholds

Evaluation

Measures

Fundamental

Objective

Means Objectives Means

Ways

Data in,

scores out

6/29/2014

Page 17: Praxophy at Palisade Regional Risk Conference in DC

PxMS Methodology Outline

17

Step 0: Marketing

1. Describe Context

2. Build the Qualitative Value Model

3. Quantify the Evaluation Measures

4. Develop the Problem Statement

5. Generate Alternative Strategies

6. Use QVM for Future Value Analysis

7. TransitionPraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

• Type of data• Type of metrics

• Natural, Direct (shared, repeatable)• Constructed, Proxy (must pass the Clairvoyant Test)

• Value functions convert data to score • Ranking Methods—determining ordinal importance• Weighting—determining the relative importance of ranked • Thresholds—adjustable grading curves

Page 18: Praxophy at Palisade Regional Risk Conference in DC

Natural or Constructed

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 18

Page 19: Praxophy at Palisade Regional Risk Conference in DC

Quick Stats Review

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 19

# Data Scale Description

1 Categorical Nominal Names. Categorically discrete data such as name of your school, type of car you drive or name of a book.

2 Quantitative Ordinal Quantities that have a natural rank ordering, but the intervals between ranks may have no relative significance.

3 Discrete Interval Like ordinal except we can say the intervals between each value are equally split, e.g., temperature in degrees Fahrenheit.

4 Continuous Ratio Discrete data with a natural zero point, e.g., time, since 0 time is meaningful, or degrees Kelvin (absolute 0). In these scales, each interval step has the same degree of magnitude.

Page 20: Praxophy at Palisade Regional Risk Conference in DC

Example Evaluation Measures

Direct Proxy

Natural

Constructed

• Net Present Value• System Reliability• Force Closure Time• Probability of Kill• Bandwidth per Sec

• Performance Evaluation(Promotion Potential)• Student Grades(Student Learning), (Teacher Performance?)• Church Income(Depth of Touches)• Mark-to-Market Value(Resilience, Capacity, Health)

20

• Results of Public Opinion Polls

• Natural Language Programming

• Mohs Scale of Mineral Hardness

• Pictograph Perceived Pain(Actual pain)• Subject Matter Expertise(True state of nature)• Church Attendance (Breadth of Lives Touched)

PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

• Temperature, deg F• Consumer Price Index• Gross Domestic Product

Page 21: Praxophy at Palisade Regional Risk Conference in DC

# Lo Hi

5 161 200 100 blue

4 121 160 99 green

3 81 120 89 yellow

2 41 80 74 orange

1 11 40 39 red

0 0 10 0 black

A Purpose & Limits

B Data Type & Collection Method

C Source of Data

D Type of Scale

E Function shape

Proxy for quantity of touches; subject to capacity limits

Discrete; Counts

Attendance records taken and maintained by church leaders

Weekly Attendance

ThresholdDescription

Ratio, Natural, Proxy

Increasing, Convex, Diminishing returns near limit

Bursting at seams, new people feel lost, retention may suffer

Growing yet retains small group feel and fits comfortably

Small and solid, good recruiting and retention

Small but viable, some new people stay and contribute

Too small, not self-sustaining, new people go elsewhere

Collapsing rapidly, unsustainable, abandon ship

Eliciting a Value Function

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 21

Page 22: Praxophy at Palisade Regional Risk Conference in DC

Converting a Datum to a Score

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 22

input > 80 74.00 < output

range delta

39 -81 -2.07692 1 -2.07692 96.92

39 -41 -1.05128 10 -10.5128 78.49

39 -1 -0.02564 15 -0.38462 73.62

39 39 1 35 35 74.00

29 69 2.37931 39 92.7931 92.79

10 80 8 0 0 0.00

RF 10000 Bottom Red Orange Yellow Green

Lo 0 0 0 39 35 15 11

Hi 200 10000 0 39 35 15 11

2. Scroll down to find the first positive delta value (39)

1. Import the Attendance number (80) from data worksheet

3. Read across to the scored value of X (74)

4. The Resolution Factor (RF) is a variable used to zoom out or add more pixels to the color-coded background. The Peltier Tech Blog by Jon Peltier has an excellent tutorial on background shading at http://peltiertech.com/WordPress/

Page 23: Praxophy at Palisade Regional Risk Conference in DC

Depicting Thresholds and the Score

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 23

0 50 100 150 200 250

0

20

40

60

80

100

120

Weekly Attendance

X

Page 24: Praxophy at Palisade Regional Risk Conference in DC

PxMS Methodology Outline

24

Step 0: Marketing

1. Describe Context

2. Build the Qualitative Value Model

3. Quantify the Evaluation Measures

4. Develop the Problem Statement

5. Generate Alternative Strategies

6. Use QVM for Future Value Analysis

7. TransitionPraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

3-element Value PropositionCustomer: visionary, pragmatist, or conservativeProduct: use “industrial strength” toolsApplication: generate better alternatives

Use the Customer’s languageTailor techniques to the applicationHave regular interaction with the decision makerPresent understandable results

Page 25: Praxophy at Palisade Regional Risk Conference in DC

Find and Close Value Gaps

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 25

0.40 0.35 0.25

Means Objective 1 Means Objective 2 Means Objective 3

55 73 78

0.25 0.33 0.25

Evaluation Measure

1.1

Evaluation Measure

2.1

Evaluation Measure

3.1

65 87 57

0.25 0.33 0.25

Evaluation Measure

1.2

Evaluation Measure

2.2

Evaluation Measure

3.2

43 85 87

0.25 0.33 0.25

Evaluation Measure

1.3

Evaluation Measure

2.3

Evaluation Measure

3.3

92 48 78

0.25 0.25

Evaluation Measure

1.4

Evaluation Measure

3.4

19 90

Time X Attend Park Income Exp Float Cum Float Net Worth

0 80 27 3.1 2.4 0.70 8 1.79

1 89 30 3.35 2.46 0.89 19 1.86

2 99 33 3.62 2.52 1.09 32 1.93

3 109 36 3.91 2.58 1.32 48 2.01

4 121 40 4.22 2.65 1.57 67 2.09

5 135 45 4.55 2.72 1.84 89 2.17

6 150 50 4.92 2.78 2.14 115 2.26

7 166 55 5.31 2.85 2.46 144 2.35

8 184 61 5.74 2.92 2.81 178 2.45

9 205 68 6.20 3.00 3.20 216 2.54

10 227 76 6.69 3.07 3.62 260 2.65

11 252 84 7.23 3.15 4.08 309 2.75

12 280 93 7.81 3.23 4.58 364 2.86

13 311 104 8.43 3.31 5.12 425 2.98

14 345 115 9.11 3.39 5.71 494 3.09

15 383 128 9.83 3.48 6.36 570 3.22

Close Value Gaps with the DMAIC ProcessD = Define the problem or opportunityM = Measure to objectively establish current baselines as the basis for improvement. A = Analyze to identify, validate and select root cause for elimination.I = Improve by identifying, testing, and implementing a solution to the problem.C = Control by monitoring improvements to ensure continued and sustainable success.

Page 26: Praxophy at Palisade Regional Risk Conference in DC

Worksheet View

PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 266/29/2014

Average Annualized Weekly AttendanceMore people in Church = more lives touched; Measure the Quantity of Touches

80 Raw number (integer)

74.00 Score (LOOKUP from Value Function)

0.4 Weight (Sum of all MO weights equals 1)

29.60 Contribution of this MO to Total Score

EVALUATION MEASURES

1.1 Worship Attendance (includes members, friends, and visitors)

62 Current 5 year average annualized weekly attendence

80 Current 1 year average annualized weekly attendence

34 Average Membership 5 years ago

47 Average membership last 12 months

183 Peak attendence last 12 months

8 Minimum attendence last 12 months

LIMITATIONS

180 Capacity per Service (seating)

39 Capacity per Service (parking)

2 Handicap

35 Regular size

2 Visitor reserved

0 Bus reserved

Lay leader participation

Age distribution

1 Means Objective Weights must sum to 1

PROJECTIONS

0.11 Annual worship attendance growth rate last 5 years

0.11 Expected annual attendance growth rate (min, mean, and max; distribution)

135 Projected attendence at time X (mean, with 90% confidence interval)

Cell requires manual input

Cell contains a formula

Cell contains random variable

Cell contains a limitation

Legend

A total of four EMs feed into MO 1. (EM 1.1 is shown.)

In addition to EMs, each MO has space for Limitations and Projections.@RISK to the

Rescue!

Page 27: Praxophy at Palisade Regional Risk Conference in DC

PxMS Methodology Outline

27

Step 0: Marketing

1. Describe Context

2. Build the Qualitative Value Model

3. Quantify the Evaluation Measures

4. Develop the Problem Statement

5. Generate Alternative Strategies

6. Use QVM for Future Value Analysis

7. TransitionPraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

• Construct Affinity Diagram• Based on Value Table• A subset of the overall model

• Determine functions, tasks, and candidate evaluation measures

• Evaluate alternatives in view of impact on System Score

Page 28: Praxophy at Palisade Regional Risk Conference in DC

A Series of Three Instructive Issues Relating to the Generation of Alternatives

• The Decision Matrix (Dec Mat)

– Techniques for Ranking

– Determining Relative Importance

• The Extrapolation Problem

• The Problem of Communicating Concisely

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 28

Page 29: Praxophy at Palisade Regional Risk Conference in DC

1. The Dec Mat Problem

• We all use Decision Matricies…

• Pro-Con analysis of 4 alternatives

• Converting Pros and Cons into CoAs and SoNs

• Converting comments to symbols++,

+,

0,

-, and

• Converting symbols to numbers

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 29

Page 30: Praxophy at Palisade Regional Risk Conference in DC

Relative SoN

Importance

Weights Sum

to Unity

v(i1,j1) v(i2,j1) v(i3,j1) v(in,j1) Row SUM

w1*v(i1,j1) w2*v(i2,j1) w3*v(i3,j1) wn*v(in,j1) Weighted Sum

v(i1,j2) v(i2,j2) v(i3,j2) v(in,j1) Row SUM

w1*v(i1,j2) w2*v(i2,j2) w3*v(i3,j2) wn*v(in,j1) Weighted Sum

v(i1,j3) v(i2,j3) v(i3,j3) v(in,j1) Row SUM

w1*v(i1,j3) w2*v(i2,j3) w3*v(i3,j3) wn*v(in,j1) Weighted Sum

v(i1,jn) v(i2,jn) v(i3,jn) v(in,j1) Row SUM

w1*v(i1,jn) w2*v(i2,jn) w3*v(i3,jn) wn*v(in,j1) Weighted Sum

Where

i = columns

j = rows

w = weights

s = score

v = values

r = rank

ScoresPreference

(Rank of

Weighted

Sum-

Products)

i1

w1

i2

States of Nature (SoN): Criteria (Objectives, Expected Outcomes) or Attributes (Desired

Characteristics)

i3 in

wnw3w2

j1

Courses of Action

(CoA): Choices,

Alternative Solutions

j2

j3

jn

Format of a Typical Dec Mat

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 30

Page 31: Praxophy at Palisade Regional Risk Conference in DC

The four big picture options

1) Sell and Relocate somewhere else, either rent, buy, or build

2) Tear Down and Rebuild on current site

3) Renovate/Upgrade current building

4) Partnering or other innovative alternate

31PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Page 32: Praxophy at Palisade Regional Risk Conference in DC

Sell and Relocate somewhere else, either rent, buy, or build

• Quick access to capital (~ 12 –18 month delay)

• (Renting) Frees us from building ownership issues

• Allows us to respond quickly to market opportunities

• “Build to suit our needs”

• Over long term, this has a net financial loss

• Few options are available• Requires fast response on

decisions, difficult to get• Breaks with our tradition and

“sacred space”• Does not help gain equity• Next phase is very expensive• Promotes heavy land use

practices (not “green”)• Less control in rented space

PROs CONs

32PraXophy: Practical Wisdom for Value-

Focused and Data-Fueled Decision-Making 6/29/2014

Page 33: Praxophy at Palisade Regional Risk Conference in DC

Rebuild on current site

• Retains “sacred location”

• Avoids land market delays

• Remaining usable land becomes more accessible

• More certainty for future

• Geographic appeal

• Clearer, surer vision

• Less change than relocating

• Maintains assets and equity for the future

• Some loss of “sacred space”

• Higher permit scrutiny

• CBPA has severe restrictions

• Causes time away, costs $$ re: alternate location, membership impact

• Risk of taking on a large, unsupportable loan

PROs CONs

33PraXophy: Practical Wisdom for Value-

Focused and Data-Fueled Decision-Making 6/29/2014

Page 34: Praxophy at Palisade Regional Risk Conference in DC

Renovate/Upgrade current building

• Faster permit process

• Less ADA, etc., impact

• Shorter time away, if any

• Can be a more limited change, less cost

• “Constrained”

• Typically costs more to refurbish existing than to build new

• Requires compromise of goals/mission/vision

PROs CONs

34PraXophy: Practical Wisdom for Value-

Focused and Data-Fueled Decision-Making 6/29/2014

Page 35: Praxophy at Palisade Regional Risk Conference in DC

Convert Pro-Con to Dec Mat, Part I

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 35

Building code (ADA) compliance and Permit process

time

Time spent away from HOME and Sacred Space;

Uncertainty; Change

Total cost of the alternative over the next 20 years

Fidelity to mission, vision, goals

Quick access to capital; Ability to respond quickly to

market opportunities

Building ownership issues (Maintenance & Repair)

Likely impact on membership, participation, and

giving

Design customized to our needs; Flexibility and

freedom of facility use

Impact on long-term financial health; net worth

Decision cycle incl. internal (church) and external

(legal) decisions

Sell and Relocate somewhere else, either rent, buy, or build

Sell and Relocate somewhere else, either rent, buy, or build

Sell and Relocate somewhere else, either rent, buy, or build

Rebuild on current site

Renovate/Upgrade current building

Partnering or other innovative alternate

The “Do Nothing” Option

Derived States of Nature Modified Courses of Action

6 CoAs

Page 36: Praxophy at Palisade Regional Risk Conference in DC

The Ranking and Weighting Problem

• Pairwise Comparison (Ranking the States of Nature (SoN))

• Value elicitation (Deriving Senior Leader’s opinion on the relative importance of ranked SoN)

• Saaty Scales (Means of converting expressed preferences or utility to continuous data on a ratio scale)

• Using weighted states of nature to place Courses of Action (CoA) into proper sequence with respect to value, quality, or utility.

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 36

Page 37: Praxophy at Palisade Regional Risk Conference in DC

Bu

ild

ing

cod

e (

AD

A)

com

pli

ance

an

d

Pe

rmit

pro

cess

tim

e

Tim

e s

pe

nt

away

fro

m H

OM

E an

d

Sacr

ed

Sp

ace

; U

nce

rtai

nty

; C

han

ge

Tota

l co

st o

f th

e a

lte

rnat

ive

ove

r

the

ne

xt 2

0 y

ear

sBu

ild

ing

cod

e (

AD

A)

com

pli

ance

an

d

Pe

rmit

pro

cess

tim

e

Tim

e s

pe

nt

away

fro

m H

OM

E an

d

Sacr

ed

Sp

ace

; U

nce

rtai

nty

; C

han

ge

Tota

l co

st o

f th

e a

lte

rnat

ive

ove

r

the

ne

xt 2

0 y

ear

s

Fid

eli

ty t

o m

issi

on

, vi

sio

n,

goal

s

ABuilding code (ADA) compliance and Permit process

timeA

BTime spent away from HOME and Sacred Space;

Uncertainty; ChangeB B

C Total cost of the alternative over the next 20 years C B C

D Fidelity to mission, vision, goals D D D D

EQuick access to capital; Ability to respond quickly to

market opportunitiesA B C D E

F Building ownership issues (Maintenance & Repair) F B C D F F

GLikely impact on membership, participation, and

givingG G G D G G G

HDesign customized to our needs; Flexibility and

freedom of facility useH B C D H F G H

I Impact on long-term financial health; net worth I B C D I F G H I

JDecision cycle incl. internal (church) and external

(legal) decisionsA B C D E F G H I J

3 8 7 10 2 6 9 5 4 1

8 3 4 1 9 5 2 6 7 10

Imp

act

on

lo

ng-

term

fin

anci

al

he

alth

; n

et

wo

rth

De

cisi

on

cyc

le i

ncl

. in

tern

al

(ch

urc

h)

and

ext

ern

al (

lega

l)

de

cisi

on

s

Tim

e s

pe

nt

away

fro

m H

OM

E an

d

Sacr

ed

Sp

ace

; U

nce

rtai

nty

; C

han

ge

Tota

l co

st o

f th

e a

lte

rnat

ive

ove

r

the

ne

xt 2

0 y

ear

s

Fid

eli

ty t

o m

issi

on

, vi

sio

n,

goal

s

Qu

ick

acce

ss t

o c

apit

al;

Ab

ilit

y to

resp

on

d q

uic

kly

to m

arke

t

op

po

rtu

nit

ies

Bu

ild

ing

ow

ne

rsh

ip i

ssu

es

(Mai

nte

nan

ce &

Re

pai

r)

Like

ly i

mp

act

on

me

mb

ers

hip

,

par

tici

pat

ion

, an

d g

ivin

g

COUNT

RANK

De

sign

cu

sto

miz

ed

to

ou

r n

ee

ds;

Fle

xib

ilit

y an

d f

ree

do

m o

f fa

cili

ty

use

Pairwise Comparison

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 37

Page 38: Praxophy at Palisade Regional Risk Conference in DC

Elicit Weights

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 38

Given rankings from 1 to 10 as shown, determine Relative Importance among those States of Nature by eliciting weights. Ask the D-M: “Starting from zero, add 100 units of utility one at a time. Where would you apply the first unit? The second? The 100th?”The resulting distribution of relative importance translates into weights

D Fidelity to mission, vision, goals 3 10 20

G Likely impact on membership, participation, and giving 2 8 15

BTime spent away from HOME and Sacred Space; Uncertainty;

Change 1 7 10

C Total cost of the alternative over the next 20 years 1 5 10

F Building ownership issues (Maintenance & Repair) 1 5 10

HDesign customized to our needs; Flexibility and freedom of

facil ity use 1 5 10

I Impact on long-term financial health; net worth 1 5 10

A Building code (ADA) compliance and Permit process time 0 3 5

EQuick access to capital; Ability to respond quickly to market

opportunities 0 2 5

JDecision cycle incl. internal (church) and external (legal)

decisions 0 0 5

10 50 100

Page 39: Praxophy at Palisade Regional Risk Conference in DC

4Phased Rebuild in Place

(Rebuild on current site)

Renovate the existing facility, replacing existing structures

over time in accordance with a master plan. This involves a

long-term solution to the parking constraint, such as a

code variance, or some kind of stacked parking structure

($$$).

Retains “sacred location”

Avoids land market delays

Remaining usable land becomes more

accessible

More certainty for future

Geographic appeal

Clearer, surer vision

Less change than relocating

Maintains assets and equity for the future

Some loss of “scacred space”

Higher permit scrutiny

Ches Bay Preservation Area (CBPA) board

has severe restrictions

Causes time away, costs $$ re: alternate

location, membership impact

Risk of taking on a large, unsupportable loan

1 0.2 1 0.15 2 0.2

2.1

Relocate (Build It) & They

Will Come

(Sell and Relocate

somewhere else, either

rent, buy, or build)

Purchase a new site and build a new facility there, with a

50-year lifecycle. Offer the current facility as collateral.

Use the current facility until the new one is ready. Finish

the sale of the existing facility when the move is complete.

Use the proceeds to reduce new debt.

Quick access to capital (~ 12 – 18 month

delay)

Allows us to respond quickly to market

opportunities

“Build to suit our needs”

Over long term, this has a net financial loss

Few options are available

Requires fast response on decisions,

difficult to get

Breaks with our tradition and “sacred

space”

Next phase is very expensive

Promotes heavy land use practices (not

“green”)

1 0.2 1 0.15 1 0.1

1

Defer and Save

(Renovate/Upgrade

current building)

Maintain the current location (building and grounds) for

another 20 years while saving for a replacement. Requires

extra maintenance and repairs on the older facility, and

may require a second service if attendance continues to

grow. Requires a solution to the parking situation (shuttle?)

Faster permit process

Less ADA, etc., impact

Shorter time away, if any

Can be a more limited change, less cost

“Constrained”

Typically costs more to refurbish existing

than to build new

Requires compromise of

goals/mission/vision

-2 -0.4 1 0.15 2 0.2

2.2

Relocate (Buy It) & They

Will Come

(Sell and Relocate

somewhere else, either

rent, buy, or build)

Use our networth and any other collateral to purchase an

existing facility (buildings and grounds) and renovate to

suit our purposes. Interest rates are low. It may take some

luck to find a suitable place in our catchment area. What

happens to our old facility after we sell and move away?

Quick access to capital (~ 12 – 18 month

delay)

Allows us to respond quickly to market

opportunities

Over long term, this has a net financial loss

Few options are available

Requires fast response on decisions,

difficult to get

Breaks with our tradition and “sacred

space”

Next phase is very expensive

0 0 0 0 -2 -0.2

0.1

Time spent

away from

HOME and

Sacred Space;

Uncertainty;

Change

0.15

Fidelity to

mission, vision,

goals#

Name

(Pro-Con Chart Name)Description and discussion Pro Con

Likely impact

on

membership,

participation,

and giving

0.2

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 39

Convert Pro-Con to Dec Mat, Part II

Sign Points

++ 2

+ 1

0 0

- -1

-- -2

Page 40: Praxophy at Palisade Regional Risk Conference in DC

Weighted Dec Mat

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 40

4Phased Rebuild in Place

(Rebuild on current site)

Renovate the existing facility, replacing existing structures

over time in accordance with a master plan. This involves a

long-term solution to the parking constraint, such as a

code variance, or some kind of stacked parking structure

($$$).

Retains “sacred location”

Avoids land market delays

Remaining usable land becomes more

accessible

More certainty for future

Geographic appeal

Clearer, surer vision

Less change than relocating

Maintains assets and equity for the future

Some loss of “scacred space”

Higher permit scrutiny

Ches Bay Preservation Area (CBPA) board

has severe restrictions

Causes time away, costs $$ re: alternate

location, membership impact

Risk of taking on a large, unsupportable loan

2.1

Relocate (Build It) & They

Will Come

(Sell and Relocate

somewhere else, either

rent, buy, or build)

Purchase a new site and build a new facility there, with a

50-year lifecycle. Offer the current facility as collateral.

Use the current facility until the new one is ready. Finish

the sale of the existing facility when the move is complete.

Use the proceeds to reduce new debt.

Quick access to capital (~ 12 – 18 month

delay)

Allows us to respond quickly to market

opportunities

“Build to suit our needs”

Over long term, this has a net financial loss

Few options are available

Requires fast response on decisions,

difficult to get

Breaks with our tradition and “sacred

space”

Next phase is very expensive

Promotes heavy land use practices (not

“green”)

1

Defer and Save

(Renovate/Upgrade

current building)

Maintain the current location (building and grounds) for

another 20 years while saving for a replacement. Requires

extra maintenance and repairs on the older facility, and

may require a second service if attendance continues to

grow. Requires a solution to the parking situation (shuttle?)

Faster permit process

Less ADA, etc., impact

Shorter time away, if any

Can be a more limited change, less cost

“Constrained”

Typically costs more to refurbish existing

than to build new

Requires compromise of

goals/mission/vision

2.2

Relocate (Buy It) & They

Will Come

(Sell and Relocate

somewhere else, either

rent, buy, or build)

Use our networth and any other collateral to purchase an

existing facility (buildings and grounds) and renovate to

suit our purposes. Interest rates are low. It may take some

luck to find a suitable place in our catchment area. What

happens to our old facility after we sell and move away?

Quick access to capital (~ 12 – 18 month

delay)

Allows us to respond quickly to market

opportunities

Over long term, this has a net financial loss

Few options are available

Requires fast response on decisions,

difficult to get

Breaks with our tradition and “sacred

space”

Next phase is very expensive

0

The Do Nothing Option

(Not part of the original

Pro-Con work)

Let's take a look at what happens if we decide to do nothing. Avoid all the hassles of Capital Campaign

Facility continues to decay, eroding Net

Worth

Attendance will decline, and income with it

Options will only get more expensive

3

The (Nothing is Ever)

Temporary (Non) Solution

(Partner, lease, share, or

other innovative

alternative)

Sell the current facility now, pay off all debts, and lease a

temporary facility (School? Theater? Existing Church?) until

a permanent replacement can be located and procured

(build, rent, buy)

Short term balance sheet boon (at the

expense of long term financial health)

No change in net worth

Simply kicks the decision can down the road

of time

Has the feel of liquidating our dreams

2.3

Relocate (Rent It) & They

Will Come

(Sell and Relocate

somewhere else, either

rent, buy, or build)

Use our credit rating to qualify for a lease to an exisitng

space. Perhaps the landlord will renovate to suit if the

terms are favorable. There is a large vacant grocery store

in Penn Daw Plaza, near new condos and townhomes.

Renting frees us from building ownership

issues

Less control in rented space

Does not help gain equity

Analysis

#Name

(Pro-Con Chart Name)Description and discussion Pro Con

Courses of Action

TOTAL RANK

1 0.2 1 0.15 2 0.2 2 0.2 0.2 0.02 2 0.2 2 0.2 2 0.1 1 0.05 2 0.1 1.42 1

1 0.2 1 0.15 1 0.1 2 0.2 -2 -0.2 2 0.2 1 0.1 1 0.05 2 0.1 1 0.05 0.95 2

-2 -0.4 1 0.15 2 0.2 1 0.1 -2 -0.2 0 0 1 0.1 2 0.1 -2 -0.1 -2 -0.1 -0.15 3

0 0 0 0 -2 -0.2 0 0 -2 -0.2 0 0 0 0 0 0 1 0.05 1 0.05 -0.3 4

-1 -0.2 -1 -0.15 2 0.2 -2 -0.2 -1 -0.1 -1 -0.1 0 0 2 0.1 -1 -0.05 -1 -0.05 -0.55 5

-2 -0.4 -2 -0.3 -1 -0.1 0 0 0 0 0 0 -1 -0.1 0 0 1 0.05 -1 -0.05 -0.9 6

-2 -0.4 -2 -0.3 -2 -0.2 -2 -0.2 1 0.1 0 0 -1 -0.1 1 0.05 0 0 1 0.05 -1 7

Building code

(ADA)

compliance

and Permit

process time

0.050.1

Time spent

away from

HOME and

Sacred Space;

Uncertainty;

Change

0.15

Total cost of

the alternative

over the next

20 years

Fidelity to

mission, vision,

goals

0.1

Quick access to

capital; Ability

to respond

quickly to

market

opportunities

States of Nature

1

Decision

0.1 0.1 0.05

Building

ownership

issues

(Maintenance

& Repair)

Likely impact

on

membership,

participation,

and giving

Design

customized to

our needs;

Flexibility and

freedom of

facility use

Impact on long-

term financial

health; net

worth

Decision cycle

incl. internal

(church) and

external (legal)

decisions

0.10.2 0.05

Page 41: Praxophy at Palisade Regional Risk Conference in DC

2. The Extrapolation Problem

• Weekly Attendance Trend

• Weekly Income Trend

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 41

Page 42: Praxophy at Palisade Regional Risk Conference in DC

Weekly Attendance TrendTOTAL Attend

Mean 62.19792

Standard Error 2.058019

Median 60

Mode 59

Standard Deviation 20.16439

Sample Variance 406.6025

Kurtosis 13.09452

Skewness 2.336839

Range 175

Minimum 8

Maximum 183

Sum 5971

Count 96

42PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

This 3-year attendance graph was used to show an 11% annual growth rate.Attendance in was estimated to hit 118 in Y5 exceed capacity in Y6 (2020).Based on that projection, and in light of maintenance issues, the leaders wanted to build a new church.

Would you advise a client to make a $2M decision based on this information?Small risk if Net Worth is, say, $200M, but…

What if that $2M is 10 to 15 times current income?

Page 43: Praxophy at Palisade Regional Risk Conference in DC

@RISK to the Rescue!

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 43

Created a model that captures the volatility inside the 3-year period and portrays the data gaps. After 1000 iterations, we can be 90% certain that the Y5 Attendance will be between 86 and 147, with a most-likely value of 113.

We can also begin productive conversations around reducing variation and moving mean.

(8%)

49%

(13%)

Page 44: Praxophy at Palisade Regional Risk Conference in DC

Weekly Income Trend

44PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

This 3-year income graph was used to show an 6% annual growth rate. This compares to a projected 11% growth in attendance over the same period.

GRAND TOTAL

Mean 2702.394

Standard Error 102.7634

Median 2537

Mode 2345

Standard Deviation 1343.806

Sample Variance 1805815

Kurtosis -0.50008

Skewness 0.546222

Range 5968

Minimum 510

Maximum 6478

Sum 462109.4

Count 171

Page 45: Praxophy at Palisade Regional Risk Conference in DC

@RISK to the Rescue!again…

45PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

(8%)

4%

7%

Attendance Rate

Low Growth -0.1

Most Likely Growth 0.1

Max Growth 0.3

Income Rate

Low Growth -0.1

Most Likely Growth 0.05

Max Growth 0.2

After 1000 iterations, we can be 90% certain that the Y5 Income will be between $2.9 and 4.4K, with a most-likely value of $3.6K.

We can also work to close the “giving gap.” Giving should keep pace with attendance, in theory.

Page 46: Praxophy at Palisade Regional Risk Conference in DC

Revised estimates of future states

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 46

118

3.9

147

113

86

4.4

3.62.9

Page 47: Praxophy at Palisade Regional Risk Conference in DC

Breadth, Quantity of Touches, looking at such things as annualized monthly attendance, lay participation in services, and participation in programs and other key processes

Application, Impact of Touches, looking at the capacity of the organization to carry on living out its vision. Resilience, Preservation of Options, etc., as indicated, in part, by financial health.

Depth, Quality of Each Touch, looking at the relationship between receiving the services and giving back in appreciation.

3. Communicating Clearly and Concisely

47

Attend-ance40%

Net Worth 25%

Income 35%

PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Three Means ObjectivesTouching Lives

Page 48: Praxophy at Palisade Regional Risk Conference in DC

48

Table 0. This is the generic model table. It tabulates the current, changeable results of the model worksheet.

Build separate tables for each scenario (Current, Do Nothing, Build New, Buy Existing, etc.).

Copy each scenario and "paste special values and source formatting" into separate labeled scenario tables

Time X Attend Park Income Exp Float Cum Float Net Worth Score

0 80 27 3.1 2.4 0.70 8 1.79 54.31

1 89 30 3.35 2.46 0.89 19 1.86

2 99 33 3.62 2.52 1.09 32 1.93

3 109 36 3.91 2.58 1.32 48 2.01

4 121 40 4.22 2.65 1.57 67 2.09

5 135 45 4.55 2.72 1.84 89 2.17

6 150 50 4.92 2.78 2.14 115 2.26

7 166 55 5.31 2.85 2.46 144 2.35

8 184 61 5.74 2.92 2.81 178 2.45

9 205 68 6.20 3.00 3.20 216 2.54

10 227 76 6.69 3.07 3.62 260 2.65

11 252 84 7.23 3.15 4.08 309 2.75

12 280 93 7.81 3.23 4.58 364 2.86

13 311 104 8.43 3.31 5.12 425 2.98

14 345 115 9.11 3.39 5.71 494 3.09

15 383 128 9.83 3.48 6.36 570 3.22

16 425 142 10.62 3.56 7.06 655 3.35

17 472 157 11.47 3.65 7.82 748 3.48

18 523 174 12.39 3.74 8.64 852 3.62

19 581 194 13.38 3.84 9.54 967 3.76

20 645 215 14.45 3.93 10.52 1,093 3.92

21 716 239 15.60 4.03 11.57 1,232 4.07

22 795 265 16.85 4.13 12.72 1,384 4.24

23 882 294 18.20 4.24 13.97 1,552 4.40

24 979 326 19.66 4.34 15.32 1,736 4.58

25 1087 362 21.23 4.45 16.78 1,937 4.76

PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

@RISK to the Rescue!

Page 49: Praxophy at Palisade Regional Risk Conference in DC

Currently at an estimated 54% of full realization of our Fundamental ObjectiveGetting to 100% means maximizing all 3 Means Objectives and their supporting Evaluation MeasuresIf we do nothing, the value of the property will fall, and behind it will fall attendance and incomeWe looked at 5 major alternatives to the Do Nothing scenario• Relocate & Rent or Share• Relocate & Buy an Existing Facility• Relocate & Build a New Facility• Stay & Renovate the Current Facility• Stay & Conduct a Phased ExpansionChart compares the expected outcomes of the alternatives after a period of 5 years

49PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Page 50: Praxophy at Palisade Regional Risk Conference in DC

PxMS Methodology Outline

50

Step 0: Marketing

1. Describe Context

2. Build the Qualitative Value Model

3. Quantify the Evaluation Measures

4. Develop the Problem Statement

5. Generate Alternative Strategies

6. Use QVM for Future Value Analysis

7. TransitionPraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

• Monte Carlo Simulation• Sensitivity Analysis (Risk)• Resources: new from the environment, or

reallocated from within?• Project selection and portfolio management• Always show your work!

Page 51: Praxophy at Palisade Regional Risk Conference in DC

Future Value Analysis

Future

Opportunities

and Challenges

Hopper of

Alternative

Projects

Portfolio

Structured

Interviews

Get the values

right or the

numbers don’t

matter

Optimization

Model

Get the

numbers right

or the results

don’t matter

Generate

alternatives to

get results that

matter

Strategic

AssessmentMulti-Objective Decision Analysis Portfolio

Analysis

Vision

Mission

Strategy

Resources and

Programmatic

Constraints

Value

Opportunities Value Gaps

Quantitative

Value

Functions

Value

Feedback

Sensitivity Analysis

Qualitative

Value Model

Dr. Gregory S. Parnell, Innovative Decisions Inc. 516/29/2014

Page 52: Praxophy at Palisade Regional Risk Conference in DC

Explorations

6/29/2014 PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 52

# Metric Definition

1 Assets The mark-to-market value of bldngs, grnds, furn & equip

2 Liabilites The value of all outstanding debts

3 Reserves Cash reserves, usually a multiple of operating budget

4 Income Avg monthly from all sources (pledge, plate, rent)

5 Expenses Avg monthly all operating expenses

6 Float Income available for discretionary spending

7 Capital Capital campaign requirements

# Variable Definition

1 Growth CPI, Inflation, equity growth factor for Assets

2 Payoff Annual debt service (Prin & Int), reduction for liabilites

3 Reserve Multiple of Operating Budget for Cash Reserve

4 Payment Montly loan payment amount

5 Deferred Deferred maintenance and repairs (20 year model)

6 Asset / Liability Ratio of Assets to Liabilities, bigger is better

7 Debt / Income Ratio of Debts to Income, smaller is better

# Topic Question

1 Debt Service What if we start paying more on the loan?

2 Liquidation What options open / close if we sell the property?

3 Income Suppose we were able to get average pledges up 20%?

4 Income Does income track proportionately with attendance?

5 Flexible Use What if we convert the parsonage to classrooms?

6 Engagement How can we better engage Millenials in the "business"?

7 Conditions What conditions must be met before we can renovate?

# Metric Definition

1 Assets The mark-to-market value of bldngs, grnds, furn & equip

2 Liabilites The value of all outstanding debts

3 Reserves Cash reserves, usually a multiple of operating budget

4 Income Avg monthly from all sources (pledge, plate, rent)

5 Expenses Avg monthly all operating expenses

6 Float Income available for discretionary spending

7 Capital Capital campaign requirements

# Variable Definition

1 Growth CPI, Inflation, equity growth factor for Assets

2 Payoff Annual debt service (Prin & Int), reduction for liabilites

3 Reserve Multiple of Operating Budget for Cash Reserve

4 Payment Montly loan payment amount

5 Deferred Deferred maintenance and repairs (20 year model)

6 Asset / Liability Ratio of Assets to Liabilities, bigger is better

7 Debt / Income Ratio of Debts to Income, smaller is better

# Topic Question

1 Debt Service What if we start paying more on the loan?

2 Liquidation What options open / close if we sell the property?

3 Income Suppose we were able to get average pledges up 20%?

4 Income Does income track proportionately with attendance?

5 Flexible Use What if we convert the parsonage to classrooms?

6 Engagement How can we better engage Millenials in the "business"?

7 Conditions What conditions must be met before we can renovate?

Page 53: Praxophy at Palisade Regional Risk Conference in DC

PxMS Methodology Outline

53

Step 0: Marketing

1. Describe Context

2. Build the Qualitative Value Model

3. Quantify the Evaluation Measures

4. Develop the Problem Statement

5. Generate Alternative Strategies

6. Use QVM for Future Value Analysis

7. TransitionPraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

TrainingDocumentationMaintenance

Page 54: Praxophy at Palisade Regional Risk Conference in DC

The Common Language Problem

• Model Nomenclature

• Analysis Types and their Questions, Perspectives, TTPs, and Modes

• Terms of Art

• Key Phrases

• Acronyms

• Data Dictionary

PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 546/29/2014

Page 55: Praxophy at Palisade Regional Risk Conference in DC

# Model Nomenclature Definition and Examples

1 WeltanschauungWorld view. External environment. Factors that are largely out

of our control but will impact our options and choices.

2 MilieuCulture. Internal environment, seen as something that can be

influenced. "The way we do things around here," Ed Schein.

3Fundamental Objective

aka Purpose

The answer to the 5th Why?, e.g., mobility. Mission First.

"Harmony" is alignment with Purpose.

4 PeoplePeople Always. Value-Focused Thinking. People are our most

precious resource. "Heart" is putting Values first.

5 Process

Every activity is a process, and every process can be improved.

Better, faster, cheaper. "Head" is planning and continuous

process improvement.

6 Product

Goods or Services. Results of effort. What we provide to add

value. "Hands" refers to applied skills, knowledge, abilities and

other characteristics.

7 Objective Functions

Max or Min functions define How, e.g., max fuel economy, min

traffic tickets, max getting to appointment on time, min

accidents

8Means Objectives aka

Strategies

How will we recognize when the Fundamental Objective has

been met? 100% on time, $0 for violations, etc. Fundamental

Objective score is the weighted sum product of means

objectives.

9 Evaluation MeasuresSpecific data source (speedometer), performance range (0 to

120 mph) used to contribute to a Means Objective score

10 Value Functions

y = f (x). Convert data (engine RPM, horse power, tire traction)

to scores (mph) on a scale based on quality, value, or utility

(preference)

11Thresholds / Rubric /

Grading Curve

Rules for determining the relative merit of a particular score,

e.g., Fines for going too slow or too fast, e.g., $25 for 5 over, $50

for 10 over, $100 for 20 over

12 Metric

a unit of measurement, e.g., mph. Can be lagging (after the fact,

confirming) or leading (before the fact, predictive). Can be a

Measure of Performance (efficiency) or a Measure of Effect

(outcome)

13 Measure a reading taken on a scale, e.g., 40 mph on a speedometer

14 Standard / Target / Rubric

The particular measure of a metric which defines success, e.g.,

35 mph. Can be seen as a yes / no check. Tolerance level

determened by the accuracy of observations and sensitivity to

Type I and Type II errors.

15 Analysis / AnalyticsConsider 4 Types (Descriptive, Comparative, Proscriptive, or

Predictive).

16 MilestonesA checkpoint in time and space. In modeling, a milestone may

be a periodic review or a scheduled rest stop on a road trip.

17 Decision Point

In a conditions-based model, decisions can be triggered when

certain thresholds are crossed. When the fuel gauge gets to 1/4,

start looking for a filling station, or when I have saved up $20K I

can trade in the Honda for a Lexus.

18 ResourcesNormally limited (constrained, bounded) quantities of time,

talent, treasure

19Constraint / Limits /

Boundary

Physical boundaries, financial limits, maximum utilization rates.

Analogous to the rules of operating a motor vehicle on a public

street.

20Performance /

Compliance / EfficiencyFuel efficiency, horsepower

21 Effect / Outcome / Results Actual (or expected) results of actions (or proposed actions)

22 Variable

23Feedback / Assessment /

Grade

Whether the measure is good or bad, e.g., 5 mph over the

posted speed limit. Rewards for meeting or exceeding

objectives and penalties for missing the mark. Consider four

"voices" of feedack: Customer, Strategy, Process, and Business.

55

# Model Nomenclature Definition and Examples

1 WeltanschauungWorld view. External environment. Factors that are largely out

of our control but will impact our options and choices.

2 MilieuCulture. Internal environment, seen as something that can be

influenced. "The way we do things around here," Ed Schein.

3Fundamental Objective

aka Purpose

The answer to the 5th Why?, e.g., mobility. Mission First.

"Harmony" is alignment with Purpose.

4 PeoplePeople Always. Value-Focused Thinking. People are our most

precious resource. "Heart" is putting Values first.

5 Process

Every activity is a process, and every process can be improved.

Better, faster, cheaper. "Head" is planning and continuous

process improvement.

6 Product

Goods or Services. Results of effort. What we provide to add

value. "Hands" refers to applied skills, knowledge, abilities and

other characteristics.

7 Objective Functions

Max or Min functions define How, e.g., max fuel economy, min

traffic tickets, max getting to appointment on time, min

accidents

8Means Objectives aka

Strategies

How will we recognize when the Fundamental Objective has

been met? 100% on time, $0 for violations, etc. Fundamental

Objective score is the weighted sum product of means

objectives.

9 Evaluation MeasuresSpecific data source (speedometer), performance range (0 to

120 mph) used to contribute to a Means Objective score

10 Value Functions

y = f (x). Convert data (engine RPM, horse power, tire traction)

to scores (mph) on a scale based on quality, value, or utility

(preference)

11Thresholds / Rubric /

Grading Curve

Rules for determining the relative merit of a particular score,

e.g., Fines for going too slow or too fast, e.g., $25 for 5 over, $50

for 10 over, $100 for 20 over

12 Metric

a unit of measurement, e.g., mph. Can be lagging (after the fact,

confirming) or leading (before the fact, predictive). Can be a

Measure of Performance (efficiency) or a Measure of Effect

(outcome)

13 Measure a reading taken on a scale, e.g., 40 mph on a speedometer

14 Standard / Target / Rubric

The particular measure of a metric which defines success, e.g.,

35 mph. Can be seen as a yes / no check. Tolerance level

determened by the accuracy of observations and sensitivity to

Type I and Type II errors.

15 Analysis / AnalyticsConsider 4 Types (Descriptive, Comparative, Proscriptive, or

Predictive).

16 MilestonesA checkpoint in time and space. In modeling, a milestone may

be a periodic review or a scheduled rest stop on a road trip.

17 Decision Point

In a conditions-based model, decisions can be triggered when

certain thresholds are crossed. When the fuel gauge gets to 1/4,

start looking for a filling station, or when I have saved up $20K I

can trade in the Honda for a Lexus.

18 ResourcesNormally limited (constrained, bounded) quantities of time,

talent, treasure

19Constraint / Limits /

Boundary

Physical boundaries, financial limits, maximum utilization rates.

Analogous to the rules of operating a motor vehicle on a public

street.

20Performance /

Compliance / EfficiencyFuel efficiency, horsepower

21 Effect / Outcome / Results Actual (or expected) results of actions (or proposed actions)

22 Variable

23Feedback / Assessment /

Grade

Whether the measure is good or bad, e.g., 5 mph over the

posted speed limit. Rewards for meeting or exceeding

objectives and penalties for missing the mark. Consider four

"voices" of feedack: Customer, Strategy, Process, and Business.

PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

Page 56: Praxophy at Palisade Regional Risk Conference in DC

Analysis Types

56PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

#

Analysis Types and Their

Questions

Distinguishing Analysis Types by Their Perspectives; Tactics,

Techniques, and Procedures; and Modes

1Descriptive

What is going on in there?

Perspective: Est (Existence). TTPs: Basic Counts, Frequencies,

Percentages, Ratios, Ranges, Histograms, Venn Diagrams.

Mode: Survival (Cave)

2

Comparative

Why does it matter? What

can we do better?

Perspective: Tao (Philosophy). TTPs: Trends, Inference, Cause

and Effect Diagrams, Value Stream Maps, SWOT Analyses, SIPOC

Diagrams, Process Flow Charts, 4 Voices Feedback Loops,

Continuous Process Improvement (CPI) Project Identification.

Mode: Stability (Cabin)

3

Proscriptive

What is best? What

should (or should not) be

there?

Perspective: Mileu (Culture). TTPs: Optimization (Maximize or

Minimize), Fundamental Objective (5th Why?), Qualitative

Value Map, Scorecard, CPI Project Selection. Mode: Success

(Condo)

4

Predictive

What is next? What might

be there in possible

future states?

Perspective: Weltanschauung (World View). TTPs: Experiments,

12 dimensions, Synergy, Syzygy, Dashboard, Dynamic System

Model, CPI Portfiolio Management. Mode: Significance (Castle)

Cave

Cabin

Condo

Castle

Page 57: Praxophy at Palisade Regional Risk Conference in DC

• Before– All or nothing

– Alternative focus

– No yardstick

– Extrapolations

Heart, Head, and Hands: a Summary

• During– Communicate Strategic Intent

• Create an assessment framework, aka Qualitative Value Model

• Measure success (system score)

– Engage a Community of Practice

• Share success stories, standards, and best practices

• Looking for value gaps / opportunities

– Improve Overall Impact

• Select better Lean Six Sigma projects

• Manage portfolios of process improvement projects

• Identify critical resource shortfalls

• Simulate proposed interventions

57PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 6/29/2014

• After– Stakeholders know what is being measured

– Decision points are defined

– What if? and What’s best? questions can be explored

– A sense of awareness comes from putting values first

– Found the 3rd Way

Page 58: Praxophy at Palisade Regional Risk Conference in DC

Shameless Commerce

PraXophy: Practical Wisdom for Value-Focused and Data-Fueled Decision-Making 58

• Questions / Discussion

• Follow-up / Contact Business Cards (AFSC) https://www.linkedin.com/in/davedoane) https://www.facebook.com/PraXophy [email protected] https://twitter.com/PraXophy @PraXophy, #RRCDC2014 http://www.slideshare.net < one month https://todaysmeet.com/PraXophy < one week

?

6/29/2014