analytics 101: how to not fail at analytics
TRANSCRIPT
Analytics 101:How to not fail at analytics
Daniel Haight
What is Analytics
Difficulty
Why Analytics?
Decision-making 1.0
Decision-making 2.0
Better Decisions
The Problem
“70 – 80% of analytics projects fail” – Gartner Group, 2011
Hypothesis:
Failure is lack of adoption.
Lack of adoption comes from misunderstanding roles.
The Data Steward
The Analytic Explorer
The Information Artist
The Automator
The Champion
Data Steward
Analytic Explorer
Information Artist Automator
Champion
Data Steward
Analytic Explorer
Information Artist Automator
Champion
Data Scientist
Data Munging
CodingMaths
Visual DesignDomain
knowledgeTalking
Some observations…
Typical structure
Misaligned structure
IT Business
Outsourcing roles to software
Slotting staff in the wrong role
Even with the right team and structure, success is not
guaranteed
The analytic processData
StewardAnalytic Explorer
Information Artist Automator
Idea generation
Data preparation
Exploration
Design Tool development
The analytic processData
StewardAnalytic Explorer
Information Artist Automator
Idea generation
Data preparation
Exploration
Design Tool development
Education Analytics
Student forecasting
Teacher Forecasting
Training
Teacher skills allocation
Capacity planning
Student attrition analysis
School security
Funding allocation
Teacher attrition analysis
Education Analytics
Student forecasting
Teacher Forecasting
Training
Teacher skills allocation
Capacity planning
Student attrition analysis
School security
Funding allocation
Teacher attrition analysis
Data Steward
Analytic Explorer
Information Artist Automator
Idea generation
Data preparation
Exploration
Design Tool development
Is it accurate?
Data Steward
Analytic Explorer
Information Artist Automator
Idea generation/ refinement
Data preparation
Exploration
Design Tool development
Is it clear?
Decision-making 3.0
Why doesn’t this happen?
= /
+=
Age Staff
CalculateStaff Attrition
Initial Teachers
Initial Population
Age Population
CalculateMigration & Births
Compare Staff and Students
Hire New Staff
CalculateStudent Participation
Cohort Component Model
X
Initial Population
01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950
050001000015000200002500030000
0123456789
1011121314151617181920212223242526272829303132333435363738394041424344454647484950
0 5000 10000 15000 20000 25000 30000
Age the Population
01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950
050001000015000200002500030000
0123456789
1011121314151617181920212223242526272829303132333435363738394041424344454647484950
0 5000 10000 15000 20000 25000 30000
Age the Population
01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950
050001000015000200002500030000
0123456789
1011121314151617181920212223242526272829303132333435363738394041424344454647484950
0 5000 10000 15000 20000 25000 30000
Add/Subtract Net-Migration
0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50
-20
-10
0
10
20
30
40
50
60
70
01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950
050001000015000200002500030000
0123456789
1011121314151617181920212223242526272829303132333435363738394041424344454647484950
0 5000 10000 15000 20000 25000 30000
Add/Subtract Net-Migration
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49
-20
-10
0
10
20
30
40
50
60
70
01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950
050001000015000200002500030000
0123456789
1011121314151617181920212223242526272829303132333435363738394041424344454647484950
0 5000 10000 15000 20000 25000 30000
Add/Subtract Net-Migration
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49
-20
-10
0
10
20
30
40
50
60
70
01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950
050001000015000200002500030000
0123456789
1011121314151617181920212223242526272829303132333435363738394041424344454647484950
0 5000 10000 15000 20000 25000 30000
Add/Subtract Net-Migration
01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950
050001000015000200002500030000
0123456789
1011121314151617181920212223242526272829303132333435363738394041424344454647484950
0 5000 10000 15000 20000 25000 30000
Add/Subtract Net-Migration
01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950
050001000015000200002500030000
0123456789
1011121314151617181920212223242526272829303132333435363738394041424344454647484950
0 5000 10000 15000 20000 25000 30000
Make Babies Using Fertility
01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950
050001000015000200002500030000
0123456789
1011121314151617181920212223242526272829303132333435363738394041424344454647484950
0 5000 10000 15000 20000 25000 30000
0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 500%
2%
4%
6%
8%
10%
12%
14%
X
Make Babies Using Fertility
01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950
050001000015000200002500030000
0123456789
1011121314151617181920212223242526272829303132333435363738394041424344454647484950
0 5000 10000 15000 20000 25000 30000
X
Focus on Student Ages
01234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950
050001000015000200002500030000
0123456789
1011121314151617181920212223242526272829303132333435363738394041424344454647484950
0 5000 10000 15000 20000 25000 30000
School Aged
Focus on Student Ages
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
050001000015000200002500030000
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
0 5000 10000 15000 20000 25000 30000
Focus on Student Ages
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
050001000015000200002500030000
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
0 5000 10000 15000 20000 25000 30000
Estimate Participation
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 200%
20%
40%
60%
80%
100%
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
050001000015000200002500030000
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
0 5000 10000 15000 20000 25000 30000
Estimate Participation
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 200%
20%
40%
60%
80%
100%
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
050001000015000200002500030000
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
0 5000 10000 15000 20000 25000 30000
Estimate Participation
X
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
050001000015000200002500030000
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
0 5000 10000 15000 20000 25000 30000
Apply Participation
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
050001000015000200002500030000
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
0 5000 10000 15000 20000 25000 30000
Apply Participation
Student Count
Age Staff
CalculateStaff Attrition
Initial Teachers
Initial Population
Age Population
CalculateMigration & Births
Compare Staff and Students
Hire New Staff
CalculateStudent Participation
Teacher Workforce
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
01002003004005006007008002021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0 100 200 300 400 500 600 700 800
Age Workforce
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
01002003004005006007008002021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0 100 200 300 400 500 600 700 800
Apply Attrition
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
01002003004005006007008002021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0 100 200 300 400 500 600 700 800
20212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374
0%
10%
20%
30%
40%
50%
Apply Attrition
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
01002003004005006007008002021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0 100 200 300 400 500 600 700 800
20212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374
0%
10%
20%
30%
40%
50%
Apply Attrition
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
01002003004005006007008002021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0 100 200 300 400 500 600 700 800
X
Apply Attrition
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
01002003004005006007008002021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0 100 200 300 400 500 600 700 800
Remaining Staff
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
01002003004005006007008002021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0 100 200 300 400 500 600 700 800
Remaining Staff
Age Staff
CalculateStaff Attrition
Initial Teachers
Initial Population
Age Population
CalculateMigration & Births
Compare Staff and Students
Hire New Staff
CalculateStudent Participation
Determine Hires
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
01002003004005006007008002021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0 100 200 300 400 500 600 700 800
Remaining Staff
Calculate Hires with Student to Staff Ratio
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
01002003004005006007008002021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0 100 200 300 400 500 600 700 800
01234567891011121314151617181920
050001000015000200002500030000
0123456789
1011121314151617181920
0 5000 1000015000200002500030000
Remaining StaffStudent Count/ Student to Staff Ratio=Required Staff Total
–= Required Hires
Estimate Hire Ages
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
01002003004005006007008002021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0 100 200 300 400 500 600 700 800
Required Hires
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0%
1%
2%
3%
4%
5%
X
Estimate Hire Ages
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
01002003004005006007008002021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0 100 200 300 400 500 600 700 800
2021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
0%
1%
2%
3%
4%
5%
X Required Hires
Repeat
Is it timely?
Is it responsive?
Estimated Time Remaining: Still Calculating
Is it interactive?
Does it engage?
***