morton middelfart, targit - meeting big data challenges - bi symposium 2012

75
TARGIT your decisions in fewest clicks Meeting Big Data challenges in Leadership with Human- Computer Synergy. Presented by Dr. Morten Middelfart, CTO

Upload: sogeti-nederland-bv

Post on 24-Jan-2015

268 views

Category:

Documents


0 download

DESCRIPTION

 

TRANSCRIPT

Page 1: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Meeting Big Data challenges

in Leadership with Human-

Computer Synergy.

Presented by

Dr. Morten Middelfart, CTO

Page 2: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Big Data

Data that exists in such large amounts or in such unstructured form that it is difficult to handle in the traditional data warehouse or any other type of database.

Right?

Page 3: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

From Control to No Control

Page 4: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

From Control to No Control

Business Intelligence (BI)

Reporting, OLAP, and data mining

on data that are under our control.

“Analytics” starts where BI ends

Typically data will not be under our

control.

Page 5: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Page 6: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

From How

to Who

Page 7: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

But also

Why

Page 8: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

From Control to No Control

No control over availability

No control over quality

Tipping point for me was 2012

Twenty years of BI, I found myself doing

more Analytics of data I did not control…

Page 9: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

From Control to No Control

Do you Fear

Change?

Page 10: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

What is Fear?

Page 11: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

What is Fear?

Page 12: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Strategic

Tactical

Operational

Page 13: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Strategic

Tactical

Operational

Page 14: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

14

TARGIT your decisions in fewest clicks

Page 15: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Page 16: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Facts Beat Fear

#HumanComputerSynergy #FactBeatFear

Page 17: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Strategic

Tactical

Operational

Page 18: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

The OODA Loop

KPI(s)

Page 19: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

The CALM Cycle

ActionStoryboard Mass-Comm.Other CommunicationWorkflow InitiationModify Cycle

ObservationDashboardsReportingAgents

OrientationAnalyticsSimulationData Mining

DecisionSearch for additionalInternal & ExternalKnowledge

KPI(s)

Page 20: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

The CALM Cycle

ActionStoryboard Mass-Comm.Other CommunicationWorkflow InitiationModify Cycle

ObservationDashboardsReportingAgents

OrientationAnalyticsSimulationData Mining

DecisionSearch for additionalInternal & ExternalKnowledge

KPI(s)

Meta-Morphing

Page 21: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 22: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 23: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 24: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 25: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 26: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 27: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

The CALM Cycle

ActionStoryboard Mass-Comm.Other CommunicationWorkflow InitiationModify Cycle

ObservationDashboardsReportingAgents

OrientationAnalyticsSimulationData Mining

DecisionSearch for additionalInternal & ExternalKnowledge

KPI(s)

Meta-Morphing

Page 28: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Strategic

Tactical

Operational

Page 29: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Any number of unintegrated features

or applications will slow you down !

- or make you FAIL !

Page 30: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

It’s a

War

Page 31: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 32: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

It’s a War

Algorithms are already influencing

(defining) structured data

Scoring – the one number analysis

Credit Score, Klout -> Profiling

Algorithms are moving into unstructured,

uncontrolled data too…

Page 33: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Page 34: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Synergy between humans

Page 35: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Synergy between humans

Page 36: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Synergy between humans

Page 37: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Synergy between humans

Ideal

Page 38: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Synergy between humans and computers

Ideal

Page 39: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

ActionStoryboard Mass-Comm.Other CommunicationWorkflow InitiationModify Cycle

ObservationDashboardsReportingAgents

OrientationAnalyticsSimulationData Mining

DecisionSearch for additionalInternal & ExternalKnowledge

KPI(s)

It’s a War: Human-Computer Synergy

Page 40: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

ActionStoryboard Mass-Comm.Other CommunicationWorkflow InitiationModify Cycle

ObservationDashboardsReportingAgents

OrientationAnalyticsSimulationData Mining

DecisionSearch for additionalInternal & ExternalKnowledge

Ad-Hoc AgentsKPI(s)

It’s a War: Human-Computer Synergy

Desktop & Mobile Notifications

Sentinel Mining

Page 41: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Strategic

Tactical

Operational

Page 42: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Data Available to Organization

M. Middelfart. Improving Business Intelligence Speed and Quality through the OODA Concept. In Proc. of DOLAP, pp. 97–98, 2007.

Page 43: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

M. Middelfart. Improving Business Intelligence Speed and Quality through the OODA Concept. In Proc. of DOLAP, pp. 97–98, 2007.

Page 44: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

M. Middelfart. Improving Business Intelligence Speed and Quality through the OODA Concept. In Proc. of DOLAP, pp. 97–98, 2007.

”Real World” Impacts

”Real World” Impacts

”Real World” Impacts

Page 45: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

”Real World” Impacts

”Real World” Impacts

Sentinel Sentinel

SentinelM. Middelfart. Improving Business Intelligence Speed and Quality through the OODA Concept. In Proc. of DOLAP, pp. 97–98, 2007.

”Real World” Impacts

Page 46: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

M. Middelfart. Improving Business Intelligence Speed and Quality through the OODA Concept. In Proc. of DOLAP, pp. 97–98, 2007.

Sentinel Sentinel

Sentinel

Page 47: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Page 48: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Page 49: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Page 50: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Page 51: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

M. Middelfart and T.B. Pedersen. Using Sentinel Technology in the TARGIT BI Suite. PVLDB 3(2): 1629–1632, 2010.

Human-Computer Synergy

Page 52: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

It’s a War

Computers can semi- or fully guard our

back

Primarily on Controlled Data

Humans can dedicate themselves more

to

Analytics on Uncontrolled Data

What do (not just my own) customers

prefer?

Which opinions are trending? Etc.

Page 53: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Big Data Analytics:

Trends, Hype,

TimeLines

Page 54: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 55: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 56: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 57: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 58: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 59: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 60: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 61: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 62: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 63: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

“data is apolitical”

Marissa MayerCEO, Yahoo

Page 64: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 65: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012
Page 66: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

The New Frontier:

MeatComputing

Page 67: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Meat Computing

There is still such a thing as intuition

Most companies will be sampling

MEAT will make the most

distinguishing decisions what to sample

or not to sample

#HumanComputerSynergy

Page 68: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

In Conclusion…

Page 69: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Page 70: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

ConclusionBusiness Intelligence (BI)

Gives ”True North” through Reporting,

OLAP, and data mining.

Can be highly automated already today!

“Analytics” starts where BI ends

Typically data will not be under our

control

therefore BIAS RULES!

Page 71: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Beat Fear …

Page 72: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Strategic

Tactical

Operational

Page 73: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

… and Change the Game

Page 74: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

It's more Fun to

be a Pirate than to join the navy

Steve Jobs, 1982.

Page 75: Morton Middelfart, TARGIT - Meeting Big Data Challenges - BI Symposium 2012

TARGIT your decisions in fewest clicks

Info and Research can be found at:

targit.com/research

Twitter: @dr_morton

#HumanComputerSynergy #FactBeatFear