insight is 20/20: the importance of analyticstight integration of modern business ... • tibco...

42
Insight is 20/20: The Importance of Analytics June 6, 2017 Amit Deokar Department of Operations and Information Systems Manning School of Business University of Massachusetts Lowell Email: [email protected]

Upload: others

Post on 07-Mar-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

Insight is 20/20:The Importance of AnalyticsJune 6, 2017

Amit Deokar

Department of Operations and Information Systems

Manning School of Business

University of Massachusetts Lowell

Email: [email protected]

Page 2: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

2

Agenda

§ Analytics / Data Science: What it is and Why Do We Care?

§ Analytics and Business Strategy

§ Analytics: A Closer Look

§ Embedded to Predictive to Cognitive Analytics

Page 3: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

3

Agenda

§ Analytics / Data Science: What it is and Why Do We Care?

§ Analytics and Business Strategy

§ Analytics: A Closer Look

§ Embedded to Predictive to Cognitive Analytics

Page 4: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

Analytics is the scientific process of

transforming data into insight for

making better decisions.

Reference: INFORMS

Page 5: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

5

Analytics: Why Now?

§ Ubiquity of data opportunities• E.g., operations, manufacturing, supply chain management, customer behavior,

marketing campaign performance, workflow procedures, …

§ Computing technology advances• E.g., distributed/cloud computing, mobile computing, IOT/sensors, …

Reference: Provost & Fawcett (2013) Data Science for Business

Page 6: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

6

Page 7: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

7

Hurricane Frances

Reference: Provost & Fawcett (2013) Data Science for Business

Page 8: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

8

Data Science (Analytics), Engineering & Data-Driven Decision Making

Reference: Provost & Fawcett (2013) Data Science for Business

Practice of basing decisions on theanalysis of data, rather than purelyon intuition.

Page 9: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

9

Agenda

§ Analytics / Data Science: What it is and Why Do We Care?

§ Analytics and Business Strategy

§ Analytics: A Closer Look

§ Embedded to Predictive to Cognitive Analytics

Page 10: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

Tight integration of modern business

analytics efforts with business strategies

&

Proactive rather than reactive approach

Distinction using analytics

Business & IT Today

Page 11: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

11

Modern Analytics Principles – A Strategy Perspective

§ Deliver business value and impact

• Building and continuous evolving analytics for high-value business impact

§ Focus on the last mile

• Deploying analytics into production to attain repeatable, ongoing business value

§ Leverage Kaizen

• Starting small and building on success

§ Accelerate learning and execution

• Doing, learning, adapting, and repeating

§ Differentiate your analytics

• Exploiting analytics to produce new results

Reference: Chambers and Dinsmore (2015) Advanced Analytics Methodologies

§ Embed analytics

• Building analytics into business processes to gain repeatability and scalability

§ Establish modern analytics architecture

• Leveraging commodity hardware and next generation technology to drive out costs

§ Build on human factors

• Maximizing and grooming talent

§ Capitalize on consumerization

• Leveraging choices to innovate

– BYOD (combine open/noncompetitive data with your data to discover patterns), BYOT (mix and match open source and proprietary tools), BYOM (leverage app stores and crowdsourcing)

Page 12: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

12

How to Distinguish Your Analytics?

§ Business area

• Applying analytics to a new business area or problem

§ Data

• Leveraging or inventing new data to enrich analytical insights

§ Approach

• Employing a combination of analytical approaches in an innovative way to discover new patterns and value

§ Precision

• Increasing granularity of analytics by focusing on individuals (people, transaction, resources, etc.) rather than segments or groups

Reference: Chambers and Dinsmore (2015) Advanced Analytics Methodologies

§ Algorithms

• Developing or using new groundbreaking mathematical of scientific approaches to gain advantage

§ Embedding

• Systematically inserting analytics into operational processes to gain deeper insights

§ Speed

• Accelerating the pace of business to stay ahead of the competition

Page 13: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

13

Agenda

§ Analytics / Data Science: What it is and Why Do We Care?

§ Analytics and Business Strategy

§ Analytics: A Closer Look

§ Embedded to Predictive to Cognitive Analytics

Page 14: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

14

AnalyticsTypes of Analytics

Reference: Delen (2015) Real-World Data Mining

Page 15: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

15

Techniques Used in

Different Types of Analytics

Reference: Asllani (2015) Business Analytics with Management Science Models and Methods

Page 16: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

16

Descriptive Analytics

HeatmapBoxplot

Histograms

Page 17: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

17

Embedding

Descriptive Analytics

§ Dashboards & KPIs

§ Example: Customer

Relationship Management

Reference: SalesForce.com

Page 18: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

18

Embedding

Descriptive Analytics

§ Descriptive Analytics

§ Dashboards & KPIs

§ Example: Product

Management

Reference: Tableau.com

Page 19: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

19

Descriptive Analytics: Vendors / Tools

§ Off the Shelf Software Tools• Progress OpenEdge 306

• Tableau

• Qlik

• SAS Visual Analytics

• IBM Watson Analytics, Cognos

• Tibco Spotfire

• …

§ Open Source Platforms / Languages• Python

• R

• …

Page 20: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

20

Types of Analytics: A Maturity Model Perspective

Page 21: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

21

Page 22: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

22

Predictive Analytics: Data Mining

§ Data mining is a process with well-understood stages based on:• application of information

technology

• analyst’s creativity

• business knowledge

• common sense

§ Decompose a data analytics problem into pieces such that you can solve a known task with a tool

§ There is a large number of data

mining algorithms available, but only a limited number of data

mining tasks

Reference: Provost & Fawcett (2013) Data Science for Business

Page 23: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

23

Predictive Analytics: Key Data Mining Tasks

§ Supervised Learning – focus is on predicting a specific “target”• Classification

• Regression

§ Unsupervised Learning – focus is on discovering patterns• Clustering

• Co-occurence grouping

• …

• Profiling

• Link prediction

• Data reduction

• …

Page 24: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

24

Predictive Analytics: Key Data Mining Tasks

Supervised Learning

§ Classification

§ Regression

Unsupervised Learning

§ Clustering

§ Co-occurence grouping

Classification attempts to predict, for each individual in a population, which class this individual belongs to.

“Among all the customers of RetailCo, which are likely to respond to a given offer?”

“Among all the parts of the machine, which is likely to fail within the next X days?”

Classification algorithms provide models that determine which class a new individual belongs to.

will respond will not respond

will fail will not fail

Page 25: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

25

Predictive Analytics: Key Data Mining Tasks

Supervised Learning

§ Classification

§ Regression

Unsupervised Learning

§ Clustering

§ Co-occurence grouping

Regression (value estimation) attempts to estimate or predict, for each individual, the numerical value of some variable for that individual

“How much will a given customer use the service?”

Predicted variable: service usage

“How much useful life of machine is remaining?

Predicted variable: useful life

Regression models are generated by algorithms that analyze other, similar individuals in the population and their historical service usage / useful lifeRegression procedures produce a model that, given an individual, estimates the value of the particular variable specific to that individual

Page 26: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

26

Predictive Analytics: Key Data Mining Tasks

Supervised Learning

§ Classification

§ Regression

Unsupervised Learning

§ Clustering

§ Co-occurence grouping

Clustering

• Do my customers form natural groups?

Usage per month

age

Page 27: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

27

Predictive Analytics: Key Data Mining Tasks

Supervised Learning

§ Classification

§ Regression

Unsupervised Learning

§ Clustering

§ Co-occurence grouping

Co-occurrence grouping / Association Rule

Mining / Market Basket Analysis

• Find associations between entities based on the transactions they are involved in.

Page 28: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

28

Predictive Analytics: Case of Predictive Maintenance of Assets

§ Regression: Predict the Remaining Useful Life (RUL), or Time to Failure (TTF).

§ Binary classification: Predict if an asset will fail within certain time frame (e.g. days).

§ Multi-class classification: Predict if an asset will fail in different time windows: E.g., fails in window [1, w0] days; fails in the window [w0+1,w1] days; not fail within w1 days

The CRISP-DM Data Mining Process

Page 29: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

29

CRISP-DM

§ Iteration as a rule

§ Process of data exploration

The CRISP-DM Data Mining Process

Page 30: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

30

Techniques Used in

Different Types of Analytics

Reference: Asllani (2015) Business Analytics with Management Science Models and Methods

Page 31: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

34

Prescriptive Analytics: Case of Transportation Models in Logistics

§ Data Sources• Radio Frequency Identification (RFID) technology

• Mobile devices

• Sensors

• External databases

§ Data• Delivery times

• Resource utilizations

• Geographical coverages

• Delivery statuses in real-time

§ Optimization procedures (e.g., transhipment models) embedded to reroute vehicles on the go, and instant direction updates to drivers on their onboard navigation system to the next “best” destination.

Page 32: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

35

Agenda

§ Analytics / Data Science: What it is and Why Do We Care?

§ Analytics and Business Strategy

§ Analytics: A Closer Look

§ Embedded to Predictive to Cognitive Analytics

Page 33: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

36

Embedded Analytics Using Predictive & Prescriptive Analytics

§ Operationalizing / Deploying• E.g., deploy web services with model scoring

§ Integrating Software Applications with Analytics• E.g.,

– specific application functionality driven by analytics models

– application meta-data incorporated in analytics models to predict application behavior

§ Best Practices / Trends• Importance of deploying analytic models into

environments that mimic real environment (not idealistic) environments

• Deployment used to be “post-process”

• Deployment and continuous improvement are now part of the full life-cycle analytic process

Reference: Chambers and Dinsmore (2015) Advanced Analytics Methodologies

Page 34: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

37

Freestanding Analytics Partially-Integrated Analytics In-Database Analytics

Reference: Chambers and Dinsmore (2015) Advanced Analytics Methodologies

Page 35: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

38

Big Data & Cognitive Analytics

§ Big Data • Volume

• Variety

• Velocity

• Value !

§ Cognitive Analytics• Scaling up predictive analytics to deal with big data

– IBM’s Watson – natural language processing

– General Electrics’ Predix for Industrial IOT

• Example techniques– Deep learning – extensions of artificial neural networks

– Text mining

– Graph mining

§ Examples of Big Data Sources• Web data (e.g., text web pages)

• Social media data (e.g., blogs, tweets, pictures)

• Event data (e.g., clickstreams, web logs)

• Machine-generated data (e.g., sensors, RFID, IOT, IIOT)

Page 36: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

39

Big Data Analytics: Case of Streaming Analytics in the Energy Industry

Reference: Delen (2015) Real-World Data Mining

Page 37: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

40

Current Trends: Integrated Applications with Cognitive Analytics

§ Traditional Application Development • Front-end tooling

• Back-end services

• Data connectivity

• Business rules

§ Integration with Cognitive Analytics• E.g., OpenEdge + DataRPM• Real-time data ingestion integrated in the application

• Streaming analytics (high velocity)

• Meta-learning – parameter tuning based on errors, i.e., learning on the go

Page 38: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

Current Trends: Cognitive Manufacturing

Reference: IBM Institute of Business Value

Page 39: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

42

Roles in Analytics / Data Science

§ Data Scientist / Data Analyst

• Understanding the potential

• Can translate from business to execution

• Ability to evaluate proposal and execution

• Can do the actual modeling

• Applied statistician X computer scientist / info systems

• Business knowledge X analytical tools knowledge

§ Collaborator in an analytics/data-science project

§ Managing an analytics/data-science project

§ Investing in an analytics/data-science project

• Understanding the potential

• Can translate from business to execution

• Ability to evaluate proposal and execution

Page 40: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

43Reference: Chambers and Dinsmore (2015) Advanced Analytics Methodologies

Page 41: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

44

Summary

§ Analytics has clearly gained traction in various industry sectors

§ Transformation from embedded to predictive to cognitive analytics

§ Key to align business strategy with analytics strategy

§ Need for investment in data sources that can improve decision-making

§ Integration of analytics in variety of applications

Page 42: Insight is 20/20: The Importance of AnalyticsTight integration of modern business ... • Tibco Spotfire • … § Open Source Platforms / Languages • Python • R • … 20 Types

Thank You

Questions or Comments?