big data use cases

1

Big Data Use CasesReleasing the Power of Data to Drive Business Value3/20/2013

2

• Russ Lankenau

• Solutions Architect at MapR (Chicago)

• http://github.com/rlankenau

• @RussLankenau

• rlankenau@maprtech.com

3

Service Bureau

Client/Server

Application Service Provider

Cloud

B2B

Software-as-a-Service

Virtualization

Social Media

Mobile

Web 2.0

4

5

Business Value

6

Business Value

7

Big Data is not new!

but the tools are.

8

Ship the Function to the Data

SAN/NAS

data data data

data data data

data data data

data data data

data data data

function

RDBMS

Traditional Architecture

data

function

data

function

data

function

data

function

data

function

data

function

data

function

data

function

data

function

data

function

data

function

data

function

Distributed Computing

9

Big Data Ecosystem

10

Use Case Company

Data Source(s)

Technique(s)

Business Value

11

Proactive Monitoring

12

Server Telemetry

Monitoring Logs

Network Flow

Data Sources

13

Pattern Recognition

Proactive Monitoring

Early Alert Delivery

Techniques

14

Business Value

15

Telecommunications Giant

ETL Offload

16

Customer Records

Contract Data

Purchase Orders

Call Center

Data SourcesTelecommunications

17

Techniques

AnalyticsETL

Telecommunications

18

Techniques

+

ETL (Hadoop) Analytics (Teradata)

Telecommunications

19

Business ValueTelecommunications

20

Idle Alerts

Waste & Recycling Leader

21

Truck Geolocation Data– 20,000 trucks– 5 sec interval

Landfill Geographic Boundaries

Data Sources

22

Techniques

TruckGeolocation

Data

Realtime Stream Computation(Storm)

Batch Computation(MapReduce)

ImmediateAlerts

Tax ReductionReporting

HadoopStorage

Shortest PathGraph Algorithm

Route Optimization

23

Business Value

24

Healthcare AnalyticsData Lake

25

Claims

Payments

Patient Records

Data Sources

26

Techniques

Billing

ClaimsData Lake(Hadoop)

Hive

StandardAnalyst Tools

Payment Records

PigAd-Hoc Analysis

27

Business Value

28

Machine LearningSearch Relevance

DNA Matching

29

Birth, Death, Census, Military, Immigration records

Search Behavior Activity

DNA SNP (snips)

Data Sources

30

Techniques

Record Linking

Search Relevance

Clickstream Behavior

Security Forensics

DNA Matching

31

Business Value

32

Similar Characteristics Lots of Data

Structured, Semi-Structured, Unstructured

Varied Systems Interoperating– Hadoop, Storm, Solr, MPP, Visualizations

Increase Revenue

Decrease Costs

33

Thank You