big data use cases
TRANSCRIPT
1
Big Data Use CasesReleasing the Power of Data to Drive Business Value3/20/2013
2
• Russ Lankenau
• Solutions Architect at MapR (Chicago)
• http://github.com/rlankenau
• @RussLankenau
3
Service Bureau
Client/Server
Application Service Provider
Cloud
B2B
Software-as-a-Service
Virtualization
Social Media
Mobile
Web 2.0
4
5
Business Value
6
Business Value
7
Big Data is not new!
but the tools are.
8
Ship the Function to the Data
SAN/NAS
data data data
data data data
data data data
data data data
data data data
function
RDBMS
Traditional Architecture
data
function
data
function
data
function
data
function
data
function
data
function
data
function
data
function
data
function
data
function
data
function
data
function
Distributed Computing
9
Big Data Ecosystem
10
Use Case Company
Data Source(s)
Technique(s)
Business Value
11
Proactive Monitoring
12
Server Telemetry
Monitoring Logs
Network Flow
Data Sources
13
Pattern Recognition
Proactive Monitoring
Early Alert Delivery
Techniques
14
Business Value
15
Telecommunications Giant
ETL Offload
16
Customer Records
Contract Data
Purchase Orders
Call Center
Data SourcesTelecommunications
17
Techniques
AnalyticsETL
Telecommunications
18
Techniques
+
ETL (Hadoop) Analytics (Teradata)
Telecommunications
19
Business ValueTelecommunications
20
Idle Alerts
Waste & Recycling Leader
21
Truck Geolocation Data– 20,000 trucks– 5 sec interval
Landfill Geographic Boundaries
Data Sources
22
Techniques
TruckGeolocation
Data
Realtime Stream Computation(Storm)
Batch Computation(MapReduce)
ImmediateAlerts
Tax ReductionReporting
HadoopStorage
Shortest PathGraph Algorithm
Route Optimization
23
Business Value
24
Healthcare AnalyticsData Lake
25
Claims
Payments
Patient Records
Data Sources
26
Techniques
Billing
ClaimsData Lake(Hadoop)
Hive
StandardAnalyst Tools
Payment Records
PigAd-Hoc Analysis
27
Business Value
28
Machine LearningSearch Relevance
DNA Matching
29
Birth, Death, Census, Military, Immigration records
Search Behavior Activity
DNA SNP (snips)
Data Sources
30
Techniques
Record Linking
Search Relevance
Clickstream Behavior
Security Forensics
DNA Matching
31
Business Value
32
Similar Characteristics Lots of Data
Structured, Semi-Structured, Unstructured
Varied Systems Interoperating– Hadoop, Storm, Solr, MPP, Visualizations
Increase Revenue
Decrease Costs
33
Thank You