the real-time cdo and the cloud-forward path to predictive analytics
TRANSCRIPT
Nikita Shamgunov, CTO and Co-founder of MemSQL
Gartner Data and Analytics Summit, March 2017
The Real-Time Chief Data Officer and theCloud-Forward Path to Predictive Analytics
Today’s TalkThe Real-Time Chief Data Officer
Introduction to MemSQLCustomer Use Cases
Demonstration: Historical, Real-Time, Predictive Analytics
Path to the Cloud
Real-time Chief Data Officer Objectives▪360 view of the Business
• No silos
▪Real-time access to ALL data• Current and historical in one system
▪Flexible and Strategic Deployment Model• Built for the Cloud: Public, Private, As-A-Service
▪Modern Data Architecture• Scalable, Elastic
Introduction to MemSQL
The Real-Time Data WarehouseFor the front lines of your business
Real-Time Scalable Multi-Cloud• Fast Ingest, Low Latency
Queries, High Concurrency• Operational and Ad-Hoc
Analytics• Powerful applications
• Petabyte scale• Elastic• Commodity hardware• Low TCO
• Cloud Managed Service• On-premises• Multi-cloud deployments• Enterprise-grade Security
A Modern Data Warehouse for the Enterprise Frontlines
Real-Time Data
Messaging andTransforms
Historical Data
Bare Metal, Virtual Machines, Containers On-Premises, Cloud, As a Service
Business Intelligence Dashboards
Real-Time ApplicationAnalyticsReal-Time Data
Warehouse
Live DataMemory Optimized
Tables
Historical DataDisk Optimized
Tables
Streaming IngestReal-Time
Data Pipelines
MemSQL Confidential8
Product or Services Scores for Operational Data Warehouse
Critical Capabilities for Data Warehouse and Data Management Solutions for Analytics
Gartner, July 2016
How Did We Get Here
Trying to build scale-out for
a traditional product
Scale-out
▪Every piece of technology is scalable▪Analyzing data from hundreds of thousands of
machines▪Delivering immense value in real-time
• Real-time code deployment• Detecting anomalies• A/B testing results
▪Fundamentally making the business faster by providing data at your fingertips
An Insider’s View at Facebook
Imagine scaling a database on industry standard hardware.
Need 2x the performance? Add 2x the nodes.
Customer Use Cases
Real-time analytics transformed profitability analysis of customer logistics from weekly to daily, and reduced latency from days to minutes
+
17
18
BUSINESS BENEFITS▪New increased profitability customer logistics analysis from weekly to daily▪Reduce Latency from days to minutes
TECHNICAL BENEFITS▪Reduced 22 hour ETL to minutes▪Increased query response time by 80x
THE KELLOGG’S REAL-TIME ARCHITECTURE
19
22 hours to minutes
80x faster
Reducing delay in “freshness of data” from two hours to 10 minutes
+
BUSINESS BENEFITS▪Reach over 1.5 billion users across 100s of thousands of mobile apps▪Real-time optimization of advertising campaigns with improved post-install
engagements▪Net new personalized campaign performance reports for greater visibility
TECHNICAL BENEFITS▪10x faster data refresh, from hours to minutes▪Ad-hoc queries on raw log-level data in seconds▪Real-time deduplication▪1 TB/day ingest
THE MANAGE REAL-TIME ARCHITECTURE
22
REAL-TIMEANALYTICS
Real-Time inputs
http://www.enterprisetech.com/2016/12/09/managing-30b-bid-requests/
DellEMC Adopts MemSQL for Customer Acquisition Lifecycle Management
+
24
BUSINESS BENEFITS• Deliver real-time customer updates to DellEMC Sales Department• Scale customer analytics to increase sales productivity• Execute joins across multiple distributed data set• Drive real-time personalization for operational efficiency
TECHNICAL BENEFITS• Data loading• Concurrency• Sub-second response• Distributed joins
Tables: Customer, Inventory and Contracts
DELLEMC REAL-TIME ARCHITECTURE
REAL-TIMEANALYTICS
SECURE DATA LAKE ARCHITECTURE
26 http://itblog.emc.com/2016/05/03/simplifying-lives-emc-myservice360/
27
The global leader in Content Delivery Network services, has deployed MemSQL to enhance billing speed and efficiency for thousands of customers around the world
+
28
BUSINESS BENEFITS▪Analyze Historical Against Live Data▪30% Increased Forecast Accuracy▪Tighter Financial Reporting to Street
TECHNICAL BENEFITS▪Analyze Millions of rows / second▪Massive Concurrency▪8 Million UPSERTS per second▪Process 1PB Data Per Day
THE AKAMAI REAL-TIME ARCHITECTURE
29
REAL-TIMEANALYTICS
Customer traffic
statistics
Demonstration
The Path to Real-Time Analytics
Real-Time Data Predictive AnalyticsHistorical Data
MemSQL Springs and Golf Resorts
Demo Details1.Showcase fast queries on historical data with Tableau2. Incorporate real-time data with MemSQL Pipelines
and exactly-once ingest from Kafka3.Add predictive analytics with Sentiment Analysis
Historical Data
CREATE PIPELINE
Real-TimeData
Sentiment Analysis
CDO Strategiesfor Hybrid Cloud
Gartner Hybrid DBMS Cloud Scenarios
36
Dev Test
Disasterrecovery
Architecture Spanning Use Case Specific Multicloud
Prod
Source: Gartner (April 2016)
A Comprehensive Hybrid Cloud Approach▪On-Premises deployments
•Any hardware, NUMA optimizations, vectorized processing•Any Linux, VMs, Containers•Robust security including Role-based Access Control (RBAC)•Perfect for retiring legacy appliances
▪Any Cloud•Any cloud service IaaS•Simple `replicate database`•Also available as a MemSQL Managed Service
Strategic Approach to Global Analytics▪ Develop a center of excellence for real-time
infrastructure• Include both real-time AND historical data
▪Identify complements and replacements for traditional technologies
• Data warehouse appliances, rigid systems
▪Choose a straightforward path• Faster historical insights, real-time data, predictive analytics
Please visit at the MemSQL booth
Q&A
www.memsql.com
Thank You