the real-time cdo and the cloud-forward path to predictive analytics

41
Nikita Shamgunov, CTO and Co-founder of MemSQL Gartner Data and Analytics Summit, March 2017 The Real-Time Chief Data Officer and the Cloud-Forward Path to Predictive Analytics

Upload: memsql

Post on 19-Mar-2017

133 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Nikita Shamgunov, CTO and Co-founder of MemSQL

Gartner Data and Analytics Summit, March 2017

The Real-Time Chief Data Officer and theCloud-Forward Path to Predictive Analytics

Page 2: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Today’s TalkThe Real-Time Chief Data Officer

Introduction to MemSQLCustomer Use Cases

Demonstration: Historical, Real-Time, Predictive Analytics

Path to the Cloud

Page 3: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Real-time Chief Data Officer Objectives▪360 view of the Business

• No silos

▪Real-time access to ALL data• Current and historical in one system

▪Flexible and Strategic Deployment Model• Built for the Cloud: Public, Private, As-A-Service

▪Modern Data Architecture• Scalable, Elastic

Page 4: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Introduction to MemSQL

Page 5: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

The Real-Time Data WarehouseFor the front lines of your business

Page 6: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Real-Time Scalable Multi-Cloud• Fast Ingest, Low Latency

Queries, High Concurrency• Operational and Ad-Hoc

Analytics• Powerful applications

• Petabyte scale• Elastic• Commodity hardware• Low TCO

• Cloud Managed Service• On-premises• Multi-cloud deployments• Enterprise-grade Security

A Modern Data Warehouse for the Enterprise Frontlines

Page 7: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Real-Time Data

Messaging andTransforms

Historical Data

Bare Metal, Virtual Machines, Containers On-Premises, Cloud, As a Service

Business Intelligence Dashboards

Real-Time ApplicationAnalyticsReal-Time Data

Warehouse

Live DataMemory Optimized

Tables

Historical DataDisk Optimized

Tables

Streaming IngestReal-Time

Data Pipelines

Page 8: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

MemSQL Confidential8

Product or Services Scores for Operational Data Warehouse

Critical Capabilities for Data Warehouse and Data Management Solutions for Analytics

Gartner, July 2016

Page 9: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

How Did We Get Here

Page 10: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics
Page 11: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Trying to build scale-out for

a traditional product

Page 12: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics
Page 13: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Scale-out

Page 14: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

▪Every piece of technology is scalable▪Analyzing data from hundreds of thousands of

machines▪Delivering immense value in real-time

• Real-time code deployment• Detecting anomalies• A/B testing results

▪Fundamentally making the business faster by providing data at your fingertips

An Insider’s View at Facebook

Page 15: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Imagine scaling a database on industry standard hardware.

Need 2x the performance? Add 2x the nodes.

Page 16: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Customer Use Cases

Page 17: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Real-time analytics transformed profitability analysis of customer logistics from weekly to daily, and reduced latency from days to minutes

+

17

Page 18: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

18

BUSINESS BENEFITS▪New increased profitability customer logistics analysis from weekly to daily▪Reduce Latency from days to minutes

TECHNICAL BENEFITS▪Reduced 22 hour ETL to minutes▪Increased query response time by 80x

Page 19: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

THE KELLOGG’S REAL-TIME ARCHITECTURE

19

22 hours to minutes

80x faster

Page 20: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Reducing delay in “freshness of data” from two hours to 10 minutes

+

Page 21: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

BUSINESS BENEFITS▪Reach over 1.5 billion users across 100s of thousands of mobile apps▪Real-time optimization of advertising campaigns with improved post-install

engagements▪Net new personalized campaign performance reports for greater visibility

TECHNICAL BENEFITS▪10x faster data refresh, from hours to minutes▪Ad-hoc queries on raw log-level data in seconds▪Real-time deduplication▪1 TB/day ingest

Page 22: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

THE MANAGE REAL-TIME ARCHITECTURE

22

REAL-TIMEANALYTICS

Real-Time inputs

http://www.enterprisetech.com/2016/12/09/managing-30b-bid-requests/

Page 23: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

DellEMC Adopts MemSQL for Customer Acquisition Lifecycle Management

+

Page 24: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

24

BUSINESS BENEFITS• Deliver real-time customer updates to DellEMC Sales Department• Scale customer analytics to increase sales productivity• Execute joins across multiple distributed data set• Drive real-time personalization for operational efficiency

TECHNICAL BENEFITS• Data loading• Concurrency• Sub-second response• Distributed joins

Tables: Customer, Inventory and Contracts

Page 25: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

DELLEMC REAL-TIME ARCHITECTURE

REAL-TIMEANALYTICS

Page 26: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

SECURE DATA LAKE ARCHITECTURE

26 http://itblog.emc.com/2016/05/03/simplifying-lives-emc-myservice360/

Page 27: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

27

The global leader in Content Delivery Network services, has deployed MemSQL to enhance billing speed and efficiency for thousands of customers around the world

+

Page 28: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

28

BUSINESS BENEFITS▪Analyze Historical Against Live Data▪30% Increased Forecast Accuracy▪Tighter Financial Reporting to Street

TECHNICAL BENEFITS▪Analyze Millions of rows / second▪Massive Concurrency▪8 Million UPSERTS per second▪Process 1PB Data Per Day

Page 29: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

THE AKAMAI REAL-TIME ARCHITECTURE

29

REAL-TIMEANALYTICS

Customer traffic

statistics

Page 30: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Demonstration

Page 31: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

The Path to Real-Time Analytics

Real-Time Data Predictive AnalyticsHistorical Data

Page 32: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

MemSQL Springs and Golf Resorts

Page 33: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Demo Details1.Showcase fast queries on historical data with Tableau2. Incorporate real-time data with MemSQL Pipelines

and exactly-once ingest from Kafka3.Add predictive analytics with Sentiment Analysis

Historical Data

CREATE PIPELINE

Real-TimeData

Sentiment Analysis

Page 34: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics
Page 35: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

CDO Strategiesfor Hybrid Cloud

Page 36: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Gartner Hybrid DBMS Cloud Scenarios

36

Dev Test

Disasterrecovery

Architecture Spanning Use Case Specific Multicloud

Prod

Source: Gartner (April 2016)

Page 37: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

A Comprehensive Hybrid Cloud Approach▪On-Premises deployments

•Any hardware, NUMA optimizations, vectorized processing•Any Linux, VMs, Containers•Robust security including Role-based Access Control (RBAC)•Perfect for retiring legacy appliances

▪Any Cloud•Any cloud service IaaS•Simple `replicate database`•Also available as a MemSQL Managed Service

Page 38: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Strategic Approach to Global Analytics▪ Develop a center of excellence for real-time

infrastructure• Include both real-time AND historical data

▪Identify complements and replacements for traditional technologies

• Data warehouse appliances, rigid systems

▪Choose a straightforward path• Faster historical insights, real-time data, predictive analytics

Page 39: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Please visit at the MemSQL booth

Page 40: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Q&A

Page 41: The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

www.memsql.com

Thank You