building and maintaining bulletproof systems with datastax

Tim Vincent Solution Engineering Team LeadWelcome and Introduction to DSEBuilding and Maintaining Bullet Proof Systems

© DataStax, All Rights Reserved. 3

Feedback

• Please use the Event App to give us your feedback• Everyone who submits feedback will be entered in the prize draw for a UE BOOM 2 by

Ultimate Ears Bluetooth Waterproof Portable Speaker• Winner will be notified via email

© 2015 DataStax, All Rights Reserved.

4

MDM: Customer 360, Product CatalogPersonalization and RecommendationInternet of Things and Time SeriesFraud DetectionList ManagementMessagingInventory ManagementAuthentication

DataStax Use Cases

© DataStax, All Rights Reserved. 5

EpicScale

RealTimeValue

© DataStax, All Rights Reserved. 6

Numerous Endpoints Geographically DistributedContinuous AvailabilityInstantaneously ResponsiveImmediately DecisivePredictably Scalable

Cloud Applications

© 2015 DataStax, All Rights Reserved.

7

Architecture of a Cloud Application

Web App Queue Ingest Operational

Database

© 2015 DataStax, All Rights Reserved.

8

Architecture of a Cloud Application

Web App Queue Ingest Operational

Database

Solr

9

Architecture of a Cloud Application

© 2015 DataStax, All Rights Reserved.

Web App Queue Ingest Operational

Database

Hadoop

Solr

Queue

Hive

Search

Batch Processing

10

Architecture of a Cloud Application

© 2015 DataStax, All Rights Reserved.

Web App Queue Ingest

Spark Streaming

Operational

Database

Hadoop

Solr

Queue

Hive

Search

Batch Processing

© 2015 DataStax, All Rights Reserved.

11

IBM Real-time Analytics Reference Architecture

Source: Explore the advanced analytics platform (http://ibm.co/1PLAneB)

Oracle Real-time Analytics Reference Architecture

Source: Big Data in Financial Services and Banking (http://bit.ly/1GP8mmE)

© 2015 DataStax, All Rights Reserved.

13

Hadoop Real-time Analytics Reference Architecture

Source: Designing Fraud-Detection Architecture That Works Like Your Brain Does (http://bit.ly/1OeAnDb)

© 2015 DataStax, All Rights Reserved.

14

“70% of Hadoop deployments will not meet cost savings and

revenue generation objectives due to skills and integration

challenges.”

Source: Hadoop promises not yet paying off (http://tek.io/1MrHtSx)

© 2015 DataStax, All Rights Reserved.

15

© 2015 DataStax, All Rights Reserved.

16

DSE Real-time Analytics Reference Architecture

HTTP Application Message Queue

Streaming

Analytics

BatchAnalytics

Real-time

• Distributed NoSQL Database• Google Big Table• Amazon Dynamo

• Continuous Availability• Disaster Avoidance

• Linear Scale Performance• Add nodes to scale

• Runs on Commodity Hardware• Cloud or on Premise

San Francisco

New York

London

Under Pinned by Apache Cassandra

18

BatchAnalytics

Indexing& Search

StreamingAnalytics

Graph

DSE Integrated Multi-Model Platform

© 2015 DataStax, All Rights Reserved.

© DataStax, All Rights Reserved. 19

DataStax Enterprise Added Value

© 2015 DataStax, All Rights Reserved.

20

OpsCenterDrag picture to placeholder or click icon to add• Monitoring

• Provisioning• Management Services

• Backup/Restore• Capacity Planning• Performance • Best Practices

21

Netflix Ensures Constant Uptime with DataStax EnterpriseWorld’s leading streaming media provider with digital revenue $1.5BN+95% of all Netflix data stored in DSEIntroduction of ‘Profiles’ drove throughput to over 10M transactions per secondDoes 1 trillion transactions/day with DSEReplaced Oracle in six data centers, worldwide, 100% in the cloud

© DataStax, All Rights Reserved. 23

EpicScale

RealTimeValue

© 2015 DataStax, All Rights Reserved. 24

Build Real Time Value Live Search and Indexing Streaming and Batch Analytics Advanced Replication

© 2015 DataStax, All Rights Reserved. 25

Operate at Scale OpsCenter Security and Auditing Services and Best Practices

© DataStax, All Rights Reserved. 26

DataStax Enterprise is the database for cloud applications.