aws purpose-built database strategy - amazon web services...© 2019, amazon web services, inc. or...

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

AWS purpose-built database strategy

Brad BebeeSenior Manager, Product Management, AWS


1970 1980 1990 2000 2010


1970 1980 1990 2000 2010

Oracle DB2

SQL Server


1970 1980 1990 2000 2010

Oracle DB2

SQL Server

MySQL

PostgreSQL

Access


1970 1980 1990 2000

Amazon

DynamoDBRedis

MongoDB

Amazon

Elasticsearch

Amazon

NeptuneCassandra

Amazon

Aurora

2010

Amazon

Timestream

Amazon

QLDB

Amazon

DocumentDB

Oracle DB2

SQL Server

MySQL

PostgreSQL

Access


Modern apps create new requirements

Users: 1 million+

Data volume: TB–PB–EB

Locality: Global

Performance: Milliseconds–microseconds

Request rate: Millions

Access: Web, mobile, IoT, devices

Scale: Up-down, out-in

Economics: Pay for what you use

Developer access: No assembly requiredSocial mediaRide hailing Media streaming Dating


Purpose-builtThe right tool for

the right job

https://www.allthingsdistributed.com/2018/06/purpose-built-databases-in-aws.html



Data categories and common use cases

Relational Key value Document In-memory Graph

Referential

integrity, ACID

transactions,

schema-

on-write

Low-latency,

key lookups

with high

throughput and

fast ingestion

of data

Indexing and

storing

documents

with support

for query on

any attribute

Microsecond

latency, key-

based queries,

and specialized

data structures

Creating and

navigating

data relations

easily and

quickly

Lift and shift,

EMR, CRM,

finance

Real-time

bidding,

shopping cart,

social

Content

management,

personalization,

mobile

Leaderboards,

real-time

analytics,

caching

Fraud detection,

social

networking,

recommendation

engine

Search

Indexing and

searching

semistructured

logs and data

Product

catalog, help,

and FAQs,

full-text

Time series Ledger

Collect, store,

and process

data sequenced

by time

IoT

applications,

event tracking

Complete,

immutable, and

verifiable history

of all changes to

application data

Systems

of record,

supply chain,

healthcare,

registrations,

financial


AWS: Purpose-built databases

Relational Key value Document In-memory Graph Search

Amazon

DynamoDBAmazon

Neptune

Amazon RDS

Aurora CommercialCommunity

Amazon

ElastiCache

Amazon

Elasticsearch

Service

Amazon

DocumentDB

Time series Ledger

Amazon

Timestream

Amazon

Quantum

Ledger

Database

(Amazon

QLDB)

MemcachedRedis


400,000+ customers using AWS databases and analytics services


“Lift and shift” existing

apps to the cloud

Moving existing applications


Amazon Aurora

MySQL and PostgreSQL-compatible relational database built for the cloud

Performance and availability of commercial-grade databases at 1/10th the cost

Performance

and scalability

Availability

and durabilityHighly secure Fully managed

5x throughput of standard

MySQL and 3x of standard

PostgreSQL; scale-out up to

15 read replicas

Fault-tolerant, self-healing

storage; six copies of data

across three Availability Zones;

continuous backup to Amazon S3

Network isolation,

encryption at

rest/transit

Managed by Amazon RDS:

No manual hardware

provisioning, software patching,

setup, configuration, or backups


Amazon Relational Database Service (Amazon RDS)

Managed relational database service with a choice of six popular database engines

Easy to administer Available and durable Highly scalable Fast and secure

No need for infrastructure

provisioning, installing, and

maintaining DB software

Automatic Multi-AZ data

replication; automated backup,

snapshots, failover

Scale database compute

and storage with a few

clicks with no app

downtime

SSD storage and

provisioned I/O; data

encryption at rest and in

transit


AWS Database Migration Service (AWS DMS)

Migrating databases

to AWS

Migrate between on-premises and AWS

Migrate between databases

Automated schema conversion

Data replication for

migration with zero downtime

100,000+databases migrated


Quickly building new

apps in the cloud

Building new applications


Amazon DynamoDB

Fast and flexible key value database service for any scale

Performance at scale Serverless Comprehensive

security

Global database

for global users

and apps

Consistent, single-digit

millisecond response times at

any scale; built applications with

virtually unlimited throughput

No server provisioning,

software patching, or

upgrades; scales up or down

automatically; continuously

backs up your data

Encrypts all data by default

and fully integrates with AWS

Identity and Access

Management (IAM) for robust

security

Build global applications

with fast access to local

data by easily replicating

tables across multiple

AWS regions


Social media

Capital One uses Amazon DynamoDB

to reduce latency for its mobile

applications by moving its mainframe

transactions to a serverless architecture for unbound scale

Lyft leverages the scalability of

Amazon DynamoDB for multiple data

stores, including a ride-tracking

system that stores GPS coordinates for all rides

Snap migrated its largest

storage workload, Snapchat

Stories, to Amazon DynamoDB

and improved performance while reducing costs

Mobile IoT

Use cases for key-value data


Amazon ElastiCacheRedis and Memcached compatible, in-memory data store and cache

Redis and Memcached

compatibleExtreme

performance

Secure and

reliableEasily scalable

Fully compatible with open-

source Redis and MemcachedIn-memory data store and

cache for microsecond

response times

Network isolation,

encryption at-rest/in-

transit; HIPAA eligible, PCI

compliant, FedRAMP

authorized; Multi-AZ; and

automatic failover

Scales writes and reads with

sharding and replicas


Use cases for in-memory data

Caching

Reducing database queries by up

to 95% with simple cachingMcDonald’s uses a number of AWS

services, including Amazon EC2, Elastic

Load Balancing, Amazon EBS, and

Amazon ElastiCache, to support its

global POS system, including 200,000

registers and 300,000 POS devices

Airbnb uses Amazon ElastiCache

for site-wide caching

Real-time bidding In real time


Amazon Elasticsearch serviceFully managed, reliable, and scalable Elasticsearch service

Easy to use Scalable Highly

availableSecure

Deploy a production-

ready Elasticsearch

cluster in minutes

Resize your cluster

with a few clicks

or a single API call

Replicate across

Availability Zones, with

monitoring and

automated self-healing

Deploy into your VPC

and restrict access

using security groups

and IAM policies


Search use cases

Log analytics

Adobe uses Amazon

Elasticsearch Service

(Amazon ES) to cost-effectively

analyze and visualize a large

amount of log data for its

developer platform, which at

peak receives more than 200K

API calls per second.

Full text search Clickstream analytics

Hearst Corporation built a

clickstream analytics platform

using Amazon Elasticsearch

Service, Amazon Kinesis Data

Streams, and Amazon Kinesis

Data Firehose to transmit and

process 30 terabytes of data

per day from 300+ Hearst

websites worldwide.

MirrorWeb uses Amazon

Elasticsearch Service (Amazon ES)

to make the UK Government and

UK Parliament’s web archives

searchable. With Amazon ES,

MirrorWeb indexed 1.4B

documents for just $337 and

indexed 146M docs per hour—14x

faster than the previously used

technology.


Amazon DocumentDBFast, scalable, and fully managed MongoDB-compatible database service

Fast Scalable Fully managed MongoDB

compatible

Millions of requests per

second with millisecond

latency; twice the

throughput of MongoDB

Separation of compute and

storage enables both layers

to scale independently;

scale out to 15 read

replicas in minutes

Managed by AWS:

no hardware provisioning;

auto patching, quick setup,

secure, and automatic

backups

Compatible with MongoDB 3.6;

use the same SDKs, tools, and

applications as with

Amazon DocumentDB


Amazon NeptuneFully managed graph database

Fast Reliable Easy Open

Query billions of relationships

with millisecond latencySix replicas of your data

across three AZs with full

backup and restore

Build powerful queries

easily with Gremlin and

SPARQL

Supports Apache TinkerPop &

W3C RDF graph models


Amazon Timestream (sign up for the preview)

Fast, scalable, fully managed time series database

1,000x faster and 1/10th the

cost of relational databases

Collect data at the rate of

millions of inserts per

second (10M/second)

Trillions of

daily events

Adaptive query processing

engine maintains steady,

predictable performance

Time series analytics

Built-in functions for

interpolation, smoothing,

and approximation

Serverless

Automated setup, configuration,

server provisioning, and

software patching


Amazon Quantum Ledger Database (Amazon QLDB): PreviewFully managed ledger database

Track and verify history of all changes made to your application’s data

Immutable

Maintains a sequenced record of

all changes to your data, which

cannot be deleted or modified;

you can query and analyze the

full history

Cryptographically

verifiable

Uses cryptography to

generate a secure output

file of your data’s history

Easy to use

Easy to use, letting you

use familiar database

capabilities like SQL APIs

for querying the data

Highly scalable

Executes 2–3x as many

transactions as ledgers

in common blockchain

frameworks


Benefits of purpose-built databases

Better

performance Better scaleMore

functionality

Easier to

debug

Independence

between teams


Additional resources

Andy Jassy’s re:Invent 2017/2018 keynote:

Databases2017: https://www.youtube.com/watch?v=1IxDLeFQKPk&feature=youtu.be&t=37m47s

2018: https://youtu.be/ZOIkOnW640A?t=3238

Werner Vogel’s blog: A one-size-fits-all

database doesn’t fit anyone https://www.allthingsdistributed.com/2018/06/purpose-built-databases-in-

aws.html

https://aws.amazon.com/products/databases/

AWS Databases

https://www.youtube.com/watch?v=1IxDLeFQKPk&feature=youtu.be&t=37m47s

https://youtu.be/ZOIkOnW640A?t=3238


https://aws.amazon.com/products/databases/


Blog and code samples: Building a modern application with purpose-built AWS databases

https://tinyurl.com/aws-purpose-built-blog

https://tinyurl.com/aws-purpose-built-github

https://tinyurl.com/aws-purpose-built-blog

https://tinyurl.com/aws-purpose-built-github


Partners can accelerate your purpose-built database strategy

APN Partners are uniquely positioned to help your firm at any stage of your Cloud AdoptionJourney

• Share a common end goal ‘focused on your success’

• Help you take full advantage of all the business benefits that AWS has to offer

• Provide services and solutions that support any AWS use case across your full customer life cycle

AWS Service Delivery Partners

APN Partners with a track record of delivering

specific AWS services to customers

AWS MSP Partners

APN Managed Service Provider Partners with cloud

infrastructure and application migration expertise

AWS Competency Partners

APN Partners with verified, vetted, and validated

specialized offerings

APN Partners with deep expertise on AWS

Find the right APN Partner that meets your need: https://aws.amazon.com/partners/find/

https://aws.amazon.com/partners/find/


Featured Global Database APN Consulting Partners North America

EMEA LATAM Japan

Korea India ANZ

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Learn from AWS experts. Advance your skills and knowledge. Build your future in the AWS Cloud.

Digital Training

Free, self-paced online

courses built by AWS

experts

Classroom Training

Classes taught by

accredited AWS instructors

AWS Certification

Exams to validate

expertise with an industry-

recognized credential

Ready to begin building your cloud skills?

Get started at: https://www.aws.training/

https://www.aws.training/

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Thank You for Attending AWS Innovate

We hope you found it interesting! A kind reminder to complete the survey.

Let us know what you thought of today’s event and how we can improve

the event experience for you in the future.

[email protected]

twitter.com/AWSCloud

facebook.com/AmazonWebServices

youtube.com/user/AmazonWebServices

slideshare.net/AmazonWebServices

twitch.tv/aws

aws purpose-built database strategy - amazon web services...© 2019, amazon web services, inc. or...

Documents