amazon aurora new features - september 2016 webinar series

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Steve Abraham – Solutions Architect

September 28, 2016

Amazon AuroraNew Features

Options for hosting databases

Self-managed EC2 instances Fully managed

Corporate data center

Database DB on EC2 instance RDS

If You Host Your Databases On-Premises

Power, HVAC, net

Rack & stack

Server maintenance

OS patches

DB s/w patchesDatabase backups

High availability

DB s/w installs

OS installation

you

ScalingApp optimization

If You Host Your Databases in EC2

Power, HVAC, net

Rack & stack

Server maintenance

OS patches


ScalingHigh availability

DB s/w installs

OS installation

you

App optimization

If You Choose a Managed Database Service

Power, HVAC, net

Rack & stack

Server maintenance

OS patches


App optimization

High availability

DB s/w installs

OS installation

you

Scaling

Database Tuning Design Consultation

App optimization

Best Practices

Relational databases

Fully managed and secure

Fast, predictable performance

Simple and fast to scale

Low cost, pay for what you useAmazon

RDS

Amazon Aurora

MySQL-compatible relational database

Performance and availability of commercial databases

Simplicity and cost-effectiveness of open-source databases

What is Amazon Aurora?

Database architectures in last 30 years

Even when you scale it out, you’re still replicating the same stack

SQL

Transactions

Caching

Logging

SQL

Transactions

Caching

Logging

ShardingCoupled at the application layer

Application

SQL

Transactions

Caching

Logging

SQL

Transactions

Caching

Logging

Shared nothingCoupled at the SQL layer

Application

SQL

Transactions

Caching

Logging

SQL

Transactions

Caching

Logging

Shared diskCoupled at the caching and

storage layer

Storage

Application

A service-oriented architecture applied to the database

Moved the logging and storage layer into a multi-tenant, scale-out database-optimized storage service

Integrated with other AWS services like Amazon EC2, Amazon VPC, Amazon DynamoDB, Amazon SWF, and Amazon Route 53 for control plane operations

Integrated with Amazon S3 for continuous backup with 99.999999999% durability

Control planeData plane

Amazon DynamoDB

Amazon SWF

Amazon Route 53

Logging + Storage

SQL

Transactions

Caching

Amazon S3

1

2

3

Fastest growing

service in AWS

history

Business applications

Web and mobile

Content management

E-commerce, retail

Internet of Things

Search, advertising

BI, analytics

Games, media

Aurora customer adoption

Expedia: On-line travel marketplace Real-time business intelligence and analytics on

a growing corpus of on-line travel marketplace data.

Current Microsoft SQL Server–based architecture is too expensive. Performance degrades as data volume grows.

Cassandra with Solr index requires large memory footprint and hundreds of nodes, adding cost.

Aurora benefits: Aurora meets scale and performance

requirements with much lower cost. 25,000 inserts/sec with peak up to 70,000. 30 ms

average response time for write and 17 ms for read, with 1 month of data.

World’s leading online travel company, with a portfolio that includes 150+ travel sites in 70 countries.

New Regions

13 Regions

35 Availability Zones

63 Edge Locations

AWS Global Infrastructure

July 2015• Virginia• Oregon• Ireland

Amazon Aurora Regions

October 2015• Tokyo


February 2016• Sydney


March 2016• Seoul


June 2016• Mumbai


Cross Region Read Replicas


• Launched 6/1/2016• Features

• Additional 15 Read Replicas in New Region

• Very Low RPO & RTO• Unencrypted Clusters

• Use Cases• Cross Region Disaster

Recovery• Cross Region Migration• Regional Availability

Local Time Zone Support

Local Time Zone support for Amazon Aurora


• Default Time Zone is UTC• Set as Cluster Parameter• Time Zone Applied for New Connections• Cross Region Uses Different Parameter Groups• Restore from Cluster Snapshot – Defaults to UTC

• Use Cases• Application Compatibility• Reporting

Local Time Zone support for Amazon Aurora

Cross Account Snapshot Sharing



• Share with Specific Accounts• Create Public Snapshots• Manually Generated, Unencrypted Snapshots

• Use Cases• Separation of Environments (dev, test, prod)• Partnering (vendors, customers)• Data Dissemination (research, public datasets)

Enhanced Monitoring

Enhanced Monitoring


• 53 Metrics (CPU, Memory, Disk, Swap, Processes, File System)

• Configure Granularity (1-60 seconds)• Use Cases

• Diagnose Bottlenecks via Console• Metrics Extraction Filter• CloudWatch Alerts (Add Read Replica)

Enhanced MonitoringAmazon CloudWatch metrics for RDS

CPU utilization Storage Memory 50+ system/OS metrics 1–60 second granularity DB connections Selects per second Latency (read and write) Cache hit ratio Replica lag

CloudWatch alarms Similar to on-premises custom

monitoring tools

Enhanced Monitoring

Additional Failover Control

Additional Failover Control for Amazon Aurora


• Up to 15 Read Replicas• Specify Failover Order• Specify High Failover Order for Application Instances

• Use Cases• Isolate Application Instances from Failover• More Control Over Failover Precedence

Additional Failover Control for Amazon Aurora

Encryption at Rest

Encryption at Rest


• AWS Managed or Customer Managed Key (KMS)• AES-256 (In-Transit & at Rest)• Database, Logs, Backups, Snapshots, Read Replicas• Specify at Creation• Annual Key Rotation• CloudTrail Audit• Can Create from Unencrypted Backup

• Use Cases• Protect Data at Rest• Compliance (PCI, SOC 1/2/3, ISO 27001/9001, ISO 27017/27018)

Encryption at Rest

Binary Snapshot Ingestion from S3

Binary Snapshot ingestion from S3


• Replaces mysqldump• Percona XtraBackup• Simplifies Import of Complex Databases• No Performance Impact on Source Database• Migrate MySQL on EC2 or on-premises


• Manual Options• User Accounts• Functions• Stored Procedures• Time Zone Information

• Does Not Support Partial Backups• --include• --tables-file• --databases


• Best Practices• Large Files – Use Multi-Part Upload / Split Option• Long Distances – Use S3 Transfer Acceleration• Backup Format Must Match File Extension

• Gzip• tar• Percona xbstream

• Use Cases• InnoDB or MyISAM table spaces

Reader Endpoint for Amazon Aurora



• Single Reader Endpoint• May Replace MariaDB

Connector Load Balancing• During Failover, read-only

connections dropped• Use Cases

• Load Balancing• High Availability


• Load Balancing• Point all Readers to Reader Endpoint• New Read Replicas are put into rotation• Retired Read Replicas are taken out of rotation• Load Balances Connections Not Queries• Check DNS Cache Settings if Connections are Lopsided


• Failover• Point all Writers to Cluster Endpoint• Ensure Read Replicas are in Different Availability Zones• DNS Change Points to Read Replica in Priority Order• Read Only Connections to Replica are Dropped• May see temporary traffic to new master while DNS changes• Make sure to use Failover Priorities

Thank you!

Steve Abraham – [email protected]

mailto:[email protected]

amazon aurora new features - september 2016 webinar series

Technology