backup to the cloud

© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

STG 201 – Backup To The Cloud

Travis Greenstreet, 2nd Watch

November 13, 2013

Agenda

• Backups - Traditional vs. Cloud

• AWS Backup, Archival & DR Tools

• DR – Traditional vs. AWS Solutions

• HA Using AWS Solutions

• Q&A

What’s wrong with Traditional Backups

• Long/slow recovery time

• Low durability (higher probability for data loss)

What’s wrong with Traditional Backups

• Requires Tape Museums

• Expensive Tech Refresh

• Disaster Recovery – Complex and highly cost-prohibitive

What makes AWS better than Traditional

Solutions?

• Eleven 9s (that’s 99.999999999%) of durability

(S3/Glacier)

• Seamless integration with existing AWS

infrastructure

• Lifecycle Management built in via “Lifecycle

Policies”

What makes AWS better than Traditional

Solutions?

• Numerous options for transferring data in/out

and syncing

• The typical reasons for using AWS apply (e.g.

Reduce CapEx, Reduce TCO, industry

compliances)

• Affordable and manageable DR with “Pilot Light”

AWS Backup, Archival, and DR tools

• S3 (backup/recovery)

• Glacier (archival)

• EBS snapshots

• AWS Import/Export (used for seeding large data

sets)

AWS Backup, Archival, and DR tools

• Storage Gateway

• Pilot Light (Disaster Recovery)

• Warm Standby (taking Pilot Light a step further

to achieve fault tolerance between on premise

and AWS DR resources)

Amazon S3 – Simple Storage Service

• Durable and low cost (1GB < $0.10 per month)

• Unlimited number of objects and volume

• Backup from any system directly to S3 buckets

via HTTP/HTTPS

– Create scripts using PowerShell, Perl, Python…

– Numerous solutions for data copy and synch

Amazon S3 – Simple Storage Service

Easily create lifecycle rules − Delete or archive to Glacier

− Single rule for the bucket or multiple based on object prefix

Security − Control access thru policies and ACLs

− Auditable access

− Encryption in flight and at rest (SSL & SSE)

− Versioning in case of accidental

– deletion

Amazon Glacier – Infinite Archival

Storage • Secure and cost

effective offsite data

archiving

• Excellent for logs

• Long term preservation

for potential future

analytic sources

EBS Snapshots

“SAN like snapshots” of EBS storage allow

recovery to a point in time – replicated across

the entire region (3+ AZ/datacenters)

Auto-scaling and scripting allow backup server

to be fully cost optimized Example: 2W Backup Server < $1 per month

AWS Import/Export

• Quickly migrate large amounts of data in/out of

AWS

– Seeding initial datasets

– Copying offsite backups into S3, EBS, Glacier

– Retrieval of offsite backups and datasets

High Availability on AWS

Plan for failure at any level

Services within a Datacenter (AZs) can fail

Regions are N+2 (minimum)

Reserve capacity (the other side of Reserved Instances)

Use AWS Services that scale across AZs

− VPC, S3, ELB, RDS, ...

• HA at each tier

• Can lose entire datacenter and maintain production load

• Auto-scaling at web and API tier to support dynamic site load

• EBS Snapshots replicated to additional region(s)

HA Example

Disaster Recovery

• Average fully managed costs of DR > $1 per GB

of protected data

• Recovering from backups can take days

• Backup tapes add risk and time to recovery

– Do you have all the tapes you need

– Are the resources available to do the restorations

Disaster Recovery on AWS

Classes of RTO’s

• Critical – Real-time availability or near real-time (minutes) – Tier 0 infrastructure, critical apps

• Major – Applications to run the business (hours) – Tier 1 infrastructure and apps

• Minor – Applications that can withstand a longer downtime (hours - days)

AWS Solution

• High Availability or Warm

Standby

• Pilot Light DR in AWS

• Backup and Recovery in

AWS

Advantages of a Pilot Light DR Scenario

• Warm standby for the price of cold storage

o Or Less!

• Super fast recovery time

o Entire recovery process could be 1-3 hours

• Data replication can keep critical systems in sync

Tip: include full domain controller to ensure all accounts are replicated and can be used at time of event for definitive source.

Storage Gateway – Cached or Stored

Gateway-Cached

• Frequently accessed data

is cached on premise

• Cost savings on storage

• Mount volumes up to

32TB

• With up to 150 TBs total

storage

Gateway-Stored

• Low-latency access to all

your data

• Asynchronous backup to

S3 as EBS Snapshots

• Mount volumes up to 1TB

• Up to 12TBs of total

storage

Storage Gateway – VTL

• Enterprise cloud backup solution

• All the benefits of S3 and Glacier, in an easy to

use package

• No need for re-architecting your datacenter, no

need for re-training your employees

Storage Gateway – VTL

• Works with your existing backup software

• Traditional tape durability is 90%, VTL achieves

99.999999999%

• Pay for what you use. If you store 1GB on a

100GB virtual tape, you’ll only pay for the 1GB

Virtual Tape Library

• Create tapes using the AWS Console or

programmatically with the Storage Gateway API

• Each gateway can contain up to 1500 tapes,

with up to 150TB of data

• S3 provides hyper durability, your backup

software and Storage Gateway VTL do the rest

Virtual Tape Shelf

• Iron Mountain for the 21st century

• Tapes moved to the Virtual Tape Shelf are stored

in Glacier

• Extremely cost effective. You’ll pay 1 penny per

gigabyte, per month. Archive 5 GB of data for

less than $1 per year.

Watch that VTL

• Leverage the existing

capabilities of CloudWatch to

monitor and alarm your backup

processes.

• Automatically send notifications

to engineers when a backup

process has exceeded a

specified threshold.

• Examine weeks worth of data to

identify patterns of behavior, all

through a familiar interface.

• Trigger API calls based on

backup activity.

Please give us your feedback on this

presentation

As a thank you, we will select prize

winners daily for completed surveys!

STG201 – Backup To The Cloud