aws webcast - backup and archiving in the aws cloud

50
© 2014 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc. © 2014 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc. Backup and Archiving in the AWS Cloud John Downey, Amazon Web Services June 18, 2014

Upload: amazon-web-services

Post on 24-Jun-2015

628 views

Category:

Technology


5 download

DESCRIPTION

Review this webinar to learn how to use the variety of AWS storage services and features to deploy backup and archiving solutions that are low cost and easy to deploy, manage and maintain. We will present reference architectures, best practices and use cases based on AWS services including Amazon S3, Glacier and Storage Gateway. Special topics will include how to move your data securely into the AWS cloud, how to retrieve and restore your data, and how to back-up on-premises data to the cloud using Amazon Storage gateway and other third party storage gateways.

TRANSCRIPT

Page 1: AWS Webcast - Backup and Archiving in the AWS Cloud

© 2014 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc. © 2014 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

Backup and Archiving

in the AWS Cloud John Downey, Amazon Web Services

June 18, 2014

Page 2: AWS Webcast - Backup and Archiving in the AWS Cloud

Agenda

• Why AWS for Backup and Archive?

• AWS Global Infrastructure

• Backup and Archive Concepts

• Traditional vs. Cloud Approach

• Cloud Integrated Backup and Archive Gateways

• Data Ingestion Options

• AWS Storage and Archive Options

• Retrieve / Restore

• TCO

Page 3: AWS Webcast - Backup and Archiving in the AWS Cloud

Why AWS for Backup and Archive?

Metered usage:

Pay as you go

No capital investment

No commitment

No risky capacity planning

Avoid opex and risks of

physical media

handling

Control your

geographic locality for

performance and

compliance

Page 4: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Global Infrastructure

10 Regions

26+ Availability Zones

50+ Edge locations

Page 5: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Regions and Availability Zones

Customer decides where applications and data reside

Asia Pacific (Tokyo) US West (Oregon) EU (Ireland) US East (N. Virginia)

US West (N. Cal) (Asia Pacific) Singapore

AWS GovCloud (US) South America (Sao Paulo) Asia Pacific (Sydney)

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone Availability

Zone

Availability

Zone

Availability

Zone Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

Availability

Zone

China (Beijing - BETA)

Availability

Zone

Availability

Zone

Page 6: AWS Webcast - Backup and Archiving in the AWS Cloud

Archive:

Data retained for the

long term, for

compliance or research

Backup:

Data retained to

support near-term

business continuity

Backup and Archive defined

Page 7: AWS Webcast - Backup and Archiving in the AWS Cloud

Traditional Backup and Archive

Page 8: AWS Webcast - Backup and Archiving in the AWS Cloud

Traditional Backup and Archive

• Time: Long/slow recovery time

• Money: Capital intensive with ongoing upgrades

• Effort: Complex to manage

• Quality: Low durability, Error Prone

Days or Weeks

Page 9: AWS Webcast - Backup and Archiving in the AWS Cloud

Traditional Backup and Archive

• Backup Software • Edge to core topologies

• Dedicated people

• Tape Silos / Tape Libraries

• Tape Drives (LTO-X / DLT / etc)

• Virtual Tape Libraries (VTLs)

• Tape out / Vaulting

• Unified Backup Solutions

• Deduplication

• Compression

• Encryption

Page 10: AWS Webcast - Backup and Archiving in the AWS Cloud

Traditional Backup and Archive Tape Systems

Page 11: AWS Webcast - Backup and Archiving in the AWS Cloud

Traditional Backup and Archive Virtual Tape Library

Page 12: AWS Webcast - Backup and Archiving in the AWS Cloud

Cloud Backup and Archive

Page 13: AWS Webcast - Backup and Archiving in the AWS Cloud

Cloud Backup and Archive

• Backup Software • Edge to core topologies

• Single pane of glass

• Tape Silos / Tape Libraries

• Tape Drives (LTO-X / DLT / etc)

• Virtual Tape Libraries (VTLs)

• Tape out

• Unified Backup Solutions

• Deduplication

• Compression

• Encryption

Page 14: AWS Webcast - Backup and Archiving in the AWS Cloud

Cloud Backup and Archive Topologies

1. Branch office backup to cloud

2. Core data center backup to cloud

3. Cloud backup to cloud

4. Hybrid cloud backup

Page 15: AWS Webcast - Backup and Archiving in the AWS Cloud

Branch office backup to cloud

Considerations: - Backup Software

- Storage / Caching Gateway

- WAN or Internet

- Deduplication

- Compression

- Encryption

- WAN Acceleration

Page 16: AWS Webcast - Backup and Archiving in the AWS Cloud

Core data center backup to cloud

Considerations: - Backup Software

- Storage / Caching gateway

- Direct Connect or Internet

- Telco Burst Models - Time Warner Telecom

- Deduplication

- Compression

- Encryption

- WAN Acceleration

Page 17: AWS Webcast - Backup and Archiving in the AWS Cloud

Cloud backup to Cloud Applications running on EC2 backing up to S3 / Glacier

Considerations: - Backup software

- Encryption

- Deduplication

- Compression

- Native S3 and Glacier

integration

- AMI Backup Appliance? - AMI = Golden Master

- EBS Snaps / Scripting

Page 18: AWS Webcast - Backup and Archiving in the AWS Cloud

Hybrid Cloud Backup

VPC – Datacenter #4

Single GUI for Management

Page 19: AWS Webcast - Backup and Archiving in the AWS Cloud

Cloud Integrated Backup and Archive Gateways

Page 20: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Storage Gateway

• On-premises, virtual iSCSI

storage appliance

• $125 / Month

• Local cache enables low

latency access to data

• Server Side Encryption (SSE)

• 5 TB of throughput per day

• Recover to Amazon EBS

Page 21: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Storage Gateway-VTL (Virtual Tape Library)

• On-premises, virtual tape library

storage appliance

• $125 / Month

• 10 virtual tape drives / 1500

virtual tape slots

• 150 TB local cache – VTL – virtual tape library

• Restore in seconds from VTL

– VTS – virtual tape shelf • Next Generation Offsite Vault

• 24 hour retrieval from VTS

• Encryption in transit and at rest

• Gateway VTL-AMI

Page 22: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS partner backup and archive solutions

Avere → S3-Glacier

AWS SGW → S3

AWS VTL → S3-Glacier

BridgeSTOR → S3-Glacier

CA Arcserve → S3

CA Mainframe → S3-Glaicer

Commvault → S3-Glacier

Ctera → S3

Druva → S3

Oracle RMAN + OSB Module → S3

Panzura → S3

Riverbed Whitewater → S3-Glacier

Sonian → S3

Veeam → S3-Glacier

Zmanda → S3

Page 23: AWS Webcast - Backup and Archiving in the AWS Cloud

Avere Systems

S3

Glacier

• S3 and Glacier integrated for NAS style archiving

• Scale-out, High Performance NAS accelerator

Page 24: AWS Webcast - Backup and Archiving in the AWS Cloud

Riverbed Whitewater

• Local caching appliance

• Presents NAS protocols – CIFS / NFS

• Up to 30x deduplication

• Compression

• Encryption

• Key Management

• WAN Acceleration

• S3 and Glacier support

• AMI Available

Page 25: AWS Webcast - Backup and Archiving in the AWS Cloud

Ctera

Page 26: AWS Webcast - Backup and Archiving in the AWS Cloud

Commvault

• Unified platform integrates

Backup, Archive, Replication,

Analysis and Search, Alerting,

Reporting, and Tracking of all

data via a single common

code base

• Integrated with Amazon S3

and Amazon Glacier with

deduplication & encryption

support

• Single console management

Amazon S3 Amazon Glacier

Page 27: AWS Webcast - Backup and Archiving in the AWS Cloud

Data Ingestion Options

Page 28: AWS Webcast - Backup and Archiving in the AWS Cloud

Data Ingestion Options

AWS Direct Connect Dedicated bandwidth between

your site and AWS

Internet Transfer data in a secure SSL tunnel over

the public Internet

AWS Import/Export Physical transfer of media into and

out of AWS

Page 29: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Ingest Options Internet / One Common Theme: Parallel Uploads

1. Multipart upload

2. Request rate optimization

3. TCP window scaling

4. TCP selective

acknowledgement

AWS has customers that ingest roughly 1 PB per day

Page 30: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Ingest Options AWS Direct Connect

• Private connectivity to AWS – Physical connection – 1 Gbps or 10 Gbps

port

• Consistent network performance • Consider burst models on ingest • Reduces costs for bandwidth-

heavy outbound workloads

Locations

• CoreSite 32 Avenue of the Americas, NY

• CoreSite One Wilshire & 900 North Alameda, LA

• Equinix DC1 – DC6 & DC10 - DC11, Ashburn, VA

• Equinix SV1 & SV5, San Jose, CA

• Equinix SE2 & SE3, Seattle, WA

• Equinix SG2, Singapore

• Equinix SY3, Sydney

• Equinix TY2, Tokyo

• Eircom, Clonshaugh

• TelecityGroup Docklands, London

• Terremark NAP do Brasil, Sao Paulo

Page 31: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Ingest Options AWS Import/Export

• Rapidly move data into and

out of AWS

• Portable storage device

shipment to AWS

• Supports – Amazon EBS

– Amazon S3

– Amazon Glacier

• Use cases – Initial data migration

– Content distribution via portable

devices

– Disaster recovery

Page 32: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Storage and Archive Options

Page 33: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Storage and Archive Options

Amazon Simple Storage Service (S3) Highly scalable object storage

1 byte to 5 TB in size

99.999999999% durability

Amazon Elastic Block Store (EBS) High-performance block storage device

1 GB to 1 TB in size

Mount as drives to instances with

snapshot/cloning functionalities

Amazon Glacier Long-term object archive

Extremely low cost per gigabyte

99.999999999% durability

Page 34: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Storage and Archive Options

Amazon Elastic Block Store (EBS)

• High I/O block storage for Amazon EC2

• Point-in-time snapshots to Amazon S3 • 99.999999999% Durability

• Snapshot software is FREE

• Point-in-time snapshots across regions

Page 35: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Storage and Archive Options Amazon Simple Storage Service (S3)

• Durable and low cost

• Unlimited number of objects and volume

• Back up to Amazon S3 buckets via

HTTP/HTTPS

– Create scripts using PowerShell,

Perl, Python…

– Numerous solutions for data backup

• Authentication mechanisms ensure data

is kept secure

• Reduced redundancy storage (RRS)

option

Page 36: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Storage and Archive Options Amazon S3: Over 2 Trillion Total Objects

• Time: Instant access, any time, any where

• Money: Pay for what you store / 17 price reductions

• Effort: Scales as you grow

• Quality: 99.999999999% durability

+2 Trillion

Objects

Page 37: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Storage and Archive Options

Amazon Glacier

• $0.01 per GB/mo, $120 per TB/yr

• 3-5 hour data retrieval latency

• Archives: single file or zipped files

• Vaults: collection of archives

• Infinite archival storage

• 99.999999999% durability

• Immutable, encrypted by default

Page 38: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS Storage and Archive Options Object Lifecycle Management: Amazon S3 → Amazon Glacier

• Seamlessly move data from Amazon S3 → Amazon Glacier

• 3-5 hour asynchronous retrieval

• Data lifecycle policies

• $0.01 per GB for Amazon Glacier costs

Page 39: AWS Webcast - Backup and Archiving in the AWS Cloud

Retrieve / Restore

Page 40: AWS Webcast - Backup and Archiving in the AWS Cloud

Retrieve / Restore back to On Premises Data Centers

Amazon

Glacier Amazon S3

3-5 Hour

Retrieval

(staging)

Immediate

Restore

*Storage Gateway mitigates restores from cloud

Page 41: AWS Webcast - Backup and Archiving in the AWS Cloud

Retrieve / Restore in AWS

$$

Hours

Amazon

Glacier Amazon S3 Amazon EC2

/ HPC

Amazon

CloudFront

Generating

Business

Value

Mins / Seconds

Page 42: AWS Webcast - Backup and Archiving in the AWS Cloud

Restore in AWS

Page 43: AWS Webcast - Backup and Archiving in the AWS Cloud

Restore in AWS

Page 44: AWS Webcast - Backup and Archiving in the AWS Cloud

Create instances from

AMIs

Restore data from backups

Restore in AWS

Page 45: AWS Webcast - Backup and Archiving in the AWS Cloud

TCO: On-Premises Cost Considerations

1. Primary storage hardware (primary / remote site)

2. DR / Remote site storage hardware

3. Raw to utilized storage (both primary and DR)

4. Storage growth (cost of upgrades)

5. Storage management software and 3rd party tools

6. Professional services

7. Hardware maintenance

8. Software maintenance

9. Backup software

10.Backup hardware (primary / remote site)

11.Offsite tape storage / vault

12.Archive software

13.Archive hardware

14.Power

15.Cooling

16.Space

17.Labor

18.Cost of capital

19.Training

20.Asset depreciation

21.Migration

22.Decommission / remove

23.Recycle

Page 46: AWS Webcast - Backup and Archiving in the AWS Cloud

Customer Stories AWS Storage Gateway is used in a variety of ways

Jollibee (JFC) is using the AWS Storage Gateway to backup and

mirror their Oracle SQL server database from their on-premises

data center to AWS. JFC is the largest fast food chain in the

Philippines with revenues well over 2 Billion USD.. The Storage

Gateway also provides us access to the same database

snapshots for use in Amazon EC2, providing a cost-effective in-

cloud DR solution.

AWS Storage Gateway provided us the most cost

effective way to backup our SAP workloads to AWS, it is

helped us perform SAP System ‘refresh’ much faster and

in a more convenient way, backing up to S3 has also helped us

to prepare for DR & also run SAP Dev/QA restores easily on EC2

“Amazon Web Services and AWS Storage Gateway are great

assets that help us scale fast, store data in an ultra-secure

environment, spend more time on product development (rather

than disaster recovery & backup)

…By using AWS Storage Gateway, we went to just hours instead

of days to restore from backup.”

The large Japanese Retail chain uses AWS

Storage Gateway to share & store files in S3 and

drastically cut down it’s spend on premise NAS

footprint.

Page 47: AWS Webcast - Backup and Archiving in the AWS Cloud

• Digital marketing agency, What’s Up Interactive, offers managed hosting for high-availability websites

• What’s Up Interactive wanted to expand this service to include affordable backup and disaster recovery (DR)

• What’s Up Interactive’s backup and DR solution is anchored by Amazon S3, which is designed to provide 99.999999999% durability and 99.99% availability of objects over a given year

AWS Allows What’s Up Interactive to Save Over $1M

Page 48: AWS Webcast - Backup and Archiving in the AWS Cloud

AWS – Your Global Data Center for Backup and Archive

• Choose the region that fits your business and compliance needs

• 10 regions world wide – set up with a few clicks

• Broad range of backup/archive tools that are AWS integrated

• Low cost, reliable AWS Transport and Storage options

• Enhance Security Posture

• Increase Scalability

• Significantly Higher Data Durability

• All at a lower TCO

Page 49: AWS Webcast - Backup and Archiving in the AWS Cloud

How to get started?

• We will be sending out an email to all attendees

• https://aws.amazon.com/backup-storage/contact-us/

Page 50: AWS Webcast - Backup and Archiving in the AWS Cloud

© 2014 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc. © 2014 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

THANK YOU

John Downey, Amazon Web Services

Sr. Business Development Manager

Enterprise Storage Strategy

[email protected]