aws summit berlin 2013 - choosing the right data storage options with aws
TRANSCRIPT
![Page 1: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/1.jpg)
James Brown, Business Development Manager
Choosing the right data storage options with AWS
![Page 2: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/2.jpg)
Object Storage
Block Storage
Connecting AWS Storage to On-premise
What are we going to cover?
![Page 3: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/3.jpg)
#1Object Storage
●○○
![Page 4: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/4.jpg)
Amazon S3Simple Storage Service
![Page 5: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/5.jpg)
99.999999999%Durability
![Page 6: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/6.jpg)
Over 2 TrillionUnique Customer Objects
![Page 7: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/7.jpg)
Over 1.1 millionPeak Transactions Per Second
![Page 8: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/8.jpg)
Spotify adds over 20,000 tracks a
day.
“Amazon S3 gives us confidence in
our ability to expand storage
quickly while also providing high data durability.”
Emil Fredriksson, operations director
Case S
tudy
![Page 9: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/9.jpg)
Amazon S3Store objects from 1 byte to 5 terabytes
Uses standards based REST and SOAP protocols
Highly durable, fully managed
Designed to make web-scale computing easier
Amazon S3 - Unlimited Storage
![Page 10: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/10.jpg)
Amazon S3 WebsitesEasily handle peak loads at low cost
Pay as you go pricing
Inexpensive and Highly Scalable web hosting
Static Website Hosting
![Page 11: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/11.jpg)
Real Clear Politics served up
to 20x normal demand with S3
Websites
Case S
tudy
![Page 12: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/12.jpg)
CloudFrontPay as you go pricing with no long term
commitments
Caches content closer to your users to
lower latency and better performance
Integrated low latency content distribution network
Deliver content with lower latency with CloudFront
![Page 13: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/13.jpg)
Storage costs as low as 5½ cents per GB
![Page 14: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/14.jpg)
USE AMAZON S3WHEN YOU NEED:
High Durability
Unlimited Storage Capacity
High Scale
High Volume Static Websites
Delivery via CloudFront
![Page 15: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/15.jpg)
Amazon GlacierLow-Cost Archiving Service
![Page 16: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/16.jpg)
1¢Per GB / Month
![Page 17: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/17.jpg)
$125Per TB / Year
![Page 18: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/18.jpg)
99.999999999%Durability
![Page 19: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/19.jpg)
3-5 HoursData Retrieval
![Page 20: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/20.jpg)
Storage Costsvs
Retrieval Costs
![Page 21: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/21.jpg)
Lifecycle PoliciesCreate rules on object prefix
Create rules to also delete expired object
Automatically tier S3 data in Glacier
Using Lifecycle policies to move data
![Page 22: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/22.jpg)
Riverbed WhitewaterEliminates the burden of tape
Improve DR
Additional layer of security
Reduce storage requirements by 10 to 30x
A physical device can manage integration with Glacier
3rd Party Solution integration with Glacier
![Page 23: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/23.jpg)
Their use of S3, Glacier and
CloudFront gives them more time to
concentrate on their business,
rather than worrying about the hardware
![Page 24: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/24.jpg)
#2Block Storage
○●○
![Page 25: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/25.jpg)
Amazon EBSElastic Block Store
![Page 26: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/26.jpg)
Ephemeral storage is on every EC2 instance
![Page 27: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/27.jpg)
Amazon EBSParticularly suited for applications that require
a database, file system, or access to raw block
level storage.
Can be attached to a running instance
Network attached persistent block level storage volumes
EBS Drives can be moved between instances
![Page 28: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/28.jpg)
How do our customers use EBS?
Enterprises
Enterprise workloads are built
on block storageOracle, SAP,
Microsoft
Gaming customers
Very high performance
databases.500,000 IOPS for a new game launch
Social Network /
Mobile Apps
Very high performance and consistent I/O for
NoSQL and relational DBs
Marketing / Analytics
High performance I/O databases
![Page 29: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/29.jpg)
Multiple drives on one Amazon EC2 instance
![Page 30: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/30.jpg)
10GB Ú 1TB
![Page 31: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/31.jpg)
Provisioned IOPSAmazon EBS
![Page 32: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/32.jpg)
Provisioned IOPSP-IOPS is designed to run transactional
applications that require high and
consistent I/O
Workloads on Provisioned IOPs
Use Cases
Relational Databases
NoSQL Databases (eg MongoDB)
High Performance File Systems
Enterprise Workloads (eg CRM, MS Exchange, ERP)
![Page 33: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/33.jpg)
Provisioned IOPS- For steady I/O use Provisioned IOPS
- For bursty I/O, run the numbers
Optimized for price/performance
![Page 34: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/34.jpg)
EBS SnapshotsAmazon EBS
![Page 35: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/35.jpg)
EBS Snapshots- Snapshots from EBS are stored in Amazon
S3- Rollback to a previous version- Can be copied between regions
EBS Snapshots – Stored in Amazon S3
![Page 36: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/36.jpg)
USE AMAZON EBSWHEN YOU NEED:
Filesystem for an instanceNTFS, ExtFS, RAID, LVM…
Long-term persistent storage
Data changes frequently
Access to raw, unformatted block-level storage
![Page 37: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/37.jpg)
#3Connecting AWS Storage to On-
Premise Environments○○●
![Page 38: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/38.jpg)
AWS Storage GatewayConnecting with on-premise
![Page 39: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/39.jpg)
AWS Storage Gateway- Low latency access to frequently accessed data- Minimise the need to scale out on-premise
storage- Snapshots allow access to old data
Up to 150TBs supported from a single Storage Gateway
Extend your on-premise storage
![Page 40: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/40.jpg)
USE AWS STORAGE GATEWAYWHEN YOU NEED:
Synchronize data for disaster recovery
Departmental fileshare
Backup your data
![Page 41: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/41.jpg)
Oracle Secure Backup Module
![Page 42: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/42.jpg)
Oracle Secure Backup (OSB) Cloud
Module allows customers to backup
Oracle Databases directly to Amazon S3
using the Oracle Recovery Manager
(RMAN)
Backup Oracle into Amazon S3
![Page 43: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/43.jpg)
Restore times reduced from 15
to 2½ hours
Took less that 1 hour to configure
per database
Offered significant improvements in
durability of backups
Case S
tudy
![Page 44: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/44.jpg)
IT’S ALL ABOUT
CHOICEPERFORMANCE-ORIENTED
COST-ORIENTED
![Page 45: AWS Summit Berlin 2013 - Choosing the right data storage options with AWS](https://reader030.vdocuments.net/reader030/viewer/2022032514/55d50ec6bb61ebd61a8b4626/html5/thumbnails/45.jpg)
Thank You