building web 2.0: next-generation data centers

30
Dr. Werner Vogels Chief Technology Officer Amazon.com WebScale Computing Compete on Ideas, Not Resources

Upload: adunne

Post on 16-Jan-2015

5.785 views

Category:

Business


3 download

DESCRIPTION

Speaker: Werner Vogels

TRANSCRIPT

Page 1: Building Web 2.0: Next-Generation Data Centers

Dr. Werner Vogels

Chief Technology Officer

Amazon.com

Web‐Scale ComputingCompete on Ideas, Not Resources

Page 2: Building Web 2.0: Next-Generation Data Centers

Online Retail Business• Over 72 million active customer accounts• Seven countries: US, UK, Germany, Japan, France, Canada, China• World‐Class Logistics – Multiple national fulfillment centers: Over 10 

million ft2

Merchant Business• Over 1.2 million active seller accounts• Fulfillment by  Amazon & Web Store by Amazon• Amazon Enterprise Services

Developer Business• Hundreds of thousands of Amazon Associates• Over 290,000 software developers registered to use Amazon Web 

Services

What is Amazon.com?

Page 3: Building Web 2.0: Next-Generation Data Centers

• Amazon Web Services 

• 290,000 registered developers

• 10 different web service offerings, including:– Amazon Simple Storage Service (Amazon S3)

– Amazon Elastic Compute Cloud (Amazon EC2)

– Amazon Flexible Payments Service (Amazon FPS)

Amazon’s Developer Business

Page 4: Building Web 2.0: Next-Generation Data Centers
Page 5: Building Web 2.0: Next-Generation Data Centers
Page 6: Building Web 2.0: Next-Generation Data Centers
Page 7: Building Web 2.0: Next-Generation Data Centers
Page 8: Building Web 2.0: Next-Generation Data Centers
Page 9: Building Web 2.0: Next-Generation Data Centers
Page 10: Building Web 2.0: Next-Generation Data Centers

Who said oneDatacenteris enough …

Page 11: Building Web 2.0: Next-Generation Data Centers
Page 12: Building Web 2.0: Next-Generation Data Centers
Page 13: Building Web 2.0: Next-Generation Data Centers

The Reliability of Hard Disks

Failure Trends in a Large Disk Drive PopulationEduardo Pinheiro, Wolf-Dietrich Weber and Luiz André Barroso

Page 14: Building Web 2.0: Next-Generation Data Centers

Dream or Nightmare?

• Scale to 100% ‐ 1000% increase popularity?• Provide 4 nines uptime?• Survive a complete datacenter failure?• Survive a router flapping?• While keeping cost low at the same time?

Page 15: Building Web 2.0: Next-Generation Data Centers

Chapter 4: Priorities – Scale Later – It is too hard to get right Chapter 4: Priorities – Scale Later – It is too hard to get right

Page 16: Building Web 2.0: Next-Generation Data Centers
Page 17: Building Web 2.0: Next-Generation Data Centers
Page 18: Building Web 2.0: Next-Generation Data Centers

The 70/30 SwitchThe 70/30 Switch

Page 19: Building Web 2.0: Next-Generation Data Centers

Scalable Infrastructure that allows your applications to meet infinite demand, cheaply and reliably

Scalable Infrastructure that allows your applications to meet infinite demand, cheaply and reliably

Page 20: Building Web 2.0: Next-Generation Data Centers
Page 21: Building Web 2.0: Next-Generation Data Centers
Page 22: Building Web 2.0: Next-Generation Data Centers

Amazon Web Services

22222222

Page 23: Building Web 2.0: Next-Generation Data Centers

Amazon Simple Storage ServiceAmazon S3 is Storage for the Internet

• Scalable– Can store an unlimited number of objects

• Reliable– Redundant across multiple datacenters– Availability SLA

• Fast– Low‐latency access and delivery

• Simple– Easy web services interface for developers

• Inexpensive– Uses Amazon’s cost‐efficient infrastructure 

Page 24: Building Web 2.0: Next-Generation Data Centers

Objects Stored in Amazon S3

5,000,000,000

April 2007

10,000,000,000

October 2007

800,000,000

July 2006

Page 25: Building Web 2.0: Next-Generation Data Centers

Amazon S3 now in Europe!

• Developers can now choose storage in Europe

• Low latency access and delivery to Europe at a very low price

Page 26: Building Web 2.0: Next-Generation Data Centers

Creating a Storage Bucket in EuropePUT / HTTP/1.1Host: mybucket.s3.amazonaws.comContent-Length: 111Date: Mon, 05 Nov 2007 12:00:00 GMTAuthorization: AWS

15B4D3461F177624206A:xQE0diMbLRepdf3YB+FIEXAMPLE=

<CreateBucketConfiguration><LocationConstraint>

EU</LocationConstraint>

</CreateBucketConfiguration>

Page 27: Building Web 2.0: Next-Generation Data Centers

Amazon S3 European Pricing

• StorageUS$ 0.18 per GB‐Month of storage used 

• Data TransferUS$ 0.10 per GB ‐ all data transfer inUS$ 0.18 per GB ‐ first 10 TB / month data transfer outUS$ 0.16 per GB ‐ next 40 TB / month data transfer outUS$ 0.13 per GB ‐ data transfer out / month over 50 TB 

• RequestsUS$ 0.012 per 1,000 PUT or LIST requestsUS$ 0.012 per 10,000 GET and all other requests

Page 28: Building Web 2.0: Next-Generation Data Centers
Page 29: Building Web 2.0: Next-Generation Data Centers

http://aws.amazon.com

Page 30: Building Web 2.0: Next-Generation Data Centers

Web‐scale Computing