chinanetcoud - cloud architecture - qcon oct 2014

77
OaaS – Operations as a Service www.ChinaNetCloud.com Copyright © 2014 ChinaNetCloud Build & Manage Servers Optimize & Manage Servers Managed Cloud Servers Running the World’s Internet Servers Cloud Systems Architecture & Issues By Steve Mushero October, 2014 International Software Development Conference Shanghai 2014

Upload: china-netcloud

Post on 07-Jul-2015

137 views

Category:

Internet


0 download

DESCRIPTION

ChinaNetCloud presentation about Cloud Architecture, on what developers should think about when building cloud-based Internet apps, games, and more. Video of Steve giving the presentation is on Youtube at: https://www.youtube.com/watch?v=nsUy3B40JB4&feature=youtu.be Given at Qcon's Developer Conference in Shanghai, China in October, 2014 by Steve Mushero.

TRANSCRIPT

Page 1: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.comCopyright © 2014 ChinaNetCloudBuild & Manage Servers Optimize & Manage Servers Managed Cloud Servers

Running the World’s Internet Servers

Cloud SystemsArchitecture & Issues

By Steve MusheroOctober, 2014

International Software

Development ConferenceShanghai 2014

Page 2: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Hi – I’m Steve

Page 3: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Welcome to the cloud !

Page 4: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

This is great, I think

Page 5: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

This is great, I think

Page 6: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

My goal is to tell you what I think

Page 7: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Clouds are great

Page 8: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Clouds are great – but can get you in trouble

Page 9: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Clouds are actually more difficult/complex than you think

Page 10: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

So let’s get started talking about clouds

Page 11: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

What is the cloud ?

Page 12: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

We are talking about IaaS / Infrastructure

Page 13: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

This is about how you Design, Build & Deploy on IaaS

Page 14: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Why the cloud ?

Page 15: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Cheap !

Page 16: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

No up-front capital – Pay as you go

Page 17: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Easy to start – Click and compute !

Page 18: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

All true, but . . .

Page 19: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Not that important

Page 20: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

It’s important to accountants – that’s not us

Page 21: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

So what is important – to US ?

Page 22: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

#1 – Flexibility – Do what we want, when we want, how we want

Page 23: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

#2 - Dynamic – Handle changing needs over time

Page 24: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

#3 - Service-Oriented Thinking

Page 25: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

#4 - That Scales – Small, big, bigger, huge . . .

Page 26: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Scales, but not in the way you think

Page 27: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Sometimes each service is the same

Page 28: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Sometimes they are not the same

Page 29: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Cloud Design – Think Layers

Page 30: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

A key opportunity is Service Architectures – Separate functions

Page 31: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

But don’t separate too much – No tiny VMs per function

Page 32: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Cloud Design – Think Services

Page 33: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Cloud Design – Think Scale – HORIZONTAL

Page 34: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Cloud Design – Think Scale – Many Small vs. Few Big

Page 35: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Clouds have limits, too

Page 36: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Common Cloud Layers

Page 37: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Load Balancer

Page 38: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Load Balancer

Page 39: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Load Balancer

Page 40: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Load Balancers

AWS ELB

Page 41: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Load Balancers – SSL, TCP, Monitoring, Features

Page 42: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Web Layer

Page 43: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Web – Statics & Proxy for App

Page 44: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Web – Statics & Sharing or S3 ?

OR

Page 45: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Application / Code Layer

Page 46: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Application / Code Layer – Memory vs. CPU

Page 47: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Application / Code Layer – Memory vs. CPU

Out of RAM - Swap

Out of CPU- Thrash

Page 48: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Database Layer

Page 49: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Database Layer – Never enough I/O – RAM is helpful

Page 50: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Database Layer – PIOPS & SSD help

Page 51: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Database Layer – PIOPS & SSD – More IOPS !

Page 52: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Database Layer – RDS (Relational DB Service)

Page 53: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Database Layer – RDS – Limitations

Page 54: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

More cloud layers – Cache

Page 55: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

More cloud layers – Search

Page 56: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

More cloud layers – Search – I/O Again (& RAM)

Page 57: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Unusual Cloud Layers - Queue

Page 58: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Unusual Cloud Layers - Unusual

Page 59: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Special Clouds Issues/Worries

Page 60: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Dependencies

Page 61: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Everything runs at speed of slowest service

Page 62: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Where are the dependencies ?

Page 63: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Big fragile machine

Page 64: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Resource Limits – Hitting the wall

Page 65: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Dynamic Cost – More than you think . . .

Page 66: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Deploying on the Cloud – Often & Easily

Page 67: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Deploying on the Cloud – DevOps & Push Systems are your friend

Page 68: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Mix of Deployment Levels

OS & Config

Services & Config

Code & Config

Page 69: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Deploying on the Cloud – Think Clones

Page 70: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

But careful of Cloud interaction & orchestration

Page 71: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Things don’t always go well – Coordinate & Signal

Page 72: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Page 73: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

Change / improve quickly

Page 74: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

And be flexible

Page 75: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

That’s the Cloud – Good Luck !

Page 76: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com 76

Pioneers in OaaS – Operations as a Service

Thanks from ChinaNetCloud

Page 77: ChinaNetCoud - Cloud Architecture - QCon Oct 2014

OaaS – Operations as a Service www.ChinaNetCloud.com

ChinaNetCloud

[email protected]

www.ChinaNetCloud.com

Beijing Office:

Lee World Business Building #305

57 Happiness Village Road, Chaoyang District

Beijing, 100027 China

Silicon Valley Office:

California Avenue

Palo Alto, 94123 USA

Shanghai Headquarters:

X2 Space 1-601, 1238 Xietu Lu

Shanghai, 200032 China

T: +86-21-6422-1946 F: +86-21-6422-4911