building cloudy apps

April 16, 2013

Building “Cloudy” Apps

OpenStack Summit April 2013 - Portland, Oregon

1

1Tuesday, April 30, 13

RACKSPACE® HOSTING | WWW.RACKSPACE.COM

The End

2

1

2

Enable Scaling

Expect Failure



Know Your Audience

• How many of you are attending your first OpenStack Summit?• How many of you have attended a Rackspace Training class before?• How many of you know which track this talk is listed under?• How many of you are just getting started with OpenStack?• How many of you are Developers?• How many of you are Operators?• How many of you are both?• How many of you are neither?• How many of you consider yourself to be technical?• How many of you have access to a working OpenStack Cluster?• How many of you know what OpenStack is?• How many of you know which projects make up OpenStack?• How many of you have ever written a production application for the cloud?• How many of you remember the end of my talk?

3



Know Your Speaker

4

Tony CampbellDirector of Training and Certification

training.rackspace.com

www.rackertalent.com

@CloudTrainMe

tonycampbell


http://www.rackertalent.com



Know Your Speaker

5

Broadcast Communications / English / Theater

Sun Microsystems

eCommerce in 1997

Hitachi Data Systems

eBenefits Start Up

Rackspace



Know Your Speaker

6

Rackspace (The last 10 years)

Web Development - Rackspace.com

Software Development - MyRackspace

The “Original” Rackspace Cloud - Mosso

Rackspace Private Cloud and OpenStack

Software Development



My Happy Place

7


Hardware Management



Before the CloudThrowback Applications

8



Once upon a time

9

Writing Apps that Users Used

Application



Once upon a time

10

Developers wrote applications

Data Access Layer

Services Layer

Presentation Layer



Once upon a time

11


Data Access Layer

Services Layer

Presentation Layer

Database



Once upon a time

12


Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1



Once upon a time

13


Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1



Once upon a time

14


Data Access Layer

Services Layer

Presentation Layer

Physical Machine 1

Database

Database Server 1



Once upon a time

15


Data Access Layer

Services Layer

Presentation Layer

Physical Machine 1

Database

Database Server 1



Once upon a time

16


Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 2

Database Server 1

Load Balancer



Once upon a time

17


Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 2

Database Server 1

Load Balancer


Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 2

Database Server 1

Load Balancer

Database

Replicated Database


Once upon a time

18



Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 2

Database Server 1

Load Balancer

Database

Replicated Database


Once upon a time

19

The Cost of Success


Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 2

Database Server 1

Load Balancer 1

Database

Replicated Database

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 3


Once upon a time

20

The Cost of Success

Physical Machine X

Physical Machine X

Physical Machine X

Just in Case



Once upon a time

21

HA Networking

Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 2

Database Server 1

Load Balancer 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 3

Load Balancer 2

Firewall 1 Firewall 2

Database

Replicated Database



Once upon a time

22

Datacenter 1

Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 2

Database Server 1

Load Balancer 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 3

Load Balancer 2


Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 2

Database Server 1

Load Balancer 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 3

Load Balancer 2


Datacenter 2



Once upon a time - Failure Scenarios

23


Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 2

Database Server 1

Load Balancer 1

Database

Replicated Database

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 3



24

Dealing with Failure


Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 2

Database Server 1

Load Balancer 1

Database

Replicated Database

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 3



25



Data Access Layer

Services Layer

Presentation Layer

Database

Physical Machine 1

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 2

Database Server 1

Load Balancer 1

Database

Replicated Database

Data Access Layer

Services Layer

Presentation Layer

Physical Machine 3



26




OpenStack in 60 SecondsBut who’s counting?

27



My Happy Place

28


Hardware Management



OpenStack in 60* seconds

29

* I reserve the right to take more than 60 seconds

Software

Hardware



OpenStack in 60* seconds

• Cracking the code (names)– Nova– Swift– Glance– Keystone– Horizon– Cinder– Quantum

30

* I reserve the right to take more than 60 seconds



Make It “Cloudy”

31



The End

32

1

2

Enable Scaling

Expect Failure



The Questions

33

1

2

How is my application going to handle success?

How is my application going to handle failure?



The Benefits

34

Cloud can provide powerful options for scaling your application

Cloud can help your application handle failure elegantly

1

2



The Benefits !instant

35

! = Scale &Fault

Tolerance+My Application



Cloud Enable Your App

36

Cloud Enabled ApplicationMy Application



Horizontal ScalingDon’t buy a bigger box, just get more boxes

37



Scaling in a Cloud World

38

Vertical Horizontal

BigBiggerBiggest

Super Big

Instance Instance InstanceInstance Instance






ComponentizedBreak your app into components

39



“Componentize” your application

40

Identify your Node Types

WebServerNode

ServiceNode

Data Node

Running the web serverMay leverage a web frameworkServes the user interface

Only accessible by the web server nodesSpecialized to deliver discrete functionalityStateless and autonomous

Interacts with the datastoreRead only from the web server nodesRead / Write from the service nodes



“Componentize” your application

41

Identify your Node Types

ServiceNode

Only accessible by the web server nodesSpecialized to deliver discrete functionalityStateless and autonomous

RegistrationServiceNode

BillingServiceNode

IdeaServiceNode

AuthServiceNode

ReportServiceNode

AdminServiceNode

Service Oriented Architecture



How you “Componentize” your application will

determine how you scale your application

42



Loosely Coupled & AutonomousLets keep it on a need to know basis

43



Loosely Coupled & Autonomous

44


PaymentServiceNode

IdeaServiceNode

AuthServiceNode

ReportServiceNode

AdminServiceNode

Web ServerNode

Web ServerNode

Web ServerNode

NOT!



Loosely Coupled & Autonomous

45


PaymentServiceNode

IdeaServiceNode

AuthServiceNode

ReportServiceNode

AdminServiceNode

Queueing System

WebServiceNode

WebServiceNode

WebServiceNode



Stateless NodesNot necessarily a stateless application

46



Stateless Nodes

47

Views

Services

Model

Database

StateData

Controller

Views

PresentationServices

Controller

ApplicationServices

Data Services

DatabaseStateData



Persistent StorageWhere does all my data live?

48



Persistent Storage

49

RelationalDB

NoSQLDB

BlockStorage

ObjectStorage

Cache



ImagesThe key to being scale ready

50



Images

51

Web NodeImage

Service NodeImage

Data StoreImage

Machine Type+ Web Node=

Machine Type+ =

Machine Type+ = Data Node

Service Node



Smart ScalingIt’s Alive!

52



Auto-Scaling

53

Monitoring

Cloud Load Balancer

Web ServerNode

Web ServerNode

Web ServerNode

Queueing System

Service Node

Service Node

Service Node

Service Node

Database

Database

Database

Database

Web ServerNode

Service Node

Web ServerNode



Cost-ScalingCloud Load

Balancer

Web ServerNode

Web ServerNode

Web ServerNode

Queueing System

Service Node

Service Node

Database

Database

Database

Database

Service Node

Service Node

Web ServerNode

Web ServerNode

Service Node

Service Node



Failure RecoveryExpect Failure and Code For It

55



Auto-Recovery

56

Cloud Load Balancer

Web ServerNode

Web ServerNode

Web ServerNode

Queueing System

Service Node

Service Node

Service Node

Service Node

Database

Database

Database

Database

Monitoring

Web ServerNode



The End

57

1

2

Enable Scaling

Expect Failure



Questions

58





www.rackertalent.com

59

We’re Hiring

We’re Training

training.rackspace.com




61


building cloudy apps

Documents

rackspace hosting

rackspace training class

working openstack cluster

databasedatabase server

hitachi data systemsebenefits

users usedapplication9tuesday

time9writing apps

production application