A way to fail in the Cloud

1

Rodolfo Kohn

ar.linkedin.com/pub/rodolfo-kohn/0/32/310

Not only the Cloud

• But all Web Systems

– Traditional Datacenters and Web Systems

– Cloud Services and Web Systems

“Traditional” Datacenter

1 .. N Layers

Load

Balancer

Consumer

-Load Balancer

-Firewall

-Content Router

Web Server Web Server Database

-Owned

-Third-party

hosting

-Housing

“Traditional” Datacenter

1 .. N Layers

Load

Balancer

Consumer

-Load Balancer

-Firewall

-Content Router

Web Server Web Server Database

-Vertical scalability -Procurement procedure -Provisioning procedure

-Long Time to install new servers -Manual procedures: Error prone

-Owned

-Third-party

hosting

-Housing

Cloud Computing:

(Compute Capacity) as a Service

• Characteristics in a Nutshell

– Self-service

– On-demand

– Measured/metered access

– Location-independent

– Over the network through standard mechanisms

– Resource pooling and virtualized resources

– Managed operations

– Programmable thru APIs (Automated management)

• Different models: IaaS, PaaS, SaaS

Cloud Computing:

(Compute Capacity) as a Service

The new challenges in the Cloud

Consumer

Competitor

My Web System

Failing to provide

Excellent user experience

Competitor’s

Web System

The new challenges in the Cloud

Consumer

Competitor

If backend system has poor performance or poor scalability, it will affect availability and

user experience.

This will definitely disrupt business.

My Web System

Competitor’s Web

System

Provides required

service

Cloud Applications are Complex: Distributed systems with number of dependencies

9

DNS Server

.com Root

GLB

Auth

Datacenter-1

GLB

Auth

Datacenter-2

3rd party Service

Cache

Cache

Cache

Cache

DNS

Disk

Network

SMTP

CDN

NoSQL

SQL

Monitoring Logs Configuration Management

Cloud Applications are Complex: Multiple Opportunities for Unexpected Failures

10

DNS Server

.com Root

GLB

Auth

Datacenter-1

GLB

Auth

Datacenter-2

3rd party Service

Cache

Cache

Cache

Cache

DNS

Disk

Network

SMTP

CDN

NoSQL

SQL

Monitoring Logs Configuration Management

Cloud Applications are Complex: Failure to keep responsive upon traffic peak

11

DNS Server

.com Root

GLB

Auth

Datacenter-1

GLB

Auth

Datacenter-2

3rd party Service

Cache

Cache

Cache

Cache

DNS

Disk

Network

SMTP

CDN

NoSQL

SQL

Monitoring Logs Configuration Management

Load bursts &

Response time

deterioration

Images of Cyber Monday in Argentina 2013

12

http://softwareargentino.wordpress.com/2013/12/05/cyber-monday-en-argentina/

Numbers of Cyber Monday 2013 and Hot Sale

event 2013 in Argentina • Cyber Monday

– 1200% growth in amount of sold products compared with Cyber

Monday 2012

– 600% more than a regular day

– More than158000 products sold

– More than 13M de visits in participant web sites Source: Survey from Camara Argentina de Comercio Electronico y OH!Panel

http://www.infobae.com/2013/12/10/1529873-las-ventas-el-cyber-monday-argentino-crecieron-1200

• Hot Sale

• 62% growth in visits

• 214% increment in purchases comparing with Cyber

Monday Source: http://www.infobae.com/2014/05/21/1566456-que-rubros-lograron-el-mayor-exito-el-hot-sale

Numbers of Cyber Monday 2013 in USA

• Consumers spent more than U$S 2.25B

• Cyber Monday represents an average increment of 55%

in daily retail revenue online/mobile Source: http://blog.smartbear.com/news/cyber-monday-2013-recap-

infographic/?imm_mid=0b45f6&cmp=em-velocity-na-na-newsltr_fl14_olc_20131205_elist

Consumer Experience During Peak Traffic Times

• Study from Equation’s Research* commissioned by

Compuware*

• Customers spend big during peak traffic times – 51% spend a significant percentage of their retail budget

• Poor experiences during peak traffic times directly impact

business results – 78% went to a competitor’s site due to poor performance

• After a poor experience: – 88% are less likely to return to a web site

– 47% left with a negative perception of the company

– 42% discussed it either with friends or online Source: http://www.gomez.com/wp-content/downloads/when-more-website-visitors-hurt-your-business-are-you-ready-for-peak-traffic.pdf

Static capacity in traditional computing

Cost &

Cap

acity

time

Waste

(over capacity)

Not enough capacity

(under capacity)

Predicted usage

Actual usage

• Poor experiences during peak traffic times directly impact business

results http://www.gomez.com/wp-content/downloads/when-more-website-visitors-hurt-your-business-are-you-ready-for-peak-traffic.pdf An elastic, on-demand, and affordable computing model is

required

Cloud Services Architecture

Applications

Front

End

Data

Cache

Server

Time Load &

Infr

astr

uctu

re C

ost

Cloud Services Architecture

Applications

Front

End

Data

Cache

Server

Load

Balancer

Front

End

Applications

Time Load &

Infr

astr

uctu

re C

ost

Load

Balancer

Cloud Services Architecture

Applications

Front

End

Data

Cache

Server

Load

Balancer

Front

End

Applications Applications App

Cache

Server

App

Data

Time Load &

Infr

astr

uctu

re C

ost

Front

End

Load

Balancer

Load

Balancer

Important aspects of cloud-based apps

Source: Cloud Development Survey 2011: Volume I, Evans Data Corp.

• New software architectures

– REST API’s

– Reliability, High Availability, Scalability, High Performance

– Security

• Development

– Lean and agile development

– Continuous Performance, Scalability and Availability tests

– PEN test

• Operations

– DevOps

– Full Automation

– Continuous API monitoring

Key Consequences for Product,

Development, and Operations

21