cost-beneﬁt analysis of cloud computing versus desktop...

Cost-Benefit Analysis of Cloud Computing versus

Desktop Grids

Derrick Kondo, Bahman Javadi, Paul Malécot, Franck CappelloINRIA, France

David P. AndersonUC Berkeley, USA

Cloud Background• Vision

• Hide complexity of hardware and software management from a user by offering computing as a service

• Benefits

• Pay as you go

• Scale up or down dynamically

• No hardware management, less software management

Platform Performance vs. CostsC

ost

Performance

low

low

high

high


ost

Performance

Cluster

Grid

Supercomputer

low

low

high

high


ost

Performance

Cluster

Grid

Supercomputer

low

low

high

high

Desktop Grids (DG)


ost

Performance

Cluster

Grid

Supercomputer

low

low

high

high

Desktop Grids (DG)

CloudWhat is the relationship?


ost

Performance

Cluster

Grid

Supercomputer

low

low

high

high

Desktop Grids (DG)

CloudWhat is the relationship?

DG + Cloud?

Outline

• Performance tradeoffs

• Monetary tradeoffs

• Client hosting

• Server hosting

Apples to Apples

Loosely-coupled,high-throughput,

compute-intensive applications

Tightly-coupled,data-intensive

real-time applications

low complexity high complexity

Apples to Apples






DG’s

Apples to Apples






DG’s

Clouds

Apples to Apples






DG’s

Clouds

Comparison assuming embarrassingly parallel, compute-intensive applications

Method

• Use real performance measurements

• Exported BOINC (middleware for desktop grids) project data

• Use real costs

• Large/small BOINC projects (SETI@home / XtremLab)

• Amazon Elastic Computing Cloud (EC2)

Stages of Project & Application

Platform Construction



Application Deployment




Application Execution





Application Completion





How long before I get X TeraFLOPS?






0 5 10 15 20 25 3010

3

104

105

106

Months for registration

Num

ber

of clo

ud n

odes

0 5 10 15 20 25 30

101

102

103

Tera

FLO

PS






0 5 10 15 20 25 3010

3

104

105

106


Num

ber

of clo

ud n

odes

0 5 10 15 20 25 30

101

102

103

Tera

FLO

PS

Can get over 20 TeraFLOPSwithin 6 months






0 5 10 15 20 25 3010

3

104

105

106


Num

ber

of clo

ud n

odes

0 5 10 15 20 25 30

101

102

103

Tera

FLO

PS

Can get over 20 TeraFLOPSwithin 6 months

Strategy:Add to BOINC project list

Press releasesForum Announcements

Google Ad SenseRespond to users (leverage

volunteers)





How long to deploy my batch of tasks

needingfaster response time?







!"#

!"$

!"%

!"!!

!""

!"!

!"&

!"'

()*+,-./0.1/2)34,,-.3/5,6

7,82/9*,34.4:*,.;*:3)4,6<

.

.

!"".4=6>6

!""".4=6>6

!"""".4=6>6







!"#

!"$

!"%

!"!!

!""

!"!

!"&

!"'

()*+,-./0.1/2)34,,-.3/5,6

7,82/9*,34.4:*,.;*:3)4,6<

.

.

!"".4=6>6

!""".4=6>6

!"""".4=6>6

For 1000 tasks,~10 minutes with 105 hosts







!"#

!"$

!"%

!"!!

!""

!"!

!"&

!"'

()*+,-./0.1/2)34,,-.3/5,6

7,82/9*,34.4:*,.;*:3)4,6<

.

.

!"".4=6>6

!""".4=6>6

!"""".4=6>6

For 1000 tasks,~10 minutes with 105 hosts

Strategy:Specify lower

latency bounds[Heien et al.]





How many volunteer nodes

are equivalent to 1 cloud node?







2.8 active volunteer hosts per 1 cloud node.

(Total performance stillorders of magnitude better)







2.8 active volunteer hosts per 1 cloud node.

(Total performance stillorders of magnitude better)

Strategy:Use statistical prediction of

availability





How long should I wait

for task completion?







Median project latency bound: 9 days for 3.7 hour work unit (on 3GHz host).

Ratio of lat. bound / exec time > 5.Good success rates: 96.1%

of WCG tasks met out of 227,000 tasks







Strategy:See BOINC Catalog for

typical deadlines and compute/comm/mem ratios.

Median project latency bound: 9 days for 3.7 hour work unit (on 3GHz host).

Ratio of lat. bound / exec time > 5.Good success rates: 96.1%

of WCG tasks met out of 227,000 tasks

Monetary Tradeoffs

• Client hosting on cloud

• Not worth it and never will

• Server hosting on the cloud

• Possible solution

Monthly Project Costs

EC2 Pricing

What about Client Hosting on the Cloud?

Cost of Clouds versus DG

How long until DG’s more cost

effective than Clouds?


! " #! #" $! $" %!#!

!#&

#!!#"

#!!#'

#!!#%

#!!#$

#!!##

()*+,-./01,/230456

7,8./9,)/:;<(

/

/=.),>;0?

@ABCDE*>,

A7$F#'!'/G*HI8.,,)/8*3,52'J&/-H*I3/8*3,56

'"&$/G*HI8.,,)/8*3,52#&#$/-H*I3/8*3,56




! " #! #" $! $" %!#!

!#&

#!!#"

#!!#'

#!!#%

#!!#$

#!!##

()*+,-./01,/230456

7,8./9,)/:;<(

/

/=.),>;0?

@ABCDE*>,

A7$F#'!'/G*HI8.,,)/8*3,52'J&/-H*I3/8*3,56

'"&$/G*HI8.,,)/8*3,52#&#$/-H*I3/8*3,56



After ~13 days

What are total costsover time?

Cost of Clouds versus DG (2)

0 5 10 15 200

1

2

3

4

5

6

7

8x 10

4

Platform age (days)

To

tal co

st

EC2 100n

EC2 1000n

EC2 10000n

XtremLab

SETI@home



0 5 10 15 200

1

2

3

4

5

6

7

8x 10

4

Platform age (days)

To

tal co

st

EC2 100n

EC2 1000n

EC2 10000n

XtremLab

SETI@home



After 3 days, DGis cheaper


How many months of DG can

X months of Cloud buy me?

0 5 10 15 20 250

500

1000

1500

2000

2500

3000

3500

Months with EC2

Mo

nth

s w

ith

VC

Xtremlab / 1000n EC2

SETI@home / 1000n EC2






0 5 10 15 20 250

500

1000

1500

2000

2500

3000

3500

Months with EC2

Mo

nth

s w

ith

VC








12 months of Cloudcan pay for > 125 DG years.

DG way more sustainable.

Equivalent Clouds given BOINC Costs

Given BOINC costs, what size Cloud can I buy?



1.75 TeraFLOPS,7 TeraBytes

.75 TeraFLOPS,3 TeraBytes



2 ordersof magnitude

lower than BOINC

1.75 TeraFLOPS,7 TeraBytes

.75 TeraFLOPS,3 TeraBytes

What about Server Hosting on the Cloud?

Number of Hosts over Time

Number of Hosts over Time

Load variation exits w/ publicity, projects run out

of work, etc.Clouds take care

of server management.Potential to

exploit clouds.

Server Costs on a Cloud

How much to host BOINC server on cloud?



(versus 43K +12K/month) (versus {4,1}K + {5,1}K/month)


1.7 - 16.5 times cheaper to host on Cloud,

but bandwidth is expensive.


(versus 43K +12K/month) (versus {4,1}K + {5,1}K/month)

Cloud Resources with Given Budget

How big of a server can I support with given budget?



4 Mbps, 2 TB 12 Mbps, 2 TB


Many project servers are sustainable on the cloud


4 Mbps, 2 TB 12 Mbps, 2 TB

Summary

Summary• Performance tradeoffs

• 20 DG TeraFLOPS within 6 months




• Client hosting

• After 13 days, DG more cost effective

• Server hosting

• DG server on cloud is cost-effective

• Best for small-medium sized projects

• Savings of at least 40%

• http://mescal.imag.fr/membres/derrick.kondo/cloud_calc.xlsx




• Client hosting

• After 13 days, DG more cost effective

• Server hosting

• DG server on cloud is cost-effective

• Best for small-medium sized projects

• Savings of at least 40%

• http://mescal.imag.fr/membres/derrick.kondo/cloud_calc.xlsx

• BOINC server image for EC2 / Xen available

• http://boinc.berkeley.edu/trac/wiki/CloudServer

Future Work

• Clouds@home

• Statistical and predictive methods for ensuring host availability

• Lightweight mechanisms for virtual machine migration

• wu flop calc

• bw in cloud

• how is cloud equiv calculated

cost-beneﬁt analysis of cloud computing versus desktop...

Documents