session 58 - cloud computing, virtualisation and the future

AakeEdlund,PhDKTH,Sweden

Bal1cGrid(ProjectDirector)

Bal1cGridInnova1onLabandBal1cCloud(Ini1ator,Manager)

PawnPromo1on(CEO),Numeri(Co‐founder)

Cloudcompu0ng,Virtualisa0on&theFuture


Paradigmchange

“Cloudcompu1ngistheabilitytomigratethecomputa1onthatusedtohappenattheedgesintothenetwork..”

RandyHKatz,BerkeleyRADLabs Seeberkeleyclouds.blogspot.com

July17,2009 2ISSGC09‐SophiaAn1polis


Paradigmchange

“Free up the relationship between software and hardware and

a whole new industry is born”

AlanWilliamson www.aw20.co.uk



CloudvsGrid

Google Trends, 1st of July 2009 July17,2009 4ISSGC09‐SophiaAn1polis


CloudCompu0ng–shortversion

Cloud = Virtualization + Automation 1. The cloud is IT infrastructure as a service. 2. The IT infrastructure is delivered as virtual machines. 3. Automation moves those VMs around, thereby providing the delivery mechanism for the service.

Rachel Chalmers, 451 group, October 20th, 2008 July17,2009 5ISSGC09‐SophiaAn1polis


Virtualisa0on‐abstrac0onofcomputerresources

“Notphysicallyexis1ngassuchbutmadebyso^waretoappeartodoso”



PlaBormvirtualiza0on–Separatesanopera1ngsystemfromtheunderlyingplaaormresources

Encapsula0on‐Thehidingofresourcecomplexitybythecrea1onofasimplifiedinterface




Storagevirtualiza0on‐Theprocessofcompletelyabstrac1nglogicalstoragefromphysicalstorage

Networkvirtualiza0on‐Crea1onofavirtualisednetworkaddressingspacewithinoracrossnetworksubnets




Computerclusters,gridcompu1ng,andcloudcompu1ng‐thecombina1onofmul1plediscretecomputersintolargermetacomputers

Applica0onvirtualiza0on‐Thehos1ngofindividualapplica1onsonalienhardware/so^ware




Virtualisa0on–why?

Hardwareisunderu1lized–Moore’s lawDatacentersrunoutofspaceEconomyandEnvironment–EnergycostexplosionSystemadministra1oncost…



Servervirtualisa0onisgeHngcri0cal–we’rerunningoutofroominourdatacenters



Threemainstrategies

OSvirtualisa1onHardwareemula1onParavirtualisa1on


OSvirtualisa0on


Virtualenvironment1

Applica1onso^ware

Systemso^ware

Systemlibraries

Virtualenvironment2

Applica1onso^ware

Systemso^ware

Systemlibraries

Virtualenvironment3

Applica1onso^ware

Systemso^ware

Systemlibraries

Hardware

Network

OS|ContainerVirtualisa1onLayer

HostOpera1ngSystem

Installedandrunsontopofanexis1nghostOS,andprovidesasetoflibrariesthatapplica1onsinteractwith.

Efficient,imposesliileoverhead,manycontainersononepieceofHWpossible.

OnlyoneOS,sameashostOS.

GoodforlargenumberofhomogeneousOS,e.g.webhos1ng.


x86Architecture

Applica1on

OS

Applica1on

OS

CPU,Memory,NIC,Disk

CPU,Memory,NIC,Disk

VMwareVirtualisa1onLayer

OSinstalledonavirtualmachinethatemulatesthehardwarethattheOSusuallyinteractwith.VVMcoordinatesaccessbetweenguestVMsandtheactualunderlyinghardware–inrun1me.

UnmodifiedguestOSes.SupportsdissimilarOSes.

Performancepenalty.

Devicedriverissues/inflexibility:couldlimittheusability.

Hardwareemula0on

Paravirtualisa0on


Hardware

XenHypervisor

XenHypercallAPI

XenToolStack

DeviceDrivers

GuestOS

GuestOS

Does not create an entire VM to host the guest OS, rather enables the guest OS to interact directly with the hypervisor.

Less performance overhead.

Uses the device drivers contained in one of the guest operating systems – i.e. not limited to the drivers (as in hardware emulation) contained in the virtualisation software.


CloudCompu0ng–shortversion

Cloud = Virtualization + Automation 1. The cloud is IT infrastructure as a service. 2. The IT infrastructure is delivered as virtual machines. 3. Automation moves those VMs around, thereby providing the delivery mechanism for the service.

Rachel Chalmers, 451 group, October 20th, 2008

Again:


“Cloud Computing refers to both the applications delivered as services over the Internet and the hardware and systems software in the datacenters that provide those services…

The datacenter hardware and software is what we will call a Cloud…

Cloud computing has the following characteristics

1. The illusion of infinite computing resources..

2. The elimination of an up-front commitment by Cloud users..

3. The ability to pay for use … as needed…”

UC Berkeley RAD Labs July17,2009 17ISSGC09‐SophiaAn1polis

CloudCompu0ng–longerversion

Cloudcompu0ng–oncemore…

1. The illusion of infinite computing resources..

2. The elimination of an up-front commitment by Cloud users..

3. The ability to pay for use … as needed…”


a) Signup for an AWS account

Use your existing Amazon.com account if you want b) Register a credit card

Billed on the 1st of every month for usage prior

c) http://aws.amazon.com/ec2

SpectrumofClouds

•  Instruction Set VM (Amazon EC2) •  Bytecode VM (Microsoft Azure) •  Framework VM (Google App Engine)

EC2 Azure AppEngine

Lower-level, Less management

Higher-level, More management

Automatic scalability and failover July17,2009 19ISSGC09‐SophiaAn1polis

Twoviews‐ofthesamething

On the right, Sam Johnston’s 6 layer Cloud Computing Stack http://samj.net/2008/09/taxonomy-6-layer-cloud-computing-stack.html July17,2009 20ISSGC09‐SophiaAn1polis

‐Provisioningofcompu0ngresources:CPU,Memory,Processing‐Basicallyan“Opera0ngSystem”ondemand‐Usuallybilledonaper‐hourusagemodel

PlayersinthisspaceAmazonEC2,Flexiscale,GoGrid,Joyent,AppNexeusManagementproviders:RightScale,Elas0cServer

Opera0onalDifferences‐WildlydifferentCPU/Memoryspecs‐Opera0ngSystemdifferences‐Difficult/Impossibletomovewholeimagesbetweenproviders

Layer1:CloudInfrastructure


- Provisioning of data storage: Either file/object based or Database like functionality. - Billed on bandwidth and storage consumed

Players in the space: Amazon S3, Nirvanix, Mosso, Amazon’s SimpleDB, Google’s BigTable, Azure Storage Management Providers: Jungle Disk, Elephant Disk, PutPlace.com

Issues - Different types of data storage models - Limitations on the size of individual data units - Different billing models makes it hard to do a straight comparison - Access to the data generally uses non-standard query syntax - No common API - Performance issues

Layer2:CloudStorage


Provides a complete software stack - An IDE for the cloud Takes care of: Runtimes, Load balancing, Resource provisioning

Players in the space - Google App Engine - Python (initially, now also Java) - Force.com (SalesForce) - Microsoft’s Azure - .NET - Heroku.com (RubyOnRails)

Issues Different languages -- Most platforms are unary Different operational philosophies - Google App Engine for example doesn’t permit files

Lots of limitations in terms of deployment Completely reliant on the provider for complete uptime and operation Widely different billing models

Layer3:CloudPlaBorm


- Applications that are completely ‘online’ - Operate on data that is stored in the ‘cloud’ or ‘ether’ - No client software generally required - Billing: Ad. Revenue, Premium Services

Players in this space - Google Apps - Gmail / Google Docs - Apple’s MobileMe - Microsoft’s Live - Hotmail, Live Spaces - SalesForce.com

Issues - Near on impossible to move between providers - GMail to Hotmail requires major disruption - End user focused o  Consumer side of cloud computing

- Completely reliant on the provider for complete uptime and operation

Layer4:CloudApplica0ons


- Provides services to which other applications can utilise - Specific to vertical markets where most “Web2.0” standards live - Usually free for non-commercial use

Players in the space - Google/Yahoo Maps - PayPal / Google Checkout - Google / Yahoo WebServices - Amazon Merchant Services - Amazon Simple Queue Service

Issues/Comments - Some “Web2.0” services have attempted a standardization path - Most however are complete vendor lock-in - Mashup applications utilize Cloud Service

Layer5:CloudServices


- Accessing the cloud - Clients utilize standard access protocols o  XML o  JSON o  REST / SOAP

Browsers o  FireFox / IE / Chrome Mobile clients o  Google Android / Symbian / iPhone / J2ME Desktop Apps o  Google Gears / Adobe AIR / Microsoft Azure

Layer6:CloudClients


Infrastructure

Storage

Platform

Applications

Services

Clients

Increasing level of

complexity and

vendor lock-in

ComplexityandVendorlock‐in


Vendorlock‐in,ortherisk/benefitdance

There are alternatives to Amazon, and the list is growing

Many pricing models are confusing and unclear, and hard to compare

Many pricing models will change (and are already)

Important to get the big picture of what you need, today and later on

Vendor locking is definitely a problem to address. Before you jump into it. But this is always true


CloudStorageCalculator

29

hip://www.aw20.co.uk/tools/storagecosts.cfm

July17,2009 ISSGC09‐SophiaAn1polis

Butisthatthefullstory?

•  Likeanygoodmodelitisonlyvalidforabroadrangeofservices

• Manyservicesspandifferentlayersatonce–  Forexample

•  Amazon/Google/Microso^•  Facebook/MySpace•  YouTube/Flickr•  Ebay

...makingstandardiza1onevenharder30July17,2009 ISSGC09‐SophiaAn1polis

Whynow?Experiencewithverylargedatacenters

Unprecedentedeconomiesofscale

Resource Cost in

Medium DC ≈ 1000 servers

Cost in Very Large DC ≈ 50,000 servers

Ratio

Network $95 / Mbps / month $13 / Mbps / month 7.1x Storage $2.20 / GB / month $0.40 / GB / month 5.7x Administration ≈140 servers/admin >1000 servers/admin 7.1x

Price per KWH Where Possible Reasons Why

3.6¢ Idaho Hydroelectric power; not sent long distance 10.0¢ California Electricity transmitted long distance over the

grid; limited transmission lines in Bay Area; no coal fired electricity allowed in California.

18.0¢ Hawaii Must ship fuel to generate electricity July17,2009 31ISSGC09‐SophiaAn1polis

– PervasivebroadbandInternet– Fastx86virtualiza0onVirtualiza1onmakesitallpossibleVirtualiza1onisnowbuilt‐intomicroprocessors

o  Intel’sVirtualiza1on(IntelVT)o Hardwarebased,veryfast

– Pay‐as‐you‐gobillingmodel– Standardsogwarestack



Why now? Technology is ready

Whynow?Businessdrive–cloudusers

• Flexibility• Eco‐efficiency• Creditcrunchbusinessimpera0ves

‐ CapExtoOpEx–pay‐as‐you‐go‐ Fixedcosttovariablecost

• Improved0metomarket


Unused resources

Paybyuseinsteadofprovisioningforpeak

Static data center Data center in the cloud

Demand

Capacity

Time

Res

ourc

es

Demand

Capacity

Time R

esou

rces



Heavy penalty for under-provisioning

Lost revenue

Lost users

Res

ourc

es

Demand

Capacity

Time (days) 1 2 3

Res

ourc

es

Demand

Capacity

Time (days) 1 2 3

Res

ourc

es

Demand

Capacity

Time (days) 1 2 3



Trends:Howiscloudcompu0ngbeingused?


Trends:Cloudproviders


Thedevilisinthedetails…

Your data in the cloud


Challenge Opportunity Availability Multiple providers & DCs

Data lock-in Standardization

Data Confidentiality and Auditability

Encryption, VLANs, Firewalls; Geographical Data Storage



Adop0onChallenges


GrowthChallenges

Challenge Opportunity Data transfer bottlenecks FedEx-ing disks, Data Backup/

Archival Performance unpredictability

Improved VM support, flash memory, scheduling VMs

Scalable storage Invent scalable store Bugs in large distributed systems

Invent Debugger that relies on Distributed VMs

Scaling quickly Invent Auto-Scaler that relies on ML; Snapshots

Challenge Opportunity Reputation Fate Sharing Offer reputation-guarding

services like those for email Software Licensing Pay-for-use licenses; Bulk

use sales



PolicyandBusinessChallenges

Startupsopportuni0es

•  Startupsandprototyping•  One‐offtasks•  Researchatscale•  CloudKillerApps:Mobileandwebapplica0ons

….moreaboutthisinthe‘Future’sec0on



Bal0cCloudBringingcloudcompu.ngtotheBal.cStatesandBelarus

Bal1cGrid

Plannedac1vi1es

SA1‐3,NA1‐4,JRA

BGi‐Bal1cGridInnova1onLab

Bal1cCloud Courses SMEconnec1vity

BC


Opensource“cloudinabox”

Our (main) choice:

-  Great team! Rich Wolski, UCSB. -  Integrated with -  Integrated with

44

BC


Cloudpilot–spreading

Bal0cCloud+SE+NO+DK+FIN+Iceland+…

45


Almost‐there‐first‐summaryCloud computing is a new way of using existing technology, driven by business value for the whole chain, from the providers to their users and their

user’s users.

At this point in time, cloud computing is best used in startups and prototyping…


from http://geekandpoke.typepad.com July17,2009 47ISSGC09‐SophiaAn1polis

•  See more cloud computing being used by startups and in-house quick prototyping

•  See more cloud computing being used in academia – esp. HPC flavours

•  See more open source alternatives, and alternative cloud providers – also in academia (BalticCloud, SweCloud, NordicCloud)

•  Improved solutions addressing the dangers in cloud computing. •  Low expectations on standard APIs (takes time, not sure about the

interest from industry, looks like for grids). I.e. industry will not help here, this is the competition epicenter.

•  Hype, problems, business issues: Successful usage will prove the value. If it is a paradigm shift, it will be clear this year.

•  Plenty to opportunities for everyone! July17,2009 48ISSGC09‐SophiaAn1polis


Expecta0onson2009


Startupscanberunsocheaplynow(withopen‐sourceso^ware,cloudcompu0ng,andvirtualteamsspreadacrosstheWeb)thatmanymorecanachieveprofitabilitywithoutanyVCcash.

PaulGraham,Ycombinator

Thestartupworldischanging


“ ”


ImaginewhatitwoulddototheVCbusinessifthenexthotcompanydidn’ttakeVCatall.Thelessventurecapitalthereisfornewstartups,thefasterthedecouplingwillbegin

PaulGraham,Ycombinator

Thestartupworldischanging


“ ”


RethinkVCs

IPOmarketisdead&M&Avalua1onsaredepressed

Fundamentalproblem:ITandmarke1nghasbecamesocheapthatVCsmaynotbeneededanymoreAngelstotakecareofearlierstage,VCsmovebackto

laterstagee.g.AllanMar1nson,MTVP


“

”


Cloudcompu0ng+Microstartups=Truelove!

Bootstrapping–morethaneverQuickstart–reallyquick!Newdirec1ons,prototyping,customerprojectsLoweryourowninternalITcostsQuicktostart,agile“VC=VISACard”



Future‐Fortune1M

Our vision is to enable one person to invent and run the next revolutionary IT service, operationally expressing a new business idea as a multi-million-user service over the course of a long weekend. By doing so we hope to enable an Internet "Fortune 1 million”.

RAD Lab, Berkeley

“ ”



EnterMicrostartups!

Thezerocoststartuphasledtotheageofthe“microstartup.”It’snolongertwofolksinagaragehopingtobuildaprototypeinordertolandahugeVCround,thengeAngmillionsofdollarstobuildoutanoffice.Microstartupsaresustainablefromprototypetolaunchandontoacoreuserbase,allforaround$5‐10,000incosts.

Jason(Calacanis.com)

“ ”


STARTUP@BGi

Scalability–Howtobuild–technologyandbusinessaspects

Course‐Learninghowtoleverageoncloudcompu1ngCourse–“Startupschool”

Networking–alumni,investors,excellencecenters,industryMentors–findingandfollowup

Prototypingresources‐thewholeBal1cCloudto“playwith”

Bal0cGridInnova0onLab(BGi)–thestar0ngpointforearlystagestartupsintheBal0cs


STARTUP@BGi

BGiisauniquestar0ngpointformicrostartups

Wanttoknowmore?

[email protected]

Tryit!Youdon’thavetobeintheBal0cs


Acknowledgement and references

Alan Williamson, www.aw20.co.uk Berkeley RAD lab, berkeleyclouds.blogspot.com Baltic Cloud team, cloud.balticgrid.eu Rich Wolski

and his Eucalyptus team, eucalyptus.cs.ucsb.edu Dan Reed, Microsoft,

www.hpcdan.org/reeds_ruminations/microsoft 451 group, www.451group.com July17,2009 57ISSGC09‐SophiaAn1polis

STARTUPSCLOUDS

Links

July17,2009 ISSGC09‐SophiaAn1polis 58

BGiandBal0cCloud:

[email protected]@gmail.comcloud.bal1cgrid.eu Startups, and Microstartups:

www.infochachkie.com blog.guykawasaki.com microstartups.blogspot.com

Clouds: berkeleyclouds.blogspot.com

STARTUP@UT

SCHOOL

Finalslide–yes,youmadeit!


July17,2009 ISSGC09‐SophiaAn1polis 60

Thanks!

session 58 - cloud computing, virtualisation and the future

Education

cloudcompu0ng oncemore1

needed july17

virtualisa0on thefutureagain

ware applica1onso

ware systemlibraries

ware exis1nghostos

hardware anda

hardware emulation