eucalyptus: an open-source infrastructure for cloud computing rich wolski eucalyptus systems inc....

Download Eucalyptus: An Open-source Infrastructure for Cloud Computing Rich Wolski Eucalyptus Systems Inc.

Post on 01-Jan-2016




0 download

Embed Size (px)


  • Eucalyptus: An Open-source Infrastructure for Cloud ComputingRich WolskiEucalyptus Systems

  • Exciting Weather Forecasts

  • Eucalyptus - ConfidentialCommercial Cloud Formation

  • What is a cloud?SLAsWeb ServicesVirtualization

  • Cloudy issuesPublic clouds are opaqueWhat applications will work well in a cloud?Many of the advantages offered by Public Clouds appear useful for on premise ITSelf-service provisioningLegacy supportFlexible resource allocationWhat extensions or modifications are required to support a wider variety of services and applications?Data assimilationMultiplayer gamingMobile devices

  • Open-source Cloud InfrastructureIdea: Develop an open-source, freely available cloud platform for commodity hardware and software environmentsStimulate interest and build community knowledgeQuickly identify useful innovationsAct to dampen the hypeFirst-principles cloud implementationNot a refactorization of previously developed technologyLinux or Anti-Linux?Linux: open-source platform supporting all cloud applications changes the software stack in the data centerAnti-Linux: transparency of the platform makes it clear that clouds do not belong in the data center

  • Whats in a name?Elastic Utility Computing Architecture Linking Your Programs To Useful SystemsWeb services based implementation of elastic/utility/cloud computing infrastructureLinux image hosting ala Amazon How do we know if it is a cloud?Try and emulate an existing cloud: Amazon AWSFunctions as a software overlayExisting installation should not be violated (too much)Focus on installation and maintenanceSystem Administrators are people too.

  • Goals for EucalyptusFoster greater understanding and uptake of cloud computing Provide a vehicle for extending what is known about the utility model of computingExperimentation vehicle prior to buying commercial servicesProvide development, debugging, and tech preview platform for Public CloudsHomogenize local IT environment with Public CloudsAWS functionality locally makes moving using Amazon AWS easier, cheaper, and more sustainableProvide a basic software development platform for the open source communityE.g. the Linux ExperienceNot designed as a replacement technology for AWS or any other Public Cloud service

  • Open-source Cloud AnatomyExtensibilitySimple architecture and open internal APIsClient-side interfaceAmazons AWS interface and functionality (familiar and testable)NetworkingVirtual private network per cloudMust function as an overlay => cannot supplant local networkingSecurityMust be compatible with local security policiesPackaging, installation, maintenancesystem administration staff is an important constituency for uptake

  • Eucalyptus Infestation

  • The EC2 APICreate and terminate virtual machinesCreate == provision and not bootTerminate == destroy and not haltImage initial root file systemInstanceImage + kernel + ramdisk + ephemeral disk + private IP + public IPCreate an image: upload a root file systemRun an instance: launch a VM with a specificImage that has been uploaded (into S3)Kernel and ramdisk that Amazon providesEphemeral disk that gets created and attached

  • The S3 APIBucket store: buckets and objectsBucket: container for objectsObject: unit of storage/retrievalBuckets are Created and DestroyedObject are either Put or GetObject storage is transactionalLast write prevailsEventually consistentObject writes will eventually be propagatedBuckets are access controlled

  • The EBS APIPersistent Storage volumes that can be attached by VMsRaw block devices (must be formatted by owner/user)Persist across VM creation and terminationCannot be shared by multiple VMs simultaneouslyNot accessible across availability zones (virtual data centers)Persistent virtual local disk

  • All Together NowREST/SOAPEC2S3EBSEBSAvailabilityZoneAvailabilityZoneVMVMVMVMVM

  • RDMA and CloudRDMA between hosted Virtual MachinesSockets are the only inter-VM IPC as of todayRequires virtualization support for RDMA for isolationHypervisorslibvirtRDMA in the cloud platform: EBSEBS performance and reliability is criticalCurrent connection is via iSCSI to SAN/JBODRequires authentication interface for RDMAAlso requires virtualization supportSuggestion: RDMA support in virtIO and XCPWill speed adoption for on-premise clouds

  • Thanks!Thanks to our original research sponsors

    and to our new commercial friends

    **Why has this uptake occurred?