Innovation in cloud computing architectures with open nebula

Download Innovation in cloud computing architectures with open nebula

Post on 13-Jan-2015




3 download

Embed Size (px)




<ul><li> 1. 20 April 2010 5th International Cloud Computing ExpoNew YorkNext Generation Data Center SummitInnovation in Cloud ComputingArchitectures with OpenNebula Distributed Systems Architecture Research GroupUniversidad Complutense de Madrid This presentation is provided under the terms of the a Creative Commons Attribution-Share Alike 3.0 OpenNebula Project Leads1/24 </li></ul> <p> 2. Position in the Cloud Ecosystem Innovation in Cloud Computing Architectures with OpenNebula WhatWhoSoftware as a ServiceOn-demand End-useraccess to any (does not care about hw or sw)applicationPlatform as a Service Platform forDeveloperbuilding and(no managing of thedelivering webunderlying hw &amp; swlayers)applicationsInfrastructure as a Raw computerSystem Administrator Service infrastructure(complete management of thecomputer infrastructure) Innovative open, flexible and scalable technology to configure your own IT resources into a IaaS cloudPhysical Infrastructure2/24 3. Transforming your IT Infrastructure into a Cloud Innovation in Cloud Computing Architectures with OpenNebulaCommercial Cloud Provider Flexible and elastic capacity to meet dynamicdemands of service Ubiquitous network access Pay per use and on-demand access Building your Own Cloud Optimize and Simplify Internal Operations Centralized management of all servers and services with dynamic resizing of infrastructure and dynamic allocation of capacity Higher utilization and operational saving of existing resources with server consolidation and removal of application silos Lower infrastructure expenses with combination of local and remote Cloud resources Support new IT, scientific, or business Cloud services 3/24 4. Deployment Models Innovation in Cloud Computing Architectures with OpenNebula ModelDefinition Examples of DeploymentInfrastructure is owned Optimize and simplify internal operation Private by a single organization SaaS/PaaS support and made available IT consolidation within large organizations only to the organization(Goverment Clouds, University Clouds)Infrastructure is owned Commercial clouds providers by a single organization Special purpose clouds with dedicated and made available to capabilities (HPC Clouds) Public other organizations Regional clouds to address regulatory or latency issues Community public clouds (Science Clouds) to enable scientific and educational projects to experiment with cloud computing Infrastructure is a Cloudbursting to address peak demands Hybrid composition of two or Cloud Federation to share infrastructure more clouds with partners Cloud Aggregation to provide a larger resource infrastructure 4/24 5. Contents Innovation in Cloud Computing Architectures with OpenNebula Challenges from Deployment and Usage ScenariosUser and InfrastructureBusinessSystemWorkloadsManagersManagersIntegrators Designing a Cloud InfrastructureAnatomy of a Cloud Architecture Building a Cloud Infrastructure OpenNebula as Cloud Enabler5/24 6. Challenges: The User Perspective Innovation in Cloud Computing Architectures with OpenNebulaRequired Functionality Cloud interface and CLI to manage virtual machines, network and storage Support for popular interfaces (Amazon EC2)Profile of Service Workloads Multi-tier service as basic management entity Compute, storage and network capacity Level of coupling between service instances Security constraints Variability of the demand Elasticity of the services Service as Groups of VMs Service components in VMs Inter-connection relationship Placement constraints 6/24 7. Challenges: The Manager Perspective Cloud Computing from an Institutional Perspective Flexible, Efficient and Scalable Management of the Cloud Administration interface for the centralized management of the cloud Support for the definition of workload and resource-aware allocation policiessuch as consolidation (energy efficiency), load balancing, affinity-aware,capacity reservation, live migration Support any storage, networking and virtualization infrastructure service Integration with existing processes and management tools in the data center Management of several clusters to address different workloadsScalable back-end Virtualization Storage Physical Infrastructure Networking7/24 8. Challenges: The Business Perspective Innovation in Cloud Computing Architectures with OpenNebula Hybrid Cloud Computing and Federation Cloudbursting at infrastructure layer, fully transparent to users Scale-out decisions are taken by infrastructure administrators according tobusiness policies Two levels of Collaboration Extend the private cloud using both partner and commercial clouds Create a federation of cloudsNimbus 8/24 9. Challenges: The Integrator Perspective Innovation in Cloud Computing Architectures with OpenNebula Open Architecture, Interfaces and Code Integration with any product and service in the virtualization/cloud ecosystem such as cloud providers, hypervisors, virtual image managers, service managers, management tools, schedulers Support to build any type of deployment: private, public, hybrid andcommunity clouds Easy to enhance to support new functionality Easy to embed into other Cloud applications and platforms Liberal open-source license 9/24 10. Designing a Cloud: A Design Driven by Requirements Innovation in Cloud Computing Architectures with OpenNebulaRequirements from Use Cases and Deployment ScenariosOne solution does not fit allrequirements and constraints, a properly architectured solution shouldfully align with your Cloud strategy Constraints from Existing Infrastructure and Processes in the Organization 10/24 11. Designing a Cloud: Anatomy of a Cloud Architecture Innovation in Cloud Computing Architectures with OpenNebulaCloud User/Service End-UsersService Provider VIRTUAL INFRASTRUCTURECloudInterfaceAdm InterfaceCloud Management System Virtual Machine ManagersSchedluer Physical Storage Physical Machines Physical Networking PHYSICAL INFRASTRUCTURE Hybrid 11/24 12. Designing a Cloud: Design Parameters for Components Innovation in Cloud Computing Architectures with OpenNebulaComponentDesign Parameters Requirements of Use Cases and Constraints from InfrastructurePhysical Memory and CPU per server Memory/CPU requirements of serviceMachines Number and scalability of servers instances Hardware virtualization support Elasticity of servicesPhysical Latency/bandwidth per network Level of coupling between service instancesNetwork Number and scalability of networks Physical Size, scalability, latency and Live migrationStorage throughout Scalability of the cluster Organization: DAS/SAN/NAS PerformanceClusters Number of clusters Workloads with different execution profiles Scalability in one clusterVirtual Hypervisors Overhead in service instancesMachine LicensingManagerInterfaces Administration interface Required functionality Cloud interface Compatibility with existing interfacesScheduler Allocation Policies Energy efficiency, load balancing, affinity-aware, capacity reservation, live migrationHybrid Cloudbursting Fluctuating demands Federation Security constraints Level of coupling between service instances 12/24 13. Designing a Cloud: Flexible Cloud Manager as Enabler Innovation in Cloud Computing Architectures with OpenNebulaCloud Manager to Orchestrate Cloud Infrastructure Complexity Management of network, computing, remote cloud and storage capacity Management of virtual network, machine and storage life-cycles Workload placement and management of VM images Management of information, accounting and security Interfacing with any infrastructure service Virt.Virt. Virt. Virt.Interfaces SchedulersOpenNebula API OpenNebula Core Driver API Virt. Virt. Virt.Virt. Virt. Virt. Virt.Virt. Compute Storage NetworkCloud 13/24 14. Building a Cloud: OpenNebula as Cloud Enabler Innovation in Cloud Computing Architectures with OpenNebula Innovations Technology challenges in cloud computing management from business use cases Open-source ToolkitOpenNebula v1.4 Open and flexible tool to fit into any datacenter andintegrate with any ecosystem component Open-source released under Apache v2.0, and VMdistributed in UbuntuVM Most advanced solution to build private, public,federated and hybrid clouds VM Based on standards avoid vendor lock-in and toenable interoperability Efficient and scalable management of the cloud14/24 15. Building a Cloud: Features for Private Clouds Innovation in Cloud Computing Architectures with OpenNebulaAdminSchedulerOpenNebulaPhysical Infrastructure Feature FunctionInternal Interface Unix-like CLI for fully management of VM life-cycle and resources XML-RPC API and libvirt virtualization APIScheduler Requirement/rank matchmaker allowing the definition of workload and resource-aware allocation policies Support for advance reservation of capacity through HaizeaVirtualization Management Xen, KVM, and VMware Image Management General mechanisms to transfer and clone VM imagesNetwork Management Definition of isolated virtual networks to interconnect VMsService Management and Support for multi-tier services consisting of groups of inter-Contextualizationconnected VMs, and their auto-configuration at boot time15/24 16. Building a Cloud: Features for Public Clouds Innovation in Cloud Computing Architectures with OpenNebula InfrastructureUsers Cloud API FeatureFunction Cloud Interfaces for Implementation of a subset of the EC2 Query API and OGF - OCCI UsersFlexibility The Cloud Service allows the implementation of new Cloud interfaces 16/24 17. Building a Cloud: Features for Hybrid Clouds Innovation in Cloud Computing Architectures with OpenNebula Admin Scheduler OpenNebulaPhysical InfrastructureFeatureFunction Cloud Plugins Amazon EC2 and ElasticHosts connectorsFederation Support for simultaneous access to several remote cloudsFlexibility Modular approach to develop new connectors 17/24 18. Building a Cloud: Ecosystem Innovation in Cloud Computing Architectures with OpenNebulaOpen Community for Cloud Computing Haizea Lease Manager (University of Chicago): Advance reservation ofcapacity and queuing of best effort requests Cloud Management Console (SARA Computing and Networking Services):Web interface for OpenNebula Virtual Cluster Tool (CRS4 Distributed Computing Group): Atomic virtualcluster management with versioning and multiple transport protocols. DeltaCloud Driver (DSA-Research@UCM) RESERVOIR Policy Engine (IBM Haifa/Elsag Datamat): Policy-drivenprobabilistic admission control and dynamic placement optimization to satisfysite level management policies VM Consolidation Scheduler (DSA-Research@UCM): Periodic re-placementof VMs for server consolidation and suspension/resume of physical resources Claudia (Telefonica I+D): SLA-driven automatic service management Under Development: SUN Cloud API, vCloud API, VirtualBox plugin, dashboardfor infrastructure management, new schedulers, SLA and security framework,Grid service manager, LVM and SAN support, 18/24 19. Building a Cloud: Users Innovation in Cloud Computing Architectures with OpenNebula Users (Different Levels of Use: From Experimental to Production)19/24 20. Building a Cloud: Innovative Projects Innovation in Cloud Computing Architectures with OpenNebula Innovative Projects on Cloud ComputingResources and Services Virtualization without BarriersEU grant agreement 215605 Open source technology to enable deployment and Service and Sw Architecturesmanagement of complex IT services across differentand Infrastructuresadministrative domains (2008-2011) Enhancing Grid Infrastructures with Cloud Computing Simplify and optimize its use and operation, providing amore flexible, dynamic computing environment forProposal in negotiation e-Infrastructure scientists. (2010-2012) Enhance existing computing infrastructures with IaaSparadigms Building Service Testbeds on FIRE Design, build and operate a multi-site cloud-based facility toProposal in negotiation support research across applications, services and systems New Infrastructure Paradigmstargeting services research community on Future Internet and Experimental Facilities(2010-2013) 20/24 21. Building a Cloud: Innovative Projects Innovation in Cloud Computing Architectures with OpenNebula Telco Utility eGov SAPCommercial Service Managers Service ProviderService Provider Service ProviderSMIService Manager AWS VMIVMI VEE Manager VHI Source: RESERVOIR ProjectVEE Host VEE HostVEE Host Commercial Infrastructure Provider 21/24 22. OpenNebula as Building Block within Future Clouds Innovation in Cloud Computing Architectures with OpenNebulaIT Resources will be the Next Utility Future enterprise datacenters will look like private Clouds supporting aflexible and agile execution of virtualized services, and combining local withpublic Cloud-based infrastructure to enable highly scalable hostingenvironments Growing number of domain specific and regional Cloud providersimplementing a utility computing business model by offering pay per useresources on-demand Public Clouds will be supported by a network of geographicallydistributed datacenters for high availability, end-user service proximity, legaland policy issues Public Clouds will be interconnected to meet fluctuating demands Grid sites will offer infrastructure cloud-like interfaces to address the newresource access demands from the community 22/24 23. ThanksFunding Agencies European Union: RESERVOIR 2008-2011, EU grant agreement 215605 Ministry Science&amp;Innovation: HPCcloud 2010-2012, MICINNTIN2009-07146 Community of Madrid: MEADIANET 2010-2013 CAM S2009/TIC-1468 The OpenNebula Community The OpenNebula Team: Ignacio M. Llorente, Ruben S. Montero, Tino Vazquez,Javier Fontan, Jaime Melis, Carlos Martn, Rafael Moreno, Daniel Molina, andBorja Sotomayor and many value community contributors from several organizationsYour support and contribution are very much appreciated! 23/24 24. More InformationMore info, downloads, mailing lists at Research References B. Rochwerger, J. Caceres, R.S. Montero,D. Breitgand,E. Elmroth,A. Galis,E. Levy,I.M.Llorente,K. Nagin,Y. Wolfsthal, The RESERVOIR Model and Architecture for OpenFederated Cloud Computing, IBM Systems Journal, Vol. 53, No. 4. (2009) B. Sotomayor, R. S. Montero, I. M. Llorente and I. Foster, Virtual InfrastructureManagement in Private and Hybrid Clouds, IEEE Internet Computing, September/October 2009 (vol. 13 no. 5)24/24 </p>


View more >