market oriented cloud

Download market oriented cloud

Post on 11-May-2015




0 download

Embed Size (px)


Market-Oriented Cloud Computing (as part of cloud symposium of ACM Compute 2009) Srikumar Venugopal Grid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software Engineering The University of Melbourne, Australia


  • 1.Market-Oriented Cloud ComputingSrikumar VenugopalGrid Computing and Distributed Systems (GRIDS) Laboratory Dept. of Computer Science and Software Engineering The University of Melbourne, Australia E:

2. AgendaMotivation for Market-based Computing A vision for Market-based Clouds Current research in GRIDS Lab Aneka: A resource provider Brokering of resources and negotiation Conclusion and Open Questions 2 3. Salient Features of Cloud ComputingAbstracted Infrastructure Using Resources without reference to their locationFully Virtualized Servers are virtual instancesDynamic Can add, delete new instances dynamicallyPay by Consumption No fixed long-term contractsConfigurable Any application or OS can be provided Forrester Research, Is Cloud Computing Ready For The Enterprise?, 3 March 2008 4. Yet..Cloud SLAs are still in their infancy Limited options for higher Quality of Service Flat Pricing Model Amazon Cloud provisioning is not a core product Amazon is an e-commerce company Google is a search company Need innovative business models A larger marketplace 4 5. The Gridbus Project @ Melbourne: Enable Leasing of ICT Services on DemandWWG GridbusPushes Grid computing intomainstream computing 5 6. The Gridbus Project @ GRIDS Lab, The University of Melbourne:The Gridbus Project @ GRIDS Lab, The University of Melbourne: Toolkit for Creating and Deploying e-* Applications on Utility GridsToolkit for Creating and Deploying e-* Applications on Utility Grids Gridbus is a open source Grid R&D Distributed Data project with focus on Grid Economy, Utility Grids and Service Oriented Computing. Gridbus Middleware components include: Aneka: .NET-based Enterprise Grid Grid Market Directory and Web Services Gridbus Grid Bank: Accounting and TransactionManagement Visual Tools for Creation of DistributedApplications Grid Service Broker and Scheduling Workflow Management Engine Libra: SLA-based Resource Allocation GridSim Toolkit 6 7. 7 8. Participants, Goals, RequirementsConsumers: - minimize expenses, meet QoS How do I express QoS requirements ?How do I trade between timeframe & cost ?How do I discover services and map jobs to meet my QoS needs?How do I manage Grid dynamics and get my work done?Providers: maximise ROI and profit How do I decide service pricing models ?How do I specify them ?How do I translate them into resource allocations ?How do I enforce them ?How do I advertise & attract consumers ?How do I do accounting and handle payments?They need mechanisms, tools and technologies that help them in value expression, value translation, and value enforcement.Service Level Agreements (SLAs) 8 9. Market Mechanisms for Clouds: A vision Broker1 Cloud Consumer Request Negotiate/BidCompute StorageResourcesCloud Cloud Directory.... BankAuctioneerMARKETEnterpriseComputeResourceBrokerNCloudManager (Proxy)StorageCloud 9 10. Aneka: a resource provider for parallel and distributed applicationsApplicationsContainerThread TaskDataflow MPI Map Other SLA ModelModelModelModel Reduce Models NegotiationPersistenceAllocation Manager Message Handler / Dispatcher Security Communication Layer10 11. Advance Reservations Commitment of a guaranteed share of aresource ahead of usage timeResources : Nodes, Bandwidth, StorageAdvantages: Lowers risk for user Easier capacity planning for provider Assured income Applications : workflow, multimedia applications, etc.Are a form of SLA11 12. Anekas SLA-View for Resource AllocationUser/Broker Enterprise GridNegotiation Protocol Engine Master NodeMembershipSchedulingReservation Service Service ServiceNodePricingMembership ReservationTask SelectionPolicyStoreStoreStorePolicyExecution Execution Execution NodeNodeNodeExecutionAllocation Service Service Time SlotReservationTask SelectionStoreStore PolicyAck: C.S. Yeo 12 13. Pricing of Reservations Dynamic pricing based on utilization level p ax by Where p is the unit price, x is the static component (base price), and y = load factor * z, is the dynamic component a and b are the relative weights b can be set higher when resource availability is low and vice versa Serves as a method of admission control takes advantage of market conditions C.S.Yeo, S. Venugopal, X. Chu, and R. Buyya, Autonomic Metered Pricing for a UtilityService, Technical Report, GRIDS-TR-2008-16, GRIDS Laboratory. 13 14. Revenue vs Strategy 14 15. Cloud Provider Architecture Users/ BrokersService R equest Examiner and A dmission Control - Customer-driven Service Management - Computational R isk Management - Autonomic Resource Management SLAResourceAllocatorPricingAccounting VMService R equestMonitorMonitor Dispatcher VirtualMachines (VMs)PhysicalMachines15 16. Gridbus Broker: Abstracting Resource AccessHome Node/PortalCredential RepositoryMyProxy Portlets batch()Gridbus-PBS -CondorBroker -SGEfork()Data CatalogGlobusAneka Data StoreUnicoreSSH Job managerAccess Technology fork() Gateway batch()fork() batch()SRB-PBSGrid FTP -PBSGridbus Gridbus -Condor -Condoragentagent-SGE -SGE -XGrid 16 17. Broker-Provider NegotiationProviderBrokerNegotiation NegotiationModuleModule Advance Reservation Resource Allocation SchedulerManagerJob Submission and MonitoringBroker acts as a user agentBroker translates user requirements to resource requirements However, the negotiation process is invisible to the end user. 17 18. The Negotiation Protocol 18 19. Effect of deadline urgencyS. Venugopal, X. Chu, and R. Buyya, A Negotiation Mechanism for Advance ResourceReservation using the Alternate Offers Protocol, IWQoS 2008. 19 20. MetaCDN: Brokering Cloud StorageProvidersDr. James Broberg, University of Melbourne, 20 21. Open Questions How to commoditise cloud services ? What would be the structure of the Cloud services market ?What are the accounting and payment mechanisms available ?How to monitor and enforce the SLAs arrived at by negotiation ?Who arbitrates the process ? 21 22. Thank You Questions?