introduction to cloud computing and the aneka platform dr. rajkumar buyya cloud computing and...
TRANSCRIPT
Introduction to Cloud Computing and the Aneka Platform
Dr. Rajkumar BuyyaCloud Computing and Distributed Systems (CLOUDS) LabDept. of Computing and Information SystemsThe University of Melbourne, Australia
www.cloudbus.orgwww.manjrasoft.com
Major Sponsors/Supporters
Manjrasoft
2
The Next Revolution in ITThe Big Switch in IT
Classical Computing Buy & Own
Hardware, System Software, Applications often to meet peak needs.
Install, Configure, Test, Verify, Evaluate
Manage .. Finally, use it $$$$....$(High CapEx)
Cloud Computing Subscribe Use
$ - pay for what you use, based on QoS
Every
18 m
on
ths?
3
Outline
“Computer Utilities” Vision and Promising IT Paradigms/Platforms
Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges
Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange
Aneka: Cloud Application Platform Summary and Thoughts for Future
4
“Computer Utilities” Vision: Implications of the Internet
1969 – Leonard Kleinrock, ARPANET project “As of now, computer networks are still in their
infancy, but as they grow up and become sophisticated, we will probably see the spread of “Computer Utilities”, which, like present electric and telephone utilities, will service individual homes and offices across the country”.
During the last 40 years, several advances have taken place in both “computing” and “communications” areas that are turning the vision of “Computer Utilities” in to a reality.
5
Computing Paradigms and Attributes: Realizing the ‘Computer
Utilities’ Vision Web Data Centres Utility Computing Service Computing Grid Computing P2P Computing Market-Oriented
Computing Cloud Computing …
-Ubiquitous -Reliable-Scalable
-Autonomic-Dynamic discovery
- Composable -QoS-SLA- …
} +
Paradigms
Attributes/Capabilities
?-Trillion $ business
6
Outline
“Computer Utilities” Vision and Promising IT Paradigms/Platforms
Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges
Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange
Aneka: Cloud Application Platform Summary and Thoughts for Future
7
Very popular: too many are “In Search” of Cloud Computing
8
Open Data Center Alliance (ODCA)for Cloud Computing
9
Defining Clouds: There are many views for what is cloud computing?
Over 20 definitions: http://cloudcomputing.sys-con.com/read/612375_p.htm Renting “remote storage” backup Renting “remote server” hosting Web server Renting “remote more servers” to manage large workload
Buyya’s Scientific definition of Cloud Computing “Cloud is a market-oriented distributed computing system consisting
of a collection of inter-connected and virtualised computers that are dynamically provisioned and presented as one or more unified computing resources based on service-level agreements (SLAs) established through negotiation between the service provider and consumers.”
SLA = {negotiated and agreed QoS parameters + rewards + penalties for violation of agreement....}
10
Subscription-Oriented Cloud Services: X{compute, apps, data, ..}
as a Service (..aaS)
Clients
OtherCloud Services
Govt.Cloud Services
PrivateCloud
Cloud Manager
Public Cloud
11
Rentable Cloud Services
Infrastructure as a Service (IaaS)
CPU, Storage: Amazon.com, Nirvanix, GoGrid….
Platform as a Service (PaaS)
Google App Engine, Microsoft Azure, Manjrasoft Aneka..
Software as a Service (SaaS)
SalesForce.Com
Infrastructure as a Service (IaaS)
Software as a Service (SaaS)
Platform as a Service (PaaS)
Manjrasoft
....
12
Cloud Deployment Models
Private/Enterprise Clouds
Cloud model run within a company’s own Data Center / infrastructure for
internal and/or partners use.
Public/Internet Clouds
3rd party, multi-tenant Cloud
infrastructure & services:
* available on subscription basis
Hybrid/InterClouds
Mixed usage of private and public
Clouds: Leasing publiccloud services
when private cloud capacity is insufficient
13
Cloud Applications
•Scientific/Tech Applications•Business Applications•Consumer/Social Applications
Science and Technical Applications
Business Applications
Consumer/Social Applications
14
When will Cloud spending become 50% of IT spending or reach to a
trillion $ business/year?
120?
2016
15%
600?
2020?
30% 1000?
2020?
50%
Buyya’s Guestimate!
2000
15
Cloud Computing Challenges: Dealing with too many issues
Uhm, I am not quite clear…Yet another
complex IT paradigm?
Virtualization
QoS
Service Level
Agreements
Resource Metering
Billing
Pricing
Provisioning on DemandUtility & Risk Management
Scalability
Reliability
Energy Efficiency
Security
Privacy
Trust
Legal &
Regulatory
Software Eng. Complexity
Programming Env. & Application Dev.
16
Outline
“Computer Utilities” Vision and Promising IT Paradigms/Platforms
Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges
Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange
Aneka: Cloud Application Platform Summary and Thoughts for Future
17
Market-Oriented Cloud Architecture: QoS negotiation and SLA-based Resource Allocation
DispatcherVM
MonitorService Request
Monitor
Pricing Accounting
Service Request Examiner and Admission Control
- Customer-driven Service Management- Computational Risk Management- Autonomic Resource Management
Users/Brokers
SLAResource Allocator
Virtual Machines
(VMs)
Physical Machines
18
Cloud to expand (lease more resources) with increase in demand
DispatcherVM
MonitorService Request
Monitor
Pricing Accounting
Service Request Examiner and Admission Control
- Customer-driven Service Management- Computational Risk Management- Autonomic Resource Management
Users/Brokers
SLAResource Allocator
Virtual Machines
(VMs)
Physical Machines
19
Cloud to shrink (unlease resources) with decrease in demand
DispatcherVM
MonitorService Request
Monitor
Pricing Accounting
Service Request Examiner and Admission Control
- Customer-driven Service Management- Computational Risk Management- Autonomic Resource Management
Users/Brokers
SLAResource Allocator
Virtual Machines
(VMs)
Physical Machines
20
Outline
“Computer Utilities” Vision and Promising IT Paradigms/Platforms
Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges
Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange
Aneka: Cloud Application Platform Summary and Thoughts for Future
21
Aneka: The Cloud Application Platform (CAP) for Resource-Intensive Apps(Available as Manjrasoft Product)
Lightweight Container hosting multiple services.
All programming models available from within the same container (unlike others)
SDK containing APIs for multiple programming models and tools
Runtime Environment for managing application execution management
Suitable for Development of Enterprise
Cloud Applications Cloud enabling legacy
applications Portability for Customer
Apps: Enterprise ↔ Public Clouds .NET/Win ↔ Mono/Linux
Multiple Infrastructures
Multi-core Cluster Grid Cloud
Thread Task ... MapReduce
2100 2100 2100 2100
2100 2100 2100 2100
Aneka
Multiple Applications
1. SDK
2. Runtime
22
Aneka: The Cloud Application Platform (CAP) for Resource-Intensive Apps(Available as Manjrasoft Product)
Lightweight Container hosting multiple services.
All programming models available from within the same container (unlike others)
SDK containing APIs for multiple programming models and tools
Runtime Environment for managing application execution management
Suitable for Development of Enterprise
Cloud Applications Cloud enabling legacy
applications Portability for Customer
Apps: Enterprise ↔ Public Clouds .NET/Win ↔ Mono/Linux
Private Cloud
LAN network
AmazonMicrosoft Google
IBM
Data Center
Hardware Profile Services
Container
Persiste
nce
TaskModel
ThreadModel
Map Reduce Model
OtherModels
.NET @ Windows Mono @ Linux
Secu
rity
Programming Models
Software Development Kit
ManagementStudio
Application
Foundation Services
MembershipServices
ReservationServices
LicenseServices
APIsDesign Explorer
Management Kit
AdministrationPortal
SLA-NegotiationWeb Services
ManagementWeb Services
StorageServices
AccountingServices
Fabric Services
Dynamic Resource Provisioning Services
Infrastructure
Physical Machines/Virtual Machines
Private Cloud
LAN network
Private Cloud
LAN network
AmazonMicrosoft Google
IBM
Data Center
AmazonMicrosoft Google
IBM
Data Center
Hardware Profile Services
Container
Persiste
nce
TaskModel
ThreadModel
Map Reduce Model
OtherModels
.NET @ Windows Mono @ Linux
Secu
rity
Programming Models
Software Development Kit
ManagementStudio
Application
Foundation Services
MembershipServices
ReservationServices
LicenseServices
APIsDesign Explorer
Management Kit
AdministrationPortal
SLA-NegotiationWeb Services
ManagementWeb Services
StorageServices
AccountingServices
Fabric Services
Dynamic Resource Provisioning Services
Infrastructure
Physical Machines/Virtual Machines
Patent
(PCT)
23
Aneka as a Cloud Application Platform
DatacentersClusters
Desktop PCsPublic Clouds
Platform
Infrastructure
Applications& Services Application Development
Cloud Middleware
Aneka
Scheduling & Execution
Monitoring Billing
SLA & QoS UserManagement
ApplicationManagement Dynamic
Provisioning
Bag of Tasks Dist. Threads MapReduce …
24
Aneka: components
public DumbTask: ITask { … public void Execute() { …… }}
for(int i=0; i<n; i++){ … DumbTask task = new DumbTask(); app.SubmitExecution(task);}
Executor
Scheduler
Executor
Executor Executor
ClientAgent
work units
internet
internet
Aneka enterprise Cloud
ClientAgent
work units
Aneka User Agent
Aneka Worker ServiceAneka Manager
Programming / Deployment Model
25
Aneka - Dynamic deployment of Application Tasks on Clouds
Application
Aneka Application
AnekaManager
Aneka Workker/Executor
Manager / Executor
Aneka Threads
26
Aneka Support for InterCloud / Federation of Resource Pools
XenServer Pool Aneka + Xen Server
private Cloud VMWare Pool
Aneka + VMWare private Cloud
Amazon EC2 Pool Aneka + public EC2
Windows Azure Aneka + public Azure
Executors/Schedulers
Executor
Client Libraries
Executors
Scheduler
Public Cloud
publicly available resources(physical and virtual)
Scheduler
internet
Private Cloud
private enterprise network
VPN(virtual resources)
Executor
Aneka Case Studies
28
(GoFront: A unit of China Southern Railway Group)
Aneka utilizes idle desktops (30) to decrease task time
from days to hours
Time (in hrs)
Single Server
Aneka Cloud
Raw Locomotive Design Files(Using AutoDesk Maya) Using Maya
Graphical Mode Directly
Case 1: Single Server
4 cores server
Aneka Maya Renderer
Use private Aneka Cloud
GoFront Private Aneka Cloud
LAN network (Running Maya Batch Mode on
demand)
Case 2: Aneka Enterprise Cloud Manjrasoft
Application: Locomotive design CAD rendering
29
A scalable architecture for TitanStrike on-line Gaming Portal
TitanStrike Private Aneka Cloud
LAN network (Running Game plugins on Demand) Case 2: Aneka Enterprise Cloud = Scalability
Aneka-based GameController
The local scheduler interacts with Aneka
and distributes the load in the cloud.
Manjrasoft
Distributed log parsing
logslogs
Case 1: Single Server = Huge Overload
Single scheduler controlling the
execution of all the matches.
Game Servers
Gamers profilesPlayers statisticsTeam playingMultiple games
Titan Strike On Line Gaming Portal
Centralized log parsing
logs
logs
Single GameController
30
Indian Space Research Organization (ISRO) - ADRIN
Receiving stationprocessing
Archiving
Aneka Cloud
Distribution
Private Cloud Citrix Xen
Public Cloud Amazon AWS
Manjrasoft
31
Health Care: SaaS Cloud for ECG Sensor Data Analysis
Embedded Bluetooth Enabled Data Processor & Communication Module
ECG Sensor ModuleECG Data Analysis Software
Wireless ECG Sensor
Sa
aS
Pa
aS
Iaa
S
Blu
etoo
th c
onne
ctiv
ity
Wireless/ Mobile 3G Network
1
2
3
4
6
5
A User
Millions of users
Use
r R
eque
sts
User Requests
User QoS based Scaling of Compute Resources
Dynamic Scalable Runtime
32
IEEE Scalable Computing Challenge at CCGrid 2010 Conference
33
Global Recognition for Aneka:Frost, Telstra….
-> 2010 Frost & Sullivan "New Product Innovation" Award
-> 2011 Telstra Innovation Challenge, “People’s Choice”
Award
34
Outline
“Computer Utilities” Vision and Promising IT Paradigms/Platforms
Cloud Computing and Related Paradigms Trends, Definition, Cloud Benefits and Challenges
Market-Oriented Cloud Architecture SLA-oriented Resource Allocation Global Cloud Exchange
Aneka: Cloud Application Platform Summary and Thoughts for Future
35
Summary
Several Computing Paradigms have promised to deliver “Computing Utilities” vision: Cloud Computing is the most recent kid in the block
promising to turn vision into reality Many exciting business and consumer applications
enabled. Aneka is rapidly emerging as a platform for:
Building Clouds (especially “private”) and their apps. Accelerating Applications and Managing their execution. Already used in engineering, life science, gaming, and
business intelligence applications.
36
References
Quick Overview: Rajkumar Buyya and Karthik Sukumar,
Platforms for Building and Deploying Applications for Cloud Computing, CSI Communications, Vol.35, No. 1, Pages: 6-11, ISSN 0970-647X, Computer Society of India (CSI), Mumbai, India, May 2011.
Aneka: C. Vecchiola, X. Chu, and R. Buyya,
Aneka: A Software Platform for .NET-based Cloud Computing, High Speed and Large Scale Scientific Computing, 267-295pp, IOS Press, Amsterdam, Netherlands, 2009.
Software – download: http://www.manjrasoft.com/
Wiley Press, New York, USA, Feb 2011