rajkumar buyya, david abramson, jon giddy
DESCRIPTION
Nimrod/G and Grid Market “ A Case for Economy Grid Architecture for Service Oriented Global Grid Computing”. Rajkumar Buyya, David Abramson, Jon Giddy. Monash University, Melbourne, Australia www.buyya.com/ecogrid. www.gridcomputing.com. 2100. 2100. 2100. 2100. 2100. 2100. 2100. 2100. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/1.jpg)
Nimrod/G and Grid Market“A Case for Economy Grid
Architecture for Service Oriented Global Grid Computing”
Rajkumar Buyya, David Abramson, Jon GiddyMonash University, Melbourne, Australiawww.buyya.com/ecogrid
www.gridcomputing.com
![Page 2: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/2.jpg)
2100
2100 2100 2100 2100
2100 2100 2100 2100
Desktop SMPs or SuperComputersLocal
ClusterGlobal
Cluster/Grid
PERFORMANCE
Inter PlanetCluster/Grid ??
•Individual•Group•Department•Campus•State•National•Globe•Inter Planet•Universe
Administrative Barriers
EnterpriseCluster/Grid
?
Scalable HPC: Breaking Administrative Barriers
![Page 3: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/3.jpg)
Why Grids ? Large Scale Exploration needs them—Killer
Applications. Solving grand challenge applications using
computer modeling, simulation and analysis
Life Sciences
CAD/CAM
Aerospace
Military ApplicationsDigital Biology Military ApplicationsMilitary Applications
Internet & Ecommerce
![Page 4: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/4.jpg)
Players in Grid Computing
![Page 5: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/5.jpg)
What users want ?Users in Grid Economy &
Strategy Grid Consumers
Execute jobs for solving varying problem size and complexity
Benefit by selecting and aggregating resources wisely Tradeoff timeframe and cost
Strategy: minimise expenses Grid Providers
Contribute “idle” resource for executing consumer jobs Benefit by maximizing resource utilisation Tradeoff local requirements & market opportunity
Strategy: maximise returns on services
![Page 6: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/6.jpg)
mix-and-match
Object-oriented
Internet-WWW
Problem Solving Approach
Market/Computational Economy
![Page 7: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/7.jpg)
Grid Node N
Grid Architecture for Computational Economy
Grid User
Application
Grid Resource Broker
Grid Service Providers
Grid Explorer
Schedule Advisor
Trade Manager
Job ControlAgent
Deployment Agent
Trade Server
Resource Allocation
ResourceReservation
R1
Misc. services
Information Server(s)
R2 Rm…
Pricing Algorithms
Accounting
Grid Node1
…
Grid Middleware Services
…
…
HealthMonitor
Grid Market Services
JobExec
Info ?
Secure
Trading
QoS
Storage
Sign-on
![Page 8: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/8.jpg)
Economy Grid = Globus + GRACE
Applications
MDS
GRAMGlobus Security Interface
Heartbeat MonitorNexus
Local Services
LSF
Condor GRD QBank
PBS
TCP
SolarisIrixLinux
UDP
High-level Services and Tools
DUROC globusrunMPI-G Nimrod/GMPI-IO CC++
GlobusView Grid Status
GASS
GRACE-TS
GARA
GridFabric
GridApps.
GridMiddleware
GridTools
GBankGMD
eCash
JVM
DUROC
Core Services
Science
Engineering Commerce Portals ActiveSheet…
![Page 9: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/9.jpg)
A resource broker for managing and steering task farming (parametric sweep) applications on computational Grids based on deadline and computational economy.
Key Features A single window to manage & control experiment Resource Discovery Trade for Resources Resource Composition & Scheduling Steering & data management
It allows to study the behaviour of some of the output variables against a range of different input scenarios.
Nimrod/G : A Grid Resource Broker
![Page 10: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/10.jpg)
A Glance at Nimrod-G Broker
Grid Middleware
Nimrod/G Client Nimrod/G ClientNimrod/G Client
Grid Information Server(s)
Schedule Advisor
Trading Manager
Nimrod/G Engine
GridStore
Grid Explorer
GE GISTM TS
RM & TS
Grid Dispatcher
RM: Local Resource Manager, TS: Trade Server
Globus,Legion, Condor-g,, Ninf,etc.
G
G
CL
Globus enabled node. Legion enabled node. C
L
Condor enabled node.
RM & TSRM & TS
![Page 11: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/11.jpg)
A Nimrod/G ClientCostCost
DeadlineDeadline
Legion hosts
Globus Hosts
Bezek is in both Globus and Legion Domains
Arlington
Alexandria
Richmond
HamptonNorfolk
Virginia BeachChesapeakePortsmouth
Newport News
RoanokeApp om a toxRive r
Ja m esRive r
Shena ndo ahRive r
Rap pa hanno c kRive r
Potom acRive r
VIRGINIA77
81
64
64
66
85
![Page 12: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/12.jpg)
Discover Discover ResourcesResources
Distribute JobsDistribute Jobs
Establish Establish RatesRates
Meet requirements ? Remaining Meet requirements ? Remaining Jobs, Deadline, & Budget ?Jobs, Deadline, & Budget ?
Evaluate & Evaluate & RescheduleReschedule
Discover Discover More More
ResourcesResources
Adaptive SchedulingAlgorithms
Execution Time (not beyond deadline)
Execution Cost (not beyond budget)
Time Minimisation Minimise Limited by budgetCost Minimisation Limited by deadline MinimiseNone Minimisation Limited by deadline Limited by budget
Adaptive Scheduling algorithms
Compose & Compose & ScheduleSchedule
![Page 13: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/13.jpg)
Globus+Legion+Condor/G
Australia
Monash Uni.:
Linux cluster
Solaris WS
Nimrod/G
Globus +GRACE_TS
EuropeZIB/FUB: T3E/Mosix Cardiff: Sun E6500Paderborn: HPCLineLecce: Compaq SCCNR: ClusterCalabria: Cluster CERN: ClusterPozman: SGI/SP2
Globus +GRACE_TS
Asia/Japan
Tokyo I-Tech.:ETL, Tuskuba
Linux cluster
Globus/LegionGRACE_TS
North America
ANL: SGI/Sun/SP2USC-ISI: SGIUVa: Linux Cluster
Internet
Inter-Continental Grid
![Page 14: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/14.jpg)
Experimentation on the Grid
Workload: 165 jobs, each need 5
minute of cpu time Deadline: 1 hrs. and
budget: 800,000 units Strategy: minimise cost
and meet deadline Execution Cost with cost
optimisation AU Peaktime:471205 (G$) AU Offpeak time: 427155
(G$)
Resource
Owner
Grid services
Peak time (G$)
Off peak cost
Linux cluster (60 nodes)
Monash, Australia
Globus/Condor
20 5
IBM SP2 (80 nodes)
ANL, Chicago, US
Globus/LL
5 10
Sun (8 nodes)
ANL, Chicago, US
Globus/Fork
5 10
SGI (96 nodes)
ANL, Chicago, US
Globus/Condor-G
15 15
SGI (10 nodes)
ISI, LA, US
Globus/Fork
10 20
![Page 15: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/15.jpg)
Execution @ AU Peak Time
0
2
4
6
8
10
12
Time (minutes)
Jobs
Linux clus ter - Monash (20) Sun - ANL (5) SP2 - ANL (5) SGI - ANL (15) SGI - ISI (10)
![Page 16: Rajkumar Buyya, David Abramson, Jon Giddy](https://reader036.vdocuments.net/reader036/viewer/2022081505/56815a6a550346895dc7bf5d/html5/thumbnails/16.jpg)
Execution @ AU Offpeak Time
0
2
4
6
8
10
12
Time (minutes)
Jobs
Linux cluster - Monash (5) Sun - ANL (10) SP2 - ANL (10) SGI - ANL (15) SGI - ISI (20)