adaptive grid computing
DESCRIPTION
Adaptive Grid Computing. Detecting and Adjusting for Dynamic Grid Conditions. Experiments with a Grid-Enabled Computational Framework. Dave Angulo, Ian Foster Chuang Liu, Matei Ripeanu, Michael Russell, Lingyun Yang Distributed Systems Laboratory - PowerPoint PPT PresentationTRANSCRIPT
www.globus.org
Adaptive Grid Computing
Detecting and Adjusting for Dynamic Grid Conditions
www.globus.org
Experiments with a Grid-Enabled Computational Framework
Dave Angulo, Ian FosterChuang Liu, Matei Ripeanu, Michael Russell, Lingyun Yang
Distributed Systems Laboratory
University of Chicago & Argonne National Laboratory
Gabrielle Allen, Thomas Dramlitsch,
Gerd Lanferman, Ed Seidel, Thomas RadkeMax-Planck-Institut für Gravitationsphysik
www.globus.org
Acknowledgements
This work was supported in part by the NSF-funded Grid Application Development Software project under Grant No. 9975020.
We are grateful to our GrADS project colleagues for discussions on the topics discussed here.
www.globus.org
Research Goals
Investigate methods and structures for efficient Grid execution via in-depth study of a demanding application, including– Constructs for adapting to heterogeneity
– Constructs for dynamic resource acquisition Create testbed for GrADSoft components,
as they emerge Investigate utility of computational
frameworks as facilitator of Grid computing
www.globus.org
Migrate to “faster/ cheaper” system– When better system
discovered
– When requirements change
– When characteristics change (e.g., competition)
Adaptation to Dynamic Grid Environments
www.globus.org
Migrate to “faster/ cheaper” system– When better system
discovered
– When requirements change
– When characteristics change (e.g., competition)
Adaptation to Dynamic Grid Environments
www.globus.org
External Processes / Services
Cactus Worm Architecture
Cactus “flesh”
CactusWormServer
Cactus WormMigrationThorn
Resource Selector Client Thorn
App & other thorns
Performance Degradation Detection
Globus Toolkit™GRAM
Resourceselector
GlobusToolkit™
GIIS
GlobusToolkit™
GRISs
GlobusToolkit™
GRISsResources
NWS Migration Logic Manager
(Under Development)
www.globus.org
Migration Demonstration
GIIS Running on jupitor.isi.edu
Cluster at UIUC Cluster at UCSD
Resource Selector Service Running on
hamachi.cs.uchicago.edu
Cactus Worm Server Running on
amajor.cs.uiuc.edu
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
Computational application begins run
NetLogger records performance and displays
visual graph
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
Competing application on one node steals
CPU cyclesNetLogger
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
Resource Selector Service contacted
NetLogger
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
resource list sent to Worm Server
NetLogger
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
Worm Server shuts down app
NetLogger
www.globus.org
Migration Demonstration
GIIS
Cluster at UIUC Cluster at UCSD
Resource SelectorService
Cactus WormServer
Worm Server starts app on new resouces
NetLogger
www.globus.org
Performance Results
www.globus.org
Gabrielle Allen; Dave Angulo; Ian Foster; Gerd Lanfermann; Chuang Liu; Thomas Radke; Ed Seidel; John Shalf. The Cactus Worm: Experiments with Dynamic Resource Discovery and Allocation in a Grid Environment. In International Journal of High-Performance Computing Applications Volume 15, Number 4, 2001
http://people.cs.uchicago.edu/~dangulo/papers/
This presentation: http://www.cs.uchicago.edu/~dangulo/scdemo.ppt