6/2/20071 grid computing sun grid engine (sge) manoj katwal
Post on 20-Dec-2015
227 views
TRANSCRIPT
![Page 1: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/1.jpg)
6/2/2007 1
Grid ComputingGrid ComputingSun Grid Engine (SGE)Sun Grid Engine (SGE)
Manoj Katwal
![Page 2: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/2.jpg)
6/2/2007 2
OutlineOutline
Grid and Cluster Terminology What is a Cluster vs. a Grid? Types of Grids Benefits of Grid Computing Areas of concern What is Sun Grid Engine? Example N1 Grid Network Setup
Do you know?Grid computing market will reach $ 12 billion by the end of 2007 (IDC)
![Page 3: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/3.jpg)
6/2/2007 3
Outline, Cont.Outline, Cont.
Managing Jobs and Resources with a Grid Sun N1 Grid Engine
Concepts in Sun Grid Engine Job Submission Queues QMON Useful commands References
Do you know?Grid computing market will reach $ 12 billion by the end of 2007 (IDC)
![Page 4: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/4.jpg)
6/2/2007 4
Grid and Cluster Grid and Cluster Terminology Terminology
A GRID is a collection of computing resources that perform tasks. A grid appears to users as a large system that provides a point(s) of access to powerful distributed resources.– Resources: Computer hardware, data, applications,networking
etc. Cluster:
– Tightly coupled homogenous computers, resources
– Redundant interconnections that appears as single system with high availability (HB)
– Not truly distributed system
![Page 5: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/5.jpg)
6/2/2007 5
Grid and Cluster Grid and Cluster Terminology, Cont.Terminology, Cont. Grid:
– Loosely coupled heterogeneous computers or resources
– Resources can come and go
– High scalability– dynamically resources can be added and removed
– It is distributed virtually everywhere
– High Performance Computing (HPC)
Do you know?
The current version of Sun Grid Engine is downloadable for free.
![Page 6: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/6.jpg)
6/2/2007 6
What is a Cluster vs. a Grid?What is a Cluster vs. a Grid?
Gentzsch, “Grid Computing: A New Technology for the Advanced Web”
![Page 7: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/7.jpg)
6/2/2007 7
Types of GridsTypes of Grids
![Page 8: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/8.jpg)
6/2/2007 8
Benefits of Grid ComputingBenefits of Grid Computing
Better utilization of resourcesIncreased user productivityFaster time-to-solution of complex
scientific, engineering, and enterprise computational tasks
Do you know?You can register to http://www.network.com and get 200 CPU hours free of charge. No obligation
![Page 9: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/9.jpg)
6/2/2007 9
Areas of ConcernAreas of Concern
Users concern about Grid operation and Management include:
Confusion about what grid is and how it works Cross-vendor interoperability CPU and application usage billing and accounting Security and user authentication Standardization Global enterprise grids across international boundaries
![Page 10: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/10.jpg)
6/2/2007 10
What is Sun Grid Engine?What is Sun Grid Engine?
Open source Grid management software – accepts jobs submitted by users
Software driving “job” distribution to compute nodes in a grid– By job means Unix like jobs (batches) or parallel
programs (MPICH- MPI Interface) Enable scheduling and prioritizing of jobs Management of jobs – submit, suspend, abort … Accounting and reporting (Arco, web based) Almost all operating systems are supported
![Page 11: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/11.jpg)
6/2/2007 11
Example N1 Grid Network SetupExample N1 Grid Network Setup
12 billions dollars…
![Page 12: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/12.jpg)
6/2/2007 12
Managing Jobs and Resources Managing Jobs and Resources with a Gridwith a Grid
![Page 13: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/13.jpg)
6/2/2007 13
Concepts in Sun Grid EngineConcepts in Sun Grid Engine
Hosts – Four types– Master host, Secondary Fail over host (optional)– Execution hosts – Admin host– Submit hosts
A system can act as more than one type of host.
![Page 14: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/14.jpg)
6/2/2007 14
Job Submission Job Submission
![Page 15: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/15.jpg)
6/2/2007 15
QueuesQueues
Cluster queues Job slots Resource reservation Parallel environment (MPI support) Policy based resource allocation Job checkpointing
![Page 16: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/16.jpg)
6/2/2007 16
QMONQMON
![Page 17: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/17.jpg)
6/2/2007 17
Useful commandsUseful commands
Qsub – to submit job Qhost – getting an overview of available resources Qacct – job accounting information Qmod – managing queue state Qmon – graphical admin tool Qconf – configuring queues
![Page 18: 6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal](https://reader034.vdocuments.net/reader034/viewer/2022051619/56649d425503460f94a1e49b/html5/thumbnails/18.jpg)
6/2/2007 18
ReferencesReferences
By Jan Stafford, Editor, 30 Aug 2005 | SearchOpenSource.com http://searchenterpriselinux.techtarget.com/originalContent/0,289142,sid39_gci1120769,00.html
California State University, LA cluster (1 head node with 10 clients) http://oscar.calstatela.edu/
Sun Grid Compute Utility Web Portal http://www.network.com