distributive computing with xgrid...oct 26, 2004 · session overview what are people doing with...
TRANSCRIPT
![Page 1: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/1.jpg)
Distributive Computingwith Xgrid
James ReynoldsStudent Computing Labs
University of Utah
![Page 2: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/2.jpg)
James Reynolds, University of Utah
Session Overview
What are people doing with Xgrid right nowHow does Xgrid workHow do you create jobsHow do you start jobsXgrid SecurityInstalling - Removing - Setting up XgridWe’ll run a jobTips and Tricks
2
![Page 3: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/3.jpg)
James Reynolds, University of Utah
What Are People Doing With Xgrid?
3
![Page 4: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/4.jpg)
James Reynolds, University of Utah
What Are Others Doing?
Richard Crandall - Reed College
Performing bioterror calculations
Complex attack/epidemic/vaccination scenarios
60 machines, 100 GHz
North Carolina State (PacMUG)
Trying to reach 1 Teraflop
aka Wolfgrid
4
![Page 5: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/5.jpg)
James Reynolds, University of Utah
What Are Others Doing?
Noah Adams @ Simon Fraser UniversityFermant Number Factoring
Sterling Anderson @ WisconsinBioinformatics using hmmpfam
Alex MajoraProtein folding
Andrew KatorBlender 3D
5
![Page 6: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/6.jpg)
James Reynolds, University of Utah
What Are Others Doing?
Charles Parnot - StanfordStudying heart disease/heart rate control
Evaluating hypothetical molecular models and comparing the results with the real data from a specific chemical reaction
Opened their grid to all100-200 agents in US200-300 agents in EurpoeUsually a total of 200-400 at one timeMax of 300+ GHz
6
![Page 7: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/7.jpg)
James Reynolds, University of Utah
![Page 8: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/8.jpg)
James Reynolds, University of Utah
University of Utah
8
![Page 9: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/9.jpg)
James Reynolds, University of Utah
University of Utah
POV-Ray ray tracingOne frame rendered per computerAnimation: 2 mins x 25 fps = 8400 framesAbout 130 G5 2.0 GHz lab computersAbout 270 G4’s (400 MHz - 1.42 GHz)Working with Fine Arts on a system for students to render Maya animationsWill also work on math & science projects
9
![Page 10: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/10.jpg)
James Reynolds, University of Utah
![Page 11: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/11.jpg)
James Reynolds, University of Utah
Watch movie
11
![Page 12: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/12.jpg)
James Reynolds, University of Utah
About the LEGO’s...
Movie created by Anton Raveswww.antonraves.com
His library of parts are available for download
Related LEGO 3D library called LDrawwww.ldraw.org
There was an LDraw BOF yesterday
Notes can be obtained at www.ldraw.org
12
![Page 13: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/13.jpg)
James Reynolds, University of Utah
How Does Xgrid Work?
13
![Page 14: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/14.jpg)
James Reynolds, University of Utah
ControllerClientDedicated agents
Dedicated agent
Screensaver agent
Distributed agents
14
![Page 15: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/15.jpg)
James Reynolds, University of Utah
ControllerClientDedicated agents
Dedicated agent
Screensaver agent
Distributed agents
Client submits job to controller1
15
![Page 16: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/16.jpg)
James Reynolds, University of Utah
ControllerClientDedicated agents
Dedicated agent
Screensaver agent
Distributed agents
Client submits job to controller1
Controller splitsjob and submitsto Agents
2
16
![Page 17: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/17.jpg)
James Reynolds, University of Utah
ControllerClientDedicated agents
Dedicated agent
Screensaver agent
Distributed agents
Client submits job to controller1
Controller splitsjob and submitsto Agents
2Agentsexecutetasks
3
17
![Page 18: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/18.jpg)
James Reynolds, University of Utah
ControllerClientDedicated agents
Dedicated agent
Screensaver agent
Distributed agents
Client submits job to controller1
Controller splitsjob and submitsto Agents
2Agentsexecutetasks
3
Agents return results to Controller
4
18
![Page 19: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/19.jpg)
James Reynolds, University of Utah
ControllerClientDedicated agents
Dedicated agent
Screensaver agent
Distributed agents
Agentsexecutetasks
3Client submits job to controller1
Controller splitsjob and submitsto Agents
2
Agents return results to Controller
4Controller collects task results, then returns job to Client
5
19
![Page 20: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/20.jpg)
James Reynolds, University of Utah
How Do You Create Jobs
20
![Page 21: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/21.jpg)
James Reynolds, University of Utah
Creating Jobs
Agent is main focus
This has nothing to do with Xgrid
A “job” is just an application
Application must run unattended
Application tasks must be dividable
Tasks must be parallel
Dedicated agent
21
![Page 22: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/22.jpg)
James Reynolds, University of Utah
Application must run unattended
Command line apps are perfect & easy
Don’t require user input
No account required (runs as user “nobody”)
Can be logged out
GUI apps are harderAppleScript UI scripting may be required
Account required
Must be logged in
22
![Page 23: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/23.jpg)
James Reynolds, University of Utah
Dividing Application Tasks
Partial executionpovray -SF1 -EF2 file_to_render.ini
povray -SF3 -EF4 file_to_render.ini
Multiple filespovray file_to_render1.ini
povray file_to_render2.ini
MPI applications
23
![Page 24: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/24.jpg)
James Reynolds, University of Utah
Gridding Apps
Not easyPhotoshopFinal Cut ProVideo compression
ffmpegSorenson Squeeze looking into Xgrid
YesProbably 99% of scientific/math appsMany rendering/animation apps
POV-Ray/BlenderMaya 6 (create “/Alias/maya” writable by “nobody”)
24
![Page 25: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/25.jpg)
James Reynolds, University of Utah
How Do You Start Jobs?
25
![Page 26: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/26.jpg)
James Reynolds, University of Utah
How Do You Start Jobs?
Client is your main focusInterfaces into the grid
Xgrid.app & Plugin architecture
Command line
Cocoa
Xgrid.app plugin API
Xgrid API
Client
26
![Page 27: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/27.jpg)
James Reynolds, University of Utah
Xgrid.app & Plugins
27
![Page 28: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/28.jpg)
James Reynolds, University of Utah
Xgrid.app & Plugins
Name of plugin
28
![Page 29: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/29.jpg)
James Reynolds, University of Utah
Xgrid.app & Plugins
Location of app
29
![Page 30: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/30.jpg)
James Reynolds, University of Utah
Xgrid.app & Plugins
Command line arguments
30
![Page 31: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/31.jpg)
James Reynolds, University of Utah
Xgrid.app & Plugins
Run in backgroundwithout GUI
-b
31
![Page 32: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/32.jpg)
James Reynolds, University of Utah
Xgrid.app & Plugins
Path to file to process
~/Desktop/yourfile....
32
![Page 33: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/33.jpg)
James Reynolds, University of Utah
Xgrid.app & Plugins
Save output to file
-f
33
![Page 34: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/34.jpg)
James Reynolds, University of Utah
Xgrid.app & Plugins
1, 2, 3, 4, 5, 6, 7, 8, 9 ,10
Range: From 1 to 10 by 1
34
![Page 35: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/35.jpg)
James Reynolds, University of Utah
Xgrid.app & Plugins
Folder to send to agentsXgrid Agent will cd to this dir
35
![Page 36: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/36.jpg)
James Reynolds, University of Utah
Xgrid.app & Plugins
STDIN (if required)
36
![Page 37: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/37.jpg)
James Reynolds, University of Utah
Xgrid.app & Plugins
Where to save output
~/Desktop
37
![Page 38: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/38.jpg)
James Reynolds, University of Utah
Command Linesetenv XGRID_CONTROLLER_HOSTNAME 10.0.0.1setenv XGRID_CONTROLLER_PASSWORD L3TmeIN.
xgrid -job run -out ~/Desktop -in ~/Desktop/workingdir /Applications/blender/blender.app/
Contents/MacOS/blender -b ./yourfile -f 1
xgrid -job run -out ~/Desktop -in ~/Desktop/workingdir /Applications/blender/blender.app/
Contents/MacOS/blender -b ./yourfile -f 2
etc... to 10
38
![Page 39: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/39.jpg)
James Reynolds, University of Utah
Command LineNAME xgrid - submit and monitor xgrid jobs, nodes, and datasets
SYNOPSIS xgrid [-h[ostname] hostname] [-p[assword] password] xgrid -job run [-si stdin] [-in indir] [-so stdout] [-se stderr] [-out outdir] cmd [arg1 [...]] xgrid -job submit [-si stdin] [-in indir] cmd [arg1 [...]] xgrid -job results -id identifier [-so stdout] [-se stderr] [-out outdir] xgrid -job {stop | delete | parameters} -id identifier xgrid -job {list | info | status} -id identifier xgrid -node {list | info | status} -id identifier
39
![Page 40: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/40.jpg)
James Reynolds, University of Utah
Cocoa - Xgrid.app plugin API
Requires Xgrid.app
Only 1 non-Apple person (?) has tried it
CocoaDev Wiki article by Charles Parnot
www.cocoadev.com/index.pl?XGridDummyPlugin
40
![Page 41: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/41.jpg)
James Reynolds, University of Utah
Cocoa - Xgrid API
Was shown at WWDC 2004STILL NDA!!!!
:(
Slides are available to those who attendedSubject to change
Any app talks directly to Xgrid controllerAuthenticate
Send jobs
Retrieve results
41
![Page 42: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/42.jpg)
James Reynolds, University of Utah
Security
42
![Page 43: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/43.jpg)
James Reynolds, University of Utah
Security - Agent - User nobody
Can execute anything the world user can/Applications
/bin
/sbin
/usr/bin/
/usr/sbin
etc
43
![Page 44: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/44.jpg)
James Reynolds, University of Utah
Security - Agent - User nobody
Can read anything the world user can/etc/etc/authorization/etc/hostconfig/Library/Preferences/Users/name//Users/name/Publicetc
44
![Page 45: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/45.jpg)
James Reynolds, University of Utah
Security - Agent - User nobody
Can write anything the world user can/tmp
/var/tmp
/Volumes
/Users/name/Public/Drop Box
45
![Page 46: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/46.jpg)
James Reynolds, University of Utah
Security - Agent - User nobody
The main problem is not the OS or XgridThe main problem is developers
Many apps install 777/666Some are SUID root binaries
Developer responded that it isn’t a problem...!?!
One app creates 777 files all over the file systemWhat are they THINKING?!
Some even REQUIRE 777/666 or they don’t runBAD BAD BAD BAD BAD!!!!!!!
www.macenterprise.org/content/view/85/41/We feel like we are the only ones educating developers about this....
46
![Page 47: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/47.jpg)
James Reynolds, University of Utah
Security - Agent - User nobody
What does this mean?If you mildly trust the Client and Controller admin
Happy day, you are probably safe
Safer than running a new app you just downloaded
Xgrid jobs run with nobody user permissions
New app runs with your user permissions -- sudo anyone?
If you don’t know/trust admin or admin lives in country with no computer crime laws
You have to be insane to let them run jobs
47
![Page 48: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/48.jpg)
James Reynolds, University of Utah
Security - Server/Client
Server opens a port, 4111
All passwords are encrypted
Remaining content is not encrypted
But could be in the future
No known vulnerabilities
48
![Page 49: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/49.jpg)
James Reynolds, University of Utah
Installing & Setting up & Removing
49
![Page 50: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/50.jpg)
James Reynolds, University of Utah
How to install
Package installer - very easy to install/Applications/Xgrid BLAST.app/Applications/Xgrid.app <-- Xgrid.app/Library/Application Support/Xgrid/Library/PreferencePanes/Xgrid.prefPane/Library/Preferences/com.apple.xgrid.agent.plist/Library/Preferences/com.apple.xgrid.controller.plist/Library/Screen Savers/Xgrid.saver/Library/StartupItems/GridAgent/Library/StartupItems/GridServer/Library/Xgrid <-- most of the files/etc/xgrid/usr/bin/xgrid <-- command line tool/usr/libexec/xgrid <-- server processes in there/usr/share/man/man1/xgrid.1
50
![Page 51: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/51.jpg)
James Reynolds, University of Utah
How to remove/Library/Xgrid/Scripts/XgridUninstall.command
Stops all Xgrid processes
Removes all Xgrid files
51
![Page 52: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/52.jpg)
James Reynolds, University of Utah
Setting Up Agents
52
![Page 53: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/53.jpg)
James Reynolds, University of Utah
Set Up One Agent
Make sure computer name is unique
53
![Page 54: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/54.jpg)
James Reynolds, University of Utah
Set Up One AgentOpen System Preferences
Xgrid pane & Enter password
54
![Page 55: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/55.jpg)
James Reynolds, University of Utah
Set Up One Agent
Enter controller address
55
![Page 56: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/56.jpg)
James Reynolds, University of Utah
Set Up One AgentSet usage options
56
![Page 57: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/57.jpg)
James Reynolds, University of Utah
Set Up One Agent
Click Start
57
![Page 58: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/58.jpg)
James Reynolds, University of Utah
Setting Up Multiple Agents
Copy files to all agents/Library/Preferences/com.apple.xgrid.agent.plist/etc/xgrid/GridAgent/controller-password
Start Xgrid/Library/Xgrid/Scripts/agent_on/Library/Xgrid/Scripts/agent_start
Never delete this folder or files in it/Library/Xgrid/Agent/Cookies
58
![Page 59: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/59.jpg)
James Reynolds, University of Utah
Should we try it????
Connect to oreilly-xgrid.scl.utah.edu
Password: OR3illyXgird
59
![Page 60: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/60.jpg)
James Reynolds, University of Utah
Setting up a Controller
Just enter passwords and “Start”
60
![Page 61: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/61.jpg)
James Reynolds, University of Utah
Tips and Tricks
61
![Page 62: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/62.jpg)
James Reynolds, University of Utah
Tips and Tricks
Command line hangsDon’t run /usr/bin/xgrid on controller
http://www.macos.utah.edu/Documentation/xgrid/xgrid_job_v5.pl
OS limits (max open files & processes)http://www.macos.utah.edu/Documentation/xgrid/xgrid_job_v5.pl
Preference Pane helper tool is missinghttp://cmgm.stanford.edu/~cparnot/xgrid-stanford/install/prefpane-problem.html
62
![Page 63: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/63.jpg)
James Reynolds, University of Utah
Tips and Tricks
Controller crashesWrite a watcher script
Controller crashes because of memoryUse a server to store files
afp/nfs & fileserver, or curl & webserver
Connection issuesCheck controller firewallDon’t delete cookiesAgent machine name must be unique
63
![Page 64: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/64.jpg)
James Reynolds, University of Utah
Tips and Tricks
Application requires fixed path or files with fixed path
Pre-install applicationRecompile application
Application requires setup on agentUse a script that does the setup and launches the real application
Application can’t run as “nobody”/Library/Xgrid/Documentation/Xgrid Release Notes
64
![Page 65: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/65.jpg)
James Reynolds, University of Utah
3rd party additions
Linux agent
Daniel Côté
GridObjects
Fabio Invernizzi
www.xgrid.info
Potential to be an Xgrid “want ads”
65
![Page 66: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/66.jpg)
James Reynolds, University of Utah
Let’s Run A Job Right Now
66
![Page 67: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/67.jpg)
James Reynolds, University of Utah
Let’s Run A Job Right Now
Let’s just get the names of the computers
hostname
67
![Page 68: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/68.jpg)
James Reynolds, University of Utah
Let’s Run A Job ‘Till Thursday
Will execute POV-Ray renderChange to root and look in /tmp/xgagent.... to see what it is doingCreate folder /xgrid (777) to save resultsAIM chat room
“OReilly Xgrid”
Result will be posted at www.macos.utah.edu/xgrid/
68
![Page 69: Distributive Computing with Xgrid...Oct 26, 2004 · Session Overview What are people doing with Xgrid right now How does Xgrid work How do you create jobs How do you start jobs](https://reader034.vdocuments.net/reader034/viewer/2022052006/601a53750cffbe3e7f1fb6d6/html5/thumbnails/69.jpg)
James Reynolds, University of Utah
Q & A
?69