session 7: using national grids - marquette universityintroductionteragridopen science gridother...
TRANSCRIPT
Introduction TeraGrid Open Science Grid Other Resources Conclusion
Session 7: Using National Grids
Craig A. Struble, Ph.D.
July 15, 2010
1 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
TeraGrid
http://www.teragrid.org
2 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
TeraGrid Resources
Large parallel computers
Research clouds based on Nimbus
Distributed computing resources on Condor
GPU cluster
Visualization cluster
3 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
TeraGrid Resource Locations
Indiana University
LONI
NCAR
NCSA
NICS
ORNL
PSC
Purdue
SDSC
TACC
4 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
TeraGrid Champions
Assist in
Getting access
Proposal development
Finding help
Finding appropriate resources
Marquette has 3 champions
Xizhou Feng
Lars Olson
Craig Struble
5 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
User Portal
https://portal.teragrid.org
6 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
Resource Allocations
Startup/Education Allocation
30,000 - 200,000 Service Units (SUs)No request deadlines2 weeks after submission
Research Allocation
200,000 - Unlimited SUs4 deadlines: Jan 15, Apr 15, Jul 15, Oct 154 starts: Apr 1, Jul 1, Oct 1, Jan 110 page, 15 page proposal
Most NSF-funded projects are eligible for TeraGrid allocations.
7 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
Open Science Grid
http://www.opensciencegrid.org
8 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
Gaining Access
“OSG does not currently support individual researchers. Rather,users of the OSG are required to band together into VirtualOrganizations (VOs).”
Join the general OSG VO
Join an existing VO(http://www.opensciencegrid.org/VO_List)
Create a new VO
9 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
Using OSG
Depends on VO you join.
Condor and Globus tools are common queuing systems.
Can set up local submission nodes for your team’s use.
10 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
OSG Resources
Much more integrated than TeraGrid
Hadoop and other large storage file systems
Primarily for distributed, high-throughput jobs
11 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
Clouds
A cloud provides a flexible environment for developing applicationsthat run on many machines you don’t own. Usually, a sharedstorage system is provided by a cloud provided for largestorage/analysis needs. Some clouds let you choose the operatingsystem to run, as if you do own the machines.
Microsoft Azure
Available to NSF funded projects
Amazon EC2
Has educational program for $100 credit
Shameless Plug: Clouded Computational Science will be offered inFall 2010 and will cover using clouds.
12 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
More Resources
caGrid (http://cagrid.org/display/cagridhome/Home)
BOINC (http://boinc.berkeley.edu/)
13 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
Summary
MUGrid is a bridge to national grid resources
National grid resources are larger and more specialized
TeraGrid is better suited for large, parallel style jobs
OSG is better suited for large, distribute, high-throughput jobs
14 / 15
Introduction TeraGrid Open Science Grid Other Resources Conclusion
Get Started
Practice using MUGrid
Contact Xizhou, Lars or Craig for help with TeraGrid
Contact Craig for help with OSG, BOINC, or other resources
15 / 15