tg user services coordination december 2006
DESCRIPTION
TG User Services Coordination December 2006. PSC. PU. UC/ANL. NCAR. IU. NCSA. ORNL. TACC. SDSC. Strategic Issues. - PowerPoint PPT PresentationTRANSCRIPT
December 2006Sergiu Sanielevici([email protected])
TG User Services Coordination December 2006
SDSC
NCAR
TACC
UC/ANL
NCSA
ORNL
PUIU
PSC
December 2006Sergiu Sanielevici([email protected])
Strategic Issues
• Petascale simulation needs strongly coupled TeraGrid resources for pre- and post-processing, data analysis,mining/filtering, visualization, steering, and management at various time scales.
• We need to get ready: engineer applications & workflows to efficiently use ultrascale systems and Grid based technologies; train our consultants and users; implement a scalable information system to support this work.
• We have made a start: SC06 successes, user information design.
December 2006Sergiu Sanielevici([email protected])
TeraGrid Wins Again!
• SC|06 HPC Analytics Challenge Winning team: CMU/U Texas Austin/UC Davis/PSC "Remote "Remote Runtime Steering of Integrated Terascale Runtime Steering of Integrated Terascale Simulation and Visualization" Simulation and Visualization" Recall that SC|05 Analytics Challenge was also won on TG
systems, with ASTA support!
• SC|06 Bandwidth Challenge Honorable Mention:
IU/PSC/ORNL Lustre-WAN experiments: "All in a Day's Work: Advancing Data Intensive Research
with the Data Capacitor"
December 2006Sergiu Sanielevici([email protected])
December 2006Sergiu Sanielevici([email protected])
December 2006Sergiu Sanielevici([email protected])
Impact of Completed ASTA Projects
Published TG Science Features, News, Nuggets:Published TG Science Features, News, Nuggets:• Arterial Karniadakis (Brown U) CTS mpich-G2, Grid interop, GridFTP, Remote Viz, PDIO Steering mpich-G2, Grid interop, GridFTP, Remote Viz, PDIO Steering • Vortonics Boghosian (Tufts U) CTS mpich-G2, Grid interop, Remote Vizmpich-G2, Grid interop, Remote Viz• SPICE Coveney (UCL) CHE Grid interop, Steering, GridFTP ; AHEGrid interop, Steering, GridFTP ; AHE• ENZO Norman (UCSD) AST GridFTP, WAN-GPFS, DMOVER, SRB, Task MappingGridFTP, WAN-GPFS, DMOVER, SRB, Task Mapping• SCEC yr1 Olsen (SDSU) GEO pegasus-VDS, GridFTP/tgcp, WAN-GPFS, SRBpegasus-VDS, GridFTP/tgcp, WAN-GPFS, SRB• BIRN Ellisman (SDSC) BIO WAN-GPFS, SRBWAN-GPFS, SRB• CMS Newman (Caltech) PHY MyCluster/GridShell MyCluster/GridShell • Crystal Deem (Rice) PHY MyCluster/GridShell MyCluster/GridShell • Tstorms Droegemeier (OU) ATM parallel scalability,I/O design, ensemble simulationsparallel scalability,I/O design, ensemble simulations• GADU Maltsev (U Chicago) BIO pegasus-VDS, Grid interoppegasus-VDS, Grid interop
Infrastructural enablers:Injector Heister (Purdue) ASC parallel scalabilityparallel scalabilityMD-Data Jakobsson (UIUC) BIO gsicp, gsissh; customized portalgsicp, gsissh; customized portalNREL Brady (Cornell) BIO parallel scalabilityparallel scalability CIG Gurnis (Caltech) GEO community code development, SGW developmentcommunity code development, SGW developmentEarthScope Pavlis (IU) GEO parallelizationparallelization
December 2006Sergiu Sanielevici([email protected])
GADU on TeraGrid and OSG…Bioinformatics is all about Comparative analysis:
• Insights of Biology are gained by Comparative Analysis:• Comparative analysis to know what is same and different between strains of an Organism• Difference between Pathogenic and non-pathogenic organisms.
ToolsBLAST , Blocks, Chisel, Interpro etc. : BLAST , Blocks, Chisel, Interpro etc. : An embarrassingly parallel workload.An embarrassingly parallel workload.
• Opportunistic use of resources without reservations.• An interoperable setup to use both the Grids.
• Site selection and scheduling across OSG and TeraGrid Sites.
• GADU uses Pegasus based Virtual Data System (developed under the Griphyn Project) to generate resource specific job submission files.
• A common installation and job submission setup for both the Grids.
GADU uses TeraGrid and OSG resources simultaneously:
December 2006Sergiu Sanielevici([email protected])
Results:Last Run .. ( November 2006)
Ran 75000 BLAST Jobs
Ran 40800 Blocks JobsUsage: 70% OSG : 30% Teragrid
• GADU was able to get about 700 CPUs throughout the last run on OSG and TeraGrid together.
• TeraGrid Community Space helped in standardizing the GADU’s installation of various TeraGrid sites.
Acknowledgements: • TeraGrid User Support Group - ASTA
David O’Neal (GIG/PSC), Joseph Insley (UC/ANL), Krishna Muriki (SDSC)
• OSG Operations – Support in getting more resources for GADU VO.• Globus and VDS Support.
• On the Application Level (OSG and TeraGrid resources helped in) : • Analyzing more than 1,000 Prokaryotic and Eukaryotic genomes using various
tools such as BLAST, Blocks and Chisel via PUMA2, Pathos and Target
• Analyzing User submitted genomes via GNARE for groups such “Shewanella Federation” (Analyzed 13 Strains of Shewanella) and “Center for Genomic Sciences” at West Penn Allegheny Health System (Analyzed Strains of Beggiatoa and Haemophilus influenzae)
December 2006Sergiu Sanielevici([email protected])
Current ASTA Projects
SCEC yr.2 Olsen (SDSU) GEO Cui (SDSC), Reddy (GIG/PSC)Turbulence Woodward (U Minn) ASC Reddy (PSC)Nemo3D Klimeck (Purdue) ECD Raymond (GIG/PSC), Muriki (SDSC)Epidemiology Barrett (VA Poly) Cuticchia (Duke) BCS Marcusiu (NCSA)Demography Lansing (U Arizona) DBS Majumdar (SDSC), Gomez (PSC)Remote Biological Microscopy Gilpin (U Texas) MCB Hempel (TACC)Adaptive GIN MD/QM Nakano (USC) DMR Brown (PSC)Pulmonary Immunity Benos (Pitt) MCB Raymond (GIG/PSC)Pleistocene Hydrology Person (IU) EAR Wang (IU)Failure of Human Bone Keaveny (UCB) MCA Majumdar (SDSC)QUAKE Bielak (CMU) MCA Urbanic (PSC)
December 2006Sergiu Sanielevici([email protected])
Vision for TeraGrid Information Flow
Info In
• Wiki• Ticket System• Knowledge Base• MDS• Resources Catalog DB (TGCDB)• Science Gateways• Accounting• User News DB• Systems monitors• Software repository(from users, systems, and staff)
Info Out
• User Info• Knowledge Base (in User Info) • Portal• Wiki• Science Gateways• RP site User Guides• User News Display• Inca• Software pages
December 2006Sergiu Sanielevici([email protected])
Ticket System
DB
ResourceCatalog(TGCDB)
Allocated Users Wiki
MDS
Portal
Help Desk Consultants, User Services/ASTA
IncaUser Info
KBWill be in User Info
Docs Coord,WG, Portal, KB, Doc Group, & other Staff
RP
Site
System
s
Automated/Dynamic
Human-mediated
Elements of the TeraGrid Information System
SoftwareRepository
RP
Web
Sites
User News
KnowledgeBase
User News DB
Accounting(TGCDB)
INCA DB
December 2006Sergiu Sanielevici([email protected])
Info systems under development for 2007
INCA DB
User News DB
User News
User InfoInca
KnowledgeBase
Allocated Users
Help Desk Consultants, etc.
KBWill be in User Info
KB Staff
Ticket System
DB
RP
Site
Syste
ms
MDS
Portal
Allocated Users WikiTG STaff.
Automated/Dynamic
Human-mediated
ResourceCatalog(TGCDB)
RP
Web
Sites
RP
site sta
ff
User Info