the state of dosar
DESCRIPTION
The State of DOSAR. DOSAR VI Workshop at Ole Miss April 17-18 2008. Dick Greenwood Louisiana Tech University. What is DOSAR ?. D istributed O rganization for S cientific & A cademic R esearch. Community and campus based grid organization Its primary goal is spreading/enabling grid use - PowerPoint PPT PresentationTRANSCRIPT
The State of DOSAR
DOSAR VI Workshop at Ole Miss
April 17-18 2008
Dick Greenwood
Louisiana Tech University
– Community and campus based grid organization– Its primary goal is spreading/enabling grid use
• DOSAR in Korean is the God of Martial Arts
• DOSAR evolved from the DØ Remote Analysis effort– Coordinated group efforts in DØ
simulation/reconstruction/production
What is DOSAR ?
Distributed Organization for Scientific & Academic Research
4/17/2008 2Dick Greenwood DOSAR VI at OleMiss
History
Ancient times: DØ Remote Computing Era
– SAM, DØ data management system, in place: pre-2001
– DØ Remote Analysis Model Proposed: Nov. 2001
– Proposal for RAC accepted and endorsed by DØ: Aug. 2002
– UTA awarded MRI for RAC: June 2002
– Formation of DØ Southern Analysis Region (D0SAR 1.0): Apr. 2003
• D0SAR DØ MC Production begins
– Activation of 1st US (Regional Analysis Center) RAC at UTA: Nov. 2003
– Formation and activation of DOSAR Grid for MC: Apr. 2004
4/17/2008 3Dick Greenwood DOSAR VI at OleMiss
Desktop Analysis Stations
Institutional Analysis Centers
Regional Analysis Centers
Normal InteractionCommunication PathOccasional Interaction Communication Path
Central Analysis Center (CAC)
DAS DAS…. DAS DAS….
IAC...
IAC IAC…
IAC
RAC….
RAC
DØ Remote Analysis Model (DØRAM)
Fermilab
•Data and Resource hub•MC Production•Data processing•Data analysis
4/17/2008 4Dick Greenwood DOSAR VI at OleMiss
History
– Transition to Distributed Organization for Scientific and
Academic Research, DOSAR: Apr. 2005 (DOSAR 2.0)
• Active engagements with LHC experiments began
– DOSAR VOMS installed at UTA: May 2005
– DOSAR registered as a VO in OSG: July 2005
– ATLAS distributed production and analysis system,
Panda, implemented at OU and UTA: Jan. 2006
– All groups engaged in LHC experiments
Modern times: beyond DØ
4/17/2008 5Dick Greenwood DOSAR VI at OleMiss
Who is DOSAR ?
First Generation IAC’s University of Texas at
Arlington Louisiana Tech
University Langston University University of Oklahoma Tata Institute (India)
• Second Generation IAC’s– Cinvestav, Mexico
SPRACE - São Paulo Regional Analysis Center, Universidade Estadual Paulista; Brazil
University of Kansas Kansas State University
• Third Generation IAC’s– University of Arizona, Tucson– Rice University Ole Miss, University of
Mississippi
Iowa State University Louisiana State University Oklahoma State University …4/17/2008 6Dick Greenwood
DOSAR VI at OleMiss
7
Goals
DOSAR seeks to bring together institutions which can/must use GRID technology to solve their computing problems (esp smaller institutions)
As its needs increase faster than funding, the scientific community should try to tap into these un(under)-used resources but, there are many barriers to utilizing these resources (technical, financial, manpower, …)
DOSAR should, as necessary, serve as a representative/liason for these institutions to the greater GRID community
DOSAR should help enable maximal use of available resources at the member institutions
(strength in collaboration)
(member institutions should serve as nucleation points for regional/statewide GRIDS)
Accomplishments
→ LTU brought in Super-Mike and additional resources for DØ & ATLAS
→ UTA plays leadership role in HiPCAT, Texas Grid community; Leading BioTex grid, working with chemists, geologists and medical professionals
→ LTU Working as a leading institution in LONI, Louisiana Grid community
→ OU and LU have been working toward creating “The Oklahoma state grid”, working closely with OSCER
→ OU has successfully developed a Condor pool of pc’s running CoLinux on Windows. UTA is developing a similar system.
→ SPRACE leads Brazilian national grid effort w/ funds!!!4/17/2008 8Dick Greenwood
DOSAR VI at OleMiss
DØ Production
4/17/2008 9Dick Greenwood DOSAR VI at OleMiss
Breakdown of DOSAR Contribution to DØ Production
4/17/2008 10Dick Greenwood DOSAR VI at OleMiss
DOSAR Weekly Production by site(common scale)
4/17/2008 11Dick Greenwood DOSAR VI at OleMiss
DOSAR Weekly Production by site
4/17/2008 12Dick Greenwood DOSAR VI at OleMiss
Some Successes in DOSAR Funding
• Funds from NSF MRI for UTA – RAC: 2002– Construction of the first U.S.
university based RAC• EPSCoR + University funds for LTU –
IAC: 2003– Increase IAC compute resources
• Brazilian National Funds for SPRACE: 2003 & 5– Construction of an extensive RAC
• EPSCoR funds for OSU, OU & LU: 2004– Compute resources for IAC– Human resource for further development– Renewal submitted
• LTU at part of LONI wins support from State of LA: 2005
• OU, LU and UTA, together with UNM, won a joint ATLAS Tier 2 site: 2005
• LTU won a joint MRI funds (PetaShare): 2006
4/17/2008 13Dick Greenwood DOSAR VI at OleMiss
DOSAR Strategy
• Maximally exploit existing software and utilities to enable as many sites to contribute to the DØ and LHC experiments– Continue to participate in DØ MC and Reco
activities in opportunistic manner– Focus on LHC experiments– Support OSG move into the global grid
framework– Engage in and contribute significantly in OSG
• Engage in realization of computing grid beyond HEP– Work closely with campus and state
computing people to bring grid onto campuses
• Bring DOSAR specific computing jobs to the grid
• Want to make grid usage more commonplace4/17/2008 14Dick Greenwood
DOSAR VI at OleMiss
Working with OSG
• We accomplished virtually everything we wanted in DØ
– J. Snow (LU) is the leader in MC production
• Bring fresh expertise to OSG• Expertise in monitoring solutions such as
Ganglia and MonALISA UTA working on Panda ATLAS monitoring together with CMS experiment
• LTU continues to investigate HA applications • DOSAR now has seat on OSG Council• Possibly engage non-HEP science use of
DOSAR?4/17/2008 15Dick Greenwood DOSAR VI at OleMiss
Developments Since Last Workshop
4/17/2008 16Dick Greenwood DOSAR VI at OleMiss
Ole Miss is ready to resume MC production!
•Got OSG v0.6.0 working (October 2007)• Fixed Condor configuration (November 2007)• Running OSG Jobs (11/2007 - 2/2008)• Power Failure “broke” Condor (February 2007• Upgraded Condor (April 2007)• Reconfigured Farm and Upgraded OSG (April 2007)
Further Developments
4/17/2008 17Dick Greenwood DOSAR VI at OleMiss
DOSAR Members Very Active in LHC Preparations for Data Taking
•All ATLAS members engaged in Tier 2 and Tier 3 FDR activities
Jim Cochran (ISU)leads the US ATLAS FDR effort and was recently appointed Chair of the U.S. ATLAS Analysis Support Activities
•Sao Paulo Groups (UNESP & UFABC) playing similar Tier 2 role in CMS preparations
Conclusions• DOSAR is an example of a successful grid
organization– Critically important asset to DØ
• All groups actively engaged in LHC experiments- (and preparations for data taking!)
• Using DOSAR resources for DØ and LHC data analyses and production
• Closely engaged in OSG activities• Continue Desktop Cluster deployment,
CONDOR pools• Provide leadership role in state-wide grid
efforts• Expanding membership and scope
4/17/2008 18Dick Greenwood DOSAR VI at OleMiss