grid deployment status and plan at kek isgc2007 takashi sasaki kek computing research center
TRANSCRIPT
GRID Deployment Status and Plan at KEK
ISGC2007
Takashi SasakiKEK Computing Research Center
ISGC2007 27/MAR/2007 [email protected] 2
Who we are?
KEK (High Energy Accelerator Research Organization)Inter University Research Institute Corporation since 2004 National Institute previouslyStill 100% funded by the government
Mission Carry out research related accelerator science
Particle Physics, Material Science, Life Science and so on Supporting collaborating universities
Universities have a freedom for the choice and they can be independent of us
ISGC2007 27/MAR/2007 [email protected] 3
KEKNagoya U.
U. Tokyo
Tokyo Inst. of Tech.
Tsukuba U.
Osaka U.
ICRR/Tpkyo
Kyoto U.JAEA Tokai
Waseda U.
Hiroshima U
Niigata U.
Nara Women U.
Osaka city U.
Shinshu U.
RIKEN
Okayama U.Kobe U.
Kanazawa U.
Kamioka
SuperSINET nodesSINET nodes
High Energy Physics in Japan
ATLAS at LHC CDF at FNAL
KEK BELLE
J-PARC
KamLand
SuperKamiokandeTohoku U.
Tokyo Metropolitan U.
Major High Energy Activities in JapanTerminated in the JFY2005
K2K Experiment at Kamiokande and KEK
Active ExperimentsBelle Experiment at KEKKamLAND at KamiokaCDF at FermiLab/USA
Under constructionJ-PARC
T2K Experiment at Tokai and KamiokaATLAS and ALICE at LHC
Future PlanSuperB FactoryInternational Linear Collider (ILC)
HEPnet-J: High Energy Physics Network in JapanKEK provides the network facility, NEPnet-J,
on the SINET/SuperSINET (NII) 。
ISGC2007 27/MAR/2007 [email protected] 4
TsukubaTsukuba
Tokai
High Energy Accelerator Research OrganizationHigh Energy Accelerator Research OrganizationHigh Energy Accelerator Research OrganizationHigh Energy Accelerator Research Organization
J-PARCJ-PARC
B-FactoryB-Factory
Photon-FactoryPhoton-Factory
LC-Test FacilityLC-Test FacilityNarita Airport
ISGC2007 27/MAR/2007 [email protected] 5
KEKB e+ e- ColliderKEKB e+ e- Collider
e+ source
Ares RF cavity
SCC RF(HER)
ARES
(LER)
3.5 GeVe+
8 GeVe-
B0J/KS
B0J/KS
Observation of CPV in the B meson systemObservation of CPV
in the B meson system
Belle Experiment13 countries, 57 institutes, ~400 collaborators
ISGC2007 27/MAR/2007 [email protected] 6
Strategy on GRID deployment
Highest priority is support on Belle and ILCLCG deployment
Help Universities to start overR&D
Preparing for ILCJapan has strong will to host ILC
NAREGIJapanese flagship project on developing a GRID middleware May substitute LCG/gLite in the future
GRID interoperability is the key
ISGC2007 27/MAR/2007 [email protected] 7
LCG at KEK
Computer Systems relatedCentral Information System since Feb. 20. 2006
Central Computer System ■ GRID System ■ Mail System, etc.B Factory Computer System since Mar. 23. 2006
CPU : 45,662 SI2K rate ■ Disk : 1 PB ■ Tape : 3.5 PB1st Phase
KEK Grid CA approved by APGRID PMA and has been in operation since Jan. 2006.
The third official Grid CA in JapanNAREGI CA software was modified to use at KEK.KEK employee and their collaborators are eligible for this service.
LCG and SRB for production usage are available on the GIRD Systemnot for public usage, but for supporting projects
WN: 36 nodes x 2 =72 CPUStorage: Disk (2TB) + HPSS(~200TB)Supported VO: Belle, APDG, Atlas_J
in operation since May 20062nd Phase
since Jan. 2007, LCG is going to be deployed in the Belle production.
ISGC2007 27/MAR/2007 [email protected] 8
LCG Sites at KEKLCG Sites at KEK
JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01
since Nov. 2005.since Nov. 2005.Site Role:Site Role:
ExperimentalExperimentalResource and Component:Resource and Component:
SL-3.0.5 w/ gLite-3.0 laterSL-3.0.5 w/ gLite-3.0 laterCPU: 14, Storage: ~1.5TBCPU: 14, Storage: ~1.5TBFTS, FTA, RB, MON, BDII, LFC, CE, SEFTS, FTA, RB, MON, BDII, LFC, CE, SE
Supported VOs:Supported VOs:belle, apdg, g4med, ppj, dteam, ops and ailbelle, apdg, g4med, ppj, dteam, ops and ail
JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02
since early 2006.since early 2006.Site Role:Site Role:
Production Production Resource and Component:Resource and Component:
SL or SLC w/ gLite-3.0 laterSL or SLC w/ gLite-3.0 laterCPU: 48, Storage: ~1TB (w/o HPSS)CPU: 48, Storage: ~1TB (w/o HPSS)Full componentsFull components
Supported VOs:Supported VOs:belle, apdg, g4med, atlasj, ppj, ilc, dteam, ops belle, apdg, g4med, atlasj, ppj, ilc, dteam, ops and ailand ail
88
We depends on services by APROC We depends on services by APROC members in ASGC, Taiwan.members in ASGC, Taiwan.We depends on services by APROC We depends on services by APROC members in ASGC, Taiwan.members in ASGC, Taiwan.
ISGC2007 27/MAR/2007 [email protected] 9
Belle GRID
LCG services are provided by the Central Computer systemOnly storage system is used in B Factory computer system Almost the same size of LHC tier-1 centersCPU’s are served in the future
JP-KEK-CRC-02 is the production site Belle data is exported by SRB-DSI
Very useful to export existing data SRB-SRM is desirable still
iRODs?
ISGC2007 27/MAR/2007 [email protected] 10
LCG at KEK (2)
Data Trans in Belle Grid
CRC-01 CRC-02
HPSSDisk/HSM
AS(Taiwan)
Melbourne
LCG/gLiteLCG/gLite
SRB-DSI
B Factory-system
SRBMCAT
SRB server
File servers
WS
Kracow
CPUs
SRB files Local files
Nagoya
Grid files
Grid-system
ISGC2007 27/MAR/2007 [email protected] 111111
B Factory Computer SystemB Factory Computer System
- New B Factory Computer System since March 23. 2006- New B Factory Computer System since March 23. 2006- History of B Factory Computer System- History of B Factory Computer System
Moore’s Law: 1.5y=x2.0 4y=x~6.3 5y=x~10
ISGC2007 27/MAR/2007 [email protected] 12
Total Number of Jobs at KEK in Total Number of Jobs at KEK in 20062006
1212
JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01 JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02
200200
700700
400400
1,0001,000
1,4001,400
BELLEBELLEBELLEBELLEBELLEBELLEBELLEBELLE
ISGC2007 27/MAR/2007 [email protected] 13
Total CPU Time at KEK in 2006Total CPU Time at KEK in 2006(Normalized by 1kSI2K)(Normalized by 1kSI2K)
1313
JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01JP-KEK-CRC-01 JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02JP-KEK-CRC-02
4,0004,000
3,0003,000
1,000 [hrs kSI2K]1,000 [hrs kSI2K]
12,00012,000
10,00010,000
4,0004,000
BELLEBELLEBELLEBELLEBELLEBELLEBELLEBELLE
ISGC2007 27/MAR/2007 [email protected] 14
JLCG
Sponsored by the s-Science promotion program of National Institute of InformaticsLCG federation among Japanese Universities and KEKNagoya: ATLAS, Belle University of Tohoku :ILC, KamLandUniversity of Tsukuba :ATLAS, ILCKobe University: ATLAS, ILCHiroshima Institute of Tech.: ATLAS, Information science KEK: Belle, ILC, ATLAS…
KEK behaves as GOC
ISGC2007 27/MAR/2007 [email protected] 15
NAREGI at KEK
NAREGINational Research GRID Initiative
What we expect? Better quality Better functionality
Job submissions with NAREGI is almost 3times faster than gLite3 now
Better support
We may substitute LCG/gLite with NAREGI if NAREGI works as advertised GRID interoperability is the key
We are working together with NAREGI for this issue
Support on operation and application adoption is necessary LCG is very excellent in support on deployment and operations
ISGC2007 27/MAR/2007 [email protected] 16
NAREGI at KEK (2)
NAREGI-betatest bed6nodes+3nodes(DG)Installation
Naregi-beta 1.0 : Nov. 2006Information, PSE, WFT, GVS
Naregi-DG : Feb 2007Test by Application
P152 (Heavy ion) experimentData analysisdata processing, then stored the results to SRB through SRB-DSI gate way
Belle event simulation
We found several inconvenient differences between gLite and NAREGI
ask NAREGI group to improve
nrg05
nrg00
nrg03
nrg01
nrg09
nrg02
nrg04
Portal node:
Super Scheduler:SS
Inforamtion Server:IS
Grid VM Sever:GVMGridVM engine node-1
GridVM engine node-2
User Manag. Serv.: VOMS
nrg10
nrg11
Gfarm FS
DG MCS(Metadata)
DG RMS(Resource Manag.)
ISGC2007 27/MAR/2007 [email protected] 17
GRID at KEK
GRID environment at KEK
gLite/CRC-01
gLite/CRC-02
HPSS
gLite/EGEEgLite/EGEE
SRB-DSI
SRBMCAT
SRB server
CPUs
SRB filesLocal files
Grid files
Naregi-kek
2007.2.9
ISGC2007 27/MAR/2007 [email protected] 18
Plan
More production use of LCGBelle
Collaboration with ASGC, National Central Univeristy(Taiwan), U. of Melborne, Krakow and so on
ILC GRIDCollaboration with CC-IN2P3 Start with CALICE
NAREGI-LCG(gLite) interoperability More tests locally and discussion with NAREGI
Seeking a possible scenario to have a tier-1 center in Japan in the future (2012?)Good practice for hosting the tier-0 center of ILC
ISGC2007 27/MAR/2007 [email protected] 19
Collaboration in Asia Pacific
Belle GRID was established by the collaboration of people in Asia PacificASGC. KNU Korea, NCU Taiwan and U. of Melbourn
We depends on efforts of ASGC very much for the operation of LCGWe sent our stuffs to ASGC for their training
We seek further collaboration in this region LCG operationAnyone who has interests in NAREGI deployment? (anybody, not only people in this region)
ISGC2007 27/MAR/2007 [email protected] 20
Summary
KEK Grid CA (member of APGRID PMA)LCG
JP-KEK-CRC-01 and 02Belle Experiment
B Factory Computer SystemSize : Tier1 level
LCG deploymentshare the simulation data among the collaborating institutionsnear future:
share the experimental data and mutual job submissionJLCG
Tohoku U. / Tsukuba U./ Kobe U./ Hiroshima Tech. / Nagoya U. / KEKNAREGI at KEK
NAREGI-beta Test bedTest by the data analysis programUsage of SRB through SRB-DSIInstallation of NAREGI-DG in progress
From now onTest of NAREGI-DGTest of Interoperability between gLite and NAREGI
ISGC2007 27/MAR/2007 [email protected] 21
Acknowledgements
We thank ASGC for their great support on the LCG/gLite operation A.E. Chen, Hide Nakazawa (NCU Taiwan), Glenn Moloney, Marco La Rosa (U. of Melbourne), Simon Lin and his stuffs at ASGC helped us for Belle GRID. We appreciate very much for them. We thank people in NAREGI for their supports on us