v.gavrilov 1, i.golutvin 2, o.kodolova 3, v.korenkov 2, l.levchuk 4, e.tikhonenko 2, s.shmatov...

26
V.Gavrilov 1 , I.Golutvin 2 , O.Kodolova 3 , V.Korenkov 2 , L.Levchuk 4 , E.Tikhonenko 2 , S.Shmatov 2 ,V.Zhiltsov 2 1- Institute of Theoretical and Experimental Physics, Moscow, Russia 2- Joint Institute for Nuclear Research, Dubna, Russia 3 – Skobeltsyn Institute of Nuclear Physics, Moscow, Russia 4 - National Scientific Center, Kharkov Institute of Physics and Technology, Kharkov NEC’2013 Varna, Bulgaria, September 13, 2013 RDMS CMS Computing

Upload: tyler-hamilton

Post on 12-Jan-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

V.Gavrilov1, I.Golutvin2, O.Kodolova3, V.Korenkov2, L.Levchuk4, E.Tikhonenko2, S.Shmatov2 ,V.Zhiltsov 2

1- Institute of Theoretical and Experimental Physics, Moscow, Russia 2- Joint Institute for Nuclear Research, Dubna, Russia

3 – Skobeltsyn Institute of Nuclear Physics, Moscow, Russia 4 - National Scientific Center, Kharkov Institute of Physics and Technology, Kharkov

NEC’2013 Varna, Bulgaria, September 13, 2013

RDMS CMS Computing

Page 2: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

2

RDMS Collaboration (about 300 scientists)

ArmeniaLPI

Russian Federation - 155

Dubna Member States - 87 JINR, Dubna - 68

CMS members:countries 8institutions 21scientists 308students 34Associated members:

institutions 3

CMS members:countries 8institutions 21scientists 308students 34Associated members:

institutions 3

Russia Russian Federation· Institute for High Energy Physics, Protvino· Institute for Theoretical and Experimental Physics, Moscow· Institute for Nuclear Research, RAS, Moscow· Moscow State University, Institute for Nuclear Physics,

Moscow· Petersburg Nuclear Physics Institute, RAS, St.Petersburg· P.N.Lebedev Physical Institute, Moscow

Associated members:· High Temperature Technology Center of Research &

Development Institute of Power Engineering, Moscow· Myasishchev Design Bureau, Zhukovsky· Electron, National Research Institute, St. Petersburg

JINR· Joint Institute for Nuclear Research, Dubna

Czech Republic· Charles University, Prague Georgia· High Energy Physics Institute, Tbilisi State

University, Tbilisi· Institute of Physics, Academy of

Science ,Tbilisi

Ukraine· Institute of Single Crystals of National Academy

of Science, Kharkov· National Scientific Center, Kharkov Institute of

Physics and Technology, Kharkov· Kharkov State University, Kharkov

Uzbekistan· Institute for Nuclear Physics, UAS, Tashkent

Dubna Member States Armenia· Yerevan Physics Institute, Yerevan

Belarus· Byelorussian State University, Minsk· Research Institute for Nuclear Problems,

Minsk· National Centre for Particle and High

Energy Physics, Minsk· Research Institute for Applied Physical

Problems, Minsk

Bulgaria· Institute for Nuclear Research and Nuclear

Energy, BAS, Sofia· University of Sofia, Sofia

Ukraine10

Bulgaria21

Belarus22

Uzbekistan11

Czech7

59PNPI

36MSU27

ITEP19

INR19

IHEP45

JINR68

Georgia11

Page 3: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

RDMS Full Responsibility

RDMSParticipation

ME1/1

HE

SE

ME

EE

FS

HF

RDMS Participation in CMS Construction

Page 4: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

Data Processing and Physics Analysis

Reconstruction & Object Performance

Calibration and alignment

Monte Carlo simulation

Design, production and installation of Detector System(Upgrade Activity)

H-like (125.2 GeV) Z0Z0 4

RDMS activities in CMS

ME1/1 muon chambers designed andproduced in Dubna

Page 5: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

RDMS CMS T2 association Now Future interest Analysis Groups

Exotica: T2_RU_JINR Exotica: T2_RU_INR

HI: T2_RU_SINP QCD: T2_RU_PNPI

Beyond the

2nd Generation (B2G): T2_UA_KIPT Top: T2_RU_SINP

FWD: T2_RU_IHEP

Object/Performance Groups

Muon: T2_RU_JINR e-gamma-ECAL: T2_RU_INR

JetMET-HCAL: T2_RU_ITEP

H-like Z0Z0 22e

Page 6: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

Forward Physics • Observation of diffraction in minbias events at LHC SINP MSU• Study of 2 jet production in hard single diffraction IHEP, MSU, Erevan• Study of 2 jet production in central diffraction IHEP, ITEP,

MSU, Erevan• Search for BFKL effects at di-jet production PNPI,

ITEP,INR• Measurement of azimuthal decorrelations of Mueller-Navelet dijets ITEP, PNPI, INR

QCD (Standard Model Analysis Group)• Measurement of the gamma+jet cross-sections JINR, ITEP,

MSU• Measurements of S JINR• Search for BFKL effects at jet production PNPI,

ITEP, INR• Study of jet shapes

JINR, ITEP, MSU• Study of jet fragmentation

JINR, MSU, LPI

EWK (Standard Model Analysis Group)• Measurement of DY muon pair production and F-B asymmetry JINR, Minsk, Gomel,

Kharkov• Measurement of Z with two forward jets ITEP,

MSU, PNPI• Measurement of triple boson couplings Minsk• Study of EW Z boson production with two jets at 7 and 8 TeV MSU, ITEP• Search for WW scattering at 8 TeV

ITEP

Top physics• Observing the t-channel single top process

IHEP, MSU

Heavy Ion • QGP hard probes (heavy quarkonia and jets) and soft probes (eliptic flow) MSU, LPI

RDMS in CMS Physics Analysis (Standard Model)

Page 7: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

RDMS in CMS Physics Analysis (Higgs and Beyond SM)

Higgs• Search for Higgs bosons in decays into 2 photons, 4 leptons, 2 leptons JINR, ITEP, MSU, Kharkov• Higgs boson decay to 2 muons MSU, ITEP

SUSY• Search for sleptons and lepton flavor number violation

INR

Exotics • Search for heavy neutrino and WR

INR• Search for new resonances (extra dimensions and Z’) in DY JINR• Search for non-resonance di-muon signals from ADD and compositeness JINR

Page 8: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

Example of Physics analysis with GRID in the CMS Experiment with Participation of Russian

Physicists

Measurement of the EW Z boson and two jets in pp collisions at √s = 7 TeV has been carried out using an integrated luminosity of 5 fb−1. σ (7 TeV)= 154 ± 24 (stat.) ± 46 (exp. Syst.) ± 27 (th. syst.) ± 3 (lum.) fb (mll > 50 GeV, pTj > 25 GeV, |η j|< 4.0, mjj >120 GeV)

Data and Monte-Carlo simulated events are distributed among N sites

Job is prepared at UI with CRAB submission toolinstalled (CMS SW on top of LCG middleware)

Run CRAB jobs: job is going to the site where events(Data or MC) are located

Monitoring through Dashboard (CERN IT tool)

Get results from SE to Local Desktop

Final analysis at local desktop

ref: CMS-PAS-FSQ-12-019

Page 9: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

9

CMS T2 requirements Basic requirements to CMS VO T2 sites

for Physics group hosting: a) persons responsible for site operation b) site visibility (BDII) c) availability of CMSSW actual version d) regular file transfer test “OK” e) Certified links with CMS T1: 2 up and 4 down f) CMS Hammer Cloud test “OK” g) Nominal T2-site: 10.9 kHS06 of Processing Resources 810 TB of Disk space: 30 TB of Stage Out Space 250 TB of Group Space (125 TB per group) 200 TB of Central Space 170 TB of Local Space 160 TB of User Space (~40 Users of 4 TB each)

Page 10: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

T2 readiness requirements

• Site visibility and CMS VO support

• Availability of disk and CPU resources

• Daily SAM availability > 80%

• Daily HummerCloud tests efficiency > 90%

• Commissioned (active) links TO Tier-1 sites ≥ 2

• Commissioned (active) links FROM Tier-1 sites ≥ 4

Page 11: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

RDMS CMS sites availability during last month

Page 12: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

Status of RDMS sites readiness on September 4, 2013( R –Ready; NR – Not Ready)

Page 13: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

Status of RDMS sites readiness on 18 July, 2012( R –Ready; NR – Not Ready)

Page 14: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

CPU time consumed by CMS VO at all CMS sites and at RDMS CMS sites

(October 2012- September 2013)

467,116,662 kSI2K

23% - consumed by Russian CMS users

All CMS sites

RDMS CMS sites

3% = 14,013,499 kSI2K

Page 15: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

CPU time consumed by CMS VO at all CMS sites and at RDMS CMS sites

(August 2011-July 2012)

267,434,620 kSI2K

11% - consumed by Russian CMS users

All CMS sites

RDMS CMS sites

4% = 10,697,384 kSI2K

Page 16: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

CPU time & Number of jobs at RDMS CMS sites during Nov.2009- Sept.2013

Page 17: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

Job Summary at RDMS CMS Sites for 2013as at the CMS Dashboard

Page 18: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

Data transfer volumes and rates (October 2012 – September 2013)

18

To Russian CMS sites

From Russian CMS sites

~ 600TB

200 TB

Page 19: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

Data transfer volumes and rates (August 2011 – July 2012)

19

To Russian CMS sites

From Russian CMS sites

~ 400TB

~ 160TB

Page 20: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

Data transfer volumes and rates (October 2012 – September 2013)

20

~ 20 TB From T2_UA_KIPT to CMS sites

To T2_UA_KIPT site~ 60TB

Page 21: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

Data transfer volumes and rates (August 2011 – July 2012)

21

> 5 TBFrom T2_UA_KIPT to CMS sites

To T2_UA_KIPT site~ 80TB

Page 22: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

CMS group-site associations for RU&UA sites: Space summary

22

July, 2012

April, 2012

September , 2013

September , 2013

Page 23: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

JINR-KIPT Common Activities in CMS Computing Support

Cooperation between JINR and KIPT (Kharkov, Ukraine) has been supported by 3 grants of Russian Foundation for Basic Research (RFBR) and Ukrainian Academy of Science:

08-07-90410-Ukr_a (2008-2009) “Preparation of LIT JINR (Dubna) and NSC KIPT (Kharkov) computing centers for CMS (CERN) distributed data analysis on the base of grid technologies” – completed (see: Bunetsky O. O. et al. , Preparation of NSC KIPT and JINR Grid-Infrastructures for Data Analysis at the CMS Experiment (CERN), P11-2010-11, Dubna, 2010, http://www1.jinr.ru/Preprints/2010/011%28P11-2010-11%29.pdf)

10-07-90400-Ukr_а (2010-2011) “Support and development of LIT JINR and NSC KIPT grid-infrastructures for CMS distributed data processing during the first two years of LHC operation” – completed

12-07-90402-Ukr_а (2012-2013) “Data processing at the LIT JINR and NSC KIPT T2-centers of the CMS grid infrastructure at high rate of the Large Hadron Collider luminosity increase” – in a progress

Page 24: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

RDMS Remote Operation Centres

Monitoring of detector systemsData Monitoring / Express AnalysisShift Operations (except for run

control)Communications of JINR shifter

with personal at CMS Control Room (SX5) and CMS Meyrin centre

Communications between JINR experts and CMS shifters

Coordination of data processing and data management

Training and Information24

JINR ROC was founded in 2009 as a part of GRID-based JINR Tier-2

MSU/IHEP ROCs were started-up two years after

Page 25: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental
Page 26: V.Gavrilov 1, I.Golutvin 2, O.Kodolova 3, V.Korenkov 2, L.Levchuk 4, E.Tikhonenko 2, S.Shmatov 2,V.Zhiltsov 2 1- Institute of Theoretical and Experimental

Summary

RDMS Tier2 sites contribute in the CMS Data Processing and Analysis Tasks

Þ Tier-2 sites are satisfied to CMS Computing Requirements

Þ they are involved actively into data processing and analysis (as of

CMS Physics Groups associated sites)

Þ CMS Regional Operation Centers in JINR/MSU/IHEP/FIAN are operated for remote monitoring of detector systems and data express-analysis

There is still a number of problems (technical, financial etc.) preventing RDMS Tier2 sites to increase their resources and operation stability

A stable and successful operation of several RDMS CMS Tier2 centers and years of operating experience lead to creation the CMS Tier-1 center in Russia as an integral part of the central data handling service of the CMS Experiment (CMS Tier-1 in Dubna)