Michele de Gruttola 2008 Report:

Online to Offline tool for non event data data

transferring using database

Collision data workflow

Raw data(Event data)

Condition data(Non event data)

CMSSW

04/21/23

Data taken from the detectors can be divided in event data (RAW data) collecting the physical responses of the detector devices to collisions, and non event data, such as the conditions of the detector (magnetic field value, status of the electronic devices, currents….) and calibration of the various subdetector components (alignment, drift time values of the drift tube, pedestals mean and error, noise, Lorentz angle of the strip).

Both event data and non event data are needed to properly reconstruct all physical quantities

Conditions/calibrations workflow

Conditions data are saved in Oracle database and transferred from online network (physically at CERN P5) to offline network (CERN network and so to the all communities and institutes)

ONLINE OFFLINE

Relational Databases (OMDS, Online Master Data Storage)

POPCON

POPCON

Automatic streaming

Pool-ORA db(ORCON, Offline Reconstraction Condition DB ONline Set

Pool-ORA db(ORCOFF, Offline Reconstraction Condition DB OFFline Set

04/21/23

Why databases for conditions?

Condition/calibration data are very important to validate and correctly analyze collision data, and a correct understating of condition quantities, and the possibility to update, recalculate and retrieve them is very critical during the overall life and activity of the experiment.

Condition/Calibration data event are almost .5 TB per year

Many efforts has been devoted to develop and testing a robust storing/transferring/retrieving system using Oracle-Database and Pool-Ora technology. Calibration/Condition data coming form online network (i.e. in the detector computers and devices’ network), from different sources (databases, txt files, root file, etc.) are packed as C++ object and moved in the Online condition database (ORCON) via a dedicated package called PopCon (Populator of Condition Objects) fully integrated in the overall CMSSW. The data are then automatically streamed to the offline database (ORCOFF) and so accessible in the offline network as C++ object. This mechanism has been intensively and succesfully used during 2008 tests with cosmic rays. 04/21/23

PopCon feautures (1) PopCon (Populator of Condition) has been ideated by V. Innocente…… The application is currently under mine responsibility

and has been improved this year, deployed and applied to all subsystems

PopCon encapsulate data coming from different sources (txt, xml file as typical from calibration output of offline C++/CMSSW jobs, and relational table in OMDS, as typical for condition data) in Pool-ORA object, i.e. in C++ classes in a proper format to be stored in Oracle database, and retrievable as pool-object (i.e. compatible with ROOT framework, as the Event data themselves).

PopCon assign to every condition/calibration object an IOV (Interval of validity) as run number or timestamp (microseconds from 1/1/1970 in UTC)

PopCon assign a tag to the data. A new tag correspond to a new recalculated calibrations

All coherent tags are grouped in a global tag, and retrieved OFFLINE with Frontier technology

PopCon provide also a log every transaction. Thanks to that a complete transaction history monitor has been be set up.

04/21/23

IOV Ecal Pedestals # mean rms………………..........……………………...245 10 1 246 11 2……………………...…………………......

calibrations

04/21/23

Ecal Pedestals # mean rms………………..........……………………...245 13 2 246 9 3……………………...…………………......

55000 56000

TAG

CR

AFT

_Eca

lPed

IOV RPC roll currents

# value……………………..……………………...

23 10 24 15

……………………...…………………......

conditions

04/21/23

RPC roll currents

# value……………………..……………………...

23 11 24 13

……………………...…………………......

121134567890 123456543890

TAG

CR

AFT

_RP

CH

V

DB activity monitoting

PopCon provide also logging information for any transaction. Thanks to that a monitor tool has been set up

04/21/23

POPCON daily applications run during CRAFT (13/10 14/11)

Conclusions

Work done for detector condition/calibration data validation.

PopCon deployed successfully during data taking with cosmics data the tool has been applied to all subdetectors during CRAFT

I’m now the official translator between Vincenzo and the CMS community ;-)

04/21/23