dpa follow-up review, malargüe, nov/2000

DPA follow-up review, Malargüe, Nov/2000 DPA follow-up review, Malargüe, Nov/2000

DPA

Data Processing and Analysis Task

Follow-up Review

Malargüe, November 14, 2000

DP

A f

ollo

w-u

p r

evie

w, M

alar

gü

e, N

ov/

2000

D

PA

fo

llow

-up

rev

iew

, Mal

arg

üe,

No

v/20

00

Data Processing and Analysis

DP

A T

ask

ove

rvie

w

S

oft

war

e d

evel

op

men

t an

d m

anag

emen

t S

imu

lati

on

R

ec

on

str

uc

tio

n A

na

lys

is T

oo

ls S

oft

wa

re D

istr

ibu

tio

n s

yste

m D

ata

Ma

na

ge

me

nt

sy

ste

m S

ite

com

pu

tin

g W

ide

area

net

wo

rkin

g R

egio

nal

co

mp

uti

ng

cen

ters

DP

A f

ollo

w-u

p r

evie

w, M

alar

gü

e, N

ov/

2000

-D

PA

fo

llow

-up

rev

iew

, Mal

arg

üe,

No

v/20

00 -

Data Processing and Analysis

DP

A T

ask

ove

rvie

w

Sim

ula

tio

n

S

ho

wer

sim

ula

tio

n A

IRE

S C

OR

SIK

A S

D s

imu

lati

on

F

D s

imu

lati

on

D

ete

cto

r s

imu

lati

on

E

lec

tro

nic

s s

imu

lati

on

T

rig

ge

r s

imu

lati

on

A

tmo

sph

ere

sim

ula

tio

n S

ho

wer

det

ecto

r in

terf

ace

DPA follow-up review, Malargüe, Nov/2000

Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

SD Simulation Detector simulation Electronics simulation Trigger simulation

Sub-task leader: John Swain

Status: Agasim/Billoir simulation operational, are used in conjunction with FDsimGeant4 (Northeastern) in preparation,more flexible, allow inclusion of all physical effects realistically.

Status for EA: Simulation of SD + FD,electronic simulation yet not integrated.Very basic trigger simulation only


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

SD Simulation (cont)

Resources needed: Integration of electronics + noise + trigger

Milestones: Output compatible with CDAS output (prototype at end of January)Inclusion of noise into sim ( )Simulation of full array with Geant 4 (July)


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

FD Simulation Detector simulation Electronics simulation Trigger simulation Atmosphere simulation

Sub-task leader: Ron Shellard

Status :• FORTRAN version• C++ translation of FD_sim• FDVC visualization package• Integrated to AIRES • ROOT format output• Effect of cloud ceiling included• Detailed sim of camera• To be completed: detailed simulation of shower lateral distribution, atmosphere simulation• Trigger sim still disconnected from sim• Electronics sim not integrated yet


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

FD Simulation (cont)

Status for EA : • Simulation of SD +FD operational• Need integration with trigger, noise + electronics

Resources needed: Help to integrate noise and electronics into sim. As well as trigger.

Milestones:•Output compatible with CDAS output (prototype at end of January).• Inclusion of “realistic noise” to generate reconstructions files (january)•Simulation of detailed FD, with imperfections of mirrors + cameras + integration with Geant 4 surface array (July).


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Shower detector interface

Sub-task leader: Pierre Billoir

Status: Inteface exist in crude form, for connection between shower and SD+FD sim, not yet very user friendly.

Status for EA:Operational. Needs some tunning. Using ROOT as intermediate steps

Resources needed: Resources are sufficient for the moment

Milestones: • Operational interface (done)• User friendly interface, isolating user from specific details (middle of the year)


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Reconstruction SD Reconstruction FD reconstruction Hybrid reconstruction

Sub-task leader: Pierre Billoir with help from Bruce Dawson and Brian Fick

Status: Prototype structures working for SD, FD and Hybrid. Needs a lot of tunning (in particular from the FD part) Simulation+Reconstruction chain: Example working from Aires to SD+FD ROOT interfaces with simulation working, but need to be streamlined. Start from pe. counting at detectors Mixed Fortran and C++ Need isolate structure from algorithms

Status for EA:• Integrated (SD+FD) will be ready by• the end of January


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Reconstruction (cont)

Resources needed: Every physicist in collaboration!

Milestones: • Prototype of integrated SD+ FD (operating with two eyes) operational (end of January)• Structure with stereo eyes (middle of the year)• User friendly structure, isolating the user from nitty gritty I/O, from sequence of calling routines, focus only on physics arguments and algorithms (optimistically by the end of next year)


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Analysis Tools Visualization tools Common Software library Documentation system

Sub-task leader: Luis Prado Jr.Status: Analysis environment: LINUX (recomend RedHat/Mandrake distribution) Visualization tools defined: ROOT, QT, OpenGL (Mesa). Some examples worked out (FDVC) seehttp://www.ifi.unicamp.br/~pradojr Common software library no concrete work yet (needs have still to be identified) Documentation tools being tested: Doxygen


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Analysis Tools (cont)

Status for EA: Some tools defined and prototypes implemented, but still needs lots of work to them tobecome effective. Input of needs from users are necessary. The number of tools will grow with demand. But basic structure is set.

Resources needed: Computers experts with experience in Object Oriented Programing to improve the visualization tools.

Milestones: Prototype of integrated visualization of SD+FD (middle of the year).ROOT analysis framework for non-experts, to do PAW-like analysis(middle of the year)


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Da

ta P

r oc

es

sin

g a

nd

An

aly

sis

DPA follow-up review, Malargüe, Nov/2000 -DPA follow-up review, Malargüe, Nov/2000 -

DPA Task overview


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Software distribution Software repository Software build system Software distribution system

Sub-task leader: Luis Prado Jr.

Status: Repositories defined (Regional Computing Centers). Directory structure for Auger is alsocreated. The build system is being created.

Status for EA: Prototype distribution system will be operational be the end of JanuaryResources needed: CVS expert to help.

Milestones: Prototype available (end of january)


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

~auger/phy/~auger/phy/sim/

~auger/phy/sim/shw/~auger/phy/sim/shw/aires/pro --> ./Aires2.2.1/~auger/phy/sim/shw/aires/Aires2.2.1/~auger/phy/sim/shw/aires/Aires2.2.0/

~auger/phy/sim/shw/corsika/

~auger/phy/sim/fd/~auger/phy/sim/fd/fdsim/pro --> ./FDSim2.1.0/

~auger/phy/sim/fd/fdsim/FDSim2.1.0/ /bin/ /demos/ /dev/ /doc/ /etc/ /include/ /lib/ /man/ /src/

~auger/phy/sim/fd/fdsim/FDSim2.0.13/~auger/phy/sim/fd/fdsim/FDSim1.9.8/

~auger/phy/sim/sd/~auger/phy/sim/sd/agasim/


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Data Management Data Handling and storage Database Data Acquisition interface

Sub-task leader:

Status:

Status for EA:

Resources needed:

Milestones:


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Offline monitoring and calibration SD Detector FD Detector Atmosphere monitoring

Sub-task leader:

Status: Stand by, will derive from detector monitoring and calibration.

Status for EA:

Resources needed:

Milestones:


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Site computing Local area network Local server Computer facilities

Sub-task leader: René Bilhaut, Sergio Sciutto

Status: LAN defined, local server defined.

Status for EA: Facilities for analysis available at the site.

Resources needed: Server system (Brazil)

Milestones: Installation of server (february), Upgrade, one year latter.


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Wide Area Network

Sub-task leader:

Status: Report by Sergio Sciutto

Status for EA:

Resources needed:

Milestones:


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

Data Mirror Centers Europe (IN2P3-Lyon)

Sub-task leader: Alain Cordier USA (Fermilab)

Sub-task leader: Lukas Néllen CERN

Sub-task leader: Lucas Taylor (?) Latin America (Buenos Aires)

Sub-task leader: Sergio SciuttoStatus: Lyon, Fermilab and CERN are operational. BAires is to be implementedStatus for EA: OK! But has to get BA going.Resources needed: Site manager for CERN if Lucas is busy with other things.Milestones: Malargue data sitting at the centers (as soon as it is available!).


Dat

a P

roce

ssin

g a

nd

An

aly

sis

Dat

a P

roce

ssin

g a

nd

An

aly

sis

DPA Task Overview

SUMMARY

DPA EA WORKSHOPDPA EA WORKSHOP Rio de JaneiroRio de Janeiro, , 22 to 26 January, 200122 to 26 January, 2001

dpa follow-up review, malargüe, nov/2000

Documents