2009 cascade filter proposal - desy · high disk memory high space consumption of 7 tb : for one...

34
2009 Cascade Filter Proposal Eike Middell and Sebastian Panknin DESY Zeuthen and Humboldt University of Berlin 2008-12-05 / Group Meeting Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 1 / 17

Upload: others

Post on 03-Jun-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

2009 Cascade Filter Proposal

Eike Middell and Sebastian Panknin

DESY Zeuthenand Humboldt University of Berlin

2008-12-05 / Group Meeting

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 1 / 17

Page 2: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Outline

1 Filter Proposal Time at DesyDesign of the filterOrganisation at DesyFeature Extractor Settings

2 Cascade Filter 2009Filter IdeaOptimized Settings

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 2 / 17

Page 3: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

The Pole Filter Script

JEBJoint Event Builder

Script Design at the PoleEvents may be interesting for many filters and some filters will usesimilar variables:

all modules run over all eventsa module may refuse a specific event (precondition not fulfilled)the filter modules tag the events, if they pass the filterevents without any tag are rejected

different filters can use same modules (in different ways)it is helpful to have the whole filter script

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 3 / 17

Page 4: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Requirements for a Proposal

TFT Board RequestAll filter proposal have to fulfill certain standards:

show data, MC agreement for IC40show cut variables for IC60decide between different settings and variablescalculate performance for IC60bandwidth estimation

same (retriggered) datasets for most groupssimilar script to calculate variablessome settings are the same (Feature Extractor)

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 4 / 17

Page 5: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Organisation

CooperationLet’s work together, because:

same data sets neededsame scripts can be usedeasier to compare results

The OFU people are also interested in a online filter study.

Eike Sebastian Robert F. and Anna F.

processing retriggering cut variables

study cascade filter FE threshold OFU

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 5 / 17

Page 6: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Resource UsageBatch SystemAbout 500 CPUh were used forvariable calculation:

High Disk MemoryHigh space consumption of7 TB:

for one setting: about500 GB

datasets: about 100 GBoutput files:

I hdf files: 700 MBI root files: 2 GBI i3 files: 97 GB

very full i3 filesbetter save than sorry

Space will be given free starting next week.

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 6 / 17

Page 7: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Resource UsageBatch SystemAbout 500 CPUh were used forvariable calculation:

High Disk MemoryHigh space consumption of7 TB:

for one setting: about500 GB

datasets: about 100 GBoutput files:

I hdf files: 700 MBI root files: 2 GBI i3 files: 97 GB

very full i3 filesbetter save than sorry

Space will be given free starting next week.

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 6 / 17

Page 8: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Resource UsageBatch SystemAbout 500 CPUh were used forvariable calculation:

High Disk MemoryHigh space consumption of7 TB:

for one setting: about500 GB

datasets: about 100 GBoutput files:

I hdf files: 700 MBI root files: 2 GBI i3 files: 97 GB

very full i3 filesbetter save than sorry

Space will be given free starting next week.

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 6 / 17

Page 9: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Resource UsageBatch SystemAbout 500 CPUh were used forvariable calculation:

High Disk MemoryHigh space consumption of7 TB:

for one setting: about500 GB

datasets: about 100 GBoutput files:

I hdf files: 700 MBI root files: 2 GBI i3 files: 97 GB

very full i3 filesbetter save than sorry

Space will be given free starting next week.

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 6 / 17

Page 10: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Resource UsageBatch SystemAbout 500 CPUh were used forvariable calculation:

High Disk MemoryHigh space consumption of7 TB:

for one setting: about500 GB

datasets: about 100 GBoutput files:

I hdf files: 700 MBI root files: 2 GBI i3 files: 97 GB

very full i3 filesbetter save than sorry

Space will be given free starting next week.

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 6 / 17

Page 11: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Resource UsageBatch SystemAbout 500 CPUh were used forvariable calculation:

High Disk MemoryHigh space consumption of7 TB:

for one setting: about500 GB

datasets: about 100 GBoutput files:

I hdf files: 700 MBI root files: 2 GBI i3 files: 97 GB

very full i3 filesbetter save than sorry

Space will be given free starting next week.

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 6 / 17

Page 12: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Resource UsageBatch SystemAbout 500 CPUh were used forvariable calculation:

High Disk MemoryHigh space consumption of7 TB:

for one setting: about500 GB

datasets: about 100 GBoutput files:

I hdf files: 700 MBI root files: 2 GBI i3 files: 97 GB

very full i3 filesbetter save than sorry

Space will be given free starting next week.

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 6 / 17

Page 13: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Used Datasets

DatasetsMinimal triggered IC80 simulation (V02-02-09):

dataset (IC40): 111310single muon corsika: 1516double muon corsika: 1511triple muon corsika: 1550νe MC: 1568νµ MC: 1560

each 100 up to 200 files available in Zeuthenretriggered to IC40 and IC60

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 7 / 17

Page 14: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

What is the ADCThreshold

threshold is used for chargecalculationfor multi peak reconstructionthreshold of 1 corresponds to thehardware discriminator

old setting was 0.4new (proposed) setting is 1.0

A scratch of two pulses:the 0.25 PE pulse

defines the 1.0 FEthreshold.

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 8 / 17

Page 15: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Effect on Pulse Charge

Charge per Pulse:only for the 1.0 threshold clear peak at 1.

many pulses are split with lower threshold.Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 9 / 17

Page 16: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Effect on Nsth

number of pulses Nhit:very sensitive on settingtotal charge of event Qevent:quite robustnumber of channels Nchan:per definition (number of DOMlaunches) independentnumber of modules withpulses NOM:a small dependence onthresholds

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 10 / 17

Page 17: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Effect on Nsth

number of pulses Nhit:very sensitive on settingtotal charge of event Qevent:quite robustnumber of channels Nchan:per definition (number of DOMlaunches) independentnumber of modules withpulses NOM:a small dependence onthresholds

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 10 / 17

Page 18: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Effect on Nsth

number of pulses Nhit:very sensitive on settingtotal charge of event Qevent:quite robustnumber of channels Nchan:per definition (number of DOMlaunches) independentnumber of modules withpulses NOM:a small dependence onthresholds

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 10 / 17

Page 19: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Effect on Nsth

number of pulses Nhit:very sensitive on settingtotal charge of event Qevent:quite robustnumber of channels Nchan:per definition (number of DOMlaunches) independentnumber of modules withpulses NOM:a small dependence onthresholds

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 10 / 17

Page 20: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Cascade Filter 2009

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 11 / 17

Page 21: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

   

Cascade Filter 2008: ToI EvalRatio > 0.12 and LineFit Velocity < 0.13 Sebastian's IC40 Test: 1204.3 Hz   17.7 Hz → BG passing: 1.5%, nue E­2 passing: 70.3 % 

Cascade Filter 2009: 16 (+ 3) additional strings  adjust filter to keep rate at about 17 Hz (eventually include some track fit zenith)

Overview Cascade Fiter

Page 22: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

   

New Settings FeatureExtractor

ADCThreshold 0.4   1.0 (influence on NHits)→ NewDiscThreshold: True

(use new routine to estimate discriminator threshold,data run has to be processed with False)

LineFit: use only FirstLeadingEdge 

LineFit doesn't weight DOM with charge but with #pulses reduce influence of Nhits

ToI: Loose Nchannel > 8  to consider StringTrigger events?

Use coincified pulses in LineFit and ToI?

Page 23: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

   

ADCThreshold

no impact on nchannel small impact on charge huge influence on #pulses 1.0 setting physically preferred (histogram of pulse 

charges peaked at 1pe   Sebastian's Wikipage)→

influence on final efficiency not totally understood

Page 24: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

   

FilterVariables (2008 Filter Settings)

ToI  Evalratio

Left: without DiscThreshold Right: with DiscThreshold

Page 25: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

   

Linefit Vel.

Left: without DiscThreshold Right: with DiscThreshold

FilterVariables (2008 Filter Settings)

Page 26: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

   

FilterVariables

Gulliver TrackFit Zenith

Left: without DiscThreshold Right: with DiscThreshold

Page 27: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

   

Rates IC40

Last year: 1140.7 Hz Corsika: 1107 Hz Data: 1076 Hz

IC60 Corsika: 1611 Hz

Last year after filter: 17 Hz

2009 Goal: Suppress Background to 1 %

Reco Success percentages(IC60) (preliminary):

nue ToI: 78% Linefit 99 % Trackfit 78 %

Corsika: ToI: 45 % Linefit: 97 % Trackfit: 53 % (Nchan > 10)

Page 28: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

   

2009 Filter Optimization

use max. LineFit velocity and min. ToI evalratio determine 1% contour line in corsika passing rate 

plot   on this search for maximum E→ ­2 passing rate along 

Nue E­2 passing  corsika  passing 

Page 29: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

   

IC60 - Old ToI and LineFit Settings (+coincify, +NewDiscThreshold, ADCTh 1.0)

down to 1% background  at 69% E­2 signal is feasible with old settings

Page 30: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

   

New ToI and LineFit Settings (+coincify, +NewDiscThreshold, ADCTh 1.0)

losen the nchannel cut in ToI   more →StringTrigger events   to achieve the →same BG supression only get  62.6% E­2 signal

Page 31: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

   

New ToI and LineFit Settings (+no coincify, +NewDiscThreshold, ADCTh 1.0)

Without coincify and with StringTrigger Events slightly better:63.8% E­2 signal 

Page 32: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Energy Efficiency

Energy Dependence of the Cut:low efficiency below 1 TeV

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 12 / 17

Page 33: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Resulting numbers

Optimal Cuts:This are the choosen cut values and the resultig efficiencies:

LineFit vel ToI evalIC40(old) 0.130 0.120IC60 0.086 0.046

Sample Efficiency [%]BG MC 1νe E−1 89νe E−2 69

Resource requirementsThe following properties were calculated:

bandwidth s = 6020 Mbd

filter rate f = 16.1 Hz

low calculation time (below 0.2 ms per event and module)

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 13 / 17

Page 34: 2009 Cascade Filter Proposal - DESY · High Disk Memory High space consumption of 7 TB : for one setting: about 500 GB datasets: about 100 GB output les: I hdf les: 700 MB I root

Summary

2009 Filter Proposals:I good collaborations with OFU peopleI high resource consumptionI Feature Extractor threshold of 1 physically preferred

Cascade FilterI LineFit and Tensor of Inertia as cut variablesI 1 % background (16 Hz, 6 Gb

d )I 69 % E−2-signal efficiency

OutlookI fast clean up of unused dataI answering open questions on request

Eike Middell and Sebastian Panknin (DESY and HU) 2009 Cascade Filter Proposal Group Meeting 14 / 17