data filtering and software
DESCRIPTION
Data Filtering and Software. IceCube Collaboration Meeting Monday, March 21, 2005. DAQ Dispatch. P&F Server. Filt/Rec Data. Raw Data. Recon Worker X 50-60?. System Overview. Expt. Control / Logging. DAQ Land. 4-15MB/s 1500-2000Hz. ALL: RAW+FILT+REC. FILT:RAW+FILT+REC. - PowerPoint PPT PresentationTRANSCRIPT
Greg SullivanUniversity of Maryland
Data Filtering and Software
IceCube Collaboration Meeting
Monday, March 21, 2005
March 21, 2005Data Systems Overview
System Overview
DAQ
Dispatch
P&F Server
Recon WorkerX 50-60?
4-15MB/s1500-2000Hz
Tape
Transient Buffer
DAQ Land
Raw Data
Online Analysis
Online Analysis
Online Analysis
Recon Monitor
Data Handling
Rec/FiltData
ALL: RAW+FILT+REC
FILT:RAW+FILT+REC
ALL:FILT+REC
Expt. Control / Logging
Offline Software/IceTray
March 21, 2005Data Systems Overview
Data Handling• Accomplishments
– South Pole Test System operational since late last year. – South Pole System installed at the Pole in late December. – SPS operational with 1 string! – SPADE installed at Pole and used to transfer drill,
webcam, and TestDAQ data.
• Coming Year Activities – Data ingestion to Data Warehouse to be implemented.– Web interface to Data Warehouse. – Upgrade data storage facilities. – IceCube Metadata standard and data directory structure to
be defined. – Upgrade SPS and SPTS for upcoming season.
March 21, 2005Data Systems Overview
Experiment Control
• Provide system for South Pole operating– Control– Configuration– Monitoring– Logging– JBoss Support
• Based on “JBoss” – Infrastructure in place– Run-Control JMX Console in development
March 21, 2005Data Systems Overview
Filtering
• PnF System– V1.0 Tested at SPTS & deployed at Pole– Currently not in data stream
• Lacking some run information and testing
– New Version of Monolith soon (April)• Test & run PnF at Pole in preparation for next year
• Plans for next year– Integrate with Real DAQ,Exp Ctrl, DAQ Disp,
SPADE at SPTS (August/Sept) • PnF is output stream for Real DAQ• Filtering at South Pole required
March 21, 2005Data Systems Overview
Offline Software• Several incremental releases this past year
– In use by reconstruction and simulation groups.– Many people developing physics modules– Lots of physics to do yet
• Current release:– OFFLINE-SOFTWARE V01-05-00
• There are tools available for all – Event viewer– Script to make histograms for ROOT
• AMANDA muon reconstruction and merging by summer
March 21, 2005Data Systems Overview
Software 1
March 21, 2005Data Systems Overview
Software 2
March 21, 2005Data Systems Overview
Software 3
March 21, 2005Data Systems Overview
Event Viewer
March 21, 2005Data Systems Overview
ATWD Calibration & Feature Extraction
March 21, 2005Data Systems Overview
Simulation
• Version 0.2 released – Implemented in IceTray
• I3Db• Corsika Reader• MMC Propagator• Hit Constructor (Photonics interface)• Noise Generator• ROMEO, ROMEO-AMANDA• DOM Simulator (atwd,fadc,TWR)• Trigger Sim• ATWD Channel Merger• Feature Extraction• Event Viewer
March 21, 2005Data Systems Overview
JULIET
300 PeV
March 21, 2005Data Systems Overview
Simulation Plans
• Version 1.0 of IceCube simulation– Ready Mid April– Generate large set of events for validation
against AMASIM with same Ice properties etc…
• New Photonics tables – Ready April-May
• Finalize metadata specs and production scripts
• Large production run using V1.0– Data set in ware house
March 21, 2005Data Systems Overview
Summary
• Great Progress in the last year– SPADE operating reliably– PnF/DAQ Dispatch tested and running– Experiment Control system defined and providing Jboss
support– Simulation V0.2 running– Broad range of developers in IceTray
• Decision for C++ and data classes 1 year ago
• For Next Year– Systems on track for physics from 30-32 string detector
• Online system integration and testing in Aug/Sep
• Reconstruction and filtering