belle-ii data handling working group status junghyun kim, daejung kong kihyeon cho* (high energy...
TRANSCRIPT
Belle-II Data Handling working group status
Junghyun Kim, Daejung KongKihyeon Cho*
(High Energy Physics Team, KISTI)
1
Korea Belle II meetingSNU, Seoul, Korea
2009. 6. 25
* Corresponding Author
Contents
• KISTI Supercomputing center• Activities of Belle II DH working group• Problems of Belle Data Handling • Status of Belle II Data Handling• Plan
2
3
응용지원실
융합자원실
응용지워팀
선도연구팀
슈퍼컴 자원팀 연구망 자원팀
사이버인프라 응용연구자
KISTI KISTI 슈퍼컴퓨팅 본부슈퍼컴퓨팅 본부KISTI KISTI 슈퍼컴퓨팅 본부슈퍼컴퓨팅 본부SC-SPSC-SP
SMB 팀
과학기술정보보호팀
차세대연구환경개발실
기반기술개발실
HEP연구팀
응용환경개발팀
응용서비스팀 서비스기반기술팀
e-Cell 팀
NSDC 구축팀
과학기술융합망팀
GEOSS 팀
일반사용자 전략분야
사용자
서비스기술사용자
협업가시화팀
e-Science 그리드기술개발팀
Ref. 이지수본부장 (2009.3.12)
4
Who is who?
• 고에너지물리연구팀 (Physicists)– 조기현 ( 팀장 )– 김정현 , 공대정 , 남수현
• e-Science 그리드 기술개발팀 (Developers)– 황순욱 ( 팀장 )– 유상수 , 김유상 , 김남규 , 안선일 등
• NSDC 구축팀 (Computing Technicians)– 장행진 ( 팀장 )– 김법균 , 유진승 , 윤희준 , 권석면 , Christopher 등
• Other teams– 김현우 , 이상동 , 김정한 , 홍태용 등
Belle II DH Working Group
• Group Leader: K. Cho• Participants: J.H. Kim, D.J.Kong, Thomas
Kuhr, Takanori Hara, Tom Fifield, Nishida Shohei, Martin Sevier, Henryk Palka
• KISTI AMGA group: Sunil Ahn, Soonwook Hwang
5
6
7
Group Activities• Data Handling Working Group Meeting
– May 27, 2009 16:00-17:00– Contents
• Define meta data• Extraction of meta data• Interaction between AMGA and Tom’s activities• Discussion – Attributes of meta data
– Existing Belle database– SAM metadata structure (CDF/D0)– Different levels of metadata
8
Group Activities• Belle II Computing Meeting Report:
– Feb. 17, 09 - Introduction of AMGA (Dr. Hwang)– April 17, 09 - Plan (Dr. J.H. Kim)– May 20, 09 - DH Scenario (Dr. J.H. Kim)– June 16, 09 - The architecture in AMGA (Dr. J.H.Kim)
9
10
Problems of Belle Data Handling
• DH based on PHP, HTTP and postgreSQL
• No Grid • Durability• Scalability
SAM, SRB (No Grid) AMGA (Grid) Working with KISTI AMGA group
11
12
Belle II Data Handling
• Scenario• Attribute of Meta Data• Architecture
13
14
15
Extraction of Attributes
Done
Doing
16
Total used data Exp#7, Run 6-2865, uds MC
Extraction of information
17
?Stream
-rw-r--r-- 1 cho hep 125 May 25 12:57 mcprod-on_resonance-evtgen-uds-00-all-e000007r002865-b20030807_1600.list-rw-r--r-- 1 cho hep 310980 May 25 12:57 mcprod-on_resonance-evtgen-uds-00-all-e000007r002865-b20030807_1600.log-rw-r--r-- 1 cho hep 373 May 25 12:57 mcprod-on_resonance-evtgen-uds-00-all-e000007r002865-b20030807_1600.lum
File from MDST
1) ***. list => Logical file location2) ***.log => Properties of events3) ***.lum => File (Run) information
The information
18
[cho@hep on_resonance]$ more mcprod-on_resonance-evtgen-uds-00-all-e000007r002865-b20030807_1600.listbfss08:/bdata/mcprod/dat/e000007/evtgen/uds/00/all/0807/on_resonance/28/evtgen-uds-00-all-e000007r002865-b20030807_1600.mdst
[cho@hep on_resonance]$ more mcprod-on_resonance-evtgen-uds-00-all-e000007r002865-b20030807_1600.log0: Parameters ; 7 ; 2865 ; 1 ; 3 ; 3 ; 0 ; 10: Parameters ; 7 ; 2865 ; 5 ; 4 ; 4 ; 1 ; 00: Parameters ; 7 ; 2865 ; 6 ; 5 ; 4 ; 3 ; 01: Parameters ; 7 ; 2865 ; 2 ; 5 ; 4 ; 2 ; 10: Parameters ; 7 ; 2865 ; 8 ; 3 ; 4 ; 1 ; 00: Parameters ; 7 ; 2865 ; 9 ; 0 ; 2 ; 0 ; 01: Parameters ; 7 ; 2865 ; 7 ; 6 ; 5 ; 3 ; 11: Parameters ; 7 ; 2865 ; 12 ; 2 ; 2 ; 1 ; 40: Parameters ; 7 ; 2865 ; 10 ; 6 ; 6 ; 1 ; 02: Parameters ; 7 ; 2865 ; 4 ; 4 ; 4 ; 1 ; 41: Parameters ; 7 ; 2865 ; 11 ; 1 ; 1 ; 0 ; 00: Parameters ; 7 ; 2865 ; 13 ; 5 ; 5 ; 4 ; 03: Parameters ; 7 ; 2865 ; 3 ; 5 ; 5 ; 3 ; 11: Parameters ; 7 ; 2865 ; 15 ; 6 ; 5 ; 2 ; 02: Parameters ; 7 ; 2865 ; 14 ; 4 ; 3 ; 1 ; 00: Parameters ; 7 ; 2865 ; 16 ; 8 ; 8 ; 4 ; 11: Parameters ; 7 ; 2865 ; 19 ; 4 ; 4 ; 2 ; 13: Parameters ; 7 ; 2865 ; 17 ; 3 ; 7 ; 3 ; 00: Parameters ; 7 ; 2865 ; 20 ; 3 ; 4 ; 0 ; 02: Parameters ; 7 ; 2865 ; 18 ; 5 ; 4 ; 5 ; 2………..=> Dummy; Dummy; Exp.#; Run#; Evt.#; Total #of positive charged track; Total # of negative charged track; Total # of Ks; Total #of KL
=> Logical file location
1) ***.list
2) ***.log
19
[cho@hep on_resonance]$ more mcprod-on_resonance-evtgen-uds-00-all-e000007r002865-b20030807_1600.lum Exp Run #evts Lum #evts/lum 4S Continuum 3S above 4S other 7 2865 6583 3.15 2089.84 3.15 0 0 0 0Total On4S lum. = 3.15 Continuum Lum. = 0 3S Lum. = 0 Above4S Lum. = 0 Other Lum. = 0
Exp.#, Run#, Total # of events, Total Lum./file, #evts/lum, Luminosity type
=> File information
3) ***.lum
20
=> Any suggestions about attributes?
Architecture of AMGA
21
22
23
24
25
Plan
• MC & Real data test with AMGA– Using Belle flat form– Writing and Reading
• Long Term – Prototype Oct. 2009
• Birger visit KISTI for two weeks (7/8/09)– Hand down AMGA to KISTI AMGA group– Questions on AMGA
26
Questions on AMGA
• Scalability– 8 million events * 50 times
• Durability– How many users?
• Performance– How fast?
27
Backup
28
29