IHEP Site Status ReportIHEP Site Status Report

IHEPCCC MeetingIHEPCCC Meeting

Gang ChenGang Chen

June 28, 2007 June 28, 2007

Gang Chen/CC/IHEP 23/4/21 - 2

Requirements at Requirements at IHEPIHEP

• LHC: Tier-2LHC: Tier-2 • to support ATLAS and CMS. to support ATLAS and CMS.

• BEPC: BES-IIIBEPC: BES-III • Start to take data in the end of 2007Start to take data in the end of 2007• 5 PB totally in next 5 years5 PB totally in next 5 years• 2000 kSpecInt2K2000 kSpecInt2K

• YBJ-ARGO Cosmic Ray ObservatoriesYBJ-ARGO Cosmic Ray Observatories• 240 TB/year240 TB/year• 400 kSpecInt2k400 kSpecInt2k• 155 Mbps dedicated link from Tibet to Beijing155 Mbps dedicated link from Tibet to Beijing

• DayaBay Neutrino ExperimentDayaBay Neutrino Experiment• 20 TB disk, 150-600 TB tape20 TB disk, 150-600 TB tape• 100 kSpecInt2k up to 2009100 kSpecInt2k up to 2009• 155 Mbps dedicated link 155 Mbps dedicated link

• Synchrotron Radiation ApplicationsSynchrotron Radiation Applications• ……..

Gang Chen/CC/IHEP 23/4/21 - 3

CPU and DiskCPU and Disk• ~500 ~500 CPU/cores installed. CPU/cores installed.

• 1U rack mounted and IBM blades1U rack mounted and IBM blades• Shared by experimentsShared by experiments• Heavily loadedHeavily loaded

• ~100 TB disk space~100 TB disk space• Most are SATAMost are SATA• Directly attached to serversDirectly attached to servers

• New resources will be purchased in the New resources will be purchased in the yearyear

Gang Chen/CC/IHEP 23/4/21 - 4

Mass StorageMass Storage• IBM TS3584 tape library IBM TS3584 tape library

• one base frame + one exp. Frame initially one base frame + one exp. Frame initially • 4 LTO drives4 LTO drives• To be expanded to full configuration next To be expanded to full configuration next

year or lateryear or later

• CASTOR 1.7 deployed on a test CASTOR 1.7 deployed on a test bed, with a ADIC tape librarybed, with a ADIC tape library

•Moving to CASTOR 2 for the Moving to CASTOR 2 for the production systemproduction system

Gang Chen/CC/IHEP 23/4/21 - 5

ImplementationImplementation

• Operating System: SLC 3.08 currentlyOperating System: SLC 3.08 currently• Going to SLC 4Going to SLC 4

• Computing resource managementComputing resource management• Batch system: Torque/LSF, Batch system: Torque/LSF, • Monitoring: GangliaMonitoring: Ganglia• login service: load-balanced interactive login service: load-balanced interactive

farmfarm

• Automated installation: QuattorAutomated installation: Quattor• Storage managementStorage management

• Home dir.: AFSHome dir.: AFS• Data dir.: NFS/RFIOData dir.: NFS/RFIO• Mass storage system: CASTORMass storage system: CASTOR

Gang Chen/CC/IHEP 23/4/21 - 6

Networking (1)Networking (1)•Gloriad: China-US-EuropeGloriad: China-US-Europe• Too Big RTT: 350 msToo Big RTT: 350 ms•~5MB/s, multi-stream transfer ~5MB/s, multi-stream transfer

between CC-IN2P3 and IHEPbetween CC-IN2P3 and IHEP

Gang Chen/CC/IHEP 23/4/21 - 7

Networking (2)Networking (2)• ORIENT/TEIN2: China-EuropeORIENT/TEIN2: China-Europe• Better RTT: 170 msBetter RTT: 170 ms• 16-26MB/s, multi-stream 16-26MB/s, multi-stream

transfer between CC-IN2P transfer between CC-IN2P and IHEPand IHEP

• Switched to TEIN2 last week!Switched to TEIN2 last week!

• Network is being improved, Network is being improved, better performance is better performance is neededneeded

2.5Gbps

Gang Chen/CC/IHEP 23/4/21 - 8

Infrastructure (1)Infrastructure (1)• 450 450 mm22 computing room computing room

refurbished in 2006refurbished in 2006•New Cooling New Cooling •New Power Supply: 0.5 MWNew Power Supply: 0.5 MW•New UPSNew UPS

Gang Chen/CC/IHEP 23/4/21 - 9

Infrastructure (2)Infrastructure (2)• Computing RoomComputing Room

Gang Chen/CC/IHEP 23/4/21 - 10

Infrastructure (3)Infrastructure (3)• Part of power supply and UPSPart of power supply and UPS

Gang Chen/CC/IHEP 23/4/21 - 11

Tier-2 Tier-2 • A site to support ATLAS and CMSA site to support ATLAS and CMS

• CE: Computing ElementCE: Computing Element• SE: Storage ElementSE: Storage Element• FTS: File Transfer ServiceFTS: File Transfer Service• LFC : LCG File CatalogLFC : LCG File Catalog• VOMS: VO Membership ServiceVOMS: VO Membership Service

• Resources Very LimitedResources Very Limited• funding not yet fully securedfunding not yet fully secured• Discussing with MoST and NSFC, Discussing with MoST and NSFC,

Gang Chen/CC/IHEP 23/4/21 - 12

Planned ResourcesPlanned Resources

20062006 20072007 20082008 20092009 20102010

CPU CPU kSI2KkSI2K

300300 1500?1500? 35003500 40004000 40004000

Disk TBDisk TB 8080 350?350? 500500 800800 10001000

Tape TBTape TB 2020 800800 28002800 38003800 48004800

For LHC, BES, etc.For LHC, BES, etc.

Gang Chen/CC/IHEP 23/4/21 - 13

SummarySummary• A lot of things to be done for A lot of things to be done for

funding funding • Have to work with MoST and NSFCHave to work with MoST and NSFC

• Better global network is needed. Better global network is needed.

• Voice from international Voice from international community, like IHEPCCC, could community, like IHEPCCC, could help to push things forward.help to push things forward.