presented by nccs hardware jim rogers director of operations national center for computational...
DESCRIPTION
3 Rogers_NCCS_Hardware_SC07 Hardware roadmap As it looks to the future, the National Center for Computational Sciences expects to lead the accelerating field of high-performance computing. Upgrades will boost Jaguar’s performance to 250 teraflops by the end of 2007, followed by installation of two separate petascale systems in 2009.TRANSCRIPT
Presented by
NCCS Hardware
Jim RogersDirector of Operations
National Center for Computational Sciences
2 Rogers_NCCS_Hardware_SC07
4512 quad-core
processors @2.3 GHz
18,048 GB Memory
TRACKII
2048 quad-core
processors @850 MHz 4096 GB Memory
BLUE/GENE P IBM LINUXNSTG
(56)3 GHz76 GB
Memory4.5 TB
VISUALIZATIONCLUSTER
(128)2.2 GHz128 GB Memory9 TB
CRAY XIEPHOENIX
(1,024)0.5 GHz
2 TB Memory44 TB
NCCS resourcesN
etw
ork
rout
ers
UltraScience
10 GigE
1 GigE
Control network
7 Systems
October 2007summary
Scientific visualization lab
Supercomputers
51,110 CPUs68 TB Memory
336 TFlops
Total shared disk 250.5 TB
5 PBdata storage 35 megapixels
Powerwall
Test systems• 96-processor Cray XT3
Evaluation platforms• 144-processor Cray XD1 with FPGAs
• SRC Mapstation• Clearspeed• BlueGene (at ANL)
5 PB
Backup storage
(23,662) 2.6GHz
45 TB Memory900 TB
CRAY XT4JAGUAR
IBMHPSS
5 TB
Many storagedevices
supported
3 Rogers_NCCS_Hardware_SC07
Hardware roadmapAs it looks to the future, the National Center for Computational Sciences expects to lead the accelerating field of high-performance computing. Upgrades will boost Jaguar’s performance to 250 teraflops by the end of 2007, followed by installation of two separate petascale systems in 2009.
4 Rogers_NCCS_Hardware_SC07
Jaguar system specifications54 TF 100 TF 250 TF 1.000 TF
Compute processors
5,212 Dual-core 2.6 GHz Opteron
11,508 Dual-core2.6 GHz Opterons
7,816 Quad-core Opterons
24,000 Multi-core Opterons
SIO processors
82 Single-core 2.4 GHz Opteron
116 Dual-core2.6 GHz Opteron
124 Dual-core Opteron
544 Quad-core Opteron
Memory per socket/total
4 GB /
20 TB total system
4 GB /
45 TB total system
8 GB /
63 TB total system
32 GB /
768 TB total system
Interconnect bandwidth per socket
Seastar 1
1.8 GB/s
Seastar 2
4.0 GB/s
Seastar 2
4.0 GB/sGemini
Disk space 120 TB 900 TB 900 TB 5-15 PB
Disk bandwidth 14 GB/s 5 GB/s Total 55 GB/s 240 GB/s
5 Rogers_NCCS_Hardware_SC07
Phoenix – Cray X1E
Ultra-high bandwidth Globally addressable
memory Addresses large-scale
problems that cannot be done on any other computer
CRAY X1E: 1,024 vector processors, 18.5 TF
6 Rogers_NCCS_Hardware_SC07
Today:
Jaguar – Cray XT4
120 TF Cray XT4 2.6 GHz dual-core
AMD Opteron processors
11,508 compute nodes
900 TB disk 124 cabinets Currently partitioned as 96 cabinets of catamount
and 32 cabinets of compute node linux November 2007: All cabinets compute node linux
7 Rogers_NCCS_Hardware_SC07
Cray XT4 scalable architecture
Jaguar – Cray XT4 architecture
Designed to scale to 10,000s of processors
Measured MPI bandwidth of 1.8 GB/s
3-D torus topology
8 Rogers_NCCS_Hardware_SC07
Phoenix – Cray X1EPhoenix Utilization by Discipline
100
Oct Dec Feb Apr Jun Aug
Util
izat
ion
(%)
90
80
70
60
50
40
30
20
10
0
AstroAtomicBiologyChemistryClimateFusionIndustryMaterialsOther
9 Rogers_NCCS_Hardware_SC07
Jaguar – Cray XT4Jaguar Utilization by Discipline
100
Oct Dec Feb Apr Jun Aug
Util
izat
ion
(%)
90
80
70
60
50
40
30
20
10
0
AstroBiologyChemistryClimate
FusionIndustryMaterials
Other
Combustion
Nuclear
10 Rogers_NCCS_Hardware_SC07
Contact
Jim RogersDirector of OperationsNational Center for Computational Sciences(865) [email protected]
10 Rogers_NCCS_Hardware_SC07