The Cray® Sonexion™ 1300 system is an integrated, high performance, high reliability storage system that takes full advantage of the Lustre file system at any scale. Brought to you by Cray Inc., the leader in productive scalable high performance computing, the Cray Sonexion 1300 storage system integrates next-generation hardware and software technology into an efficient modular design that scales from terabytes to petabytes and offers optimal reliability, performance and ease of management.

Performance and Capacity

The Cray Sonexion 1300 scale-out storage architecture maximizes the performance and capacity scaling capabilities of the Lustre file system. This integrated and modular storage solution is composed of high performance Scalable Storage Units (SSU), a Metadata Management Unit (MMU) and a network-ready rack that includes all storage and processing needs for a complete file system. This architecture results in a high performance Lustre solution that is more manageable, more reliable and easier to deploy – and does so in half the space of traditional solutions.

The SSU is at the heart of the Cray Sonexion scalable storage architecture. Each SSU consolidates and integrates traditional block storage, network and file system components and is a balanced performance, high-capacity building block fully integrated with Lustre according to best practices. Features include dual hot spare drives and mirrored solid state disk that help accelerate file system journaling. With the range of options available, SSUs can be configured to deliver an unmatched level of performance that scales almost linearly with minimal storage or network performance degradation.

Each SSU can deliver 3 GB/sec, each rack can deliver 20 GB/sec and a multi-rack system can deliver up to 500 GB/sec. Each standard rack can store up to 1.5 petabytes of usable file system capacity. These numbers represent more bandwidth, capacity and file system capability per standard rack than any other Lustre implementation.

System Management Software

The Cray Sonexion System Manager (CSSM) software application simplifies the experience of deploying and managing a Lustre file system. The CSSM graphical and command line interfaces provide system administra-tors and users an intuitive interface to deploy, moni-tor and optimize the entire system. From initial installa-tion to expansion and soft-ware upgrades, CSSM brings control of the entire storage solution to your fingertips.

CSSM provides comprehensive status and control of all system components, including storage hardware, RAID, operating sys-tem and the Lustre file system in an integrated administrator in-terface. A web client hosted on one of the dual controller mod-ules in the MMU interfaces with all distributed system manager component services. CSSM also integrates a comprehensive set of community-developed tools that collect, index and analyze fast-moving data to help administrators keep the system stable and balanced.

Reliability, Serviceability and Efficiency

The modular and redundant architecture of the Cray Sonexion 1300 system delivers the highest reliability and highest resiliency storage solution in the industry. In addition, each component, module and sub-system must pass extensive factory testing under demanding test conditions to ensure maximum system robustness year after year.

The MMU module hosts the metadata and management server operations. SSU modules operate as active/

active integrated server modules with redun-dant and independent system inter-

connections providing maximum reliability while delivering maximum performance. Metis™ Power Protec-tion Technology provides further pro-tection against unplanned outages.

The CSSM software is tightly integrated into the system stack – from stor-age and embedded server modules through to the Lustre file system and the entire storage cluster – enabling rapid, accurate monitoring and diag-nosis down to the component level. System-wide software and firmware upgrades are executed through a simple and single interface in the CSSM system, removing the complexity and risks of traditional large Lustre imple-mentations.

Every Cray Sonexion rack comes fully assembled and tested. The modular architecture and CSSM software make deployment simple. Additionally, the Cray Sonexion storage system offers datacenter flexibility with air-cooled and water-cooled options. This power efficiency and extreme density result in the best Lustre file system price perfor-mance and capacity per kilowatt-hour.

Configuration

Configuring a Cray Sonexion storage system requires selection of only three major items – number of racks, MMU and number and type of SSUs to meet individual bandwidth and useable capacity requirements. Each 42U rack comes with two InfiniBand QDR switches for linking the MMU, SSUs and Lustre clients. The rack also contains all power supplies and InfiniBand and GigE cabling and a Gigabit Ethernet switch for management system connections to individual components.

A base MMU is configured in a 2U 24-bay 2.5” drive enclosure with 22 10K RPM disk drives and two solid state drives. Up to three 24-drive MMU expansion enclosures can be connected to each base MMU to facilitate file systems with several billion files.

A base SSU is housed in a 5U 84-bay 3.5” drive enclosure with 80 drives used to provide data storage in an 8 x (8+2) RAID6 target configuration, two global hot spares and two solid state drives. An SSU expansion enclosure, which has the same drive configuration as the base SSU, can be added via 6Gb SAS connections to double the usable capacity for a given bandwidth.

Lustre File System

The Cray Sonexion is the preeminent Lustre solution and leverages Cray expertise in large Lustre configurations. Among its achievements, Cray has built and deployed some of the fastest Lustre file systems available and has almost 10 years of experience hardening Lustre for demanding HPC customers. Cray has an internal team working on Lustre integration, testing and configuration for HPC. Additionally, Cray is a founding member of the OpenSFS consortium which is dedicated to continually improving the Lustre roadmap.

Service and Support

Cray offers a flexible set of customer support options and will tailor these to meet the needs of small and large customers, educational institutions, business and industry. Cray can provide expert support for tuning the entire file system to application needs as well as pre- and post-sales support for facilities and datacenter integration.

Copyright 2011 Cray Inc. All rights reserved. Cray is a registered trademark and the Cray logo, Cray Sonexion, Cray Sonexion 1300 are trademarks of Cray Inc. All other trademarks mentioned herein are the properties of their respective owners. 120103v2

Cray Sonexion 1300 – Small Configuration: 192 TB

SSU Modules 3 base, 0 expansion

Base/Expansion MMUs 1 HA pair

Racks 1

Total number of SSU drives 240

Maximum number of files 300 million

Sustainable Bandwidth 9GB/s (using IOR write)

Useable Capacity 192 terabytes

Cray Sonexion 1300 – Large Configuration: 67PB

SSU Modules 180 base, 180 expansion

Base/Expansion MMUs 3 HA pairs

Racks 60

Total number of SSU drives 28,800

Maximum number of files 6 billion

Sustainable Bandwidth >500 GB/s (IOR write)

Useable Capacity 67 petabytes

Cray Sonexion 1300 – Medium Configuration : 2.3PB

SSU Modules 18 base, 0 expansion

Base/Expansion MMUs 1 HA pair

Racks 3

Total number of SSU drives 1,440

Maximum number of files 1 billion

Sustainable Bandwidth >50GB/s (using IOR write)

Useable Capacity 2.3 petabytes

Base Rack 01

Base Rack 01

Base Rack 01

Expansion Rack 01

Expansion Rack 01

Expansion Rack 02

Expansion Rack 02

Expansion Rack 19

20 racks per22 petabytefile system

Peak Power Consumption

Rack with Switches 0.9 kilowatts Base SSU 2.3 kilowatts

Base MMU 1.5 kilowatts Expansion SSU 2.0 kilowatts

Expansion MMU 1.1 kilowatts

Peak Heat Dissipation

Rack with Switches 3,073 BTU Base SSU 7,853 BTU

Base MMU 5,122 BTU Expansion SSU 6,829 BTU

Expansion MMU 3,756 BTU

Cray Sonexion 1300 General System Environmental Specifications

Altitude and Temperatures

Operational Altitude -30 to 3048m (-100 to 10,000ft)

Operating Temperature Range 5-35° C

Temperature Variance De-rated by 1° C/300m above 900m below the specified maximum temperature

Humidity 20% to 80% non-condensing

Power Options Per Rack

US 208V AC 24A, 3 Phase delta, 6 Circuit/Rack, NEMA L21-30P

EMEA 415V AC 32A, 3+N+E Phases, 4 Circuit/Rack, IEC60309 32A

Cray Sonexion 1300 Technical Specifications

Rack

Height 42U or 1,867 mm (73.5 in)

Width 600 mm (23.62 in)

Depth 1,200 mm (47.24 in)

Rack Switches 1 x 48-port Gigabit Ethernet, 2 x 18-port InfiniBand QDR (40Gb/s) (36-port switch option)

Standard Cooling Passive

Water Cooled Option Rear Door Heat Exchange Unit

Weight (Standard Air-cooled) 621 kg (1,368 lbs)

Weight (Water Cooled Door Wet) 34.5 kg (76 lbs) additional

Metadata Management Unit (MMU)

Base/Expansion Unit Height 2U or 89 mm (3.5 in)

Base/Expansion Unit Drive Slots 24 x 2.5 inch drives

Base Metadata Data Drives 22 x 146GB 15K RPM, 450GB or 600GB, 10K RPM, SAS, RAID10

Base Metadata Journal SSDs 2 x 100GB, RAID1

Expansion Data Drives 24 x 600GB, 10K RPM SAS, RAID10

Maximum Number of Files per File System 6 billion

Scalable Storage Unit (SSU)

Base/Expansion Unit Height 5U or 222.2 mm (8.75 inches)

Base/Expansion Unit Drive Slots 84 x 3.5 inch drives

Base/Expansion Unit Data Drives 82 x 1TB, 2TB or 3TB, 7.2K RPM NL-SAS, RAID6

Base/Expansion Unit SSDs 2 x 100GB, RAID1

IOR Read Bandwidth 3 GB/s

IOR Write Bandwidth 3 GB/s

System Availability

Hot Swappable Disk Drives, Power Supply Units, Fans, Power Cooling Modules, Metis Battery Unit, Server Modules

Software & Support Information

Software CSSM, Linux and Lustre included

Hardware 1 Year Renewable Software 1 Year Renewable