Trust & File SystemsRick WagnerHPC Systems Manager

IDI: Building the Digital University

Rick Wagner Frank K. Wuerthwein Rob Knight

“…integrates compute & storage resources at SDSC with instruments and labs across campus…”

2 Focuses• Integrative Omics • Seamless Data & Computing

3 Components• High-performance, scalable, central storage• Campus backbone and the Prism network as a Science DMZ• Core and embedded IT staff in a tiered model

Why Will This Succeed?

Tiered Staffing ModelProject funds central storage engineers and lab admins

Labs are not customers, they’re part of the team!

storage engineer

lab admin lab admin

researcher

researcher

researcher researcher

researcher

researcher

Project Team

Lab A Lab B

On Campus c = ∞

Parallel File System

Lab ALab B

Comet

ScienceDMZ

Lab A Lab B

CometScalable Parallel File System

OSS

OSS

MDS

ost0/labA-ost0

ost0/labB-ost0

ost0/comet-ost0

ost1/labA-ost1

ost1/labB-ost1

ost1/comet-ost1

mdt0/labA-mdt0

mdt0/labB-mdt0

mdt0/comet-mdt0

Lab A

Lab B

Comet

/oasis/projects/labA

/oasis/projects/labB

/oasis/comet/scratch

/oasis/projects/labA

/oasis/projects/labB

NID0

NID1

ZFS is magical!

zpoo

lda

tase

t

Lack of Trust

Lustre nodemap

Steve Simms, IULUG2015

+shared keys!

Lab A

Lab B

CometScalable Parallel File System

Lab C

virtual cluster

FIONA

FIONAF

ION

A

Lab A

Lab B

CometScalable Parallel

File System

Lab C

virtual cluster

Lab D c != ∞ ∴ streaming IO

FIONA

FIONA

FIONA

FIO

NA