data management for tao of fusion at the aps - update

Data Management for!Tao of Fusion at the APS - Update

Faisal Khan and Nicholas Schwarz!Software Services Group!

APS Engineering Support Division!16 January 2014

Data Management for Tao of Fusion at the APS - Update - 16 January 2014

OverviewPrototype System!Account and Ownership Management - Update!Hardware Infrastructure - Update!Automated Data Movement!Timeline - Update

�2


Prototype SystemAccount & Ownership Management!A web interface for beam-line staff and administrators for managing permissions. !

A Unix account for experimenters/users!A Unix group for the experiment/project!Unix file permissions for managing access to data.!

SPADE!Automated transfer and database of files

�3


�4

Prototype System

Local Disk

��

��

��

��

��

��

��

��

��

��

!�"��

��

��

��

��

��

��

��

��

��

��

!�"�� GlobusCatalog Globus

APS.LDAP.Server.formanaging.user.accounts

Tier:NTier:1

So=ware.Glue.(SPADE,.

Registry.etc)Staff

1..See.list.of.experiments2..Manage.access.to.files3..Manage.life.cycle.of.data

User

Access.data

.AuthenNcate.

...using.badge#

Beam:LineHigh.performance/.

Dedicated./.Short.term./.No.outside.access

High.capacity./.Mid.term./.Shared./

Accessible.using.GO.Cloud

Transfer.data.between.Ners.Keep.track.of.transferred.data

AcquisiNon.System

OnlineTransfer

Data Management for Tao of Fusion at the APS - Update - 16 January 2014Data Management for the Tao of Fusion Project at the APS - 09/24/2013

User accounts - Current

�5

External)Users

Globus

badge#'XXXXX

Storage

MyProxy

map-file

tomo

Data Management for Tao of Fusion at the APS - Update - 16 January 2014Data Management for the Tao of Fusion Project at the APS - 09/24/2013

User accounts - Work In Progress

�6

External)Users

Globus

badge#'XXXXX

Storage

MyProxy

LDAP


Accounts - ProgressA tool for automatically syncing user account information between Oracle and LDAP systems! Oracle - Badge accounts managed by IS! LDAP - APS accounts managed by APS/IT!!

�7


Ownership

�8

Admin!Administrator of the system. !

Beam-line Staff !Manager of the beam-line, can be more than one for a given beam-line.!

P.I.!Can add or remove other users in their project. !

Users !Users come here for running their experiments


Ownership

�9

Data$Administrators Beamline$Staff P.$I. User

Experiment (or Project) Directory!

rw !Data administrator owns all group directories !enforced at creation time

r !Group manager is in experiment group !Experiment directory is rx for group !

r!PI is in experiment group!Experiment directory is rwx for group

r!User is in experiment group !Experiment directory is rwx for group

Data in Experiment (or Project) Directory!

rw !Data administrator owns all files and subdirectories !enforced with transfer script !

rw !Group manager is in experiment group !Experiment directory is rwx for group !

rw !User is in experiment group !Experiment directory is rwx for group !!

rw !User is in experiment group !Experiment directory is rwx for group !!

Experiment (or Project) Group!

create group !modify group member !

modify group members !Group manager uid has additional group owner attribute in schema !

modify group members of their own group.

none !User can not modify group !!


Hardware InfrastructureHigh Density Storage!

$102K LDRD plus $36K from APS IT!HP BLc7000 chassis!2x HP BL460c blade!2x HP D6000 storage array (70 x3 TB 7.5K RPM SAS)!420 TB raw storage!

APS machine room!APS IT set up system - currently writing procedures

�10


Automated Data Movement

�11

Acquisi'on*Machines

��

��

��

��

��

��

��

��

��

��

!�"��

Lustre

��

��

��

��

��

��

��

��

��

��

!�"��

ssgdev1*

1"Gb/s Infiniband

GlobusCatalog

Globus

2*x*HP*2600*SmartArray****Over*40*TB*disk*storage

2*x*HP*D6000*400*TB*total*disk*storage.*

Internal"GridFTP"Server

DataTransfer

Ingestor.py

TXM

New$servers$will$also$help$us$avoid$interference$with$produc4on$system

Analysis/Reconstruction


Timeline

�12

Descrip8on Start End

User0account0integra9on0Prototype0tools0Sync0Oracle0and0LDAP0accounts

10/13 01/14

Automated0data0transfer0at0Sector0320using0SPADE0Automate0transfer0from0detector0to0storage0Verify0and0delete0source0files

02/14 03/14

Data0ownership0Read0ESAF0informa9on0Create0groups0and0permissions0based0on0ESAF

04/14 06/14

Iterate0|0Web0UIs0|0SPADE0transfer0to0proper0directories


Thanks!

�13

confluence.aps.anl.gov/display/TAO

David Wallis - overall system architecture, setup and configuration!Brian Pruit - rack installation, blade and storage system physical installation, power installation!Mike Bauer - physical installation, fiber and copper cable installation and labeling!Steve Potempa - Blade system setup and configuration!Dave Leibfritz - network switch, trunk and routing configuration!Brian Robinson - RHEL configuration, Kickstart support and software installation setup!Roger Sersted - Lustre software build, installation and configuration

data management for tao of fusion at the aps - update

Documents