Upload File

orangefs overview tutorial · 2012. 4. 15. · tutorial)goals) • brief)history) •...

  • Home
  • Documents
  • OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)
52
OrangeFS Overview Tutorial Walt Ligon Clemson University

Upload: others

Post on 14-Jun-2021

4 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

OrangeFS  Overview  Tutorial  

Walt  Ligon  Clemson  University  

Page 2: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Tutorial  Goals  

•  Brief  History  •  Architecture  Overview  •  User  Interfaces  •  Important  Features  •  InstallaBon/ConfiguraBon  

Page 3: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Brief  History  

•  Brief  Historyß  Star&ng  here!  

•  Architecture  Overview  •  User  Interfaces  •  Important  Features  •  InstallaBon/ConfiguraBon  

Page 4: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

A  Brief  History  

•  First  there  was  PVFS  –  V0  

•  Aric  Blumer  (Clemson)    •  1993    •  PVM  User’s  MeeBng  Oak  Ridge  

–  V1    •  Rob  Ross  (Clemson)  •  1994  –  2000  

–  V2  •  Rob  Ross  (Argonne),  Phil  Carns  (Clemson),  et  al.  •  2000  -­‐  Present  

Page 5: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

PVFS  Funding  

•  NASA  •  NSF  – PACI  – HECURA  

•  DOE  – Office  of  Science  – SciDAC  

•  Government  Agencies  

Page 6: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

PVFS  Partnerships  

•  Clemson  U  •  Argonne  NL  •  Northwestern  U  •  Acxiom  •  Ames  NL  •  U  of  Michigan  •  Ohio  St.  U  

•  Ohio  Supercomputer  Center  

•  Carnegie  Mellon  U  •  U  of  Heidleberg  •  Sandia  NL  •  U  of  Oregon  

Page 7: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Emergence  of  Orange  •  Project  started  in  2007  – Develop  PVFS  for  “non-­‐tradiBonal”  uses  

•  Very  large  number  of  small  files  •  Smaller  accesses  •  Much  more  metadata  

–  Robust  security  features  –  Improved  resilience  

•  Began  to  see  opportuniBes  for  broader  area  –  Big  Data  Management  –  Clouds  –  Enterprise  

Page 8: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Today  and  Beyond  

•  Clemson  reclaims  primary  site  – As  of  2.8.4  began  using  name  “OrangeFS”  – Omnibond  offers  commercial  support  – Currently  on  2.8.6  – Version  2.9.0  soon  to  be  released  with  new  features  

– 2.10  is  internal  development  version  for  …  

•  OrangeFS  3.0  

Page 9: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

What  to  Expect  in  3.0  

•  Totally  Redesigned  Object  Model  – ReplicaBon  – MigraBon  – Dynamic  configuraBon  – Hierarchical  Storage  Management  (Bers)  – Metadata  support  for  external  devices  (archive)  – Rule-­‐based  security  model  – Rule-­‐based  policies  

Page 10: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Architecture  Overview  

•  Brief  History  •  Architecture  Overview  ß  You  are  here!  

•  User  Interfaces  •  Important  Features  •  InstallaBon/ConfiguraBon  

Page 11: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Architecture  Overview  

•  OrangeFS  is  designed  for  parallel  machines  – Client/Server  architecture  – Expects  mulBple  clients  and  servers  

•  Two  major  sofware  components  – Server  daemon  – Client  library  

•  Two  auxiliary  components  – Client  core  daemon  – Kernel  module  

Page 12: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

User  Level  File  System  

•  Everything  runs  at  the  user  level  on  clients  and  servers  – ExcepBon  is  the  kernel  module,  which  is  really  just  a  shim  –  more  details  later  

•  Server  daemon  runs  on  each  server  node  and  serves  requests  sent  by  the  client  library,  which  is  linked  to  client  code  on  compute  nodes  

Page 13: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Networking  

•  Client  and  server  communicate  using  an  interface  called  “BMI”  – BMI  supports  tcp/ip,  ib,  mx,  portals  – Module  design  allows  addiBon  of  new  protocols  – Requests  use  PVFS  protocol  similar  to  that  of  NFS  but  expanded  to  support  a  number  of  high  performance  features  

Page 14: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Server-­‐to-­‐Server  CommunicaBon  

TradiBonal  Metadata  OperaBon  

 Create  request  causes  client  to  communicate  with  all  servers  O(p)  

Scalable  Metadata  OperaBon  

 Create  request  communicates  with  a  single  server  which  in  turn  communicates  with  other  servers  using  a  tree-­‐based  protocol  O(log  p)  

Mid  Client  

Serv  

App  Mid  Mid  

Client  

Serv  

Client  

Serv  

App  

Network  

App  Mid  Client  

Serv  

App  Mid  Mid  

Client  

Serv  

Client  

Serv  

App  

Network  

App  

Page 15: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Storage  

•  The  OrangeFS  server  interacts  with  storage  on  the  host  using  an  interface  layer  named  “trove”  – All  storage  objects  referenced  with  a  “handle”  – Storage  objects  consist  of  two  components  •  Bytestreams  –  sequences  of  data  •  Key/Value  Pairs  –  data  items  that  are  accessed  by  key  

– As  currently  implemented  …  •  Bytestreams  with  the  local  file  system  (data)  •  Key/value  pairs  with  BerkeleyDB  (metadata)  

Page 16: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

File  Model  

•  Every  file  consists  of  two  or  more  objects  – Metadata  object  contains  •  TradiBonal  file  metadata  (owner,  permissions,  etc.)  •  List  of  data  object  handles  •  FS  specific  items  (layout,  distribuBon,  parameters)  •  User-­‐defined  aiributes  

– Data  objects  contain  •  Contents  of  the  file  •  Aiributes  specific  to  that  object  (usually  not  visible)  

Page 17: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Directories  

•  Work  just  like  files  except  – Data  objects  contain  directory  entries  rather  than  data  

– Directory  entries  have  entry  name  and  handle  of  that  entry’s  metadata  object  (like  inode  number)  

– Extendable  hash  funcBon  selects  which  data  object  contains  each  entry  

– Mechanisms  based  on  GIGA+  manage  consistency  as  directory  grows  or  shrinks  

Page 18: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Distributed  Directories  

DirEnt1  

DirEnt2  

DirEnt3  

DirEnt4  

DirEnt5  

DirEnt6  

DirEnt1  DirEnt5  

DirEnt3  

DirEnt2  

DirEnt6  

DirEnt4  

Server0  

Server1  

Server2  

Server3  

Extensible Hashing  

Page 19: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Policies  

•  Objects  of  any  type  can  reside  on  any  server.  –  Random  selecBon  (default)  used  to  balance  – User  can  control  various  things  

•  Which  servers  hold  data  •  Which  servers  hold  metadata  •  How  many  servers  a  given  file  or  directory  are  spread  across  •  How  those  servers  are  selected  •  How  file  data  is  distributed  to  the  servers  

–  Parameters  can  be  set  in  configuraBon  file,  many  on  a  directory,  or  for  a  specific  file  

Page 20: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

User  Interfaces  

•  Brief  History  •  Architecture  Overview  •  User  Interfacesß  Half  way!  

•  Important  Features  •  InstallaBon/ConfiguraBon  

Page 21: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

User  Interfaces  

•  System  Interface  •  VFS  Interface  •  Direct  Access  Library  •  MPI-­‐IO  •  Windows  Client  •  Web  Services  Module  •  UBliBes  

Page 22: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

The  System  Interface  

•  Low-­‐level  interface  of  the  client  library  –  PVFS_sys_lookup()  –  PVFS_sys_getair()  –  PVFS_sys_setair()  –  PVFS_sys_io()  

•  Based  on  the  PVFS  request  protocol  •  Designed  to  have  interfaces  built  on  them  •  Provide  access  to  all  of  the  features  •  NOT  a  POSIX-­‐like  interface  

Page 23: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

The  VFS  Interface  

•  Linux  kernel  module  allows  OrangeFS  volumes  to  be  mounted  and  used  like  any  other  – Limited  mmap  support  – No  client  side  cache  – A  few  semanBc  issues  

•  Must  run  client_core  daemon  – Reads  requests  from  the  kernel  then  calls  library  

•  The  most  common  and  convenient  interface  •  BSD  and  OS  X  support  via  FUSE  

Page 24: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

The  Direct  Library  

•  InterposiBon  library  for  file  related  stdio  and  Linux  system  calls  

•  Links  programs  directly  to  the  client  library  •  Can  preload  the  shared  library  and  run  programs  without  relinking  

•  Faster,  lower  latency,  more  efficient  than  VFS  •  Configurable  user-­‐level  client  cache  •  Best  opBon  for  serious  applicaBons  

Page 25: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Direct  Access  Library  

•  Implements:  – POSIX  system  calls  – Stdio  library  calls  

•  Parallel  extensions  – NonconBguous  I/O  – Non-­‐blocking  I/O  

•  MPI-­‐IO  library  

App  

Kernel  PVFS  lib  

Client  Core  

Direct  lib  

PVFS  lib  Kernel  

App  

Page 26: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Direct  Interface  Client  Caching  

•  Direct  Interface  enables  MulB-­‐Process  Coherent  Client  Caching  for  a  single  client  

File  System  File  System  File  System  

File  System  File  System  

Client  ApplicaBon  

Direct  Interface    

Client  Cache  

File  System  

Page 27: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

MPI-­‐IO  

•  Most  MPI  libraries  provide  ROMIO  support,  which  has  support  for  direct  access  to  the  client  library  

•  A  number  of  specific  opBmizaBons  for  MPI  programs,  especially  for  collecBve  IO  – Aggregators,  data  sieving,  data  type  support  

•  Probably  the  best  overall  interface,  but  only  for  MPI  program  

Page 28: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Windows  Client  

•  Supports  Windows  32/64  bit  •  Server  2008,  R2,  Vista,  7  

Dokan  

PVFS  Protocol  

Windows  Drive  

Mapping  

OrangeFS  API  

Direct  Apps  

OrangeFS  Servers  

Page 29: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Web  Services  Module  

•  WebDAV  •  S3  •  REST  

Page 30: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

WebDAV  

ModDAV

PVFS  Protocol  OrangeFS  API  

Server  

Server  

Server  

OrangeFS  

DAVOrangeFS

Apache  

•  Supports  DAV  protocol  and  tested  with  (insert  reference  test  run  –  check  with  mike)  

•  Supports  DAV  cooperaBve  locking  in  metadata    

Page 31: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

S3  

OrangeFS  

PVFS  Protocol  OrangeFS  API  

Server  

Server  

Server

ModS3  

Apache  

Page 32: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Admin  REST  Interface  

PVFS  Protocol  OrangeFS  API  

Server

Server

Server

OrangeFS  

Mod_OrangeFSREST  

Apache  

DojoToolkit  UI  

REST  

Page 33: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Important  Features  

•  Brief  History  •  Architecture  Overview  •  User  Interfaces  •  Important  Featuresß  Over  the  hump!  

•  InstallaBon/ConfiguraBon  

Page 34: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Important  Features  •  Already  Touched  On  

–  Parallel  Files  (1.0)  –  Stateless,  User-­‐level  ImplementaBon  (2.0)  –  Distributed  Metadata  (2.0)  –  Extended  Aiributes  (2.0)  –  Configurable  Parameters  (2.0)  –  Distributed  Directories  (2.9)  

•  Non-­‐ConBguous  I/O  (1.0)  •  SSD  Metadata  Storage  (2.8.5)  •  Replicate  On  Immutable  (2.8.5)  •  Capability-­‐based  Security  (2.9)  

Page 35: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Non-­‐ConBguous  I/O  §  NonconBguous  I/O  operaBons  are  

common  in  computaBonal  science  applicaBons  

§  Most  PFSs  available  today  implement  a  POSIX-­‐like  interface  (open,  write,  close)  

§  POSIX  nonconBguous  support  is  poor:  •  readv/writev  only  good  for  

nonconBguous  in  memory  •  POSIX  lisBo  requires  matching  sizes  in  

memory  and  file  §  Beier  interfaces  allow  for  beier  

scalability  

Noncontiguous in file Memory

File

Noncontiguous in memory Memory

File

Noncontiguous in memory and file Memory

File

Page 36: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

SSD  Metadata  Storage  

SSD  

Disk  

Server  

Data  

Metadata  

•  WriBng  metadata  to  SSD    –  Improves  Performance  – Maintains  Reliability  

Page 37: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Replicate  On  Immutable  

•  First  Step  in  ReplicaBon  Roadmap    •  Replicate  data  to  provide  resiliency  –  IniBally  replicate  on  Immutable  –  Client  read  fails  over  to  replicated  file  if  primary  is  unavailable  

Metadata  

Client   File  I/O  

Data  

Server   Server  

Data  

Page 38: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Capability  Based  Security  

Metadata  Servers  

Client  

Cert  or  CredenBal  

Signed  Capability  I/O  

Signed  Capability  

Server  

Server  

Server  

Signed  Capability  I/O  Signed  Capability  I/O  

OpenSSL  PKI  

Page 39: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Future  Features  

•  Airibute  Based  Search  •  Hierarchical  Data  Management  

Page 40: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Airibute-­‐Based  Search  

•  Client  tags  files  with  Keys/Values    •   Keys/Values  indexed  on  Metadata  Servers  •   Clients  query  for  files  based  on  Keys/Values  •   Returns  file  handles  with  opBons  for  filename  and  path  

Metadata  

Client  

Key/Value  Parallel  Query  

Data  

Data  

Metadata  

File  Access  

Page 41: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Hierarchical  Data  Management  

Archive  Intermediate  Storage  NFS  

Remote  Systems  TeraGrid,  OSG,  Lustre,  GPFS  

HPC  OrangeFS  

Metadata  OrangeFS  

Users  

Page 42: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

InstallaBon/ConfiguraBon  

•  Brief  History  •  Architecture  Overview  •  User  Interfaces  •  Important  Features  •  Installa>on/Configura>onß  Last  One!  

Page 43: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Installing  OrangeFS  

•  Distributed  as  a  tarball  – You  need  •  GNU  Development  environment  

–  GCC,  GNU  Make,  Autoconf,  flex,  bison  

•  Berkeley  DB  V4  (4.8.32  or  later)  •  Kernel  Headers  (for  kernel  module)  •  A  few  libraries  

–  OpenSSL,  etc.  

Page 44: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Building  OrangeFS  

# ./configure  -­‐-­‐prefix=<install_dir>            -­‐-­‐with-­‐kernel=<kernel_dir>          -­‐-­‐with-­‐db=<db_dir>  

# make  # make  install  # make  kmod  # make  kmod_install  

Page 45: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Configuring  OrangeFS  

•  Servers  – Many  installaBons  have  dedicated  servers  •  MulB-­‐core  •  Large  RAM  •  RAID  subsystems  •  Faster  network  connecBons  

– Others  have  every  node  as  both  client  and  server  •  Checkpoint  scratch  space  •  User-­‐level  file  system  •  Smaller,  more  adaptable  systems  

Page 46: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Server  Storage  Modules  

•  AltIO  – General-­‐purpose  – Uses  Linux  AIO  to  implement  reads/writes  – Typically  uBlizes  Linux  page  cache  

•  DirectIO  – Designed  for  dedicated  storage  with  RAID  – Uses  Linux  threads  and  direct  IO  – Bypasses  Linux  page  cache  

Page 47: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Parameters  to  Consider  

•  Default  number  of  IO  Servers  •  Default  strip  size  •  RAID  parameters  – Cache  behavior  – Block  sizes  

•  Local  file  system  layout  (alignment)  

Page 48: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Metadata  Servers  

•  As  many  or  as  few  as  you  need  – Every  server  can  be  a  metadata  server  •  Metadata  access  load  spread  across  servers  

– Dedicated  metadata  servers  •  Keep  metadata  traffic  from  data  servers  •  Custom  configured  for  metadata  

– Depends  on  workload  and  data  center  resources  

Page 49: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Clients  •  Minimum  each  client  needs  libpvfs2  – Direct  access  lib  (libofs)  – MPI  libraries  –  Precompiled  programs  – Web  Services  

•  Most  clients  will  want  VFS  interface  –  pvfs2-­‐client-­‐core  – Modpvfs2  

•  Need  a  mount  string  poinBng  to  a  server  (fstab)  – Many  clients,  spread  load  across  servers  

Page 50: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Learning  More  

•  www.orangefs.org  web  site  – Releases  – DocumentaBon  – Wiki  

•  pvfs2-­‐users@beowulf-­‐underground.org  – Support  for  users  

•  pvfs2-­‐developers@beowulf-­‐underground.org  – Support  for  developers  

Page 51: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

Commercial  Support  

•  www.orangefs.com  &  www.omnibond.com  – Professional  Support  &  Development  team    

Page 52: OrangeFS Overview Tutorial · 2012. 4. 15. · Tutorial)Goals) • Brief)History) • Architecture)Overview) • User)Interfaces) • ImportantFeatures) • Installaon/Configuraon)

QUESTIONS  &  ANSWERS    

     


Dropwizard* - nimret › seajug › past › 2012 › sep › slides.pdf · “Dropwizard*has*outofStheSbox* supportfor*sophisOcated* configuraon,*applicaon*metrics,* logging,*operaonal*tools,*and*much*

OrangeFS Reference Architecture - Delli.dell.com/sites/.../en/Documents/orange-fs-reference-architecture.pdf · OrangeFS Reference Architecture for Dell R710/MD Storage Stack –

OrangeFS DDN SFA12K Architecture - Squarespace€¦ · Executive Summary The DDN SFA12K platform with the addition of OrangeFS can be leveraged in a wide variety of high-performance,

Architecture of the Upcoming OrangeFS v3 Distributed Parallel File System

Direct Vent Tankless Water Heater Installaon and Operaon Manual

Splunk*Configuraon* Managementand* Deploymentwith* … · Running*Searchhead*Playbook* 13 /etc/ansible#ansible-playbook playbooks/search_heads.yml! PLAY [apply common configuration

Saeed%Hagh% ProductManager(–Policy(Compliance( · 2 Manage(Security%Risk,iden7fying(and(remediang(so:ware(Vulnerabili6es (including(so:ware(Configuraon (sengs,( Misuse& Flaws%

Downscaling Configuraon of WRF Weather …wakes.uma.pt/workshop/Tutorial_WRF.pdfDownscaling Configuraon of WRF Weather Research & Forecasng Model CCM, Madeira University, Funchal,

KeepYourMission2cri4calApplica4onsUp andRunning24 ...vox.veritas.com/legacyfs/online/veritasdata/IAB13.pdfSYMANTEC#VISION#2013# AHer#Failover#Cluster#is#configured,##from##SoluFon#Configuraon#Center#(SCC)#launch#

Steeroids® Installaon Instrucons - SpeedDirect · 2018. 2. 6. · Steeroids® Installaon Instrucons Document: 780-65550-3; Rev 2/2018 Page 2 of 8 (888) 425-2776 2. Support the car

Introduction to distributed file systems. OrangeFS ... · Examples:GFS2[3],OCFS2[4]..... Distributedfilesystems client1 server1 server2 serverM client2 clientN storage1 storage2 storageM

Quick Installaon Guide - Packet8 - Support Information

Installaon)von) MySQL) - pub.informatik.uni-wuerzburg.de€¦ · Installaon)von) MySQL) Armin)Kerscher Vorlesung)Datenbanken)WS)2013/2014) UniversitätWürzburg)I)Lehrstuhl)I–Informak)

OrangeFS Installation Instructions (2.9)

Theiracepackage :tutorial - Université libre de Bruxellesiridia.ulb.ac.be/.../slides/matheuristics2016-tutorial.pdf · Overview • Configuraon"scenario" • Irace"opCons" • ExecuCng"irace"

OFFENSIVE:)) ExploingchangesonDNSserver) configuraon)...• CSRF/XSS.(• Insufficientauthorizaon.(• SNMP/TFTP.(• Defaultpassword(+external(administraon.(• Cracking(wifi(passwords(+defaultpassword.•

TCS-Aberra*on Control: status and perspecves · } Pre-installaon tests at Rome Tor Vergata University. First characterizaon on AdV done during MS installaon (March 2018); HWS-HR 24/07/2018

Steeroids® Installaon Instrucons - SpeedDirect

Oracle*Forms*Applica2on* Moderniza2on*– …6.0,6i,9i,10g * Oracle*Forms/*Reports*11g* Start Leveraging*WebLogic* Technologies Unsupported* ... Oracle*Forms*and*Reports*Installaon*and*Configuraon*!

DM Specialist in Marine and Offshore HVAC SystemsALSCOTThwt0166.51software.net/uploadfiles/201651816223088.pdf · new-buildings. Alsco specializes in design, supply, installaon and

Wartung Notbeleuchtung - eTeam plus · 2018-04-30 · Notbeleuchtung WARTUNG Objekt: Installaon: Standort / Bezeichnung Schaltgerätekombinaon (SGK) Anlagen mit Notbeleuchtung müssen

Source pack installaon of OpenFOAM. 4.0 into RHLofbkansai.sakura.ne.jp/data/takagi20160702OFInstall.pdf · Source pack installaon of OpenFOAM. 4.0 into RHL Open CAE Local Study Mee0ng

OZ HEATRE SCREENS Majesc Fixed Screen Installaon Manual

AACE:%Technology%% · PDF fileRook Vendor Intel® Configuraon% Standalone%workstaon% CPU%Family% Westmere% Numberof%CPUs% 2 CPUcores 12 CPUcorespeed 1.6%GHz

Permeable(Reac+ve(Barriers(for( Reduc+on(of(Nitrate(Discharge( … · PilotProjectTasks" • Well"installaon"and"tes;ng"to"determine"site"" hydrogeology"–2014" • PreV"installaon"GW"and"SW"design"sampling"and"baseline"

Installaon)von) MySQL) - pub.informatik.uni-wuerzburg.de€¦Installaon)von) MySQL) Armin)Kerscher Vorlesung)Datenbanken)WS)2013/2014) UniversitätWürzburg)I)Lehrstuhl)I–Informak)

Installaon MATRIX PICKET S Picket Fencing System

GRAYS&HARBORCOUNTY&COST&ESTIMATES ... 3 SiteUlies Quan1ty Unit Costper Unit Material/Cost Installaon Cost Equipment/ Cost Locaon Factor Total/Cost Comments

Configuraon* Management Foundaons*leomurta/courses/2017.1/gc/aula3.pdfLeonardo*Murta* Configuraon*ManagementFoundaons* 4 Configuraon*Item* System* Module* Procedure * Coarse* Fine*

ACloseExaminaonofPerformanceand PowerCharacteris ...hjx/file/mobisys12_presentation.pdfLTE"state"machine" LTEpowermodel Network"performance" Parameter"configuraon" Energyefficiency"

Safety in Design and Installaon of Heat Recovery Steam ... · Safety in Design and Installaon of Heat Recovery Steam Generator ... HRSGs in Lamma Power Staon ... Flow Accelerated

Context‐based Online Configuraon Error Detecon · Movaon Configuraon errors are caused by erroneous sengs in the soware system Huge impact An incorrect configuraon within Swedens

Dependable)Compu.ng:)Basic) Concepts)and)Defini.ons)courses.ece.ubc.ca/513/Basic-concepts.pdf · 2011-09-08 · Dependable)Compu.ng:)Basic) Concepts)and)Defini.ons) ... configuraon,)human)

iridex group plasc · Triaxial geogrid installaon Extrusion welding around the pipelines and „T“ intersecon zones. Installaon of leakage monitoring system. Geocells installaon

Federated High Performance Computing with OPENCCQ · Self-Service Elastic HPC Scheduler CCQ EFS S3 Auto-Scaling Compute OrangeFS HPC Parallel Storage DDB HPC Job Login WebDAV iRODS