7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 1/27
Introduction and Early Experiences withthe SME & HPSS integration
Kamran Yousaf Jaime Pinto
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 2/27
Storage Made Easy - Briefing
Rationale/Use Case
Rationale for SME:
Attract a new host of researchers that work primarily fromtheir desktops, and who still need a place “in the cloud” toarchive their data.
HSI/HTAR: power users – internal transfers
Globus/DSI: power users – cross site transfers
SME: light users – web transfers, dropbox,remote drives
Intended/typical use of the HPSS clients at SciNet
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 3/27
What Storage Made Easyprovides
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 4/27
Storage Made Easy - Briefing
Enterprise File Share and Sync fabric
Bridge & control public/private Storage Assets
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 5/27
SME Features
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 6/27
Storage Made Easy - Briefing
Provides a controlled access point
Web File Manager
Support all Mobiles / Tabletsnatively
(iOS, Android, Windows Phone, BlackBerry)
Native Cloud Drives, syncApps & Mail integration
(Windows, Mac & Linux)
For all data assets no matter where they reside
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 7/27
Manage & secure all company data in on place
Federated data access
Storage Made Easy - Briefing
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 8/27
Connectors to over 50 public / private Storage andSaas Providers
Storage Connectors
Storage Made Easy - Briefing
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 9/27
Protect, secure and promote access visiblity
Data Secure Features
Storage Made Easy - Briefing
Secure File Sharing-Password protected-Time Expiry
Controlled encryption- SHA-256
Audit-Export to Excel CSV-Output to Syslog format
Cloud Governance-Set Policies-Control all sharing features File versioning
locking, trashGEO Location controls
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 10/27
Across data silos
Focus on Governance and Compliance
Storage Made Easy - Briefing
Single-Sign-On-For LDAP & Active Directory
Data Retention policiesLegal Hold
File Alerts- Real-Tme file access alerts
File Versioning- File versioning retention
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 11/27
Integrates with LDAP and Active Directory for Single-Sign-On
Identity Management
Storage Made Easy - Briefing
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 12/27Storage Made Easy - Briefing
Data is not tampered with
No lock in. Easy to migrate. Accessible over otherchannels and Apps.
Files view in storageConsole of other EFSS Apps
Files view in storage consoleof SME data
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 13/27
Built in collaboration that work across data silos
Built in Collaboration
Storage Made Easy - Briefing
Web office editing(Best of breed)
(Cloud to desktop editing)
File Commenting(& notifications)
PDF Annotation editing(multi-user support) Secure File and
Folder Sharing(+ versioning & notifications)
Bookmark links(& notifications)
Project WorkSpaces(create virtual workspaces
Across Storage Silos)
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 14/27
Highly Available
Storage Made Easy - Briefing
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 15/27
HPSS Journey
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 16/27Storage Made Easy - Briefing
Start of Journey
! 6 months ago Jaime watched SME in a webinar and
became interested in integrating SME with SciNet
! How to bridge the gap between a product built for Cloud (SME)and Mature product
!Initial setup was challenging, during trial the appliance wasbehind multiple firewalls
! HTTP/S access was through a sequence of ssh tunnels, we had
problems with hostnames and outbound access
! Web UI was not working because of tunneling and hostnames
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 17/27Storage Made Easy - Briefing
First Attempt HPSS/FTP
! Out of box SME provides an FTP connector
! HPSS provides a FTP interface
! The FTP interface worked with minor changes
Problems
! Getting the listing was very slow
!
Had to open a lot of ports
! No unified login
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 18/27Storage Made Easy - Briefing
Second Attempt HPSS/API
! Looked promising at the start
! HPSS provides shell binaries to access HPSS
! The API is stable, then
HPSS Upgrade!!!
! The API binaries are now only supported onCentOS 6.6 and CentOS 7
! SME is based on CentOS 5.11
! To authenticate on the SciNet test environment we had to usekeytab files
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 19/27Storage Made Easy - Briefing
Eureka (VFS-Fuse)
!
HPSS now also supports VFS Fuse
! VFS Fuse exposes HPSS as a Virtual FileSystem
! VFS Fuse Honors user permissions
! SME already has a provider for CIFS
! SME writing a Storage Provider to integrate withHPSS using VFS-Fuse
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 20/27
Storage Made Easy - Briefing
Eureka (VFS-Fuse)
! SME will authenticate a user via LDAP and use thesame credentials to access HPSS (Single Sign on)
!
User’s HPSS data will be immediately availableusing all the SME tools
! Release date: First week of October (for now still
over and NFS mount on the appliance)
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 21/27
Storage Made Easy - Briefing
Futures
! SME will be upgraded to CentOS 7
! VFS FUSE will be supported directly on Appliance!
Initial release will be at SciNet and then generallyavailable
! Make your HPSS system Cloud aware!
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 22/27
Storage Made Easy - Briefing
Futures
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 23/27
Storage Made Easy - Briefing
Futures
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 24/27
Storage Made Easy - Briefing
Futures
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 25/27
Storage Made Easy - Briefing
Summary
! Private Enterprise File Share & Sync fabric
! Works with HPSS and any other Storage combination
! Planned HPSS release date first week of October
! Does not ‘tamper’ with data
! Fully brandable
! Integrates with LDAP / Active directory
! Enables Cloud Governance / Security features for allcorporate data assets
! Strong Collaboration features
! Build in BYOD & integrates with best-of-breed
! Private ‘Google’ for all corporate data
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 26/27
Storage Made Easy - Briefing
Storage Made Easy
d
7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share
http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 27/27
Questions ?
Storage Made Easy