globus online integrating with globus online
TRANSCRIPT
![Page 1: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/1.jpg)
globus online
Integrating with Globus Online
Steve Tuecke Computation Institute University of Chicago and Argonne National Laboratory
![Page 2: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/2.jpg)
www.globusonline.org
• Resource integration – Connect campus, project, personal and cloud
resources with Globus Online
• Branded interface – Make Globus Online Web site look like 3rd party site
• Domestication – Integrate 3rd party Web sites with Globus Online
Types of integration
2
![Page 3: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/3.jpg)
globus online
Resource Integration
![Page 4: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/4.jpg)
www.globusonline.org
• End user controlled resource integration – Simple install in minutes – No admin privileges required – Works behind most NATs and firewalls – Mac, Windows, Linux binaries
• Primary uses: – Connecting your personal computer or laptop – Temporarily connecting your account on server – Embedded: Linux setup/shutdown can be scripted
Globus Connect
4
![Page 5: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/5.jpg)
www.globusonline.org
• What is GCMU? – Make you server available as an endpoint for all your users – Packages a GridFTP server and MyProxy CA authentication
server (OAuth soon), pre-configured for use with Globus Online
• Why GCMU? – Create transfer endpoints in minutes – Avoid complex GridFTP install
• To download: https://www.globusonline.org/gcmu/
Globus Connect Multi-User
5
“We used GCMU to form a campus‐wide GSI authen;ca;on service spanning mul;ple servers. Now my users have a fast, easy way to get their data wherever it needs to go, and the setup process was trivial." ‐‐University of Michigan
“As a resource admin, I've found GCMU an exceedingly useful tool.... With GCMU, seGng up a GridFTP server and handling authen;ca;on for mul;ple users is easy." ‐‐Oak Ridge Na8onal Lab
![Page 6: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/6.jpg)
www.globusonline.org
• Single port GridFTP – Firewall no longer needs inbound ephemeral ports – TCP-based data channel – Connects on same port as control channel (2811)
• NAT friendly GridFTP – Allow Globus Connect to Globus Connect transfer – UDP-based data channel w/ STUN NAT traversal
• Other changes (completed) – MLSC: Directory listing over control channel – CKSM progress markers / heartbeats
Firewall Friendly GridFTP (future)
6
![Page 7: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/7.jpg)
www.globusonline.org
Flight Control Endpoint Operations Console (soon)
7
![Page 8: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/8.jpg)
www.globusonline.org
• Storage providers can plug storage into the Globus Storage cloud – Campuses, projects, commercial clouds – Provider determines usage policies and pricing
• Globus Connect will be enhanced to make it easy to plug in storage from: – Any file system – S3-style object stores
• Planned: U.Chicago Isilon, S3, SDSC Cloud, Cornell RedCloud
Globus Storage providers (future)
8
![Page 9: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/9.jpg)
www.globusonline.org
• Identities: Allow your users to login to Globus services using your identities – Currently support OpenID, MyProxy, MyProxy OAuth – InCommon via CILogon will be supported soon – Simple Web GUI for binding external identities to
Globus identities – Pre-populate select profile attributes (future)
• Groups: Mirror your group membership to Globus groups (future)
Globus Nexus providers
9
![Page 10: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/10.jpg)
globus online
Branded interface
![Page 11: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/11.jpg)
www.globusonline.org
Blue Waters
11
![Page 12: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/12.jpg)
www.globusonline.org
BIRN Customized Web Presence
12
![Page 13: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/13.jpg)
www.globusonline.org
• Configure your headers, footers, logo, menus, sign-up text, login text
• Use your own domain name
• Single sign-on: Set the default identity provider for login
Features
13
![Page 14: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/14.jpg)
globus online
Domestication
![Page 15: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/15.jpg)
www.globusonline.org
Write programs that access/manage user identities, profiles, groups, resources—and data …
… via REST APIs and command line programs
Globus Integrate
Globus Integrate: For when you want to…
Globus Transfer
Globus Storage Globus
Collaborate
Globus Connect Mul5 User
Globus Connect
Globus Nexus Globus Toolkit
![Page 16: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/16.jpg)
www.globusonline.org
ESGF – Portal integration
16
• Outsource data transfer to Globus – Data download to user machine
from search – Data transfer to another server
by user – Replica;on of data between sites
by administrator • No ESGF client soPware needed
![Page 17: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/17.jpg)
www.globusonline.org
BIRN – Service provider
17
Wiki (Confluence) Data Transfer (Globus GridFTP/ Globus Transfer)
Manage accounts and groups
Secure access to data
Secure access to documents
Provision accounts and groups
Provision accounts and groups
BIRN Community Web Presence
Globus Integrate Globus Integrate
![Page 18: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/18.jpg)
www.globusonline.org
• User facing service with Web GUI – Manage my identity mappings – Create groups, manage membership and policies – Manage my profile attributes
• Developer interfaces for using Globus as: – Identity provider
• OAuth, OpenID, REST, LDAP (restricted), SAML (soon)
– Group provider • LDAP, REST, SAML assertions (future)
– Profile provider • REST
Globus Nexus
18
![Page 19: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/19.jpg)
www.globusonline.org
• Globus Nexus – Graph of identities, groups, profiles, policies
• Globus Transfer – Transfer / synchronize files between endpoints
• GridFTP and Globus Storage endpoints – Manage files: ls, mkdir, rm, etc. – Create and manage endpoints
• Globus Storage – Primary interface to a storage volume is Globus Transfer – Manage storage volumes – Access files via http(s)
• Globus Collaborate – Create and manage collaborative environments
REST APIs
19
![Page 20: globus online Integrating with Globus Online](https://reader033.vdocuments.net/reader033/viewer/2022051404/58679ed11a28ab6d408bdb5c/html5/thumbnails/20.jpg)
www.globusonline.org
• Simplify app creation by domesticating common app development frameworks – Currently have Java and Python client libraries for the
Globus Transfer REST API • Which development frameworks?
– Google App Engine, Force.com – Liferay, Djanjo, Ruby on Rails – Drupal, Joomla – Others? Priority?
Domesticating development frameworks
20