project moonshot case study - hpc midlands (janet networkshop 41)
DESCRIPTION
These are the slides for my talk on HPC Midlands' involvement in the JANET(UK) Project Moonshot pilot. For more information on Project Moonshot, please see https://www.ja.net/products-services/janet-futures/moonshot. For more on HPC Midlands, please see http://hpc-midlands.ac.ukTRANSCRIPT
![Page 1: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/1.jpg)
Moonshot Case Study: HPC Midlands Martin Hamilton hpc-midlands.ac.uk
![Page 2: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/2.jpg)
Contents• Introducing HPC
Midlands• Motivations for
Moonshot• Early Moonshot Pilot
Findings• Next Steps
![Page 3: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/3.jpg)
Contents• Introducing HPC
Midlands• Motivations for
Moonshot• Early Moonshot Pilot
Findings• Next Steps
![Page 4: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/4.jpg)
Introducing HPC Midlands
• BIS/EPSRC e-Infrastructure Centre• Supercomputing for research and industry• On demand access to HPC capacity
– Licensed software from leading vendors, including ANSYS, CD-adapco and MSC Software
• See hpc-midlands.ac.uk/launch-event for case studies from E.ON, Rolls Royce and Tata Steel
![Page 5: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/5.jpg)
Hera cluster:3,000 cores (48 Teraflops)
15TB RAM
120TB Lustre storage
Non-blocking QDR Infiniband
188 compute node blades• 2 x 2.0GHz (8 core) Sandy Bridge • 140 with 64GB RAM (4GB/core)• 48 with 128GB RAM (8GB/core)
Introducing HPC Midlands
![Page 6: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/6.jpg)
Introducing HPC Midlands
Note the 50 node (800 core) and 25 node (400 core) jobs!
![Page 7: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/7.jpg)
HPC Midlands Applications
![Page 8: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/8.jpg)
HPC Midlands Applications
CFD Based Study of Unconventional Aeroengine Exhaust Systems
T. CoatesG. J. Page
30th AIAA Applied Aerodynamics Conference
DOI: 10.2514/6.2012-2775
![Page 9: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/9.jpg)
Contents• Introducing HPC
Midlands• Motivations for
Moonshot• Early Moonshot Pilot
Findings• Next Steps
![Page 10: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/10.jpg)
Motivations for Moonshot• Desire to avoid separate HPC Midlands
credentials for service users• Use organizational credentials for multiple
services, e.g. OpenSSH, Apache, Samba• Delegated authority for managing user
identities and access to services• Services built around the user not the service
providers (see next slide)• Comfort zones: ssh keys, CLI etc
![Page 11: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/11.jpg)
Slide credit: Gary Page / Leigh Lapworth
![Page 12: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/12.jpg)
Motivations for Moonshot
![Page 13: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/13.jpg)
Contents• Introducing HPC
Midlands• Motivations for
Moonshot• Early Moonshot Pilot
Findings• Next Steps
![Page 14: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/14.jpg)
Early Moonshot Pilot Findings• Dedicated HPC Midlands login node
allocated for development work– Live DVD image also available for testing
• Moonshot RPMs from yum.dev.ja.net– Patched versions of FreeRADIUS, OpenSSH,
Shibboleth SP, GSS Server, libraries etc– (Mostly) Install into /opt/moonshot– RPM package dependency fun and games with
vendor respins (common for HPC)
![Page 15: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/15.jpg)
Yum… (github coming soon)
![Page 16: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/16.jpg)
Early Moonshot Pilot Findings
Moonshot up and running in test mode:
hera12# /opt/moonshot/bin/ssh -p 2222 -l "" 127.0.0.1CTRL-EVENT-EAP-STARTED EAP authentication startedCTRL-EVENT-EAP-PROPOSED-METHOD vendor=0 method=21CTRL-EVENT-EAP-METHOD EAP vendor 0 method 21 (TTLS) selectedCTRL-EVENT-EAP-SUCCESS EAP authentication completed successfully[comth@hera12 ~]$
This proves that Moonshot enabled ssh, sshd, gss-server, radiusd and shibd are all talking to each other.
![Page 17: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/17.jpg)
Contents• Introducing HPC
Midlands• Motivations for
Moonshot• Early Moonshot Pilot
Findings• Next Steps
![Page 18: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/18.jpg)
Next Steps
• Get Moonshot installation up and running with institutional RADIUS servers / Trust Router– Loughborough contracted to JANET(UK) to provide
technical support for the Moonshot Pilot– Leicester also working on Moonshot for DiRAC (HPC
for Particle Physics, Astronomy + Cosmology)
• Discussions with industrial collaborators– Firewall holes, VPNs, SOCKS proxies etc– Hosted Moonshot portal to manage access?– JANET connectivity?
![Page 19: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/19.jpg)
Next Steps
![Page 20: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/20.jpg)
Next Steps
![Page 21: Project Moonshot Case Study - HPC Midlands (JANET Networkshop 41)](https://reader035.vdocuments.net/reader035/viewer/2022070303/54b81bf64a7959340a8b4587/html5/thumbnails/21.jpg)
Next Steps