streamlining hpc workloads with containers
TRANSCRIPT
Streamlining HPC Workloadswith Containers
@DustinKirkland
what doeshigh-performance computing
look like?
Wikipediasays...
Or perhaps in China...
Google image search shows...
Theuniversitystudentlearns...
HackerNews suggests...
Your DevOps engineer launches...
x1.32xlarge
Butthenthereisyourreal,actualdatacenter...
what do all of thesehave in common?
a lot,actually
they’re all runningLinux
directly on thebare metal itself
performance ismaximized
overhead isminimized
big problems aredistributed across a cluster
everyone prefers aclean environment
virtual machinesalways involve overhead
VM MonitorVMXON VMXOFF
Guest
VM EntryVM Exit
oh, and let’s reboota datacenter
BIOS is checking memory for problems…Scanning 1,199,511,627,776 bytes…This may take several minutes…
Running test 1 of 8: 1.0% completeOverall test status: 0.1% completeTime elapsed: 17m23s
Status:No problems have been found yet.
so let’s have a look atcontainers
first,process containers
awesome for HPCfunctions
LXD
second,machine containers
➢ Ultra fast “vm-lite” guests (bare metal speed)➢ Any distribution of Linux - e.g. Ubuntu, CentOS➢ Starts in less than 1 second➢ 15x density of KVM or ESX for idle workloads
host A
nova-lxd lxc cli
lxdkernel
other restful apps
lxc machine
LXD REST API
host B
lxc machine
lxdkernel
host C host D host ...
lxc machine
lxc machine
lxc machine
lxdkernel lxdkernel lxdkernel
➢ Ultra fast “vm-lite” guests (bare metal speed)➢ Any distribution of Linux - e.g. Ubuntu, CentOS➢ Starts in less than 1 second➢ 15x density of KVM or ESX for idle workloads
host A
nova-lxd lxc cli
lxdkernel
other restful apps
LXD REST API
host B
lxdkernel
host C host D host ...
lxdkernel lxdkernel lxdkernel
lxc machine
lxc machine
lxc machine
lxc machine
lxc machine
CPU CoresCPU Cycles
MemoryDisk Space
Disk IONetwork IO
One LXD container,with 100% of the system:
“alloy” mode
exclusive accessto system resources
but secured from theunderlying hardware and OS
cgroups, user namespaces,apparmor, seccomp
instantstartup
looks like a machine,Linux on Linux
zerolatency
zerooverhead
identicalperformance
snapshotrestore
livemigration
demo
ubuntu.com/lxdgithub.com/lxc
linuxcontainers.org