![Page 1: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/1.jpg)
Observe, Enhance, Control: From VMs to Containers
![Page 2: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/2.jpg)
Mitchell Hashimoto @mitchellh
![Page 3: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/3.jpg)
![Page 4: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/4.jpg)
![Page 5: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/5.jpg)
HashiConf 2016June 13-15 Amsterdam
One day of training followed by two days of talks in Amsterdam on all things HashiCorp
HASHICONF.EU >
by HashiCorp
![Page 6: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/6.jpg)
Observe, Enhance, Control: From VMs to Containers
![Page 7: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/7.jpg)
Welcome to the Age of Containers!
![Page 8: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/8.jpg)
or… Age of Reinvention?
![Page 9: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/9.jpg)
Monitoring
Configuration
Deployment
Nagios
Sensu
Chef
Puppet
Fabric
Chef, Puppet
![Page 10: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/10.jpg)
Monitoring
Configuration
Deployment
Nagios
Sensu
Chef
Puppet
Fabric
Chef, Puppet
![Page 11: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/11.jpg)
Monitoring
Configuration
Deployment
Nagios
Sensu
Chef
Puppet
Fabric
Chef, Puppet
Still Widely Used!
![Page 12: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/12.jpg)
What is going on?
• Not a singular event
• Happening across a lot of categories
• The work of many well-accepted “smart” people
• Gathering real adoption! (Or, real abandonment)
![Page 13: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/13.jpg)
App Lifecycle
Dev
Deploy
TestMonitor
![Page 14: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/14.jpg)
App Lifecycle
Dev
Deploy
TestMonitor
EnhanceObserve
Control
![Page 15: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/15.jpg)
Observe, Enhance, Control
![Page 16: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/16.jpg)
Observe
Enhance
Control
Monitoring
Logging
Debug
Improve
Deploy
Scale
Telemetry
Package
Configure
Migrate
![Page 17: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/17.jpg)
Age of the Virtual Machine (Circa 2006)
![Page 18: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/18.jpg)
Circa 2006
Datacenter
• No APIs• No elasticity• Monolithic applications• Young IaaS
![Page 19: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/19.jpg)
Circa 2006
Datacenter Problems
• No APIs• No elasticity• Monolithic applications• Young IaaS
• Uniformity of servers• Scalable change
management• Auditing server state• Early service discovery
![Page 20: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/20.jpg)
Circa 2006
Datacenter Problems Software
• No APIs• No elasticity• Monolithic applications• Young IaaS
• Uniformity of servers• Scalable change
management• Auditing server state• Early service discovery
• Manual node (de)registration
• Single master servers• Check/correct
divergence• Agent model• (Relevant: lots of Ruby)
![Page 21: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/21.jpg)
Circa 2006
• Datacenters introduce constraints
• Applications fill constraints and cause problems
• Software written to help solve those problems in an architectural way that is comfortable for the time
![Page 22: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/22.jpg)
Datacenter + Problems → Software
![Page 23: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/23.jpg)
Monitoring
Configuration
Deployment
Nagios
Sensu
Chef
Puppet
Fabric
Chef, Puppet
![Page 24: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/24.jpg)
Monitoring
Configuration
Deployment
Nagios
Sensu
Chef
Puppet
Fabric
Chef, Puppet
![Page 25: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/25.jpg)
Monitoring
Configuration
Deployment
Nagios
Sensu
Chef
Puppet
Fabric
Chef, Puppet
Circa… ?
![Page 26: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/26.jpg)
Monitoring
Configuration
Deployment
Nagios
Sensu
Chef
Puppet
Fabric
Chef, Puppet
Circa… ~2006
![Page 27: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/27.jpg)
Applying the Model
• What happens if we apply the same model to today?
• Will it fit?
• What would it tell us?
![Page 28: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/28.jpg)
Age of the Container (Present Day, 2016)
![Page 29: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/29.jpg)
Today: 2016
Datacenter
• API-driven• Highly elastic• Small, bin-packed
servers• Containers on VMs• Fast
![Page 30: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/30.jpg)
Today: 2016
Datacenter Problems
• API-driven• Highly elastic• Small, bin-packed
servers• Containers on VMs• Fast
• Infrastructure management
• Service discovery• Configuration• Scale: speed and size
![Page 31: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/31.jpg)
Today: 2016
Datacenter Problems Software
• API-driven• Highly elastic• Small, bin-packed
servers• Containers on VMs• Fast
• Infrastructure management
• Service discovery• Configuration• Scale: speed and size ?
![Page 32: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/32.jpg)
Today: 2016
Datacenter Problems Software
• API-driven• Highly elastic• Small, bin-packed
servers• Containers on VMs• Fast
• Infrastructure management
• Service discovery• Configuration• Scale: speed and size
• Distributed systems• Failure expectation• API-driven, Infra as
Code• Low resource usage
![Page 33: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/33.jpg)
Today: 2016
• Software designed for a 2006 architecture doesn’t adapt well to the needs of software in 2016
• Rather than wait for existing vendors to catch up, new vendors are showing up and filling in gaps
![Page 34: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/34.jpg)
Monitoring
Configuration
Deployment
Nagios
Sensu
Chef
Puppet
Fabric
Chef, Puppet
What changed?
![Page 35: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/35.jpg)
Monitoring
Configuration
Deployment
Nagios
Sensu
Chef
Puppet
Fabric
Chef, Puppet
Sysdig
Datadog
Consul
etcd
Kubernetes
Nomad
![Page 36: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/36.jpg)
Monitoring
Configuration
Deployment
Nagios
Sensu
Chef
Puppet
Fabric
Chef, Puppet
Sysdig
Datadog
Consul
etcd
Kubernetes
Nomad
Wow
![Page 37: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/37.jpg)
2006 vs 2016
• My disclaimer: the examples used from 2006 are still highly deployed, highly successful, and highly relevant.
• But that shouldn’t stop the community (and hasn’t) from trying new designs and testing if they’re better
• It is going to take years to reach the same level of maturity and production-hardening
![Page 38: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/38.jpg)
From VMs to Containers: Molding Our Thinking
![Page 39: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/39.jpg)
Out vs. Up
Build OutBuild Up
![Page 40: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/40.jpg)
Build Out
• New tools
• Not abstracting anything new
• Solve existing problems
• Lay a new foundation
![Page 41: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/41.jpg)
Build Up
• Assume lower layers are correct (or correct enough)
• Leverage existing solutions
• Create new abstractions
![Page 42: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/42.jpg)
Out and Up
• I argue we had to build out for containers
• The build out will continue
• What will we build up? (Platforms?)
![Page 43: Observe, Enhance, Control: From VMs to Containers › london-2016 › system › files › ...2006 vs 2016 • My disclaimer: the examples used from 2006 are still highly deployed,](https://reader033.vdocuments.net/reader033/viewer/2022060400/5f0e02087e708231d43d299a/html5/thumbnails/43.jpg)
Age of Reinvention
• We aren’t reinventing anything.
• We’re building the same wheels, but instead of for a car they’re for a fighter jet.