what's beyond virtualization? - qcon london 2014
DESCRIPTION
What lies beyond virtualization? How do we start the journey to a secure, trusted hybrid platform that truly delivers the business value and velocity we all want? In the era of software-defined everything, one goal is to reach a fluid infrastructure that has the level of plasticity needed to self heal itself and provide higher level SLAs for applications and services. Adding value to existing applications and services in a transparent fashion requires a rethinking of core technologies in the platform space. In this talk we will take a look at some low level technologies and approaches to achieving this goal. Topics will range from Intelligent layer 7 SDN with semantic awareness, distributed scheduling algorithms, policy distribution and invalidation, health monitoring and management, self healing techniques, and the role of unsupervised deep machine learning and anomaly detection.TRANSCRIPT
![Page 1: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/1.jpg)
What’s Beyond Virtualization?Derek Collison - @derekcollison
Apcera Inc. QCon London - March 7, 2014
![Page 2: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/2.jpg)
What does the future of Enterprise IT look like?
![Page 3: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/3.jpg)
What does it look like today?
![Page 4: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/4.jpg)
It Depends!
![Page 5: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/5.jpg)
Could be very old school - Just physical machines!
Could be virtualized: CPU/MEM, Storage and Network
Could be IaaS or IaaS++
Could be IaaS + PaaS
Could be off-premise and in the Cloud
![Page 6: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/6.jpg)
Why do we care?
![Page 7: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/7.jpg)
What do these things really buy us?
![Page 8: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/8.jpg)
They remove undifferentiated heavy lifting!
![Page 9: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/9.jpg)
They speed up the slow and mundane
![Page 10: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/10.jpg)
Transparent value-add!
![Page 11: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/11.jpg)
What about PaaS?
![Page 12: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/12.jpg)
What about PaaS?Tries to speed up deployment
Very opinionated, still is..
Is only a piece of the larger puzzle
Carrying costs in the delivery pipeline
Pipeline is a biz requirement thru value delivered
BUT PaaS as a standalone technology is not enough..
![Page 13: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/13.jpg)
So..
![Page 14: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/14.jpg)
What do we want?
![Page 15: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/15.jpg)
What do we want..
Self Service
Faster iterative development and deployments
Fault Tolerance, High Availability
Higher and guaranteed SLAs
Composeable Systems - legos
![Page 16: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/16.jpg)
Software Defined Everything!
![Page 17: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/17.jpg)
But..
![Page 18: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/18.jpg)
What do we really want?
![Page 19: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/19.jpg)
What do we really want?
Meta-data driven description of my system
Extreme Agility
Transparent Compliance
Fluid and Abstracted Infrastructure and Services
Multiple delivery models in a single system
![Page 20: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/20.jpg)
What do we want really?
Meta-data driven description of my system
Extreme Agility
Transparent Compliance
Fluid and Abstracted Infrastructure and Services
Multiple delivery models in a single system
![Page 21: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/21.jpg)
Meta-Data DrivenMy app A needs to talk to B and C
I need 4 instances of A, 2 of B and 3 of C
It needs X memory and Y CPU
It needs NNN storage
It requires I/O SLAs for talking to B and C
It needs to be available via a URL for trusted identities
It needs to run on-premise and co-located near B
![Page 22: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/22.jpg)
Is this Autonomic Computing?
![Page 23: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/23.jpg)
How would we do this?
![Page 24: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/24.jpg)
How would we even start?
![Page 25: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/25.jpg)
Getting Started - App A
What does App A need?
Where will App A be run?
How will App A find B and C?
How do others find my App A?
What happens on a failures?
![Page 26: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/26.jpg)
Getting Started - App A
What does App A need? - Packaging and Dependencies
Where will App A be run? - Provision and Schedule
How will App A find B and C? - Addressing/Discovery
How do others find my App A? - External Mapping
What happens on a failures? - Health Monitoring
![Page 27: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/27.jpg)
Packaging and DependencyWhat does the job need to run?
What runtimes, OS, libraries?
What tools can I use for consistency, compliance, audit?
SCCS and Chef / Puppet
AMIs or VMDKs
Docker Images
![Page 28: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/28.jpg)
Packaging and Dependency Challenges
Do these change when I change from Dev to Production?
What runtimes, OS, libraries then?
Who defines what these are?
Are the existing tools and best practices still sufficient?
![Page 29: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/29.jpg)
Provision and ScheduleHow fast can I provision?
Can my workload run anywhere and be compliant?
How do network perimeter security models effect placement?
What is my unit or work? VM, App, Image?
Can the system automatically handle compliance and policy?
Can compliance and deployment be handled independently?
What new tools exist? Mesos, Fleet?
![Page 30: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/30.jpg)
Addressing and DiscoveryIs DNS sufficient?
Do we need to change our applications?
When things get moved, how does the system react?
Is load balancing handled or is this a manual process?
What happens when we scale up or down?
How do others find us?
![Page 31: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/31.jpg)
Monitoring and ManagementWhat happens when something fails?
Is this a manual process?
Who determines failure? Can we trust the system?
What if they are sick, not dead? Latency vs Chaos
Do we know if the change even helped?
Pluggable Health
![Page 32: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/32.jpg)
SO.. How do we get here?
![Page 33: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/33.jpg)
Is it a Bolt-On Solution?
![Page 34: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/34.jpg)
Or is it Bolt-In?
![Page 35: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/35.jpg)
Bolt-On got us into this mess in the first place!
![Page 36: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/36.jpg)
What we need is a Platform OS!
![Page 37: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/37.jpg)
Programmable, pluggable and composeable..
![Page 38: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/38.jpg)
From the inside out..
![Page 39: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/39.jpg)
The OS for the datacenter
![Page 40: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/40.jpg)
The OS for the datacenter Multiple Datacenters
![Page 41: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/41.jpg)
Secure, Trusted, and Hybrid
![Page 42: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/42.jpg)
Multi-Datacenter OSTreat all resources as a common pool
Handle all networking access, addressing and discovery in realtime, and at scale
Be aware of ontologies and their communication semantics
Be security and policy aware
Be purposely built to accept and promote rapid change
Provide policy compliant resource isolation, connectivity and SLAs
![Page 43: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/43.jpg)
Multi-Datacenter OS
Virtualization
SDN - Software-Defined Networking
Management and Resource Pooling
Intelligent and Compliant Job Scheduling
Intelligent canarying, A/B rollouts
![Page 44: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/44.jpg)
Multi-Datacenter OS
Virtualization
SDN - Software-Defined Networking
Management and Resource Pooling
Intelligent and Compliant Job Scheduling
Intelligent canarying, A/B rollouts
![Page 45: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/45.jpg)
Virtualization?
What about speed and weight?
Google chargeback diversion
What about containers, e.g. Docker?
Is there a container equivalent for .NET?
Micro-task Virtualization?
![Page 46: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/46.jpg)
Multi-Datacenter OS
Virtualization
SDN - Software-Defined Networking
Management and Resource Pooling
Intelligent and Compliant Job Scheduling
Intelligent canarying, A/B rollouts
![Page 47: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/47.jpg)
SDN?Solve network perimeter security?
Does it involve application level changes?
What about layer 7 semantics?
How many INSERTS per second from all of App A?
Can I disallow DROP and DELETE calls between 1a-3a?
Can the network be made compliant and transparent?
It just works, e.g. mobile
![Page 48: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/48.jpg)
Multi-Datacenter OS
Virtualization
SDN - Software-Defined Networking
Management and Resource Pooling
Intelligent and Compliant Job Scheduling
Intelligent canarying, A/B rollouts
![Page 49: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/49.jpg)
intelligent and Compliant Job Scheduling
Pick the best place to run for a given job and policy
How does a system rebalance, utilize new resources?
Centralized or Distributed Algorithms?
How does policy effect decision making? E.g Geo
![Page 50: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/50.jpg)
Multi-Datacenter OS
Virtualization
SDN - Software-Defined Networking
Management and Resource Pooling
Intelligent and Compliant Job Scheduling
Intelligent canarying, A/B rollouts
![Page 51: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/51.jpg)
Intelligent Canarying
Want to roll out a new version of App A
Do we know what App A - v2 success looks like?
How do we do roll in and roll back (if needed)?
How do we avoid our fingers on the keyboard?
What is needed for this process to be automated?
![Page 52: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/52.jpg)
Intelligent CanaryingWhat data is needed to say if it is ok?
resource utilizations - CPU, Mem, Storage
communication patterns - cascading effects
temporal awareness
All data feeds into anomaly detection services
Utilizes unsupervised deep machine learning
![Page 53: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/53.jpg)
Summary
![Page 54: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/54.jpg)
SummaryIntelligent, holistic platform technologies - Pluggable and Composeable
Transparent value add to jobs/workloads - No code changes!
Packaging and Dependency Management - Policy aware
Job Scheduling and Provisioning - Also policy aware
Addressing, Discovery, Networking - Policy again, theme developing
Monitoring and Management
Lifecycle Management and Intelligent Canarying
![Page 55: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/55.jpg)
Some Resources
Docker - https://www.docker.io/
Mesos - http://mesos.apache.org/
CoreOS - https://coreos.com/
Fleet, Etcd - https://coreos.com/using-coreos/etcd/
Continuum - http://apcera.com/continuum/
![Page 56: What's Beyond Virtualization? - QCon London 2014](https://reader037.vdocuments.net/reader037/viewer/2022102805/54c855164a7959d7758b4646/html5/thumbnails/56.jpg)
Thank You