vmworld 2015: container orchestration with the sddc

Container Orchestration with the SDDCAaron Blasius, VMware, Inc

CNA4590

#CNA4590

CONFIDENTIAL 2

• This presentation may contain product features that are currently under development.

• This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.

• Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.

• Technical feasibility and market demand will affect final delivery.

• Pricing and packaging for any new technologies or features discussed or presented have not been determined.

Disclaimer

CONFIDENTIAL 3

Agenda

1 New Business Imperatives

2 Four Focuses

3 VMware and Cloud Native Applications in the Data Center

4 Introduction to vSphere Integrated Containers

5 Introduction to Photon Platform

6 Wrap it up

7 Completing the Cloud Native Story at VMworld

New Business ImperativesApplications are changing

User Expectations are Changing

CONFIDENTIAL 5

Software is Transforming Businesses

CONFIDENTIAL 6Source: Why Software is Eating the World, WSJ Online

Traditional applications Cloud-native applications

Monolithic / LayeredMicro Services,

Containers

Wal-Mart uses softwareto power its logistics and

distribution …

FedEx is best thought of asa software network that

happens to have trucks and planes

Differentiation through mobile

cloud analytics

Agile Delivery

+Internet Scale

Empowering IT to enable new application development models is fundamental to business success

http://online.wsj.com/articles/SB10001424053111903480904576512250915629460

CONFIDENTIAL 7

Agenda


2 Four Focuses




6 Wrap it up


Four ForcesTrends Shaping the Industry

Confluence of Four Forces

CONFIDENTIAL 9

Agile

CONFIDENTIAL 10

Definition of DevOps

ApplicationCode

RunningApplication

DevOps WorkflowRepeatable, Safe Process to Turn

Application Code into a Running Application

CONFIDENTIAL 11

Hardware

OS Kernel

OS File system

Use

rspa

ce

Container

App

pro

cess

App

pro

cess

App

pro

cess

App

pro

cess

App

pro

cess

Container

App

pro

cess

App

pro

cess

Linux Containers • OS-level Isolation

– Isolation at individual kernel subsystem level (e.g. filesystem, process table, etc)

– User-level process (LXC, libcontainer) orchestrates these subsystems to create a container

• Existed for Many Years– Solaris Zones, FreeBSD Jails, OpenVZ

• Why?– Process isolation– Reproducible environment– Enables management at scale

11

IT Drives These Changes

Compared to peers across the industry, high-performing IT organizations experience:

12Source: https://puppetlabs.com/2015-devops-report

60xfewer failures

168xfaster failurerecovery time

30xmore frequentdeployments

200xshorter

lead times

https://puppetlabs.com/2015-devops-report

https://puppetlabs.com/2015-devops-report

13

Application Design is Changing

Properties of a Microservice• Small code base

• Easy to scale, deploy and throw away

• Autonomous

• Resilient

Benefits of a Microservices Architecture• A highly resilient, scalable and resource efficient

application

• Enables smaller development teams

• Teams free to use the right languages and tools for the job

• Rapid application development

Monolithic/Layered Micro Services

CONFIDENTIAL 14

is a “Shipping Container” for CodeDevelopers because …

• Frictionless deployment and maximum portability

On developer laptop:

Then on server:

That’s it!!

A natural fit for 3rd Platform, 12 factor, microservices (psst. all the stuff we just talked about)

• It makes DevOps much much easier

~# docker build my_app~# docker push my_app~#

~# docker pull my_app~# docker run my_app~#

CONFIDENTIAL 15

Agenda


2 Four Focuses



5 Introduction to Photon Containers

6 Wrap it up


VMware and Cloud Native Applications in the Data Center

CONFIDENTIAL 17

Our Mission

Make the Developer a First-Class User of the Data Center • Turn the datacenter into an API

• Elevate infrastructure abstractions to expose developer-centric concepts

• Build to and support open systems and standards

CONFIDENTIAL 18

Our Mission




CONFIDENTIAL 19

Turning Infrastructure into an API

Developer Laptop Production Stack

vSphereprivate cloud

OpenStackAPI

ContainerAPI

ContainerAPI

vCloud Air

CloudAPI

CONFIDENTIAL 20




OpenStackAPI

ContainerAPI

ContainerAPI

vCloud Air

CloudAPI

VMware Integrated OpenStack

CONFIDENTIAL 21

OpenStack APIs + tools tightly integrated with VMware’s SDDC offering:• Utilizes best-of-breed compute,

network, storage from VMware + partners.

• Allows customers to leverage existing expertise and investments.

• Fills key cloud management gaps.

Most powerful OpenStack cloud available, with fastest time-to-value, lowest TCO.

Open IaaS APIs + Ecosystem

vSphereDriver

NSXDriver

vSphereDriver

vSphere Compute NSX vSphere

StorageVMware SDDC

vCOPs, Log Insight, vRB

VMware Optimized OpenStack

Install + mgmt

VMware Integrated OpenStack (VIO)

…industry leading data center technologies that enterprise IT already knows how to operate

An open and vendor-neutral API ecosystem that gives

developers the right tools …

CONFIDENTIAL 22

Agenda


2 Four Focuses



5 Introduction to Photon Containers

6 Wrap it up


vSphere Integrated ContainersSolution Introduction

CONFIDENTIAL 24




OpenStackAPI

ContainerAPI

ContainerAPI

vCloud Air

CloudAPI

Uniting Technologies – Introducing vSphere Integrated Containers

CONFIDENTIAL 25

Unified Hybrid Platform• Extending support within an existing

vSphere environment

• Industry-leading capabilities• DRS, vMotion, HA/DR• Storage and Network Integration

(VSAN and NSX)• Full compatibility with existing tools

• Broadest ecosystem• Cloud-Native developer tools, application

services, and hardware platforms

Leverage your existing investments and enable on-ramp to cloud-native

NSX

vSAN

vRealize

…

vSphere

vSphere Integrated Containers(Instant Clone, Project Bonneville,

Photon OS)

CONFIDENTIAL 26

vSphere Integrated Containers Architecture• Containers are first-class citizens on the hypervisor

• No need for a separately managed Linux container host, ESX is the container host

• Virtualization brings many benefits: Security, Isolation and multiple-OS support

Docker HubVanilla Docker Client

Modified Docker

Daemon

ESXi HOST

DockerImages

Container

Container

Legacy VM

Docker REST API

Control PullImage

Mount Image

Container

27

25MB

Disk footprint:

<1second

0MB

Initial memory footprint:

New powered-on VM in:

Efficiency

Photon OS Instant Clone

µVM

CONFIDENTIAL

CONFIDENTIAL

What is Instant Clone?• Fast instantiation of “ready” VMs with minimal

resource overheads– Ready to use immediately (i.e. post boot) – Resources include CPU, Memory, and Disk– Minimal/no changes to the guest OS and applications– Unique and independent instances (e.g. IP, MAC, Hostname)

on the network once customized– Scale-out application ready

• Optimize critical path of VM Instantiation– Keep only essential operations in the critical path

• Pre-register VMs• Break large pages etc.

28

VM

VM VM …

Secure Container Runtime

Container Optimized Linux OSDocker, rkt and Garden (Pivotal) support

Minimal footprint to run containers

vSphere IntegrationPart of your vSphere install

Hypervisor-optimized container runtime

Updates from VMwareEnterprise support

Security and update patches from VMware

Open Source

CONFIDENTIAL 30

Agenda


2 Four Focuses




6 Wrap it up


VMware Photon PlatformSolution Introduction

CONFIDENTIAL 32

Our Mission




CONFIDENTIAL 33

Turning Infrastructure into an API – Improving the Infra



OpenStackAPI

ContainerAPI

ContainerAPI

vCloud Air

CloudAPI

CONFIDENTIAL 34

Photon PlatformCLOUD-NATIVE PLATFORMUNIFIED PLATFORM

vSphere + vSphere Integrated Containers

Purpose-built for Containers

“Just What You Need” Feature Set

High Scale and Churn

API-Driven

Any App (including Containers!)

Broad Feature Set

Highly Compatible

IT-Driven

CONFIDENTIAL 35

Compute Infrastructure Choice

ESXi

VMware Integrated OpenStack

Photon OS

vSphere Integrated Containers

vCenter

Photon Machine

Photon OS

Photon Controller(includes container API)

Compute Host

Container Host

Container API

Infra Orchestrator

Infrastructure API(optional)

Compute infra that “just works”• Supports running any app• Built for compatibility• Broad feature set

Compute infra for “containers at scale”• Optimized for cloud-native apps• Built for efficiency• Just what you need

Repository + Lightw

ave

Security throughout via Lightwave

I need Jenkins and Mesos clusters for my app

But All We Have to Offer are Virtual Machines

CONFIDENTIAL 36

DevelopersData Center

Here are some VMs

Developers

Developers Have to Set Up New Infrastructure on Top of VMs

CONFIDENTIAL 37

Service Service Service

Operations

This Leads to Inefficiency

CONFIDENTIAL 38

Time wasted turning VM’s into

cluster frameworks

Every deployment is different. Difficult to enforce standards

Every app builds its own custom

management system

Need for a New Unit of Management

• Multi-container clusters, on-demand to your developers

• Open support for common cluster frameworks

• Isolate and protect your workloads

• High availability

• Resource management

CONFIDENTIAL 39

Cluster

VolumesNetwork

Scheduler

Container

Users

Developers

ContainerContainerContainerContainerContainerContainerContainer

CONFIDENTIAL

Photon Platform Architecture

41

Photon Machine 100

Photon Controller 1

Photon API

Combination of local and / or shared ESX

datastores

Photon Controller 2

Photon Controller 100

1. Create cluster(s) of choice

Consumption API

2. Run cluster(s)

Photon OS + Microvisor

Containers – Support for 100K

Containers or MorePhoton Machine 1

Photon OS + Microvisor

Photon Machine 2Photon OS + Microvisor

CONFIDENTIAL 42




OpenStackAPI

ContainerAPI

ContainerAPI

vCloud Air

CloudAPI

CONFIDENTIAL

AppCatalyst Architecture

43

Developer Desktop

VMware AppCatalyst

CLI

RE

ST

AP

I

Network and Storage Abstractions (coming soon)

Docker Machine

Container Container Container

Container Container Container

BYOL(Bring your own Linux)

Vagrant

CONFIDENTIAL 44

Agenda


2 Four Focuses




6 Wrap it up


Extension to vSphereSupports running any app

Built for compatibilityBroad feature set

Announcements

CONFIDENTIAL 45

vSphere Integrated Containers

Unified Hybrid Platform

New platformOptimized for cloud-native

Large-scale API automation“Just what you need” feature set

VMware Photon Platform

Cloud-Native Platform

vSphere Integrated Containers will Help You on Your Journey

CONFIDENTIAL 46

Unified Hybrid Platform• Extending support within an existing

vSphere environment

• Industry-leading capabilities• DRS, vMotion, HA/DR• Storage and Network Integration

(VSAN and NSX)• Full compatibility with existing tools

• Broadest ecosystem• Cloud-Native developer tools, application

services, and hardware platforms

Leverage your existing investments and enable on-ramp to cloud-native

NSX

vSAN

vRealize

…

vSphere

vSphere Integrated Containers(Instant Clone, Project Bonneville,

Photon OS)

CONFIDENTIAL 47

Agenda


2 Four Focuses


4 vSphere Integrated Containers

5 Demo – vSphere Integrated Containers

6 Wrap it up


CONFIDENTIAL 48

@cloudnativeapps#vmwcna

vmware.github.io

Thank You!• Visit the Hands on Lab to walk through vSphere Integrated Containers

• Walk through demos on the show floor

• Download AppCatalyst – www.getappcatalyst.com

[email protected]

blogs.vmware.com/cloudnative

http://www.getappcatalyst.com/

@cloudnativeapps#vmwcna

vmware.github.io

Thank You!

[email protected]

blogs.vmware.com/cloudnative

• Visit the Hands on Lab to walk through vSphere Integrated Containers

• Walk through demos on the show floor

• Download AppCatalyst - www.getappcatalyst.com

http://www.getappcatalyst.com/

CONFIDENTIAL 50

More on Cloud-Native Apps @ VMware

Container Orchestration with the SDDCAaron Blasius, VMware, Inc

CNA4590

#CNA4590

vmworld 2015: container orchestration with the sddc

Technology