basics of kubernetes on bosh: run production-grade ... · what is kubernetes (k8s) • kubernetes,...

Colin Humphreys, CTO, Cloud, PivotalNathan Ness, Technical Product Manager, CNABU

CNA3429BU

#VMworld #CNA3429BU

Basics of Kubernetes on BOSH: Run Production-grade Kubernetes on the SDDC

VMworld 2017 Content: Not fo

r publication or distri

bution

• This presentation may contain product features that are currently under development.

• This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.

• Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.

• Technical feasibility and market demand will affect final delivery.

• Pricing and packaging for any new technologies or features discussed or presented have not been determined.

Disclaimer

CONFIDENTIAL 2



bution

Agenda

Introductions

What and Why of SDDC

What and Why Bosh

What and Why Kubernetes

What and Why Kubo

What and Why of PKS

What and Why of Google



bution

Introductions



bution

What and Why of SDDC



bution

What is the SDDC

6

Abstraction of Hardware



bution

7

Compute VirtualizationSDDC



bution

OpsTeams

Network StorageCompute

WW

A A

R

Web

2 VMs, 2CPU, 2GB mem, 10GB disk, RHEL

LoadBalancer

Open 80,443

App

2 VMs 4CPU, 4GB mem, 30GB disk

Open 22 internal only, 8443 from Web

Request Infrastructure

web_instance: webxyz

flavor: m1.small

image: RHEL-x86_64-chef

network: web-net

security: web-sec

quantity: 2

-------<snip>----------

Web-net: web-net

Subnet: 10.10.0.0

Mask: 255.255.255.0

Web-sec: name: web-sec

in: allow: tcp: 22

out: allow: tcp: 80, 443

Describe Infrastructure

Days & Variability Fast &

Predictable

flavor: m1.small

Cpu: 2

Mem: 2

Disk: 10

Cloud APIs

Infrastructure

“Consumer”

Wait

https://youtu.be/Nk8JCAgmDmg

Long LivedShort Lived

IaaS



bution

What and Why of Bosh



bution



bution

VS



bution



bution

Release

Software



bution

BOSH

Director

VM

Release

Software



bution

BOSH

Director

VM

Release

Software

Stemcell

OS



bution

BOSH

Director

VM

Manifest

Definition

Release

Software

Stemcell

OS



bution

BOSH

Director

VM

Manifest

Definition

Release

Software

Stemcell

OS

Cloud

IaaS



bution



bution

Day Two



bution

Day TwoOps problem now



bution


• Declarative and self-healing



bution


• Declarative and self-healing• Updates - canaries + MIF



bution


• Declarative and self-healing• Updates - canaries + MIF• Scaling - director holds all



bution

What and Why Kubernetes



bution



bution

I have 1000’s of containers!!



bution

What is Kubernetes (K8s)

• Kubernetes, is an open-source platform for managing, automating deployment, scaling, and operating containerized applications across a cluster of worker nodes.

39

Capabilities:

• Deploy your applications quickly and

predictably

• Scale your applications on the fly

• Seamlessly roll out new features

• Optimize use of your hardware by using only

the resources you need

Role:

• K8s sits in the Container as a Service (CaaS)

or Container orchestration layer



bution

Deployment_X.yaml

ContainerImage1

Replicas: 3

ContainerImage2

Replicas: 2

10,000 Foot View

• Container Cluster = “Desired State Management”

– Kubernetes Cluster Services (w/API)

• Worker = (Container Host) have agent called “Kubelet”

• Deployment = Configuration File of desired state

• Container Image = Runs in a Pod

• Replicas = QTY of Pods that must be running

40

Worker

(Container Host)

P1R1

Worker

(Container Host)

P1R2 P2R1 P1R1

P2R1

Worker

(Container Host)

P1R3 P2R2 P2R2

Kubernetes

Cluster

ServicesAPI

K

K

KDeployment_Y.yaml

ContainerImage1

Replicas: 1

ContainerImage2

Replicas: 2

P1R1

P1R2

P2R1



bution

What and Why of Kubo



bution



bution

What problem does Kubo solve?

Uniform way to instantiate, deploy, and manage highly available Kubernetes clusters. On any cloud.



bution

What and Why of PKS



bution

BOSH

Director

VM

Manifest

Definition

Release

Software

Stemcell

OS

Cloud

IaaS



bution

Manifests



bution

Manifests“Normal” CF is ~6000 lines of

YAMLVMworld 2017 Content: N

ot for publicatio

n or distribution

Manifests“Normal” CF is ~6000 lines of

YAML

---

instance_groups:

- azs:

- z1

instances: 3

jobs:

- name: etcd

properties:

etcd:

peer_require_ssl: false



bution

Tenancy



bution



bution

TenancyEverybody wants their own

KubernetesVMworld 2017 Content: N

ot for publicatio

n or distribution


Kubernetes

• Privileged containers



bution


Kubernetes

• Privileged containers• Security



bution


Kubernetes

• Privileged containers• Security• Network performance isolation



bution


Kubernetes

• Privileged containers• Security• Network performance isolation• Storage performance isolation



bution


Kubernetes

• Privileged containers• Security• Network performance isolation• Storage performance isolation• API Versioning



bution

BOSH-managed Kubernetes environmentsprovisioned through a service broker.

BOSH

ServiceBroker

VSphere

So, what is PKS?

pks cli



bution

K8s cluster


BOSH

ServiceBroker

VSphere

So, what is PKS?

pks cli



bution

K8s cluster


BOSH

ServiceBroker

VSphere

kubectl

So, what is PKS?

pks cli



bution

K8s clusterK8s clusterK8s cluster


BOSH

ServiceBroker

VSphere

kubectl

So, what is PKS?

pks cli



bution

K8s clusterK8s clusterK8s clusterK8s cluster


BOSH

ServiceBroker

VSphere

K8s clusterK8s clusterkubectl

So, what is PKS?

pks cli



bution

Sample v1.0 PKS CLI Experience

Deploy a K8s cluster instance$pks create-service kubo-odb small myk8s

Get access credentials to Kubernetes API$pks create-service-key myk8s myk8s-key

Use existing Kubernetes toolchain$kubectl get pods --namespace=kube-system



bution

What and Why of Google



bution

Apps are cross-compatible between PKS and Google Container Engine (GKE)

Google Container

Engine (GKE)Pivotal Container

Service (PKS)

Private and

Public Cloud

Public Cloud

(on GCP)



bution

“But I’m Not Google!”How any enterprise can use hyper-scale Google cloud services

[PBO3475BU]

Wednesday, Aug 30, 11:00 a.m. - 12:00 p.m. | Mandalay Bay Ballroom L, Level 2

Google Container

Engine (GKE)Pivotal Container

Service (PKS)

Private and

Public Cloud

Public Cloud

(on GCP)



bution

The Future of PKS



bution

FutureColin’s crystal ball



bution


• Automated cred rotation



bution


• Automated cred rotation• Integrations everywhere!



bution


• Automated cred rotation• Integrations everywhere!• Workflow automation



bution


• Automated cred rotation• Integrations everywhere!• Workflow automation• Closer ERT integration



bution


• Automated cred rotation• Integrations everywhere!• Workflow automation• Closer ERT integration• The best way to deploy K8s



bution

Q&A

82



bution



bution

basics of kubernetes on bosh: run production-grade ... · what is kubernetes (k8s) • kubernetes,...

Documents