part 2: architecture and the operator experience (pivotal cloud platform roadshow)

© Copyright 2014 Pivotal. All rights reserved.

Pivotal Cloud Platform Deep DivePart 2: Architecture and The Operator Experience

Pivotal CF Team

2

© Copyright 2014 Pivotal. All rights reserved. 3

Loggregator

DEA Pool

Router Cloud Controller

BOSH Director BOSH Agent

UAA/Login Servers Health Manager

Service Broker Node(s)

Messaging (NATS)

IaaS

Cloud Foundry Architecture Stack


Rou

ter

Cloud Controller Service Broker Node(s)

DEA DEA

DEA DEA

Blobstore DB

Runtime

1. Upload bits/metadata

2. Create/bind services

3. Stage app

4. Deploy app

push app+ app MD

SC

+ =

Pushing an application


Rou

ter

Cloud Controller

DEA

Blobstore DB

Runtime

Detect Compile UploadNo

System Buildpacks

+ =

Yes

Application Staging

Runtime


Blobstore

R

oute

r Cloud Controller

DEA

Messaging (NATS)

DEA DEA

Runtime

Access App

Application containers and scaling


DB

Rou

ter

Service credentials

reserve resources

obtain connection data

CLI Cloud Controller

Service Broker

Data Service

Runtime

create service (HTTP)

bind service (HTTP)

create service (HTTP)

bind service (HTTP)

Service create and bind

© Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved.

What’s on Pivotal CF for an operator?

8


Pivotal CF operations

Developer Operator


Install runtime and container

Deploy to dev



Install services (db, messaging, hadoop, …)

Deploy to dev




Setup load-balancing, SSL termination and dynamic routing

Deploy to dev




Setup / config High Availability

Deploy to dev






Setup APM

Deploy to dev






Setup APM

Setup log streaming

Deploy to dev






Setup APM

Setup log streaming

Deploy to dev

App Deployed





Setup load-balancing and dynamic routing


Setup APM

Setup log streaming

Deploy to dev

Deploy to Test

Deploy to QA

Promote to production

Scale up

Update app

Scale down

Redeploy

Unbind service

Bind service

Restart server

Change route

Scale Platform

Create service

Delete App

Blue-green deployment

Check logsEscale memory

Update app server

Change JDK

Upgrade app


Deploy to dev

The Pivotal CF way


Deploy to dev

> cf pushCloud

ControllerHealth

Manager

NATS (message bus)

RouterApp Deployed

The Pivotal CF way


The operator in the PaaS era

Developer Operator


The operator in the PaaS era


Operator Concerns

Monitor the platform

Handle upgrades and updates

Plan capacity

Manage users and quotas

Install the platform

Setup High Availability


IaaS

Pivotal CF



Handle live upgrades and updates

Scale and plan capacity

Install and manage servicesTarget multiple

clouds


IaaS


Mobile Services for Pivotal CF

ElasticSearch for Pivotal CF

CloudBees Jenkins Enterprise

Cassandra for Pivotal CF


IaaS


Mobile Services for Pivotal CF

ElasticSearch for Pivotal CF

CloudBees Jenkins Enterprise

Cassandra for Pivotal CF

Click to install

No downtime updates

Explore install logs

Click to scale the platform

Built-in High Availability

Built-in Platform Monitoring

Integrated services


Demo


BOSH


Provision services, not machines

Enables continuous delivery

Cloud-agnostic view of Platform Ops

Holistic Toolchain for “rule them all"

Eliminate bespoke automation on top of config management

Why BOSH


Ops Manager + BOSH

Blobstore

BOSH

Health Monitor

DBDeploy my Services

Worker VMs

Messaging

Health Manager

Cloud Controller

Target VM

BOSH Director

NATS

IaaS


Operator Concerns



Plan capacity





Orgs, Spaces, Users and Quotas


Organizations

Logical division within a Pivotal CF install / Foundation.

Each organization has its own users and assigned quota

User permissions / roles are specified per space within an organization

Sub-divided into Spaces


Quotas and Plans

Different quota limits (e.g. “small”, “enterprise”, “default”, “runaway”) can be assigned per Organization

Quota defines !• Total Memory • Total # of Services • Total # of Routes


Spaces

Logical sub-division within an organization

Services and Applications are created / specified per Space

Users authorized at an organization level can have different roles per space

Same Service can have different meanings per space


Operator Concerns



Plan capacity





Platform Monitoring

How do I know when to scale DEAs?

How many requests each Router is servicing?

What is the current load of my Cloud Controllers?


Platform Monitoring

Pivotal Ops Metrics provides a single JMX interface to access metrics for each Pivotal CF component

• DEAs

• Cloud Controllers

• Routers

• Health Managers

• NATS, UAA, Login Server, …


Platform Monitoring

Collector

JMX Provider

JMX Monitoring Tool


Operator Concerns



Plan capacity





4 Layers of built-in High Availability

Application Instance

Platform Processes

Platform VMs

Availability Zones




Platform Processes

Platform VMs

Availability Zones


App Instance HA

Blobstore

Rou

ter

Cloud Controller

DEA

Messaging (NATS)

DEA DEA

Runtime

Health ManagerActual State

Cloud Foundry




Platform Processes

Platform VMs

Availability Zones


47

Platform Processes HA

Blobstore

BOSH

Health Monitor

DB

Messaging

Health Manager

Target Cloud Controller

BOSH Director

NATS

Agent

Agent

Agent

Process

Process

Process

Pivotal CFDEA

Agent Process


Platform Processes HA

Target Cloud Controller

Agent ProcessRestart




Platform Processes

Platform VMs

Availability Zones


50

Platform VMs HA

Blobstore

BOSH

Health Monitor

DB

Messaging

Health Manager BOSH Director

NATS Agent

Agent

Cloud Controller

Agent Process

Process

Process

Pivotal CFCloud Controller

Agent Process

Ressurector

Re-create VM

VM is missing…




Platform Processes

Platform VMs

Availability Zones


Availability Zone #2

52

Availability Zones

DEA

DEA

DEA

Rou

ter Blobstore

Cloud Controller

Health Manager

Messaging (NATS)

Push app

Availability Zone #1

DEA

DEA


Operator Concerns



Plan capacity





Pivotal CF: Enterprise Grade SW Delivery Simple & Comprehensive •  End to end platform to iterate quickly and build

highly scalable cloud apps •  IT Ops automation with no scripts, no templates,

no config headaches •  Easy to use management dashboard

Extensible •  Independent of the IaaS provider, the runtime

languages supported & the brokered services •  Simple APIs ensure easy extension and

customization

Governed & Secure •  Individual and team-based roles and permissions •  Easy integration w/ 3rd party tools and agents

Highly Available •  Built in health monitoring and management of

applications and the platform •  Zero downtime deploys/updates of the platform

and applications

Scalable & Efficient •  Elastic scale of PaaS capacity and applications

through simple interfaces or scripting •  Higher application instance density on the

same IaaS footprint through advanced containerization


The Platform for a New Era of Software Innovation Pivotal CF:

•  Instant Dynamic Routing • Streaming Logging Agg •  ID/team/RBAC/Policy • APM, Auto-scaling • Ready integration • Four layers of built-in Availability

• Auto-detect runtimes, frameworks

•  “Push and it works” model

• CF Push [.WAR] • CF Push [Docker] • CF Push [.ASP]

• Elastic Pivotal HD • HAWQ Analytics • Mobile Push • Mobile Sync • Mobile API

• MySQL HA • Redis • Rabbit MQ • Elastic Search • Cassandra • Jenkins (Partner)

….and more

DEPLOY, OPERATE, UPDATE, SCALE ON ANY INFRASTRUCTURE

INTEGRATED OPERATOR FUNCTIONS READY MIDDLEWARE SERVICES AUTO DEPLOY

AND SCALE

A NEW PLATFORM FOR A NEW ERA

part 2: architecture and the operator experience (pivotal cloud platform roadshow)

Software

pivotal cf way copyright

dev copyright

devapp deployed copyright

paas era copyright

app md1

bosh copyr

devupgrade appdeploy

application containers