development on cloud,paas and sddc

© Copyright 2014 Pivotal. All rights reserved.

The image cannot be displayed. Your computer may not have enough memory to open the image, or the image


Development on Cloud, PaaS and SDDC

Kim Min Seok Sr, Field Engineer Pivotal Korea 2014.12.18


Agenda

Pivotal’s Vision on SDDC

DevOps and PaaS

PaaS characteristics

Conclusion


정책 기반 관리 & 자동화!클라우드 자동화 ! 클라우드 운영! 클라우드 비즈니스!

소프트웨어 정의 데이터센터(Software-Defined Data Center)!

프라이빗 클라우드 !

퍼블릭 클라우드 !

하이브리드 클라우드!

VMware 및vCloud Data Center 파트너"

가상화 인프라 !추상화 & 풀링!

!

컴퓨팅 추상화 = "서버 가상화"

네트워크 추상화 = 가상 네트워킹 "

스토리지 추상화 =" 소프트웨어 정의 스토리지"

애플리케이션!

최종 사용자 컴퓨팅! 데스크톱 ! 모바일!

가상 작업공간!

현대적! SaaS!전통적! Pivotal

PaaS on SDDC

3


New platform for the new era

Linux for the cloud

“We'll see the development and open-source community essentially come up with Linux for the cloud”

http://www.informationweek.com/cloud/infrastructure-as-a-service/pivotal-ceo-maritz-teases-linux-for-the-cloud/d/d-id/1111474?


Pivotal’s Vision

App Fabric!

Language & Framework

Services Analy7cs

Data Fabric!

Ingest & Query: in-‐memory

Scale-‐out storage: HDFS

Cloud Fabric!

Automa7on: App provisioning & life-‐cycle

Service Registry Cloud Abstrac7on

...ETC"SDDC"

Warehouse scale computer"

The New Cloud OS

The New Middleware The New Database

APPS

ANALYTICS DATA

Speed"

New user experiences New business models New business value

5


New OS and Middleware for cloud

• Cloud Orchestration

• Container orchestration

• Cross-cloud Portability

–  Write once, run everywhere

•  Scale-out architecture

–  cluster app development

–  Scaling/healthcheck

• Governance App Development

• Multiple language support

–  Nodejs, PHP, ruby, python, java, go

Pivotal

On-Premise Data Centers

Public Clouds

Software Defined Data Centers

Applications

6


Agenda


DevOps and PaaS PaaS characteristics:

- Orchestration

- Cross-Cloud Portability

- Cluster application

- True Agile Development

Conclusion

© Copyright 2014 Pivotal. All rights reserved. 8

Organizations expect to have to deliver up to 20% more application in 2014.

IT Reality

http://go.xebialabs.com/Automation-Trends-Report-2014.html#.U2DtDPldWf8


**Source: Xebia Labs Survey Report

DevOps"Continuous Delivery" Agile"

Enterprise initiatives in 2014**"

Changing development and release disciplines

CONTINUOUS DELIVERY! AGILE! DEVOPS!

9


DevOps"

http://devops.sys-con.com/node/3118596


Removing Developer and Operator Constrains

BUILD APPLICATION!

PUSH FIRST RELEASE!

MAINTAIN APPLICATION!

UPDATE APPLICATIONS!

RETIRE APPLICATIONS!

•  service deploy •  routing

•  Elastic scale •  Integrated HA •  scaling and APM •  Log aggregation •  Policy and Auth

•  A/B versioning •  Live upgrades

•  service removal

11


Netflix Cloud Evolution with PaaS

12


Cloud Foundry Project

Open Source

Private Clouds

Public Clouds

CUSTOM SERVICES

http://www.cloudfoundry.org


Pivotal CF Architecture

Ops Manager UI

Ops Manager Director

Operations Manager

Service

Service Broker

Service Nodes

Service Broker

Service Nodes

Service

App Log Aggregator

Login Server

Dynamic Router

Cloud Controller

UAA

Health Manager

DEA Pool

Messaging (NATS)

Apps

Metrics Collec7on

Apps

HA Proxy LB

Elastic Runtime

14


Agenda


DevOps and PaaS

PaaS characteristics: - Orchestration - Cross-Cloud Portability



Conclusion


Puppet Automates

tool for automating system administration

doesn’t enforce cloud native architecture

16


Cloud timeline

2004 Puppet

2006 AWS 2009

DevOps

2010 Cloud Foundry

2010 OpenStack

2008 Chef

2010 Continuous

Delivery

2012

Timeline

2007 Heroku

2008 App Engine

2014 Foundation

17


Cloud Orchestration : BOSH

18


Cloud Orchestration : BOSH

19


Agenda


DevOps and PaaS

PaaS characteristics: - Orchestration

- Cross-Cloud Portability - Cluster application


Conclusion


Write Once, Run Everywhere

http://www.devmanuals.com/images/images1/6java-cod.gif

http://i.imgur.com/lU30MCv.jpg 21


Write Once, Run Every CLOUD

http://blog.cloudfoundry.com/wp-content/uploads/2012/01/PreviousVsNextGen.png 22


Cross-cloud portability

Deploy App

Open Cloud Platform!

AWS" SP X"Service Provider

XYZ"

On-Premise Data Centers Public Clouds

OpenStack" VMWare"“Bare

Metal” +"Containers"


Applications

Cloud Provider Interface"Cross-Cloud Portability

•  Single codebase

• No configuration change

• Cloud agnostic

–  Private/public

–  dev/stage/production

23


Agenda


DevOps and PaaS



- Cluster application - True Agile Development

Conclusion


Needs to consider

Traditional Cluster Application

http://mibuso.com/blogs/mandyk/2009/06/11/how-to-configure-ssl-for-biztalk-https-receive-port-adapter/

•  Configuration synchronization •  Health check •  Load balancing •  Scaling •  Monitoring

25


Pivotal CF supports

IaaS

Install the platform

Handle live upgrades and updates

Scale and plan capacity

Install and manage services

Target multiple clouds

Security


Architecture for Cluster application

Cloud Controller Health Manager

Messaging (NATS)


Service

Pivotal HD

Service

Jenkins

Service

MySql

DEA app app

app

DEA app app

app

DEA app app

app app

DEA app

app app

DEA app

app

… …

DEA Pool clusters

Cloud Foundry BOSH

Service clusters

Routers

27


Built-in Fast App Scaling

VM

10 minutes Linux container

0.02 seconds

http://blog.pivotal.io/cloud-foundry-pivotal/case-studies-2/platform-wind-tunnel-part-i-heroku

28


Load Balancing

29

Load Balancer

DEA! DEA! DEA!

Router

Access App"

Pivotal CF Elas7c Run7me (PaaS)

Router Router

DNS!

Load Balancer

myapp.<mycfdomain.com>

Resolve app and system domain names to LB IP


Built-in 4 Level HA

PCF

A" B" C"

B"

3. Resurrector restarts failed VMs

PCF

A" B" C"

Process"

PCF

A" B" C"

VM1 VM2

OS,"Mware"

VM3

OS,"Mware"

OS,"Mware"VM1 VM2

App Fail" Process Fail" VM Fail" Rack Fail"

Zone 1 Zone 2

Zone 3

30


Platform Monitoring"

How do I know when to scale DEAs? How many requests each Router is servicing?

What is the current load of my Cloud Controllers?


Platform Monitoring"

Collector

JMX Provider

JMX Monitoring

Tool


Log Aggregation and Ops Metrics

One source for all platform logs and metrics. Single view console that makes system and application monitoring visible & actionable

�  Aggregated Logging

HTTP Events, Counters, Gauges, Errors

�  Application Metrics

IT Operator health gauges

�  Snap-in best of breed application monitors

AppDynamics, New Relic, Splunk

Image credit: http://imgarcade.com/1/fire-hose-spraying-fire/

33


Agenda


DevOps and PaaS




- True Agile Development Conclusion


10x Increase in Speed"Deploy App

Cloud Controller

Health Manager

NATS (message

bus)

Router

App Deployed

Application Zone


mod proxy

1.  The platform takes care of all the steps on the left automatically

50 Configuration Touches

1.  Register Hostname with DNS (1) 2.  Configure F5 Load Balancing Group (2) 3.  Configure Apache HTTPd Worker Pool (4) 4.  Configure mod_proxy Connector Routing (4) 5.  Configure Tomcat Connector Pool (40)

1 Configuration Touch

1 2 4 4 40 1

Pivotal CF: From 50 touch points to 1

36


app dev in large organizations has a tendency to be all over the place; PaaS enables you to enforce the same app dev policies and procedures across languages and frameworks

Governance App Development Framework

Your application

App Server

Runtime

Operating System

Libraries

Buildpack

IAAS!

App Servers Frameworks

JREs

Java Buildpack http://intelmicrosite.idg.co.uk/cmsdata/features/3401344/Internet_istock_thumb300.jpg

37


Large Buildpack Community

https://github.com/cloudfoundry-community/cf-docs-contrib/wiki/Buildpacks

Built-in Community

6"Third party

Jetty Virgo

Clojure Haskell Mono Jboss

Websphere Erlang nginx

24" 37"C

Lisp Dart Elixir

Emacs Erlang Factor Fakesu

Lua .NET Null Perl R

Sphinx PhantoJS


Spring Project support

39


Cloud Foundry Plugin

Cloud Contro

ller

Health Manage

r

NATS (message

bus)

Router

Pivotal CF

Developer support

40


Operators manage and offer a variety of growing native and external enterprise-grade services to developers. Future proof and extend your environment.

Pivotal CF Services: Data, Mobile & Platform

build on Pivotal Technologies

offered on 3rd Party Technologies

…"

My custom service"

offered via connection to your custom-built services

Pivotal HD

HAWQ

Redis

Greenplum

GemFire XD Data Sync

API Gateway

Push Notifications

RabbitMQ

Spring XD

41


Simple & Fast Service creation"

Cloud Controller

Health Manager

NATS (message

bus)

Router

Service Zone

Application Zone

$ cf create-service p-mysql .. mydb $ cf bind-service myapp mydb $ cf restage myapp


Developer Console


requires separate Clusters for each Build and test

Agile Development requires Lots of VMs

http://www.infoq.com/news/2012/04/Branching-Guide

Staging (shared)

Dev team1

Dev team2,3 (shared)

Release debug

Release build

Release debug

44


Turns Agile development into true Parallel activity

True Parallel Development

http://www.infoq.com/news/2012/04/Branching-Guide

DEA Pool clusters

Service clusters

Dev

DEA Pool clusters

Service clusters

Stage

45


Decomposing by functionality Micro Services increase/support

Application patterns are changing

•  Availability •  Polyglot: Multiple language •  Parallel development •  Easy to understand services •  Easy to maintain services

http://microservices.io/patterns/microservices.html 46


Decomposing by functionality PaaS supports deployment complexity of services

Micro Services

Monolithic/Layered Micro services

47


Agenda


DevOps and PaaS

PaaS characteristics:

- Orchestration




Conclusion


How to Get There With Cloud+ PaaS

Better SLAs Flexibility Speed Availability

Faster Time To Market Mobile + Data Services Agile and Iterative Leverage OSS

Continuous Delivery No Downtime Instant scaling Consistency & Automation

PaaS Dev PaaS Ops Cloud

49


Savings From Cloud and Pivotal CF

""

"" PaaS Dev PaaS Ops Cloud

50


Agile Enterprise with Pivotal CF

DevOps Continuous Delivery

The New Cloud OS Pivotal

Cluster enabled Application

...ETC"SDDC"

Warehouse scale computer"

APPS

ANALYTICS DATA

Speed"

New user experiences New business models New business value

51

development on cloud,paas and sddc

Technology

pivotal paas

pivotal korea

image copyright

u2dtdpl copyright

comnode3118596 copyright

cloud http

new middleware

new os