© 2014 IBM Corporation

Cloud Foundry on OpenStackAutomated Lifecycle Management Animesh Singh @AnimeshSingh

IBM Cloud Architect

2 © 2014 IBM Corporation

Cloud Foundry on OpenStack!

Apps

3 © 2014 IBM Corporation

Cloud Foundry & OpenStack - Top Two Open Source Technologies!

http://analystpov.com/cloud-computing/top-15-open-source-cloud-computing-technologies-2014-24727

4 © 2014 IBM Corporation

Meets Developer’s NeedsFocus on app development, not provisioning VMs, databases, messaging servers, etcAgile development modelDeploy and scale in seconds

Open Cloud PlatformThere is an increasing appetite for cloud-based mobile, social and analytics applications from line-of-business executives - drives the need for a more open cloud development platform

Compelling Community Cloud Foundry has a compelling community and emerging ecosystem as well as a mature set of capabilities and robustness

Platinum Founding Sponsors1.3k 739k

LINES OF CODETOTAL CONTRIBUTORS

Cloud Foundry Overview

5 © 2014 IBM Corporation

Eclipse IDE

CLI

Browser

cf push

http

Cloud Foundry Developer Experience

6 © 2014 IBM Corporation

Eclipse IDE

CLI

Browser

cf push

http

Cloud Controller(API)

Router

DEA Pool DEA Pool Droplet Execution

Agent (DEA) VM Pool

HealthManager

NATS(Message bus)

Cloud Foundry Architecture

7 © 2014 IBM Corporation

IBM BlueMix (powered by Cloud Foundry)http://bluemix.net

IBM initiative to develop a Platform as a Services offering

IBM and partner cloud services

Integrated DevOps with both Browser and Eclipse-based tools

Services

Lifecycle Management

(JazzHub)

ApplicationRuntime

Runtimes &Frameworks

Middleware Application Operational Mobile ExternalData

node java ruby WorklightWebSphereLiberty

Web IDE(Eclipse Orion)

Eclipse IDEApplication

CompositionEnvironment

Create & Manage Services

Test/Run Test/Run

ExploreServices

ExploreServices

IBM Bluemix ™Check In Code Check In Code

8 © 2014 IBM Corporation

IBM Bluemix (http://bluemix.net)

9 © 2014 IBM Corporation

OpenStack Swift Object Storage Service Available in Bluemix!

10 © 2014 IBM Corporation

Integrate !

11 © 2014 IBM Corporation

PaaS

Cloud

Integration

IaaS

UAA

Router

DEA Pool Apps

Service Connector

Health Manager

Messaging

Cloud Controller

Build Packs

Service Nodes

BOSHCloud Provider Interface

Cloud Foundry , OpenStack Integration

• Static / floating ips• Persistent disks• Custom VM

Configurations• Specialized Security

groups

12 © 2014 IBM Corporation

BOSH deployment process

Deployment Manifest• Release name/version• # VMs, job params• Stemcells to use

Stemcell• Base OS• BOSH agent

Release• Name• Software packages• Config templates• Scripts

BOSH

DeployedCloud Foundry

Virtual Machine• Configuration• Software Packages

Virtual Machine• Configuration• Software Packages

Virtual Machine• Configuration• Software Packages

Virtual Machine• Configuration• Software packages

13 © 2014 IBM Corporation

Automate the Lifecycle (Leverage the power of community) !

14 © 2014 IBM Corporation

Leverage the power of Open Source Community• Open technologies give us a tremendous amount of power and flexibility to integrate them together

seamlessly• Lets see some of the examples of what we can do with the power of Open technologies to go from bare metal hardware to a deployed Cloud Foundry ready to push apps

Open Source for Cloud Foundry and OpenStack Automation!

15 © 2014 IBM Corporation

OpenStack Installation:• Leverage the open source Chef Cloud infrastructure Automation framework• Requires information about hardware, network environment and software repositories.• Automate OpenStack installation in approximately 15 minutes!

Chef for OpenStack Install Automation

Setup Compute

Setup Network

Setup Controller

Setup Storage

16 © 2014 IBM Corporation

OpenStack Discovery:• Leverage the open source Fog gem to discover OpenStack artifacts in an automated manner • Require OpenStack credentials and discover OpenStack compute and network information.

Fog for OpenStack Discovery Automation

Discover VM Configuration Sizes

Discover NetworkSubnets

Discover Network Security Rules

Discover DHCP , DNS Gateway and floating IPs

Discover Security Credentials

17 © 2014 IBM Corporation

Fog for OpenStack Setup Automation

Cloud Foundry Pre-req setup on OpenStack:• Leverage the open source Fog gem to setup Cloud Foundry requirements in an automated manner • Setup according to best practices and guidelines – still giving users the flexibility to change if desired

Create Security Credentials

Create VM configs for Router, DEAs, Cloud Controller, Service Nodes

Create network Security Rules

Setup tenant quota

18 © 2014 IBM Corporation

BOSH and Ruby for Cloud Foundry Deployment AutomationCloud Foundry Deployment Automation

• Automate base OS image creation or modification • Automate Cloud Foundry deployment manifest file genration using Ruby ERB• Automate upload of Cloud Foundry core release, services and runtime frameworks, followed by Cloud

Foundry deployment

Stemcell Creation and Upload

Generate BOSH and Cloud Foundry Manifest

Upload Cloud Foundry core, Services and runtime

Deploy Cloud Foundry

Deploy Microbosh

RUBY BOSH

19 © 2014 IBM Corporation

Automate end to end deployments in under an hour !• Previous example signify the power of Open source community• Leveraging tools like Chef, Fog, BOSH, Ruby ERB from the community can help create powerful

automation which can be repeatedly and consistently replicated in under an hour!

Open way is the only way!

BOSH

RUBY

20 © 2014 IBM Corporation

Automate the Update/Upgrade!

21 © 2014 IBM Corporation

Automate the update/upgrade lifecycle operations• Updates can be automated using code from the initial automated deployment (e.g. bosh deploy)• Follow te same workflow – do OpenStack discovery operation, and then leverage BOSH for

update/upgrade/• To ensure application availability throughout the update, use tools like JMeter to test application responsiveness

Updates/Upgrades Automation!

22 © 2014 IBM Corporation

Application Uptime during Updates/Upgrades Automation!

23 © 2014 IBM Corporation

Scale!

24 © 2014 IBM Corporation

Scaling OpenStackOptimize Internal Communication

• Configure OpenStack for scaled concurrency

Optimize Performance• Configure OpenStack scheduler to evenly distribute load

Setup Highly Available Architecture for PaaS workloads

Load Balancer Nodes

DataNodes

3x

Compute Nodes

15xStorage

Nodes

2x

Controller Nodes

2x 6x

25 © 2014 IBM Corporation

Scaling Cloud Foundry / BOSHOptimize Internal Communication

• Configure messaging bus for VM communication

Optimized routing and bandwidth allocation• Isolate Cloud Foundry components using multiple networks

Maintain Cloud Foundry’s Highly Available Architecture

Service Gateways

10xRouters

3x

Service Nodes15x

DEAs20x

Cloud Controllers

2x

26 © 2014 IBM Corporation

Why Cloud Foundry and OpenStack are a great fit ?

• 100% Open PaaS and IaaS solutions – No vendor lock-ins • Strong and growing community of contributors and sponsors on both sides

• Power of Open Source community can be leveraged to automate the deployment and lifecycle management of Cloud Foundry on OpenStack

• OpenStack meets Cloud Foundry integration requirements, and is totally configurable and adaptable to handle the scale of a PaaS solution like Cloud Foundry

• Bottom Line: They are a great fit!

27 © 2014 IBM Corporation

What next? Join us at our Silicon Valley Meetups

http://www.meetup.com/BlueMix/

http://www.meetup.com/CloudFoundry/

For more technical details, refer to the slides and video herehttp://www.slideshare.net/AnimeshSingh/optimizing-cloud-foundry-and-openstack-for-large-scale-deploymentshttps://www.openstack.org/assets/presentation-media/A-Practical-Approach-to-HA-Final.pdfhttps://www.youtube.com/watch?v=jCwtV9n_ak4https://www.youtube.com/watch?v=FsrCGkBo4Vg 

28 © 2014 IBM Corporation

IBM Sponsored Sessions on Wednesday, November 5th 9:50 in Room 243

Step on the Gas: See how Open Technologies are driving the future of the enterpriseTodd Moore, Director, Open Technologies and PartnershipsDavid Lindquist, Chief Technology Officer / Vice President Strategy and Architecture

11:50 Room 212/213

IBM and OpenStack: Collaborations beyond the code Manuel Silveyra, Daniel Krook

13:50 Room 212/213

A Use Case Driven view of IBM’s OpenStack based Offerings Moe Abdula, Vice President of Cloud Strategy

14:40 Room 212/213

IBM OpenStack Offerings in Action Moe Abdula, Vice President of Cloud Strategy

29 © 2014 IBM Corporation

IBM Technical Sessions IBM Sessions on Monday, November 3rd 15:20

R.251When Disaster Strikes the Cloud: Who, What, When, Where and How to recover Ronen Kat, Michael Factor, and Red Hat

11:40A.Blue

IPv6 Features in OpenStack Juno Xu Han Peng, Comcast, and Cisco

15:20R252

Why is my Volume in 'ERROR' State!?!  An Introduction to Troubleshooting Your Cinder Configuration Jay Bryant

16:20A.Blue

Group Based Policy Extension for NetworkingMohammad Banikazemi, Cisco, Midokura, and One Convergence

IBM Sessions on Tuesday. November 4th 11:15

R252 The perfect match: Apache Spark meets Swift. Gil Vernik, Michael Factor, and Databricks

15:40R242

Docker Meets Swift: A Broadcaster's ExperienceEran Rom, and RAI

16:40Maillot

User Group Panel: India, Japan, China Ying Chun Guo, Guang Ya Liu, Qiang Guo Tong

14:50Passe

A Practical Approach to Dockerizing OpenStack High Availability Manuel Silveyra, Shaun Murakami, Kalonji Bankole, Daniel Krook

IBM Sessions on Wednesday, November 5th 09:00

R241Monasca DeepDive: Monitoring at scale Tong Li , Rob Basham, HP and Rackspace

09:00R242

Beyond 86: Managing multi-platform environments with OpenStack Shaun Murakami, Philip Estes

09:50 R253

Troubleshooting Problems in Heat DeploymentsFabio Oliveira,Ton Ngo,Priya Nagpurkar, Winnie Tsang

11:50 R251

Keystone to Keystone Federation Enhancements for Hybrid Cloud EnablementSteve Martinelli, Brad Topol, CERN, and Rackspace

17:50 R253

Practical advice on deployment and management of enterprise workloads Jarek Miszczyk, Venkata Jagana

30 © 2014 IBM Corporation

Learn more at these IBM sponsored sessions on Wednesday: 9:50 Room 243 Step on the Gas: See how Open Technologies are driving the

future of the enterprise11:50 Room 212/213 IBM and OpenStack: Collaborations beyond the code 1:50 Room 212/213 A Use Case Driven view of IBM’s OpenStack based Offerings 2:40 Room 212/213 IBM OpenStack Offerings in Action

Stop by the IBM Booth (B4)Demos, games and FREE tee

shirt.

31 © 2014 IBM Corporation

BLUE 1R131 G209 B245

BLUE 3R0 G178 B239

BLUE 6R0 G63 B105

RED 1R240 G78 B55

Primary Colors

Fonts: Arial for Headings and TextMay use Rockwell for accents

Potentially Useful Graphics

Private Hybrid Hosted Private Public

32 © 2014 IBM Corporation

33 © 2014 IBM Corporation

Color Palette

Status Colors

PrimaryPalette

AccentPalette

IBM Blue 5R0 G100 B157*Title Text

IBM Orange 2R221 G115 B28

IBM Olive 1R165 G162 B21

IBM Teal 2R0 G118 B112

IBM Purple 3R59 G28 B125

IBM Blue 6R0 G63 B105

IBM Red 3R168 G16 B36

IBM Yellow 3R253 G184 B19

IBM Green 3R0 G138 B82

IBM Blue 1R131 G209 B245

IBM Blue 4R0 G138 B191

34 © 2014 IBM Corporation

Legal Disclaimer

• © IBM Corporation 2011. All Rights Reserved.• The information contained in this publication is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained in this publication, it is

provided AS IS without warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans and strategy, which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this publication or any other materials. Nothing contained in this publication is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

• References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in this presentation may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.

• If the text contains performance statistics or references to benchmarks, insert the following language; otherwise delete:Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

• If the text includes any customer examples, please confirm we have prior written approval from such customer and insert the following language; otherwise delete:All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

• Please review text for proper trademark attribution of IBM products. At first use, each product name must be the full name and include appropriate trademark symbols (e.g., IBM Lotus® Sametime® Unyte™). Subsequent references can drop “IBM” but should include the proper branding (e.g., Lotus Sametime Gateway, or WebSphere Application Server). Please refer to http://www.ibm.com/legal/copytrade.shtml for guidance on which trademarks require the ® or ™ symbol. Do not use abbreviations for IBM product names in your presentation. All product names must be used as adjectives rather than nouns. Please list all of the trademarks that you use in your presentation as follows; delete any not included in your presentation. IBM, the IBM logo, Lotus, Lotus Notes, Notes, Domino, Quickr, Sametime, WebSphere, UC2, PartnerWorld and Lotusphere are trademarks of International Business Machines Corporation in the United States, other countries, or both. Unyte is a trademark of WebDialogs, Inc., in the United States, other countries, or both.

• If you reference Adobe® in the text, please mark the first use and include the following; otherwise delete:Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.

• If you reference Java™ in the text, please mark the first use and include the following; otherwise delete:Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

• If you reference Microsoft® and/or Windows® in the text, please mark the first use and include the following, as applicable; otherwise delete:Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both.

• If you reference Intel® and/or any of the following Intel products in the text, please mark the first use and include those that you use as follows; otherwise delete:Intel, Intel Centrino, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

• If you reference UNIX® in the text, please mark the first use and include the following; otherwise delete:UNIX is a registered trademark of The Open Group in the United States and other countries.

• If you reference Linux® in your presentation, please mark the first use and include the following; otherwise delete:Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.

• If the text/graphics include screenshots, no actual IBM employee names may be used (even your own), if your screenshots include fictitious company names (e.g., Renovations, Zeta Bank, Acme) please update and insert the following; otherwise delete: All references to [insert fictitious company name] refer to a fictitious company and are used for illustration purposes only.