and automation openstack deployment - … filecompute i/o based numa scheduling quiesce file-systems...

@kernelcdub@thomasdcameron@jameslabocki

May 5, 2015

OPENSTACK DEPLOYMENTAND AUTOMATION

OPENSTACK AT RED HAT

OPENSTACK CONTRIBUTIONS

OPENSTACK DEPLOYMENT AND AUTOMATION00

Overall Commits by Company (aggregated) Red Hat Commits by Project

Bitergia: http://activity.openstack.org/dash/browser/scm-companies.html?release=junoStakalytics: http://stackalytics.com/?release=juno&company=red%20hat

Red Hat Cares … About Every Project

RHEL OpenStack Platform 7

●OpenStack Kilo

●3 Year Life-Cycle

●Co-Engineered with RHEL 7

●Faster Paced Management ToolRelease (2 months)

00 OPENSTACK DEPLOYMENT AND AUTOMATION

NEW SERVICES

● Database as a Service (“Trove”) - Fully supported

● VM high availability Service based on Pacemaker Remote

● DNS as a Service (“Designate”) - Tech Preview

● Operational tools (logging, monitoring, etc) - Tech Preview

● File Share Service (“Manila”) - Tech Preview

00 OPENSTACK DEPLOYMENT AND AUTOMATION

RED HAT CONTRIBUTIONS TO KILONetworking

● ML2/OVS port security● DPDK accelerated OVS (Tech Preview)● LBaaS v2 API

Compute

● I/O based NUMA scheduling● Quiesce file-systems during image

snapshot using QEMU guest agent● Support for vhost-user virtual interfaces

Storage

● Image Conversion● Incremental Backup● Private Volume Types● Import/Export snapshots

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Identity

● Hierarchical multi-tenancy● Federation support

Dashboard

● Refined Plugin Framework● AngularJS based wizards● Improved Network Topology Graph

Management● Pluggable Horizon component● Integrated management tools

DEPLOYMENT AND AUTOMATION

CONFIGURATIONMANAGEMENT

Leverage existing expertise to deploy OpenStack

DEPLOYMENT AND AUTOMATION

RDO MANAGER

Tools for deploying and managing OpenStack with

OpenStack

CONTAINERS

The not so distant future for OpenStack deployments

Multiple Methodologies For Deployment

00 OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONConfiguration Management

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Tempest

QuickStack UpdatesCommitted to Git

Jenkins StartsBuild

Jenkins Verifies

Deployment

Jenkins UpdatesForeman

SystemsDeployClasses

DEPLOYMENT AND AUTOMATIONRDO Manager

Hardware

Ironic

Nova

Tuskar and Heat

Ceilometer Glance

Ironic API

hardware management driver

hardware management driver

Deployment Orchestration

Instrumentation Agents

Bare Metal Drivers

Supporting ComponentsHA configurationService configuration

00 OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

00 OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

1. One or more Management Nodes are installed in the control rack.

00 OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

2. Operator logs into Operator Dashboard to configure the infrastructure

00 OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

3. Management App discovers your infrastructure hardware.

Hardware Discovery

00 OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

4. Operator defines the OpenStack control services.

00 OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

5. Operator defines the OpenStack resource nodes.

00 OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

6. Control service and Resource nodes get provisioned.(Tuskar -> Heat -> Nova -> Ironic -> Hardware)

00 OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONRDO Manager

Logical view of the Management and Production clouds

Deployment & Management App

OpenStack Production Cloud

00 OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONContainers

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Current deployment methods have difficulties

● Build Based○ Inefficient - 1 service per operating system○ Difficult - Imperative deployments are not easily rolled back○ Slow - `yum install`

● Image Based○ Difficult - Someone still has to build the image○ Expensive - New update = Large new image

DEPLOYMENT AND AUTOMATIONContainers

00 OPENSTACK DEPLOYMENT AND AUTOMATION

● Project Kolla○ Container Based Deployment of OpenStack Services○ Clean separation of host and openstack services○ Deploy all openstack services in under 2 minutes

● Kubernetes or Heat○ Declarative method for describing deployment ○ Application driven infrastructure

● Project Atomic○ minimal OS for container based workloads○ os-tree for atomic upgrades

CONTAINER BASED SERVICES DEMOKolla

00 OPENSTACK DEPLOYMENT AND AUTOMATION

DEPLOYMENT AND AUTOMATIONAutomated Scaling

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Tenant VMs

Ready HostsWorkload Cloud

Deployment Cloud

Infrastructure Provider

Cloud Provider

PolicyUtilization Compliance

DEPLOYMENT AND AUTOMATIONAutomated Scaling

00 OPENSTACK DEPLOYMENT AND AUTOMATION

Tenant VMs

Workload Cloud

Deployment Cloud

Infrastructure Provider

Cloud Provider

PolicyUtilization Compliance

AUTOMATED SCALING DEMOManageIQ + OpenStack

00 OPENSTACK DEPLOYMENT AND AUTOMATION

COMMUNITY TO ENTERPRISE

00 OPENSTACK DEPLOYMENT AND AUTOMATION

OpenStack

Foreman

ManageIQ

Kubernetes

Project Atomic

00 OPENSTACK DEPLOYMENT AND AUTOMATION

RESOURCES

This Presentation - www.allthingsopen.com

Foreman - www.theforeman.org

RDO Manager - https://www.rdoproject.org/RDO-Manager

Kolla - https://github.com/stackforge/kolla

ManageIQ - www.manageiq.org

Project Atomic - www.projectatomic.io

Kubernetes - www.kubernetes.io

00 OPENSTACK DEPLOYMENT AND AUTOMATION

THANK YOU

plus.google.com/+RedHat

linkedin.com/company/red-hat

youtube.com/user/RedHatVideos

twitter.com/RedHatNews

facebook.com/redhatinc