OpenStack Summit Tokyo 2015

Hybrid CloudA Different Approach to Managing Multiple Clouds in a Single Pane

Eshed Gal-Or, Sr. Architect, European Research Center

What is a Hybrid Cloud?

15 Year Evolution of the Data Center

Bare Metal Data Centre

Virtualized Data Centre

Private Cloud / VPC

Cloud Burst Hybrid Cloud

Hyper CloudHybrid Cloud over Clouds

Hyper Cloud: Hybrid Cloud over Clouds

OpenStack API

OpenStack API

Top

Public Cloud 1

Public Cloud 2

Private Cloud

What can it do?

Single Pane of GlassResource ManagementMonitoring & DashboardUser/Role ManagementImage RepositoryNetwork Topology

Cross-Site Network

Extended L2 & L3 Cross-cloud Tenant Subnet and Routing

QoS Rate Limiting,…

Heterogeneous Cross-cloud Overlay

Different overlay types (e.g. vlan, vxlan, geneve)Different network mechanisms (e.g. neutron-ovs, odl, dragonflow, midonet)

Security AlignmentCross-cloud NACL and SGDistributed FWaaS

Geo ElasticityGeo-aware Load Balancing

(More instances where needed, less instances where not)

Auto-optimize service for best UX and lowest OPEXRegulatory conformanceQoS/SLA Constraints

Zero ConfigurationVM migrate with all ancillary configuration

Security group, IP, volumes, image, FW entries

LB Pools defined by the Subnet

Any VM in the subnet automatically added to the pool

ImagesAutomatic synchronization

From Top to BottomAutomatic format conversion

What can we use it for?

Cross-Cloud App Deployment

Hyper Cloud

Private Site 1 Private Site 2

Public Cloud 1 Public Cloud 2

App

Cross-Cloud App Migration

Hyper Cloud

Private Site 1 Private Site 2

Public Cloud 1 Public Cloud 2

App1

App2

App

Cross-Cloud App Scaling (Burst)

Hyper Cloud

Private Site 1Private Site 2

Public Cloud 1Public Cloud 2

Add Clouds DynamicallyHyper Cloud

Private Site 1

Private Site 2

Public Cloud 1 Public Cloud 2

AddSite

RemoveSite

Cross-Cloud DR

Hyper Cloud

Private Site 1

Public Cloud 1

Public Cloud 2

Apps

Apps

Apps

Cross-Cloud ContainersHyper Cloud

Private Site 1Private Site 2

Public Cloud 1 Public Cloud 2

App

Hear about Kuryr: Container Network Management for NeutronWednesday, 12:05pm - 12:45am @ Kyokko

What is the challenge?

API Diversity & Feature ParityPublic Clouds use different APIs and provide differentiated features

Cross-Cloud Activities?Can become very complicated to do with just API conversion

Cross-Cloud Consistency?Requires an “overcloud” management layer to maintain

How do it with OpenStack?

Make EVERYONE OpenStack

Tricircle Multi-site

Management

DPaaSData

Protection

Building Blocks

AzureJacket

AWSJacket

vCloudJacket

Adapters (Jackets) for commercial public clouds

OpenStack

Hear about the new Open DPaaS ProjectThursday, 11:00am - 11:40am @ Outei

TricircleMulti-site Management for OpenStack

Tricircle: Multi-Site OpenStack

OpenStack API

OpenStack API

Top

Site 1

Site 2

Site 3

Bottom 1

Bottom 2

Bottom 3

Tricircle Architecture

BOTTOMBOTTOMBottom Site

Top Site

UnmodifiedOpenStack

CascadedService

OpenStack Adaptor

CinderNovaNeutron Keystone

Unmodified OpenStackManagement Layer

Cascading Service

Mgmt.Service

API

Workload Distributor

Service

Multi-Site Admin Multi-Site Tenant

Entities

Tricircle Cross-Site L2 Connectivity192.168.10.2 192.168.10.3192.168.10.8

ComputeNode

ComputeNode

NeutronNode

ComputeNode

ComputeNode

ComputeNode

NeutronNode

ComputeNode

Site ASite B

GW-to-GW Tunnel

Intra-cloud Tunnels Intra-cloud

Tunnels

BGWL2GW

BGWL2GW

HardwareDevices

Hyper CloudCross-Cloud Multi-Site Management

Hyper Cloud Architecture

AWS

VPC

VMVMVM

Hyper Cloud Management(Tricircle)

Horizon

Cinder APINova API Neutron API

Tricircle Top Service

KeystoneAzure OpenStack

VPCVMVMVMVM

AWS Jacket

OpenStack API

AWS API

VPC

VMVMVM

VM

AzureJacket

OpenStack API

Azure API

CinderNova NeutronBottom Service

Hyper TenantCross-Cloud Tenants

provider tenant A

provider

tenant B

The Hyper Tenant

hyper tenant tenant C

Hyper Tenant Management

AWS

VPC

VMVMVM

Hyper Cloud Management(Tricircle)

Horizon

Cinder APINova API Neutron API

Tricircle Top Service

Keystone

Azure OpenStack

VPCVMVMVMVM

AWS Jacket

OpenStack API

AWS API

VPC

VMVMVM

VM

AzureJacket

OpenStack API

Azure API

CinderNova NeutronBottom Service

Hyper Tenants managed in Top Keystone

Bottom OpenStack connect to Top Keystone

Bottom Public Cloud define a VPC Provider Tenant

Bottom Jackets connect to Top Keystone and use Provider Tenant to perform local actions on-behalf of the Hyper Tenant

Hyper NetworkCross-Cloud L2 Network

Hyper VPC over AWS and OpenStack

AWS Region (e.g. Tokyo)AWS Tenant “X”

VPC 10.0.0.0/8Subnet

10.0.1.0/24

OpenStack

TenantNetworkSubnet

172.16.31.0/24Hyper Subnet

172.16.31.0/24

VM VM VM

VMVM

Reuse OpenStack for ManagementWith some additional per-Provider addons

Hyper VPC over Public Cloud and OpenStackVMVMVM

Host

ComputeNode

Host

ControllerNode

Host

NetworkNode

VMVMVM

Host

ComputeNode

VM VM VM

VM

HyperNode

VM

HyperController

VM

HyperSwitch

VM VM VM

VM

HyperNode

OpenstackPhysical

NewProvider Cloud

Hyper VPC over Public Cloud and OpenStackUnder the hood, using Dragonflow for SDN Controller

VMVMVM

Host

HostHost

VMVMVM

Host

VM VM VM

VM

VM VM

VM VM VM

VMq-agt

n-cpuovs

Dragonflownova-drv

Message Queuen-api q-svcnova neutron BGW

q-df-l3SDN Controller

q-agtn-cpuovs

Dragonflowq-agtn-cpuovs

Dragonflow

Message Queuen-apiq-svcnovaneutronBGW

OpenstackPhysical

NewProvider Cloud

Dragonflow

q-df-l3SDN Controller

q-agtn-cpuovs

Dragonflownova-drv

Hyper VPC over AWS and OpenStack

Cascading Svc

AZ 01

CN_1

VM2-3 hIP

CN_2

VM4-3 hIP

Cascaded SvcHyper Controller

Q-API N-API

N-CPU

Hyper Switch

L2GW (BGW)

Q-AgntL3-Agnt

AZ 31

SN0

VM0-1

VM0-2

pIP hIPpIPhIP

SN2

VM2-1pIPhIP

SN4

VM4-1pIPhIP

Hyper Node

Q-AgentHN-Agent

AWS Jacket

Hyper Switch

L2GW (BGW)

Q-AgntL3-Agnt

Hyper ControllerQ-APIN-API

N-CPUNova Driver

Let’s see an End-to-End flow

Cross-cloud VM-to-VM in same subnet

VM

NetworkNode

BGW

VM

CN

SN

BGWVM1

VMHN

ovsbr-tunbr-int

br-trans

IP:10.1.0.1HyP: 192.168.10.1 IP: 192.168.10.2

VM

ComputeNode

L2Pop

l2pop

VM2Custom Route Table

Destination Target192.168.10.254/32

192.168.10.254.254

192.168.10.0/24 192.168.10.254.254

10.1.0.0/24 local0.0.0.0/0 192.168.10.254.254

Source-Destination Check Disabled

Cross-cloud VM-to-VM in same subnet

VM

NetworkNode

BGW

VM

CN

SN

BGWVM1

VMHN

ovsbr-tunbr-int

br-trans

IP:10.1.0.1HyP: 192.168.10.1 IP: 192.168.10.2

VM

ComputeNode

L2Pop

l2pop

VM2Custom Route Table

Destination Target192.168.10.254/32

192.168.10.254.254

192.168.10.0/24 192.168.10.254.254

10.1.0.0/24 local0.0.0.0/0 192.168.10.254.254

Source-Destination Check Disabled

Next time:Hyper Image & Hyper VolumeCross-Cloud Image Synchronization and Volume Migration

Some Screenshots…

Don’t miss these talks:

Kuryr, Wednesday, 12:05pm - 12:45am

Kyokko

DPaaS, Thursday, 11:00am - 11:40am

Outei

Thanks