silicon valley cloudstack user group - introduction to apache cloudstack

36
An Introduction to Apache CloudStack Geoff Higginbottom CTO ShapeBlue [email protected] Twitter: @CloudStackGuru

Upload: shapeblue

Post on 19-Jan-2015

178 views

Category:

Technology


6 download

DESCRIPTION

Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

TRANSCRIPT

Page 1: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

An Introduction to Apache CloudStack

Geoff HigginbottomCTO ShapeBlue

[email protected]: @CloudStackGuru

Page 2: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Cloud Architect & ShapeBlue CTO Specialise in….

Designing & Building Clouds based on Apache CloudStack / Citrix CloudPlatform

Developing CloudStack training Blogging and sharing CloudStack knowledge

Involved with CloudStack before donation to Apache Designed Clouds for Cloudera, SunGard, Ascenty, BskyB,

Trader Media, M5 Hosting, Team Cymru, Interoute, University of Pennsylvania.…

CloudStack Committer

About Me

Page 3: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

“ShapeBlue are expert builders of public &

private clouds. They are the leading global

Apache CloudStack / CloudPlatform integrator & consultancy”

About ShapeBlue

Page 4: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Cloud computing is a general term for anything that involves delivering hosted services over a network.

These services are broadly divided into three categories: Infrastructure-as-a-Service (IaaS)

I want virtual servers all connected to each other via an internal network

Platform-as-a-Service (PaaS) I want web server, app server, and database functionality

Software-as-a-Service (SaaS) I want X number of mailboxes or SharePoint instances

What is ‘The Cloud’?

Page 5: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

What makes these services ‘Cloudy’? On-demand self-service Elasticity Scalability API integration Resource accounting

What is ‘The Cloud’?

Page 6: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Public clouds (SPs/MSPs) General public can create or log into instances

themselves

Private Clouds (Enterprises) Anyone who wants to be able to orchestrate their

environment

Who Uses Clouds?

Page 7: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

How to build an IaaS cloud

Commodity

ComputeStorage

Networking

Hypervisor

CMP - Orchestration layer

Orchestration API

eCommerce Platform

XenServer, KVM, VMWare, Hyper-V, OVM LXC, UCS, Bare Metal

Apache CloudStack

eCommerce Platform

CloudStack API

Billing Management

Networking

Compute Storage

PaaSDeveloper

ToolingMulti-cloud

Management

Page 8: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

vCloud DirectorMicrosoft System

Center

Vendor Centric

AbiquoOnAppFlexiantHexagrid

End to End

CloudStackOpenStack

OpenNebulaEucalyptus

Open Communities

The World of IaaS Choices

Page 9: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Apache CloudStack is a top-level project of the Apache Software Foundation (ASF). The project develops open source software for deploying public and private Infrastructure-as-a-Service (IaaS) clouds.

CloudStack provides an open and flexible cloud orchestration platform to deliver reliable and scalable private and public clouds

Apache CloudStack

Page 10: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Open source Infrastructure-as-a-Service platform, under ASL 2.0 license

A vibrant and growing community in ASF Developed since 2008 by Cloud.com Acquired by Citrix in 2011 Donated to Apache April 2012 Became top level ASF project March 2013 A proven cloud platform

CloudStack Background

Page 11: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

“OpenStack is for science projects” Proven “product” Quick to deploy AWS API fidelity Scalable Open standards Strong & open governance from Apache

Why CloudStack?

Page 12: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Our community is driven by users

Page 13: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Global User Groups

Page 14: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

CloudStack Users

Page 15: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru15

CloudStack Users 2.0

Page 16: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru16

CloudStack Users 3.0

Page 17: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Multiple Cloud Strategies

Dedicated Resources Security & Total Control Internal Network Managed by Enterprise

or 3rd Party

Mix of shared and dedicated resources

Elastic scaling Pay as you go Public internet

Private Clouds Public CloudsOn-Premise

Enterprise Cloud

Dedicated resources Security SLA bound 3rd party owned and

operated

HostedEnterprise Cloud

Multi-Tenant Public Cloud

Page 18: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Broad Hypervisor support XenServer, KVM, VMware, Oracle VM, Hyper-V, LXC, UCS,

Bare Metal Scalable architecture

Support thousands of hosts and virtual machine guests Largest known production cloud 65k+ physical hosts

AWS API fidelity High Availability Virtual Networking Web UI, API, CLI

Feature Highlights

Page 19: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Open Flexible Platform

XenServer

VMware OVMKVM(LXC)

UCS

Compute

Network Type

Isolation Firewall LB GSLB

Network

Local Disk

iSCSIFibre

ChannelNFS Swift

Storage

Primary Storage Secondary Storage

VPN

Bare metal

S3

Hyper-V

Page 20: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Create Virtual Machines from Templates or ISOs Start & Stop, Clone, Import, Export Virtual Machines Create Isolated, Shared and Multi-Tiered Networks Manage Firewall and Port Forwarding Rules Manage Network Services such as Firewall, Load

Balancing, Static and Source NAT, VPNs, Multi-Tiered Networks, Global Server Load Balancing and Auto-Scaling

What can you do with CloudStack?

Page 21: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Hierarchical structure enables massive scale Region

A grouping of Availability Zones within a geographic area Dedicated Management Server infrastructure to manage the

Region and all of its Zones Availability Zone

Typically one Zone per DC Contains at least 1 POD, 1 Cluster and Secondary Storage

CloudStack Architecture

Page 22: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Pod Logical entity, typically a Rack containing one or more

Clusters and Networking Uses concept of something shared i.e. switch stack or

storage array Cluster

Group of identical Hosts running a common Hypervisor Primary Storage

CloudStack Architecture

Page 23: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Primary Storage Traditionally unique to each Cluster KVM and VMware now support Zone-Wide Primary Storage Hosts the Guest Virtual Machines and VM Snapshots Can be any format the Hypervisor Supports

Secondary Storage Zone Wide (region wide for S3) NFS + S3 or NFS + Swift for Region Wide Replication Stores Templates, ISOs and Volume Snapshots (backups)

CloudStack Architecture

Page 24: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Management Server Deployment Architectures Single-Node Deployment

Management Server

Zone 1Zone 1Zone

s

MySQL DB

GUI

API

Page 25: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Management Server Deployment Architectures Multi-Node Deployment

Management Server

Zone 1Zone 1Zone

s

MySQL DB

(Master)GUI

API

MySQL DB

(Slave)

Management Server

Management Server

Load Balancer

Load Balancer

Page 26: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

CloudStack Architecture Multiple Availability Zones within a Region

DC 1

Zone 1DC 2

Zone 2

Zone 3

DC n

Zone n

Management Servers

Management Servers

Page 27: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

CloudStack Architecture Multiple Availability Zones within a Region

Region 1

DC 1

Zone 1

DC 2

Zone 2

Management Servers

Region 2

DC 3

Zone 3

DC 4

Zone 4

Management Servers

Rabbit MQAccount/User data

DC 5

Zone 5

Page 28: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Physical Connectivity

POD 1

Hosts

PrimaryStorage

Secondary Storage

Management

Server(s)

MySQLDB(s)

Admins & Users

POD 2

POD n

Users

www

Page 29: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

AWS Style L3 isolation – Massive Scale Simple Flat Network Each POD has a unique CIDR (Broadcast domain) Optional Guest Isolation via Security Groups Optional NetScaler Integration - Elastic IPs and Elastic

LB Optional Nicira NVP Integration

Basic Networking

Page 30: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Guest Networks isolated by VLANs / SDN Technologies Private and Shared Guest Networks Multiple Physical Networks Virtual Router for each Network providing:

DNS & DHCP Firewall Client VPN Load Balancing Source / Static NAT Port Forwarding

Advanced Networking

Page 31: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Effectively enables the deployment of multiple ‘Basic’ style networks which use Security Groups for isolation of VMs, but with each Network encapsulated within a unique VLAN (or SDN)

Enables the ‘stretching’ of Guest IP Address Space across multiple PODs

Security Groups in Advanced Zones

Page 32: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Basic Zone – Example IP Schema

L3 Switch

Host n

Host 1

POD 1192.168.0.0/2

6Res IPs 0.10 -

0.29Hosts 0.30 –

0.62

VR

DHCPDNSUserdataMetadata

VMVM

VMVM

L2 Switch

www

Host n

Host 1

POD 2192.168.0.64/26

Res IPs 0.73 - 0.92Hosts 0.93 - 0.126

Guest IPs:172.16.2.2- 3.254

GW 172.16.2.1

L2 Switch

Host n

Host 1

POD 3192.168.0.128/26

Res IPs 0.138 – 0.147Hosts 0.149 – 0.190

Guest IPs:172.16.4.2 - 5.254

GW 172.16.4.1

L2 Switch

Guest IPs:172.16.0.2 -

1.254GW 172.16.0.1

Page 33: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Advanced Zone – Example IP Schema

L3 Switch

www

Host n

Host 2

POD 1 - XenServer

192.168.0.0/26Res IPs 0.10 -

0.29Hosts 0.30 –

0.62

Host 1

L2 SwitchVMb1

VRb VMb2

VRaVMa2

VMa1

VMa3Host n

Host 2

POD 2 - vSphere

192.168.2.0/23Res IPs 2.43 -

3.254Hosts 2.10 –

2.42

Host 1

L2 Switch

VMc3

VRc

VMc2

VMc1

Guest Networks10.1.1.0/24GW 10.1.1.1

Guest IPs 1.2 - 1.254

VLANs

VLANs

Page 34: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Demo

Page 35: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

www.shapeblue.com

@CloudStackGuru

Any Questions ?

Page 36: Silicon Valley CloudStack User Group - Introduction to Apache CloudStack

An Introduction to Apache CloudStack

Geoff HigginbottomCTO ShapeBlue

[email protected]: @CloudStackGuru