silicon valley cloudstack user group - introduction to apache cloudstack
DESCRIPTION
Silicon Valley CloudStack User Group - Introduction to Apache CloudStackTRANSCRIPT
An Introduction to Apache CloudStack
Geoff HigginbottomCTO ShapeBlue
[email protected]: @CloudStackGuru
www.shapeblue.com
@CloudStackGuru
Cloud Architect & ShapeBlue CTO Specialise in….
Designing & Building Clouds based on Apache CloudStack / Citrix CloudPlatform
Developing CloudStack training Blogging and sharing CloudStack knowledge
Involved with CloudStack before donation to Apache Designed Clouds for Cloudera, SunGard, Ascenty, BskyB,
Trader Media, M5 Hosting, Team Cymru, Interoute, University of Pennsylvania.…
CloudStack Committer
About Me
www.shapeblue.com
@CloudStackGuru
“ShapeBlue are expert builders of public &
private clouds. They are the leading global
Apache CloudStack / CloudPlatform integrator & consultancy”
About ShapeBlue
www.shapeblue.com
@CloudStackGuru
Cloud computing is a general term for anything that involves delivering hosted services over a network.
These services are broadly divided into three categories: Infrastructure-as-a-Service (IaaS)
I want virtual servers all connected to each other via an internal network
Platform-as-a-Service (PaaS) I want web server, app server, and database functionality
Software-as-a-Service (SaaS) I want X number of mailboxes or SharePoint instances
What is ‘The Cloud’?
www.shapeblue.com
@CloudStackGuru
What makes these services ‘Cloudy’? On-demand self-service Elasticity Scalability API integration Resource accounting
What is ‘The Cloud’?
www.shapeblue.com
@CloudStackGuru
Public clouds (SPs/MSPs) General public can create or log into instances
themselves
Private Clouds (Enterprises) Anyone who wants to be able to orchestrate their
environment
Who Uses Clouds?
www.shapeblue.com
@CloudStackGuru
How to build an IaaS cloud
Commodity
ComputeStorage
Networking
Hypervisor
CMP - Orchestration layer
Orchestration API
eCommerce Platform
XenServer, KVM, VMWare, Hyper-V, OVM LXC, UCS, Bare Metal
Apache CloudStack
eCommerce Platform
CloudStack API
Billing Management
Networking
Compute Storage
PaaSDeveloper
ToolingMulti-cloud
Management
www.shapeblue.com
@CloudStackGuru
vCloud DirectorMicrosoft System
Center
Vendor Centric
AbiquoOnAppFlexiantHexagrid
End to End
CloudStackOpenStack
OpenNebulaEucalyptus
Open Communities
The World of IaaS Choices
www.shapeblue.com
@CloudStackGuru
Apache CloudStack is a top-level project of the Apache Software Foundation (ASF). The project develops open source software for deploying public and private Infrastructure-as-a-Service (IaaS) clouds.
CloudStack provides an open and flexible cloud orchestration platform to deliver reliable and scalable private and public clouds
Apache CloudStack
www.shapeblue.com
@CloudStackGuru
Open source Infrastructure-as-a-Service platform, under ASL 2.0 license
A vibrant and growing community in ASF Developed since 2008 by Cloud.com Acquired by Citrix in 2011 Donated to Apache April 2012 Became top level ASF project March 2013 A proven cloud platform
CloudStack Background
www.shapeblue.com
@CloudStackGuru
“OpenStack is for science projects” Proven “product” Quick to deploy AWS API fidelity Scalable Open standards Strong & open governance from Apache
Why CloudStack?
www.shapeblue.com
@CloudStackGuru
Our community is driven by users
www.shapeblue.com
@CloudStackGuru
Global User Groups
www.shapeblue.com
@CloudStackGuru
CloudStack Users
www.shapeblue.com
@CloudStackGuru15
CloudStack Users 2.0
www.shapeblue.com
@CloudStackGuru16
CloudStack Users 3.0
www.shapeblue.com
@CloudStackGuru
Multiple Cloud Strategies
Dedicated Resources Security & Total Control Internal Network Managed by Enterprise
or 3rd Party
Mix of shared and dedicated resources
Elastic scaling Pay as you go Public internet
Private Clouds Public CloudsOn-Premise
Enterprise Cloud
Dedicated resources Security SLA bound 3rd party owned and
operated
HostedEnterprise Cloud
Multi-Tenant Public Cloud
www.shapeblue.com
@CloudStackGuru
Broad Hypervisor support XenServer, KVM, VMware, Oracle VM, Hyper-V, LXC, UCS,
Bare Metal Scalable architecture
Support thousands of hosts and virtual machine guests Largest known production cloud 65k+ physical hosts
AWS API fidelity High Availability Virtual Networking Web UI, API, CLI
Feature Highlights
www.shapeblue.com
@CloudStackGuru
Open Flexible Platform
XenServer
VMware OVMKVM(LXC)
UCS
Compute
Network Type
Isolation Firewall LB GSLB
Network
Local Disk
iSCSIFibre
ChannelNFS Swift
Storage
Primary Storage Secondary Storage
VPN
Bare metal
S3
Hyper-V
www.shapeblue.com
@CloudStackGuru
Create Virtual Machines from Templates or ISOs Start & Stop, Clone, Import, Export Virtual Machines Create Isolated, Shared and Multi-Tiered Networks Manage Firewall and Port Forwarding Rules Manage Network Services such as Firewall, Load
Balancing, Static and Source NAT, VPNs, Multi-Tiered Networks, Global Server Load Balancing and Auto-Scaling
What can you do with CloudStack?
www.shapeblue.com
@CloudStackGuru
Hierarchical structure enables massive scale Region
A grouping of Availability Zones within a geographic area Dedicated Management Server infrastructure to manage the
Region and all of its Zones Availability Zone
Typically one Zone per DC Contains at least 1 POD, 1 Cluster and Secondary Storage
CloudStack Architecture
www.shapeblue.com
@CloudStackGuru
Pod Logical entity, typically a Rack containing one or more
Clusters and Networking Uses concept of something shared i.e. switch stack or
storage array Cluster
Group of identical Hosts running a common Hypervisor Primary Storage
CloudStack Architecture
www.shapeblue.com
@CloudStackGuru
Primary Storage Traditionally unique to each Cluster KVM and VMware now support Zone-Wide Primary Storage Hosts the Guest Virtual Machines and VM Snapshots Can be any format the Hypervisor Supports
Secondary Storage Zone Wide (region wide for S3) NFS + S3 or NFS + Swift for Region Wide Replication Stores Templates, ISOs and Volume Snapshots (backups)
CloudStack Architecture
www.shapeblue.com
@CloudStackGuru
Management Server Deployment Architectures Single-Node Deployment
Management Server
Zone 1Zone 1Zone
s
MySQL DB
GUI
API
www.shapeblue.com
@CloudStackGuru
Management Server Deployment Architectures Multi-Node Deployment
Management Server
Zone 1Zone 1Zone
s
MySQL DB
(Master)GUI
API
MySQL DB
(Slave)
Management Server
Management Server
Load Balancer
Load Balancer
www.shapeblue.com
@CloudStackGuru
CloudStack Architecture Multiple Availability Zones within a Region
DC 1
Zone 1DC 2
Zone 2
Zone 3
DC n
Zone n
Management Servers
Management Servers
www.shapeblue.com
@CloudStackGuru
CloudStack Architecture Multiple Availability Zones within a Region
Region 1
DC 1
Zone 1
DC 2
Zone 2
Management Servers
Region 2
DC 3
Zone 3
DC 4
Zone 4
Management Servers
Rabbit MQAccount/User data
DC 5
Zone 5
www.shapeblue.com
@CloudStackGuru
Physical Connectivity
POD 1
Hosts
PrimaryStorage
Secondary Storage
Management
Server(s)
MySQLDB(s)
Admins & Users
POD 2
POD n
Users
www
www.shapeblue.com
@CloudStackGuru
AWS Style L3 isolation – Massive Scale Simple Flat Network Each POD has a unique CIDR (Broadcast domain) Optional Guest Isolation via Security Groups Optional NetScaler Integration - Elastic IPs and Elastic
LB Optional Nicira NVP Integration
Basic Networking
www.shapeblue.com
@CloudStackGuru
Guest Networks isolated by VLANs / SDN Technologies Private and Shared Guest Networks Multiple Physical Networks Virtual Router for each Network providing:
DNS & DHCP Firewall Client VPN Load Balancing Source / Static NAT Port Forwarding
Advanced Networking
www.shapeblue.com
@CloudStackGuru
Effectively enables the deployment of multiple ‘Basic’ style networks which use Security Groups for isolation of VMs, but with each Network encapsulated within a unique VLAN (or SDN)
Enables the ‘stretching’ of Guest IP Address Space across multiple PODs
Security Groups in Advanced Zones
www.shapeblue.com
@CloudStackGuru
Basic Zone – Example IP Schema
L3 Switch
Host n
Host 1
POD 1192.168.0.0/2
6Res IPs 0.10 -
0.29Hosts 0.30 –
0.62
VR
DHCPDNSUserdataMetadata
VMVM
VMVM
L2 Switch
www
Host n
Host 1
POD 2192.168.0.64/26
Res IPs 0.73 - 0.92Hosts 0.93 - 0.126
Guest IPs:172.16.2.2- 3.254
GW 172.16.2.1
L2 Switch
Host n
Host 1
POD 3192.168.0.128/26
Res IPs 0.138 – 0.147Hosts 0.149 – 0.190
Guest IPs:172.16.4.2 - 5.254
GW 172.16.4.1
L2 Switch
Guest IPs:172.16.0.2 -
1.254GW 172.16.0.1
www.shapeblue.com
@CloudStackGuru
Advanced Zone – Example IP Schema
L3 Switch
www
Host n
Host 2
POD 1 - XenServer
192.168.0.0/26Res IPs 0.10 -
0.29Hosts 0.30 –
0.62
Host 1
L2 SwitchVMb1
VRb VMb2
VRaVMa2
VMa1
VMa3Host n
Host 2
POD 2 - vSphere
192.168.2.0/23Res IPs 2.43 -
3.254Hosts 2.10 –
2.42
Host 1
L2 Switch
VMc3
VRc
VMc2
VMc1
Guest Networks10.1.1.0/24GW 10.1.1.1
Guest IPs 1.2 - 1.254
VLANs
VLANs
www.shapeblue.com
@CloudStackGuru
Demo
www.shapeblue.com
@CloudStackGuru
Any Questions ?
An Introduction to Apache CloudStack
Geoff HigginbottomCTO ShapeBlue
[email protected]: @CloudStackGuru