openstack overview for austin cloud user group

OpenStackOpen source software to build public and private clouds

Austin Cloud User Group, December 2010

Anne Gentle anne.gentle@rackspace.com Chuck Thier chuck.thier@rackspace.com

Rackspace Hosting OverviewFounded in 1998

• Publicly traded on NYSE: RAX• 100,000+ customers

$735M USD ($61.3B Yen) revenue in prior year• Dedicated Managed Hosting• Cloud Infrastructure & Apps (Servers, Files, Sites,

Email) Primary focus on customer service ("Fanatical

Support")• 3,000+ employees• 9 datacenters in the US, UK and Hong Kong• 60,000+ physical servers

What is OpenStack?

+

+Community

Community

+

+Community

Technology

creating open source software to build public and private clouds

Software to provision virtual machines on standard hardware at massive scale

Software to reliably store billions of objects distributed across standard hardware

OpenStack Compute

OpenStack Object Storage

creating open source software to build public and private clouds

OpenStack Mission

‣ “To produce the ubiquitous open source cloud computing platform that will meet

the needs of public and private cloud providers regardless of size, by being

simple to implement and massively scalable.”

Why is OpenStack important?

‣ Open eliminates vendor lock-in

‣ Working together, we all go faster

‣ Freedom to federate, or move between clouds

OpenStack Founding Principles

‣ Apache 2.0 license (OSI), no paid ‘enterprise’ version

‣ Open design process, 2x year public Design Summits

‣ Publicly available source code repository

‣ All community processes documented and transparent

‣ Commitment to drive and adopt open standards

‣ Modular design for deployment flexibility via APIs

Architect for in-house

Re-Architect for service provider

Architect once Deploy anywhere

No Standards

With OpenStack

OpenStack History

Rackspace Decides to Open

Source Cloud Software

March

NASA Open Sources Nebula

Platform

May June July

OpenStack formed b/w

Rackspace and NASA

Inaugural Design Summit in Austin

20

10

20

05

Rackspace Cloud

developed

OpenStack History

OpenStack launches with 25+ partners

July

First ‘Austin’ code release with 35+

partners

October November February

First public Design Summit in

San Antonio

Second ‘Bexar’ code release

planned

20

11

NASANASAFounding members operate at

massive scale

OpenStack Community Today

+

People

OpenStack Community Today

HOW TO: Turn Racks of Standard Hardware Into a

Cloud with OpenStack

Start with an open, scalable platform

OpenStack Compute OpenStack Object Storage

CLOUD OS

OpenStack Image Service

User Control Panel

TicketingSystem

NetworkManagement

MonitoringSystems

Host Server Management

ECOSYSTEM

OpenStack Compute OpenStack Object Storage

CLOUD OS

OpenStack Image Service

Add 3rd party tools from the ecosystem

User Control Panel

TicketingSystem

NetworkManagement

MonitoringSystems

Host Server Management

AccountBilling

Admin CLITools

Live ChatSupport

AccountManagement

ECOSYSTEM

PUBLIC CLOUD

OpenStack Compute OpenStack Object Storage

CLOUD OS

OpenStack Image Service

User Control Panel

TicketingSystem

NetworkManagement

MonitoringSystems

Host Server Management

ECOSYSTEM

Admin ControlPanel

Dept. Accounting Chargeback

UserManagement

Enterprise SoftwareIntegration Systems

PRIVATE CLOUD

OpenStack Compute OpenStack Object Storage

CLOUD OS

OpenStack Image Service

Integrate with existing enterprise systems

OpenStack Compute DetailsSoftware to provision virtual machines on standard hardware at massive scale.

Asynchronous eventually consistent

communication 

REST-based API

Horizontally and massively scalable

Hypervisor agnostic: support for Xen ,XenServer, Hyper-

V, KVM, UML and ESX is coming Hardware agnostic: standard hardware, RAID not required

OpenStack Compute Key Features

API: Receives HTTP requests, converts commands to/from API format, and sends requests to cloud controller

Cloud Controller: Global state of system, talks to LDAP, OpenStack Object Storage, and node/storage workers through a queue

User Manager

ATAoE / iSCSI

Host Machines: workers that spawn instances

Glance: HTTP + OpenStack Object Storage for server imagesOpenStack Compute

Server Groups1 GigE

ConnectivityDual Quad CoreRAID 10 Drives

Public Network

Private Network(intra data center)

Management

Example OpenStack Compute Hardware

(other models possible)

OpenStack Object Storage DetailsSoftware to reliably store billions of objects distributed across standard hardware

REST-based API Data distributed evenly throughout system

Hardware agnostic: standard hardware, RAID not required

OpenStack Object Storage Key Features

No centraldatabase

Scalable to multiple petabytes, billions of objects

Account/Container/Object structure (not file system, no nesting) plus Replication (N copies of accounts, containers, objects) 

5 Zones2 Proxies per 25

Storage Nodes10 GigE to

Proxies1 GigE to

Storage Nodes24 x 2TB Drives

per Storage Node

Public Internet

Example OpenStack Object Storage

Hardware

Load Balancers (SW)

Example only – many configurations possible

Hardware Selection

‣ OpenStack is designed to run on industry standard hardware with flexible configurations

‣ Compute

‣ X86 Server

‣ Storage flexible (Local, SAN, NAS)

‣ Object Storage

‣ X86 Server (other architectures possible)

‣ Do not deploy with RAID (can use controller for case)

OpenStack Release Process: Four Phases

Design*

Development QA Release

*Design phase and Design Summit occur every other release, 2x per year

OpenStack Releases

Cactus:April 2011

Bexar: February

2011Austin:

October 2010

• OpenStack Object Storage production-ready• OpenStack Compute developer preview, ready for testing and proofs of concept

• OpenStack Compute ready for enterprise private cloud deployments and mid-size service provider deployments• Enhanced documentation• Easier to install and deploy

•OpenStack Compute ready for large service provider scale deployments

We are

here!

OpenStack Compute ‘Austin’ Release Features

‣ Multi-hypervisor support: KVM, QEMU, User-Mode Linux, Xen and XenServer

‣ Introduces official OpenStack API, while maintaining EC2 API option

‣ New image registry and delivery service, called the Glance project

‣ Support for two network models on compute nodes: VLANs with DHCP and flat with either static IP pools or DHCP

‣ Addition of base scheduling service

‣ Implements WSGI to create a standard API layer with reusable components

‣ Support for user-friendly naming

‣ Refactored ORM and networking code for simpler code that is easier to understand

‣ Addition of SQLAlchemy Database toolkit so users can leverage existing SQL infrastructure

Object Storage ‘Austin’ Release Features‣ Addition of a stats system that produces per-account

hourly summaries of system usage

‣ Ability for users to set ACL’s and grant public access to containers

‣ Support for API access to account and container metadata

‣ Rate limiting was extended to allow requests to be slowed down and support stair stepped rate limits based on container size

‣ WSGI support was improved and pulled into middleware

Join Us‣ Team: Mark@openstack.org Jim@openstack.org Bret@openstack.org

Jonathan@openstack.org Anne@openstack.org Lauren@openstack.org Stephen.spector@openstack.org - contact us!

‣ Developers & Testers

‣ http://launchpad.net/openstack

‣ http://wiki.openstack.org

‣ Writers: http://wiki.openstack.org/Documentation

‣ Blog: http://openstack.org/blog

‣ Twitter: http://twitter.com/openstack

‣ Jobs: http://openstack.org/jobs