prying the cloud open: dell crowbar & openstack · prying the cloud open: dell crowbar &...
Post on 02-Jun-2020
11 Views
Preview:
TRANSCRIPT
Prying the Cloud Open: Dell Crowbar & OpenStack Rob Hirschfeld (@zehicle), Principal Cloud Architect
Joseph B. George (@jbgeorge), Senior Cloud Strategist
July 2011, OSCON
Intersection of two major technology waves:
Operational Automation (DevOps)
Open Source Cloud (OpenStack)
Together, a practical approach to cloud scale
Manages elastic resources
Embraces constant change
Productizes best practices
July 20, 2011 Dell Cloud Solutions 2
Open Cloud Operations
Hyper-scale (1000s of servers) forced customers to change their core assumptions.
To operate large systems, customers
Embraced scale out design (inconsistency is OK)
Eliminated hardware redundancy (too expensive)
Shunned manual steps (too slow)
Lessons from Hyper-scale
July 20, 2011 Dell Cloud Solutions 3
Cloud servers forced customers to change their core assumptions.
To operate remote virtualized systems, customers
Embraced scale out design (to get elastic growth)
Lived with weak SLAs (that was all that was offered)
Worked around lack of physical access (not available)
July 21, 2011 4
Lessons from Public Clouds
Dell Cloud Solutions
Clouds demand significant operational and process controls
Operational decisions drive hardware and software decisions
We are finding ways to productize operations into best practices
July 20, 2011 Dell Cloud Solutions 5
Clouds require an Operational Focus
HW
SW
OPS
DevOps is an operational approach that automates system configuration and management.
To manage cloud systems, customers
Need to manage servers as groups
Must respond to rapid infrastructure changes
Have repeatable automated deployments
July 21, 2011 6
DevOps Addresses Challenges
Dell Cloud Solutions
The cloud market was highly fragmented
Amazon dominated but was not public domain
VMware was building on their enterprise base
Microsoft was taking the PaaS route
Many small players but no community projects
Service Providers could not agree on APIs
July 20, 2011 Dell Cloud Solutions 7
Missing Cloud Infrastructure
We needed Cloud Infrastructure that
Had support from major industry players
Was collaboratively developed without a single owner
Had an API that was Service Provider license friendly
Could be demonstrated to run at scale
Was built on open source components
Had global reach and support
July 20, 2011 Dell Cloud Solutions 8
Community Cloud Infrastructure
July 20, 2011 Dell Cloud Solutions 9
OpenStack!
July 20, 2011 Dell Cloud Solutions 10
Making an OpenStack Cloud
HW
SW
OPS
? Operations
? Expertise
Resources ?
OPS
SW
July 20, 2011 Dell Cloud Solutions 11
Dell OpenStack Cloud Solution
HW
SW
OPS
“Crowbar”
CloudOps
Software
Services &
Consulting
Reference
Architecture
How DevOps is Different Images vs. Layers
TECHNICAL CONTENT AHEAD
July 20, 2011 Dell Cloud Solutions 12
$ $
Images vs. Layers: Overview
Images: Single Unit Layers: Stacked Pieces
July 20, 2011 Dell Cloud Solutions 13
Integrations + Applications +
Utilities + Operating System
Configuration
Operating System
Utilities
Application Bar
Application Foo
Integrations
Co
nfi
gu
rati
on
Images vs. Layers: Lifecycle
Images: Replacement Layers: Upgrade
July 20, 2011 Dell Cloud Solutions 14
I+A+U+O/S
Config
OS
U Bar v1
Foo I
Co
nfi
g
I+A+U+O/S
Config
I+A+U+O/S
Config
I+A+U+O/S
Config
OS
U Bar v2
Foo I
Co
nfi
g
Bar v2
Images vs. Layers: Details
Images
Like a Compiled Language
Early Binding
Tightly Coupled
Assembled as a package
1-Step Deployment
Big Storage Footprint
Cloned from “Golden Image”
Single Version
Layers
Like an Interpreted Language
Late Binding
Loosely Coupled
Assembled in parts
Multi-Step Deployment
Small Footprint (packages)
Setup per instance
Discrete Versions
July 20, 2011 Dell Cloud Solutions 15
Images vs. Layers: Mo’ Details
Images
Very Static Operations
Manual Setup
Low Entry / High Maintenance
Works well in Enterprise
Hardware Sensitive
Brittle
Typically: Windows
Layers
High Change Operations
Automated setup
High Entry / Low Maintenance
Works well in Cloud
Hardware Agnostic
Elastic
Typically: Linux
July 20, 2011 Dell Cloud Solutions 16
Images vs. Layers
Soup
Delicious!
Fast!
Premixed
Hard to customize
Hard to change
Hard to carry
Every batch is unique
Sandwich
Delicious!
Fast!
Flexible
Easy to customize
Configurable
Very portable
Components can be common
July 20, 2011 Dell Cloud Solutions 17
7/21/2011 Confidential 18
Cloud Deployments are Complex
Source: Ken Pepple
Crowbar has scripts that install the components of OpenStack Nova in a proven pattern that can be customized after the fact.
There are lot of pieces, but they share many elements!
July 20, 2011 Dell Cloud Solutions 19
CloudOps for OpenStack
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova API
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I C
on
fig
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova DB
I
Co
nfi
g
OS
U
Nova Cntrl
I
Co
nfi
g
OS
U
Dash Board
I
Co
nfi
g
OS
U
Nagios
I
Co
nfi
g
OS
U
Crowbar Chef
I
Co
nfi
g
Plus interconnections are highly complex and dynamic
July 20, 2011 Dell Cloud Solutions 20
CloudOps for OpenStack
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova API
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I C
on
fig
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova Node
I
Co
nfi
g
OS
U
Nova DB
I
Co
nfi
g
OS
U
Nova Cntrl
I
Co
nfi
g
OS
U
Dash Board
I
Co
nfi
g
OS
U
Nagios
I
Co
nfi
g
OS
U
Crowbar Chef
I
Co
nfi
g
7/21/2011 Confidential 21
No soup for you!
Crowbar Deep Dive
WARNING: TECHNICAL CONTENT AHEAD
July 20, 2011 Dell Cloud Solutions 22
$ $
Mission: “A Zero Touch Cloud Installer” Servers in boxes to full function cloud in under 2 hours
Fast & Flexible Bare metal install including BIOS & RAID config Users can choose how their system is configured (“barclamps”)
DevOps Embracing Ongoing Operations Model (DevOps for Clouds) Leverages & Wraps Opscode Chef
Open Not specific to OpenStack – Dell using for other Apps Not restricted to Dell hardware Apache 2 licensed
July 20, 2011 Dell Cloud Solutions 23
What is Crowbar?
July 20, 2011 Dell Cloud Solutions 24
Crowbar Stages of Deployment D
ell
“C
row
ba
r”
Op
s M
an
ag
em
en
t
Core Components &
Operating Systems
Cloud
Infrastructure &
Dell IP Extensions
Physical Resources
APIs, User Access,
& Ecosystem
Partners
* Crowbar has potential to service other programs beyond OpenStack
Includes all the components required to implement an entire cloud infrastructure including ecosystems partners
Pluggable components deploy cloud infrastructure.
Allow for addition of Dell IP and expansion by the community services and customers
Can integrate with Dell existing products
Delivers basic data center services and required cloud infrastructure.
Provision bare-metal servers from box to cloud WITHOUT user intervention (other than racking/cabling and some minimal configuration questions) NOT EXCLUSIVE TO DELL HARDWARE
July 20, 2011 Dell Cloud Solutions 25
Crowbar = Install State Machine
July 20, 2011 Dell Cloud Solutions 26
Modular Design: Barclamps D
ell
“C
row
ba
r”
Op
s M
an
ag
em
en
t
Core Components &
Operating Systems
Cloud
Infrastructure &
Dell IP Extensions
Physical Resources
APIs, User Access,
& Ecosystem
Partners
* Crowbar has potential to service other programs beyond OpenStack
Crowbar
Deployer
Provisioner
Network RAID
BIOS IMPI
NTP
DNS Logging
Nova Swift Glace
Nagios Ganglia Dashboard
Compellent EqualLogic
July 20, 2011 Dell Cloud Solutions 27
Live Demo (placeholder)
July 20, 2011 Dell Cloud Solutions 28
Live Demo (placeholder)
In Conclusion,
July 20, 2011 Dell Cloud Solutions 29
Intersection of two major technology waves:
Operational Automation (DevOps)
Open Source Cloud (OpenStack)
Together, a practical approach to cloud scale
Manages elastic resources
Embraces constant change
Productizes best practices
July 20, 2011 Dell Cloud Solutions 30
Open Cloud Operations
July 20, 2011 Dell Cloud Solutions 31
OpenStack + Crowbar =
Questions? More info:
• http://Dell.com/OpenStack - White Papers & More!
• http://RobHirschfeld.com – Technical & Agile
• http://JBGeorge.net – Business & Marketing
top related