operating the hyperscale cloud

23

Upload: open-stack

Post on 14-May-2015

1.998 views

Category:

Technology


6 download

TRANSCRIPT

Page 1: Operating the Hyperscale Cloud
Page 2: Operating the Hyperscale Cloud

Into cloud since 1999

Principal Cloud Solution

Architect at Dell

Based in DCS, the

hyperscale solutions

group

Lead in Dell’s work with

Azure, Joyent, and

Eucalyptus

Page 3: Operating the Hyperscale Cloud

It’s Open, Capable, and Affordable

Dell Leadership in Community

• First hardware solutions vendor

• Active community participation

• Solutions now being offered

Working with Rackspace, Opscode,

Equinix and others

Solution Available NOW

• Hyperscale whitepaper

• Reference Architecture

• “Crowbar” bare metal installer

• Hardware & Services

• with Rackspace Cloud Builders

Page 4: Operating the Hyperscale Cloud

We started building an

OpenStack installer,

then, we discovered something

much more important.

Page 5: Operating the Hyperscale Cloud

AP

I C

lie

nts

O

ps

In

fra

str

uc

ture

Hypervisor (KVM,

Xen, etc)

Nova

VM Mmgt.

Amazon API Compatibility

Operations

Mgmt.

Operating Systems (Ubuntu, RedHat, CentOS, Windows, etc)

Swift

Obj. Mgmt.

Pa

rtn

er

Ec

os

ys

tem

Pa

rtn

er

Ec

os

ys

tem

VM mgmt

Orchestrate

Templates

Provisioning

Billing

Aggregate

Charging

Thresholds

Portals

User Mgmt.

Delegation

VM Mgmt.

Monitoring

Status

Health

Alerts

Network

Monitoring

Metering

Console

Security

Security

& Perform.

Identity

IP Inspect

Log Monitor

Physical Infrastructure: Servers & Networks

Crowbar

Chef

LDAP

Nagios

Glance

Image Mgmt.

OpenStack Cloud API

Dell’s Destination

for OpenStack

Page 6: Operating the Hyperscale Cloud

Build a cloud installer

• <4 hours from box to cloud without Internet

• Enable complete refresh from RAID & BIOS up

• Deploy multiple components in parallel

• Grow to production scale

• Ship-ready ASAP

Page 7: Operating the Hyperscale Cloud

A Cloud Installer

A way to deploy the taxonomy

Technical

• Discovery Engine

• Hardware Configuration (BIOS)

• Imaging State Machine

Process

• Pluggable Components

• Cloud Deployment Logic

• Cloud Maintenance Model

Op

s

O/S

Cloud

Physical

APIs

Page 8: Operating the Hyperscale Cloud

Two Sides

of Cloud

Cloud = Ops

CloudOps

SW

HW

OPS

Ecosystem

+API

Ops

Black Box

Op

s

O/S

Cloud

Physical

APIs

Page 9: Operating the Hyperscale Cloud

NOT ABOUT

• Selecting technology

• An end state

• A single product

IS ABOUT

• Process innovation

• Business acceleration

• Service

Cloud is always ready,

never finished.

Page 10: Operating the Hyperscale Cloud

Ecosystem

+API

Ops

Black Box

Clouds have 2 sides:

1) A public facing API and

2) A hidden elastic infrastructure

Page 11: Operating the Hyperscale Cloud

APIs provide the smallest usable

“surface area”

• Creates resource abstraction

(cloud is infinitely elastic)

• Enables standards

• Limits provider’s exposure

Ecosystem exists beyond the API

• Creates a cloud market

• Targeted use cases & usability

• Frees the cloud provider to

focus on scale

Ecosystem

+API

Ops

Black Box

Page 12: Operating the Hyperscale Cloud

Inside clouds should

seem to be a

• perfectly performing,

• strictly partitioned and

• totally elastic resource pool.

To the API user, it does not

matter if the inside is ugly,

inefficient, or inelegant

Except, of course, that it

does matter a great deal to

the cloud operator.

Ecosystem

+API

Ops

Black Box

Page 13: Operating the Hyperscale Cloud

We have capable hardware &

software, the real question is how are

we going to operate it as a service?

SW

HW

OPS

Page 14: Operating the Hyperscale Cloud

We’ve been calling this CloudOps

Different mindset to infrastructure

• Software is constantly changing

• Fluid resources instead of servers

• Manual touch is poison

“Automate or Die!”

Ultimately, all the rules for operating the data center become encoded as automation software.

Page 15: Operating the Hyperscale Cloud

Opscode Chef Server based

• Classic DevOps tool

• Crowbar deploys using Cookbooks & Recipes

• General Community Scripts

Flexible (not prescriptive)

• Pluggable modules (Barclamps)

• Expected to be site specific

Agile (iterative)

• repeatable & highly scalable

Deploy, Fix, Redeploy, Repeat!

Page 16: Operating the Hyperscale Cloud

Op

s M

an

ag

em

en

t

Operating Systems

Cloud

Infrastructure

Physical

Resources

APIs & User

Access

Crowbar drives an Ops Model to deploy

components at all layers of the cloud taxonomy.

Page 17: Operating the Hyperscale Cloud

Apache 2 license

Release pending field trials

Working with collaboration

partners including Rackspace,

Citrix and Opscode

To be Site Validated

• Via DOSS customers

• Working with partners

Released as an independent

project to be submitted for

inclusion in OS at next design

conference

Page 18: Operating the Hyperscale Cloud
Page 19: Operating the Hyperscale Cloud

Operational

Ownership

Don’t wait for all the

king’s horses and

consultants to put your

cloud back together

again, but…

Asking for help is OK.

Page 20: Operating the Hyperscale Cloud

Simple APIs

reduce the ways that consumers

can stress the system making

the scale challenges more

predictable.

Efficiency based

financial incentives

customers will dramatically

modify their consumption if you

offer rewards that better match

your black box’s capabilities.

Page 21: Operating the Hyperscale Cloud

Automated processes & verification

ensures that changes and fixes can propagate at scale while errors are self-correcting.

Frequent incremental rolling adjustments

prevents the great from being the enemy of the good so that systems are constantly improving (learn more about “split testing”)

Page 22: Operating the Hyperscale Cloud

Passion for operational simplicity

Complexity translates into increased risk and reduced agility

Hunger for feedback & root-cause knowledge

The only thing more frustrating than fixing a problem at scale, is fixing the same problem multiple times.

Page 23: Operating the Hyperscale Cloud

More Reading?

• RobHirschfeld.com

• Dell.com/OpenStack

• Hyperscale white paper

More Action?

• Dell OpenStack Starter Solution (DOSS)

• Crowbar collaboration

More Dialog?