Crowbar 2 update

Osonoi@Dell

Agenda

• Crowbar overview

• Openstack,DevOps, Chef, Puppet, Ruby on Rails

• What is a Crowbar

• Crowbar architecture

• Demo

• Crowbar 2

• What's new

• Upstreaming

• Community Support & Contents

Speaker Introduction

• Yasushi Osonoi

•1989 ~ 2006 Intel

•2007 ~ 2010 OpenDream

Linux Foundation

•2010 ~ Dell

OSDL Linux

World

Advisory

board

Drupal

Japan

Japan Linux

Symposium

Moblin

Japan

Linux

associat

ion

MeeGo

Dell Techcenter community

Communities

Openstack

• Cloud management software

• Over 80 countries

• Over 100 companies

• Over 7000 developpers

• Cloud OS mainly for IaaS

• Amazone EC2/S3/EBS/VPC compatible

• OpenStack Mission

“To produce the ubiquitous open source cloud computing platform that will meet the needs of public and private cloud providers regardless of size, by being simple to implement and massively scalable.”

Openstack History

• 2005 Rackspace development start

• 2010.3 Rackspace make cloud software to open source

• 2010.5 NASA Nebula opensource

• 2010.6 Rackspace, NASA established OpenStack

• 2010.10 Austin release

• 2011.2 Bexar Release

• 2011.4 Cactus Release

• 2011.9 Diable Release

• 2012.4 Essex release

• 2012.9 Folsom

• 2013.4 Grizzly Release

• 2013.10(?) Havana

• Release Naming

• https://wiki.openstack.org/wiki/ReleaseNaming

Openstack Component

• Swift - Object Storage

• Glance - catalog and repository for virtual disk images

• Nova - provides virtual servers upon demand

• Horizon - provides a modular web-based user interface for all the

OpenStack services

• Keystone - provides authentication and authorization for all the OpenStack

services

• Quantum - provides "network connectivity as a service" between interface

devices managed by other OpenStack services (most likely Nova)

• Cinder - provides persistent block storage to guest VMs

Chef

• Chef is a systems and cloud infrastructure automation framework that makes it easy to deploy servers and applications to any physical, virtual, or cloud location, no matter the size of the infrastructure.

http://docs.opscode.com/chef_overview.html

Chef relies on abstract definitions

(known as cookbooks and recipes)

Cookbooks and receipes are written

in Ruby

Chef Cookbooks

• Cookbooks are used to tell Chef how each node in your organization should be configured.

OpsCode Community

http://community.opscode.com/cookbooks

Puppet

• Puppet is IT automation software that helps system administrators manage infrastructure throughout its lifecycle, from provisioning and configuration to patch management and compliance

DevOps

• DevOps (a portmanteau of development and operations) is a

software development method that stresses communication,

collaboration and integration between software developers and

information technology (IT) professionals.[1] DevOps is a response

to the interdependence of software development and IT operations.

It aims to help an organization rapidly produce software products

and services

Wikipedia: http://en.wikipedia.org/wiki/DevOps

Layer Vs. Image

Crowbar Overview • What is a Crowbar

• Crowbar is a platform for server provisioning and deployment from bare metal.

• Crowbar was originally developed by the Dell CloudEdge Solutions Team as

an OpenStack installer.

• Features

• Server discovery

• Firmware upgrades

• Operating system installation via PXE Boot

• Application development via Chef

Please Find Dell Crowbar at GitHub

Crowbar Overview • Current Release

The release currently under development is Pebbles, which will be the base of our next Openstack Grizzly and Cloudera Hadoop solutions. It is based on the Crowbar 1.x codebase.

Crowbar 2.0

Latest release

Detail to be shown later

Crowbar Archtecturer(1.*)

• Barclamp is the description of a component that can be

deployed on the target node. It generally consists of:

o Rails components (i.e. models, controllers, views, etc.)

o Contents component (Chef components cookbooks, data bags etc.)

o Executables (e.g. a CLI interface)

o Meta-data describing the barclamp and its dependencies

o Documentation

o Tests

Barclamps

Crowbar Screen

• Admin screen

Crowbar Screen

• Node Dashboard

Crowbar Screen

• Discovery

Crowbar Screen

• Edit proposal for each Barclamps

Crowbar Screen

• Edit proposal for each Barclamps

Crowbar Screen

• Barclamps

Crowbar

• Video

Crowbar 2 architecture

Crowbar 2

1. simplify our use of Chef and eliminate Crowbar requirements in our Opscode Chef recipes.

A.reduce the initial effort required to leverage Crowbar

B.opens Crowbar to a broader audience (see Upstreaming)

What does “enable upstream recipes” mean? Not just fishing for

community goodness!

http://robhirschfeld.com/2012/07/05/upstreaming/

Crowbar 2

2. provide heterogeneous / multiple operating system deployments. This enables:

A.multiple versions of the same OS running for upgrades

B.different operating systems operating simultaneously (and deal with heterogeneous packaging issues)

C.accommodation of no-agent systems like locked systems (e.g.: virtualization hosts) and switches (aka external entities)

D.UEFI booting in Sledgehammer

3. strengthen networking abstractions

A.allow networking configurations to be created dynamically (so that users are not locked into choices made before Crowbar deployment)

B.better manage connected operations

C.enable pull-from-source deployments that are ahead of (or forked from) available packages.

Crowbar 2

4.

improvements in Crowbar’s core database and state machine to enable

A.larger scale concerns

B.controlled production migrations and upgrades

5. other important items

A.make documentation more coupled to current features and easier to maintain

B.upgrade to Rails 3 to simplify code base, security and performance

C.deepen automated test coverage and capabilities

Crowbar 2 info

• http://crowbar.github.io/home.html

• 2.0 archtecture

• https://github.com/crowbar/crowbar/wiki/Architecture

• Crowbar 2.0 objectives

http://robhirschfeld.com/2012/07/06/crowbar-2-0-objectives-scalable-

heterogeneous-flexible-and-connected/

http://www.youtube.com/watch?v=wtUNJfrHU1Q&feature=youtu.be

http://www.youtube.com/watch?v=U05apbOqq0k&feature=youtu.be

http://www.youtube.com/watch?v=Bo4V6Dax3LU

http://www.youtube.com/watch?v=xL-2eefqH8s

http://crowbar.sync.in/crowbar2-core?

Crowbar @ Dell Techcenter

• DellTechCenter.com

• And find Crowbar

Crowbar

In Japanese