agile enterprise devops and cloud - interop 2010 nyc

80
Copyright © 2010 Opscode, Inc - All Rights Reserved 1 John Willis VP of Services [email protected] twitter.com/botchagalupe Thursday, October 21, 2010

Upload: chef-software-inc

Post on 15-Jun-2015

1.252 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 1

John WillisVP of [email protected]/botchagalupe

Thursday, October 21, 2010

Page 2: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 2

IT Management PodcastDevopsCafeCloudCafe

Thursday, October 21, 2010

Page 3: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 2

IT Management PodcastDevopsCafeCloudCafe

Thursday, October 21, 2010

Page 4: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 3

The Agile EnterpriseCloud and Devops

Thursday, October 21, 2010

Page 5: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 4

Agile Infrastructure

• Operating at Cloud Scale • Ephemeral Infrastructure • Frictionless Infrastructure• Self Service Operations

Thursday, October 21, 2010

Page 6: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 5

Agile Operations

• Products not Projects• Walk on Walk off Projects• Velocity of Innovation• Continuos Delivery• Enterprise Lean Startup

Thursday, October 21, 2010

Page 7: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Devops

Thursday, October 21, 2010

Page 8: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Devops: You Should Care?

Short Answer:

It’s a way to make your business

more agile

Thursday, October 21, 2010

Page 9: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Devops: You Should Care?

Short Answer:

It’s a way to make your business

more agile

It’s about the business stupid

Thursday, October 21, 2010

Page 10: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved

Devops is a cultural and professional movement!

8Thursday, October 21, 2010

Page 11: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Ah-ha! Ka-ching!Wall o

f C

on

fusio

n

OpsDev

Ah-ha!

Anti-Pattern

Thursday, October 21, 2010

Page 12: Agile Enterprise Devops and Cloud - Interop 2010 NYC

DevOps

Wall of iononfusC

Dev Ops

Thursday, October 21, 2010

Page 13: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Ah-ha! Ka-ching!

Application Lifecycle

Devops is About Velocity

Thursday, October 21, 2010

Page 14: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 12

Devops

• Culture• Automation• Measurement• Sharing

Thursday, October 21, 2010

Page 15: Agile Enterprise Devops and Cloud - Interop 2010 NYC

So  What’sYourCultureDog

Thursday, October 21, 2010

Page 16: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Culture Before Tools

• Leadership • Behavior• Communication• Passion• Having Fun

Thursday, October 21, 2010

Page 17: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Testing as a SkillTesting as a CultureQuality as a Culture

Testing to just get by

Testing to create value or

Thursday, October 21, 2010

Page 18: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Leadership

Thursday, October 21, 2010

Page 19: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Devs Ops

Leadership

Thursday, October 21, 2010

Page 20: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Leadership

Thursday, October 21, 2010

Page 21: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Behavior

Thursday, October 21, 2010

Page 22: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Behavior

Thursday, October 21, 2010

Page 23: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Behavior

Thursday, October 21, 2010

Page 24: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Communication

Thursday, October 21, 2010

Page 25: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Communication

Thursday, October 21, 2010

Page 26: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Communication

Thursday, October 21, 2010

Page 27: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Communication

Thursday, October 21, 2010

Page 28: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Passion

Thursday, October 21, 2010

Page 29: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 27

Cloudy Operations and Devops

Thursday, October 21, 2010

Page 30: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 28

Till the Meatball Hits the Fan

Thursday, October 21, 2010

Page 31: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 28

Till the Meatball Hits the Fan

I did not have “cloudy” meatballs with that provider

Thursday, October 21, 2010

Page 32: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Automa4on

Thursday, October 21, 2010

Page 33: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved

Infrastructure is Hard!

30Thursday, October 21, 2010

Page 34: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 31

FullyAutomated Infrastructure

ReleaseControl

Orchestration

Dispatcher

Provisioning

Deploy

Config management

OS boot/install

Artifact repository

Build

CI Server Issue tracker

SCM Repository

Model

Asset inventory

Host naming

Identity

CMDBMonitoring

Events

Trending Reporting

Trending

Workflows

Resources

Topology

Configuration

Code

Sources

Scheduler

Thursday, October 21, 2010

Page 35: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 31

FullyAutomated Infrastructure

ReleaseControl

Orchestration

Dispatcher

Provisioning

Deploy

Config management

OS boot/install

Artifact repository

Build

CI Server Issue tracker

SCM Repository

Model

Asset inventory

Host naming

Identity

CMDBMonitoring

Events

Trending Reporting

Trending

Workflows

Resources

Topology

Configuration

Code

Sources

Scheduler

Thursday, October 21, 2010

Page 36: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 32

What Do Developers

Want?

Thursday, October 21, 2010

Page 37: Agile Enterprise Devops and Cloud - Interop 2010 NYC

For Developers...

• Self Service Operations

• The infrastructure is the application (and vice versa)

• Minimize Bottlenecks

• The “Right” Tools

Thursday, October 21, 2010

Page 38: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 34

What Does Operations Want?

Thursday, October 21, 2010

Page 39: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 35Thursday, October 21, 2010

Page 40: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Operations• Say “Yes”.

• You never liked rack and stack that much anyway.

• You have never been more critical.

• Just get out of the way.

http://covers.oreilly.com/images/9780596007836/lrg.jpg

Lean into it appears courtesy of Cliff Moon, of Dynomite fame: http://twitter.com/moonpolysoft

Thursday, October 21, 2010

Page 41: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Automate Everything

• Builds• Tests• Deploys• Integration•Orchestration

Thursday, October 21, 2010

Page 42: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Infrastructure as Code

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Thursday, October 21, 2010

Page 43: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Infrastructure as Code

‣ Version control

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Thursday, October 21, 2010

Page 44: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Infrastructure as Code

‣ Version control

‣ Process control

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Thursday, October 21, 2010

Page 45: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Infrastructure as Code

‣ Version control

‣ Process control

‣ Application control

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Thursday, October 21, 2010

Page 46: Agile Enterprise Devops and Cloud - Interop 2010 NYC

The 10th Floor Test

Can you automatically restore your services if you:

1. Toss a random server out the window2. Toss a random engineer out the window

Thursday, October 21, 2010

Page 47: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved

Cloudy Devops

40Thursday, October 21, 2010

Page 48: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved

Cloudy Devops

40

Provisioning

Thursday, October 21, 2010

Page 49: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved

Cloudy Devops

40

Provisioning

Configuration

Thursday, October 21, 2010

Page 50: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved

Cloudy Devops

40

Provisioning

Configuration

Systems Integration

Thursday, October 21, 2010

Page 51: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 41

Nodes

opslb01

opsws01opsws02

opsdm01opsds01opsds02

Provisioning

Thursday, October 21, 2010

Page 52: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 42

Roles

loadbalancerwebserverdbmasterdbslave

Configuration Management

Thursday, October 21, 2010

Page 53: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 43

Load Balancer

Web Server Web Server

DB Master

DiskDisk

DB Slave DB Slave

Disk

Recipes

haproxyapache2myssql

Systems Integration

Thursday, October 21, 2010

Page 54: Agile Enterprise Devops and Cloud - Interop 2010 NYC

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

Thursday, October 21, 2010

Page 55: Agile Enterprise Devops and Cloud - Interop 2010 NYC

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

Thursday, October 21, 2010

Page 56: Agile Enterprise Devops and Cloud - Interop 2010 NYC

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

Thursday, October 21, 2010

Page 57: Agile Enterprise Devops and Cloud - Interop 2010 NYC

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

Thursday, October 21, 2010

Page 58: Agile Enterprise Devops and Cloud - Interop 2010 NYC

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

opsws01

Thursday, October 21, 2010

Page 59: Agile Enterprise Devops and Cloud - Interop 2010 NYC

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

opsws01 opsws02

Thursday, October 21, 2010

Page 60: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Systems Integration

Thursday, October 21, 2010

Page 61: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Systems Integration

Thursday, October 21, 2010

Page 62: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Systems Integration

Thursday, October 21, 2010

Page 63: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Systems Integration

Thursday, October 21, 2010

Page 64: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 46

Load Balancer

Web Server Web Server

DB Master

DiskDisk

DB Slave DB Slave

Disk

Fully Automated InfrastructureProvisioning Configuration Integration

Thursday, October 21, 2010

Page 65: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved 47

Sharable Infrastructure

Thursday, October 21, 2010

Page 66: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Metrics

Measurement

Thursday, October 21, 2010

Page 67: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Measure Everything

• Performance Data• Process Data• People Data•Huristics

Thursday, October 21, 2010

Page 68: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Continuos Improvement

Thursday, October 21, 2010

Page 69: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Old School

•Change•Incident•TTR/TTD

Thursday, October 21, 2010

Page 70: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Sharing

Thursday, October 21, 2010

Page 71: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Thinking that secrecy

makes you better

Anti-Pattern:

Thursday, October 21, 2010

Page 72: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Share Everything

• Share Metrics• Share Ideas• Share Stories•Give Developers Access• Allow Operations to Leverage

Technology

Thursday, October 21, 2010

Page 73: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Case Studies

• Animoto• Flightcaster• Kaching• Shopzilla

Thursday, October 21, 2010

Page 74: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Thursday, October 21, 2010

Page 75: Agile Enterprise Devops and Cloud - Interop 2010 NYC

A Period of Combinatorial Innovation

Thursday, October 21, 2010

Page 76: Agile Enterprise Devops and Cloud - Interop 2010 NYC

A Period of Combinatorial Innovation

• Abstract and fault tolerant components

Thursday, October 21, 2010

Page 77: Agile Enterprise Devops and Cloud - Interop 2010 NYC

A Period of Combinatorial Innovation

• Abstract and fault tolerant components

• Integrated network accessible services

Thursday, October 21, 2010

Page 78: Agile Enterprise Devops and Cloud - Interop 2010 NYC

A Period of Combinatorial Innovation

• Abstract and fault tolerant components

• Integrated network accessible services

• Unlimited infrastructure

Thursday, October 21, 2010

Page 79: Agile Enterprise Devops and Cloud - Interop 2010 NYC

Copyright © 2010 Opscode, Inc - All Rights Reserved

Industry Shifts

57

Be bold-and mighty forces will come to your aidBasil King

Thursday, October 21, 2010

Page 80: Agile Enterprise Devops and Cloud - Interop 2010 NYC

P

Stakes are high

Thursday, October 21, 2010