cleaning up the kitchen: migrating to enterprise chef from open source - chefconf 2015

62
Cleaning up the Kitchen

Upload: chef

Post on 09-Aug-2015

48 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

Cleaning up the Kitchen

Page 2: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablytheCleaning up the Kitchen

Page 3: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Lessons• Be Patient/Be Hungry• Look outward– Ask Community– Ask Chef

• You can’t please all the people• Know your constraints and work within them

Page 4: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Recommendations • Have a focused team - Configuration Management does

not just happen• Focus on the Workflow• Incent your community to work together• Define how your collective organization should use

roles/environments/data bags• Educate!!• Involve Your Friends at Chef

Page 5: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

http://www.slideshare.net/AaronBlythe/

Page 6: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Aaron Blythe

http://www.meetup.com/DevOps-Kansas-City/

Page 7: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015
Page 8: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

Founded in 1979

Page 9: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015
Page 10: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015
Page 11: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

2011 2012 2014 20152013

Journey With

Page 12: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

20112012 2014 20152013

Page 13: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

2011 2014 20152013

2012

Page 14: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

http://www.pxleyes.com/photography-picture/50ccc14f7f012/Fork-Off.html

Page 15: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Page 16: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

ON

Page 17: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

January 2012 – Late March 2012

Page 18: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

2011 2012 2014 2015

2013

We 50+

Page 19: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Which Chef Server?

What is the admin password?

How is this being backed up?Where did this cookbook come from?

Is this the original cookbook or a fork?

Why is this in production, but not in Staging?

Is this wiki page up to date with which Server to connect to?

Can we double bootstrap it?? ? ? ?

Page 20: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Page 21: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Page 22: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

• Value Proposition of Chef:– Infrastructure as Code• Repeatable/Testable Deployments• Consistency - Staging Like Production

Page 23: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

In Kansas City… One Night Only

• http://www.meetup.com/DevOps-Kansas-City/Adam Jacob!!

Page 24: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Later that week…

OpsInfra

Page 25: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Later that Month…

"I have never been in a room with that many system engineers that were all smiling, almost giddy. It was as if we all knew a secret."

Page 26: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Page 27: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Paul Edelhertz - Interview• Senior VP Customer Ops – Chef• Former CEO – Empath, Inc. (bought by

Navigant)

Page 28: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Paul Edelhertz - Interview• Ability to persuade through writing is

becoming a lost art– Make the message short– State exactly how I feel – Different mediums but repeat the message over

and over to many people

Page 29: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Chef – “The List”

• Fuel the love of Chef• Make it easy to be successful• Give organizations reasons to buy• Be their favorite company to work with• Speed matters, be disruptive

Page 30: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

We Believe…• A minimal number of associates need to directly touch

nodes (approaching zero)• These tools matter – improve the lives of our users

• Tools should be hardened - so that we can find the root cause and drive corrective action

Page 31: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Identity• Tools Team

• Culture Team

Page 32: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Page 33: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Page 34: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Page 35: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Workflow

Step 1:Source Code

Step 2:?????

Step 3:Production(Profit!!!)

Page 36: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Page 37: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Page 38: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Page 39: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

RFC’s

Page 40: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Conway’s Law – Educate who you need to

2 classes * 15 attendess

* Re-delivering to 15-30/month

* Over 1 year__________________200+

https://learn.chef.io/index.html

Page 41: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

$20/Class

Page 42: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

2011 2012 20152013

2014

Provide the Platform

Page 43: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Migration Workshop• 1st rule of teaching:– Control all variables other than the concept you

are focusing on

Page 44: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Current State of Cookbooks• https://wiki.ucern.com/display/ChefEcosystem/Booksh

elf• 129 Cookbooks listed

– 87% of cookbooks have a metadata.rb. (112/129)– 79% of cookbooks have a cookbooks folder (102/129)– 56% of cookbooks have a Rakefile. (72/129)– 33% of cookbooks have a Berksfile. (42/129)– 30% of cookbooks have a Vagrantfile. (39/129)– 24% of cookbooks have a pom.xml. (31/129)

Page 45: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Good Migrations

Page 46: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Success Engineer

Page 47: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Stephen Lauck

“Usually I show up and I am helping companies go from 0 to 20. You are clearly going from 40 to 60. Keep me in the loop, because I want to continue to be part of your success. We all know the companies that will be able to move fast will be the companies that remain successful in the market.”

Page 48: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

• Push Jobs• Analytics• OpenStack• SuperMarket

Page 49: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Push Jobs• Value: Orchestration • Review: Overall positive, have-to-have feature

for most of our teams• Drawbacks: Push Jobs 1.x is not very mature

or feature rich. We have seen issues with Networking.

Page 50: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Analytics• Value: Compliance/Auditing for non-coders• Review: Interesting need to see latest version.

We get asked about creating this functionality regularly… Future features look promising.

• Drawbacks: Early versions search slightly confusing. Filtering was not working right so very busy.

Page 51: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

OpenStack Integration• Decision (At this point): Heat Templates

• Still really want to see chef-provisioning mature

Page 52: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

SuperMarket • Value: Helps lock down our pipeline• Review: Decided that we need a better pipeline

first.• Drawbacks: Early on was not ready for RHEL,

hacked something together, but need to revisit. Authorization model not there for an Enterprise (CCLA not applicable).

Page 53: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

2011 2012 2014

20152013

March toward Continuous Integration/

Continuous Delivery

Page 54: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Where are we now?• We are at about the 1 year mark of a focused

well oiled system• Have over 3000 Chef nodes involved with

100’s of separate systems/sub-systems• Over 400 user accounts created on the server

Page 55: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Wat ta do about CD?• Jenkins – Workflow Plugin• Go.cd• Chef Delivery• All the wonderful things we have seen at the

booths here

Page 56: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Blocker – Sensitive Flaguser 'zabbix' do shell '/sbin/nologin' comment 'Zabbix Monitoring System' supports manage_home: true node.run_state['zabbix_password'] = SecureRandom.base64(36) password node.run_state['zabbix_password'] gid 'zabbix' unless platform_family?('windows') sensitive true action [:create, :lock] endend

Page 57: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Centralized vs. Decentralized

Page 58: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Open Source• 6 associates contribute to core Chef• Another 15 or so contribute to Cookbooks in

SuperMarket

Page 59: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

2011 2012 2014 20152013

Journey With

Page 60: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Lessons• Be Patient/Be Hungry• Look outward– Ask Community– Ask Chef

• You can’t please all the people• Know your constraints and work within them

Page 61: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

Recommendations• Have a focused team - Configuration Management does

not just happen• Focus on the Workflow• Incent your community to work together• Define how your collective organization should use

roles/environments/data bags• Educate!!• Involve Your Friends at Chef

Page 62: Cleaning Up the Kitchen: Migrating to Enterprise Chef From Open Source - ChefConf 2015

@ablythe

What do you think? @ablythe

[email protected] http://www.slideshare.net/AaronBlythe/ Community room next session 3-4PM