operations at soundcloud · intro: soundcloud who i am and where i work . engineer in production...

23
You own it, you run it Operations at SoundCloud

Upload: others

Post on 20-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

You own it, you run it

Operations at SoundCloud

Page 2: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

a cloud full of sounds

135M tracks, 12M artists, 175M listeners

300+ employees

no ops team

Intro: SoundCloud Who I am and where I work

Page 3: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

Engineer in Production Engineering

(platform, monitoring, availability)

Intro: me Who I am and where I work

Page 4: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

Where we came from

Where we are today

Why we did it

How you can do it

Intro: Agenda

Page 5: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

Where we came from

Page 6: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

2008-2010 Rails monolith, "app team", ops team

2011/2012 some services, some teams, "platforms team"

2013-2015 semi-autonomous teams, ~100 services

A brief history of Engineering at SoundCloud

Page 7: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

Today

~400 services

feature teams and collectives

shared components & libraries

continuous delivery

Page 8: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

Where we are today

Page 9: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

simplified

Org chart

Page 10: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

every

feature • service • codebase

is owned by a team

Ownership You build own it, you run it

Page 11: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

owners are on call for what they own

groups of teams work together to reduce load

remove alerts • write documentation

On Call

Page 12: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

avoid shared infrastructure

be flexible

don't duplicate work

Shared Components

Page 13: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

Why we did it

Page 14: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

autonomy

predictability

velocity

Delivery get more done, consistently

Page 15: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

learn something new every day

no pure specialists

internal mobility

Personal growth

Page 16: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

simple

resilient

operable

Better systems

Page 17: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

How you can do it

Page 18: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

basic automation

openness

pride

trust

Prerequisites

Page 19: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

testing & deployment

on-call

provisioning

dependencies

Expanding ownership

Page 20: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

internal moves

escalation paths

documentation

tooling

Checks & Balances

Page 21: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

learn

improve

commiserate

Postmortems

Page 22: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

.

soundcloud.com

Berlin • London • Los Angeles • New York • San Francisco

Slides: bit.ly/gids17-soundcloud

We're hiring: soundcloud.com/jobs

Page 23: Operations at SoundCloud · Intro: SoundCloud Who I am and where I work . Engineer in Production Engineering (platform, monitoring, availability) Intro: me Who I am and where I work

.

soundcloud.com

Berlin • London • Los Angeles • New York • San Francisco

www.modsummit.com

www.developersummit.com