Nir Kriss

Head of ProductionEngineering

Capacity challenges at Outbrain

Serving a huge traffic

Traffic scale of M/minDynamic content

Low latency SLA

100% service with a minimum cost

5000+ physical servers3 DCs. Cloud & On premise hybrid env. - Work is in process

Capacity planning assumes a DR event

How to calculate our capacity?

Load test

Continuous deployment

23-Jun-16 Terror attack in Germany - ~15%

15-Jul-2016 France terror attack - ~25%

Unplanned events

18-Sep-2016 Bomb in Manhattan - ~50%

28-Nov-2016 Ohio shooting - ~25%

Unplanned events

12-Jun-2016 Orlando Shooting

Event started US morning

18%13%

18%13%

17%30%

80%

Capacity

DR Capacity

Day2day

peak

DC1

DC2

DC3

?

Capacity planning

What is the probability for a DR + A news event?

Remember Hurricane Sandy?..

24-Jun-16 - UK voted toleave the EU:

30%

Regular day Brexit dayEU daytime EU daytime

24-Jun-16 - UK voted toleave the EU:

10%Only

Regular day Brexit dayUS daytime US

daytime

25% Hillary Clinton fainted

3 X TV debates~40%

Trump rushed from stage due to a suspected gunman40%

15%

LowHigh

100%Low

530%High

Outbrain is hiring :-)