(app203) how sumo logic and anki build highly resilient services on aws to manage massive usage...

November 12, 2014 | Las Vegas, NV

APP203

Ben Whaley, Anki

Christian Beedgen, Sumo Logic

Introductions

Chasing Infinity

Obvious Versus Hard

Co-Founder & CTO Chief Architect

Applications

Internet of ThingsNetwork

Mobile

Search

Visualize

Predict

0

200,000

400,000

600,000

800,000

1,000,000

1,200,000

0

2,000

4,000

6,000

8,000

10,000

12,000

14,000

16,000

Ma

y-1

2

Jun-1

2

Jul-1

2

Aug-1

2

Sep-1

2

Oct-

12

No

v-1

2

De

c-1

2

Jan-1

3

Feb

-13

Ma

r-1

3

Apr-

13

Ma

y-1

3

Jun-1

3

Jul-1

3

Aug-1

3

Sep-1

3

Oct-

13

No

v-1

3

De

c-1

3

Jan-1

4

Feb

-14

Ma

r-1

4

Apr-

14

Ma

y-1

4

Jun-1

4

Jul-1

4

Aug-1

4

Sep-1

4

Oct-

14

GB per Day

Searches

AWS Infrastructure Lead Cloud Architect

In 2010, we knew that

success will look

something like this…

Just one typical Sumo Logic customer - 8x Variance!

Datacenter As An API!!!

A++++++++++++!! Will Buy Again

$ bin/receiver prod.service-registry.sumologic.com

Here We Are

In 2014

Deployment wide services

Ingest

Search

Internal tools

receiverhornetq-

forgeforge

cqsplitter

search

cloud collector

service

api

con-cierge

stream

katta

glass, ganglia

bill

mix

meta

configzoo-

keeperappvault org

rawhornetq-inbound

cocoa

bloom filter

analyticscsi

cqmerger

rework

view

autoview

depman

hornetq-internal

hornetq-metadata

nrt

Embrace Change Or Die

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 1 1 1 1

1 1 1 1 1

1 1 1 1 1

1 1 1 1 1

1 1 1 1 1

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 2 1 2 1 2 1 2 1 2

1 2 1 2 1 2 1 2 1 2

1 2 1 2 1 2 1 2 1 2

1 2 1 2 1 2 1 2 1 2

1 2 1 2 1 2 1 2 1 2

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

1 2 3 4

5 6 7 8

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 1

1 1

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 1 2 2 2

1 1 2 2 2

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

Index

1 3 4 1 3 4 2 3 5 2 3 5 2 3 6

7 7 5 8 5 8

1 3 4 1 3 4 2 3 5 2 3 5 2 3 6

7 7 5 8 5 8

7 7 5 8 5 8

5 8

5 8

5 8

6

6

6

Set[Customer], Set[Instance] Map[Instance, Set[Customer]]

http://bit.ly/awsevals

http://bit.ly/awsevals

(app203) how sumo logic and anki build highly resilient services on aws to manage massive usage...

Technology