build a killer app ecosystem - big data everywhere

Build a Killer App Ecosystem with Docker

on Apache MesosPaul Otto

paul@OttoOps.com @potto007

But wait…

How is this connected to big data??

B E R K E L E Y D ATA A N A LY T I C S S TA C K ( B D A S )

What We Needed

Elastic scaling

High availability

Multi-tenancy

Easy deployment

The Problem

Choose One

OR

Focus on Meta

One Size Does Not Fit All

Containers!

Docker on Mesos

Multiple Frameworks

MapR-FS

Continuous Deployment

GitHubJenkins Docker Build

Docker Private Registry

Jenkins Deploy

JobMarathon Mesos

Cluster

Why Mesos?

Evolution of Infrastructure

Dedicated Servers Datacenter

Evolution of Infrastructure

Virtualization Datacenter

• more machines to manage • lower performance • utilization problem still

unsolved

Evolution of Infrastructure

Mesos Datacenter (One Pool of Resources)

Mesos Architecture

Mesos Architecture

Why Use Mesos?

• allows services to scale

• think about services, not machines

• fault tolerant - no SPoF

Thank You!

Paul Ottopaul@OttoOps.com

@potto007

www.OttoOps.com