hyperscale computing, enterprise agility with mesosphere

© 2016 Mesosphere, Inc. All Rights Reserved.

HYPERSCALE COMPUTING, ENTERPRISE AGILITY

Mesosphere Datacenter Operating System

V6

“We wanted people to be able to program for the datacenter just like they program for their laptop”

— Benjamin Hindman,Apache Mesos PMC Chair

© 2016 Mesosphere, Inc. All Rights Reserved. 3

THE FUTURE IS ALREADY HERE...

...IT’S JUST NOT EVENLY DISTRIBUTED- WILLIAM FORD GIBSON


HYPERSCALE COMPUTING FOR MAINSTREAM ENTERPRISES

Definitive Apps

Enabling Technology

Unit of Management

NEW FORM FACTOR FOR DEVELOPING AND RUNNING APPS

Datacenter Operating System (DC/OS)

MAINFRAME

Data Processing

RISC Processor

Partition (LPAR)

PHYSICAL (x86)

ERP, CRM

X86 HW & OS

Physical Server

VIRTUAL

Web Client / Server

Hypervisor(Partitioning)

Logical Server (VM)

HYPERSCALE

Modern Distributed Apps:Big Data, Web Scale, IoT

Datacenter Operating System (Aggregation)

Logical Datacenter


MICROSERVICES ARCHITECTURETraditional Architecture

Small number of large processes with strong inter-dependencies

Many functions in a single process

Siloed teams

REST

API

s

Microservices Architecture

Cross-functional teams creating new microservices without interdependencies

Cross-functional teams organized around capabilities

Scales individually

Each element of functionality defined as “microservices”

Scales monolithically

Hyperscale Computing Properties


NOT JUST CONTAINERS...

Private Copy

Shared

User Code

Libraries

Virtual Processor

Operating System

Physical Processor

Virtual Machines Containers

User Code

Libraries

Virtual Processor

Operating System

Physical Processor

Start time 30-45 seconds < 50 ms

Stop time 5-10 seconds < 50 ms

Workload density 10 - 100x1x



CONTAINER ORCHESTRATIONHyperscale Computing Properties

REST

API

sDependencies Between Microservices Running Multiple Microservices-based Apps


BIG DATA BUILT-IN

Who is next?

New capabilities to meet unprecedented expectations

Predictive user interface

Product recommendations

Real-time ads



Functions & Logic

Microservices (in containers)

Big Data + Analytics Engines

Streaming

Batch

Machine Learning

Analytics

Search

Time Series

SQL / NoSQL

Databases

HYPERSCALE MEANS: MODERN APPLICATIONS


IMPLICATIONS OF HYPERSCALE

VIRTUAL HYPERSCALE

Workload pooling

Deploying apps

Business continuity

Ensuring performance

● Partition physical servers to run multiple VMs

● Place some VMs in server pool (e.g., DB, App Svr, Web Svr)

● Restart VMs in right order

● Increase VM size; clear host of other VMs

● Aggregate a logical DC to run multiple distributed systems

● Launch hundreds of microservices; service discovery automation

● Scale distributed microservices programmatically

● Ensure microservices are fault tolerant and self-healing


DETAILED ENTERPRISE DC/OS FEATURESDC/OS Mesosphere Enterprise DC/OS

Feat

ures

Open source platform for modern apps Production-grade solution for mission-critical apps

Supp

ort

Pric

ing

Scalability No limits No limits No limitsProduction provenExtensible architectureValidated, tested architecture with best practicesIntegrated solution (with service discovery, monitoring, etc.)Guided on-premise and cloud installer Powerful CLI and GUI with integrated troubleshooting/monitoringDistributed services app storeTask log truncationNon-disruptive DCOS upgradesHealth monitoring of system componentsDistributed DNS Server for service discovery HAPersistent volumes and external volumesDistributed load balancerOrchestrated rolling service upgradesMulti-user identity and authentication with RBACIdentity management integration (Active Directory/LDAP)Access logs and permission management UIEmergency patchingTraining and help Knowledge base Knowledge base Professional in-depth trainingSupport options Community Community Standard, Premium

List price Open source Open source Standard: $2,000Premium: $2,750

Apache MesosBattle proven distributed system kernel

Core

1.7

Engine Troubleshooting/monitoring


THE DATACENTER OPERATING SYSTEM



● Provides infrastructure primitives to modern distributed apps

● Orchestrates distributed applications against available core within the datacenter (physical, virtual, or cloud-based)

DC/OS

...Agent 1 Agent 2 Agent 3 Agent n

Server VM Cloud VM

...Microservices

FROM SERVER TO DATACENTER-SCALEPC / Server Operating System

● Provides common services for applications

● Assigns application processes to available cores within the server

OS (e.g., Windows, OSX)

...Core 0 Core 1 Core 2 Core n

Server

Process



MODERN APPS RUNNING ON DC/OS

Abstraction & AggregationServers VMs Azure, AWS, or GCP

Single logical datacenter

App Functions Big Data + Analytics Engines

Data Storage Message QueueBig Data Processing

... ... ...... Two-level

scheduling

Container OrchestrationStateless and Stateful Services

Operations & Service Quality AutomationReactive, Self-Healing Infrastructure

Turnkey setup & operations


MESOSPHERE DATACENTER OPERATING SYSTEM (DC/OS)

1. Production proven

2. Extensible architecture for all modern apps

3. Simplified operational model

4. Hybrid cloud

Key benefits


1. PRODUCTION PROVEN: DC/OS KERNEL APPLIES LESSONS FROM EARLY INNOVATORS

Tupperware/BistroBorg/Omega Apache Mesos

ProprietaryProprietary Open Source (Apache License)

~2007~2001 2010+

Production-proven Web Scale Cluster Managers

● Built at UC Berkeley AMPLab by Ben Hindman (Mesosphere Co-founder) ● Built in collaboration with Google to overcome some Borg Challenges● Production proven at scale +80K hosts @ Twitter


2. EXTENSIBLE ARCHITECTURE DC/OS BUILT ON THE HIGHLY FLEXIBLE MESOS KERNEL

DC/OS kernel was designed to be flexible

● Aggregate all resources in the datacenter for modern apps

● Intentionally simple to enable massive scalability

● Handles different types of tasks - long running, batch & real-time

● Two-level scheduler architecture enable multiple scheduling logics (a key challenge at Google)

● Extensible to work with new technologies

Dow

nloa

ds

Mesos daily downloads, July 2014 - November 2015

Gaining massive adoption


2. EXTENSIBLE ARCHITECTURE DC/OS EXTENSIBILITY FAR BEYOND “COMPETITION”

Next Gen Application Support

Supported Infrastructure

On Premise

Public Cloud

Core Technology Mesos(Production proven)

Swarm(Under development)

Kubernetes(Nascent)

KubernetesRedhat

OpenShift Cloud FoundryDocker

DatacenterMesosphere

DC/OS

Big Data (e.g., Hadoop, Spark, Storm)

Distributed Services(e.g., Kafka, Cassandra)

Extensible Architecture

Cloud Foundry(Production proven)

PaaS

Containers(e.g., Docker, rKt)

Strong Capability

Some Capability

Not Supported

Kubernetes(Nascent)

OpenShift(Production proven)


3. SIMPLIFIED OPERATING MODEL FOR DEVELOPERS AND OPERATORS

Developers:Program against a single form factor

● Run PaaS, containers, and distributed apps at will

● Simplified continuous integration & deployment with existing dev toolchain

● Experiment with new technologies with less risk

OperatorsRun a single form factor

● Single commands against the datacenter to install common frameworks, or scale them up or down

● Pool distributed systems (frameworks) with different resource usage patterns

● Zero planned downtime upgrades


4. HYBRID CLOUD IS DC/OS FOR ON PREMISES OR CLOUD SERVICE? - YES

● Application portability

● Identical developer and operator experience

● Growing set of cloud services on DC/OS


MESOSPHERE MILESTONES & CUSTOMER OUTCOMES


MESOSPHERE: BORN OF THE HYPERSCALE ERA

Mesosphere is well funded$50M by Tier 1 investors: Andreessen Horowitz & Khosla Ventures

2009 2013 2014 2015

First Mesosphere DC/OS lighthouse customersTens of thousands of containers launched

Expanded OperationsSan Francisco (2013)Hamburg (2014)New York (2015)

Mesosphere FoundedKey engineering leaders from Twitter, Airbnb - companies behind open-source tech

Apache Mesos built at UC Berkeley● Core technology from AMPlab

● Corporate large-scale production deployments begin (e.g., Apple, Twitter, Salesforce)

Growing Ecosystem & DC/OS General AvailabilityNow a breeze to install modern app services (e.g., Hadoop, Spark, Cassandra)


DELIVERING OUTCOMES FOR ENTERPRISESMESOSPHERE DATACENTER OPERATING SYSTEM (DC/OS)

DEVELOPER AGILITY

HYPERSCALE OPERATIONS

DATA AGILITY

Highly Efficient & Scalable IT

Distributed Framework Pooling

Container Orchestration

Cont. Integration/Delivery

Developer Cloud

Self-Service Container Runtime

Big Data

Internet Of Things

Reactive applications


● NYC-based Hedge Fund● $25 Billion AUM● Uses a variety of technological

methods for its trading strategies: ● Artificial Intelligence● Machine Learning● Distributed Systems

TWO SIGMACUSTOMER HIGHLIGHT

Challenges

● Two Sigma OPS struggled with developer demands for agile real-time analysis

● Already explored various IaaS & PaaS solutions

Mesosphere Solution

● After successful consulting services engagement determined Mesosphere was the right fit

● Compelling reason to move fast; Agility/Performance/Scalability

● 100s of servers moving to 1000s in next 6 months



MICROSOFT AZURE CONTAINER SERVICE (ACS)CUSTOMER HIGHLIGHT

Challenges

● Needed a production grade native container service that would work on premises and on azure, at massive scale

● Must easily integrate with Azure CI/CD, app management and auto scaling infrastructure

● Microsoft and Linux friendly technology

Mesosphere Solution

● After independent evaluation, MS team determined Mesos/Mesosphere was the right fit

● Currently integrating Mesosphere DC/OS as a core technology for Azure Container Service



LEADING NORTH AMERICAN BANKCUSTOMER HIGHLIGHT

Challenges

● 400 developers submitting jobs to Jenkins for CI/CD builds experienced sizable delays in task completion due to Jenkins job queueing

Mesosphere Solution

● Customer wanted to replicate the eBay use case1 of running CI builds for eBay's applications in Mesos with Docker containers

● Mesosphere DC/OS allowed Customer to move from an enterprise Continuous Integration solution to open source as Marathon provides equivalent HA functionality

● One of North America's leading diversified financial services companies

● Provides banking, wealth management, insurance and capital markets services on a global basis

DEVELOPER AGILITY

1www.ebaytechblog.com/2014/04/04/delivering-ebays-ci-solution-with-apache-mesos-part-i/


VERIZONCUSTOMER HIGHLIGHT

Larry Rau from @Verizon with @flo Launching 50,000 containers in seconds with @mesosphere #DC/OS

DATA AGILITY

Challenges

● Verizon needed infrastructure that could handle the volume and speed of data that its users generate across video services and mobile apps

● Verizon was seeking to improve automation, scalability and efficiency when deploying applications, services and big data infrastructure

Mesosphere Solution

● Mesosphere DC/OS allowed Verizon to quickly launch new products and services while reducing the IT requirements in their datacenters

● Chose Mesosphere DC/OS for hybrid cloud capabilities, to move from AWS to Verizon’s private datacenter

https://twitter.com/Verizon



https://twitter.com/flo



https://twitter.com/mesosphere



https://twitter.com/hashtag/DCOS?src=hash




RECENT PARTNERSHIP ANNOUNCEMENTS


MESOSPHERE DC/OS:HYPERSCALE COMPUTING, ENTERPRISE AGILITY

Hybrid Infrastructure (Compute, Storage, Networking)

Modern Apps(Big Data built-in)

The Modern Cloud Stack

Containers & Microservices Orchestration

Mesosphere DC/OS(Mesos, Marathon, Datacenter Operations) HYPERSCALE OPERATIONS

Continuous Integration & Continuous Delivery

Common CI/CD Tools on Mesosphere DC/OS(GitHub, Jenkins) DEVELOPER AGILITY

Analytics & Database● Streaming, Pipelines, Search, ML● Relational, NoSQL, Data Warehouses

Mesosphere Infinity(Spark, Kafka, Cassandra, Akka) DATA AGILITY


APPENDIX


DC/OS FRAMEWORKS PROVIDE APPLICATION OPERATIONAL LOGIC AND BEST PRACTICES- Multi-tenancy with different versions

- Simple deployment & upgrade

i.e Cassandra, if a node fails, try to restart it on the same server nodes to reduce rebuild time, if not possible, create a new node, but do not allow more than one new node at a time for performance

i.e HDFS Journal and Name roles should be together on the same physical server, while Data node should NOT be on the same physical node

- Simplified Installation of all app components

- Advanced node and role placement

- Easily scale resources up and down

- Configuration update across the cluster

- Software upgrade including rolling upgrades with checkpoints and recovery points

- Graceful Migration for Infrastructure Maintenance

- Health checks and advanced failure monitoring

- Application specific recovery logic

- Backup and restore

- Resiliency: uptime/data protection


DC/OS

32

Application Orchestration

Container Orchestration

Job Scheduling

Containerization

Resource Management

Provisioning

CloudFoundry, Heroku, OpenShift

Kubernetes, Marathon, Swarm, Fleet, Lattice, ECS

Chronos, Kubernetes

Docker, Rkt, Garden, Mesos

Mesos

Vagrant, Otto, Puppet, Chef, Ansible, Salt

Machine Management AWS, Azure, GCE, OpenStack, vSphere, VirtualBox, Fusion

MESOSPHERE DATACENTER OPERATING SYSTEM (DC/OS)



Distributed Systems Kernel (Mesos)

MESOSPHERE DC/OS ACCELERATES ENTERPRISES TO A MODERN CLOUD STACK WITH THE DATACENTER FORM FACTOR

Big Data + Analytics EnginesMicroservices (in containers)

Streaming

Batch

Machine Learning

Analytics

Functions & Logic

Search

Time Series

SQL / NoSQL

Databases

Modern App Components

Distributed systems kernel to abstract resources

Killer “apps” ecosystem

Cont Integration/Cont Delivery

Framework “app” architecture to consistently run on top of kernel

User Interface (GUI & CLI)

Core system services (e.g., distributed init, cron, service discovery, package mgt & installer, storage)

Any Infrastructure (Physical, Virtual, Cloud)


DC/OS BRINGS HYPERSCALE TO MAINSTREAM ENTERPRISES

Mac OS Android Datacenter OS (DC/OS)

Desktop Apps (e.g., Safari, Adobe Photoshop, Itunes)

GUI (Aqua)/CLI

Personal computer

- App store - OpenGL - Advanced UI gestures

BSD Unix

Mobile Apps (e.g., Spotify, Evernote, WhatsApp)

Android GUI

Mobile devices

- Telephony Manager- Battery management- External storage support

Linux

Distributed systems (e.g., Docker, Spark, Hadoop, Cassandra)

GUI/CLI (DC/OS CLI)

Full Datacenter / Cloud

- Container orchestration- Distributed batch jobs- Persistent storage mgmt

Apache MesosKernel

Applications

Form Factor

User Interface

OS Services(highlights)

Computing for the masses Mobile apps for the masses Datacenter-scale apps for mainstream enterprises

Benefits


CHALLENGES OF HYPERSCALEChallenges in building modern cloud applications Microservices and interactions at Hailo

Design & deploy

Monitoring & operations

● Developer access to production-like environments

● Service discovery between large number of services

● Complex deployment and rollback of services

● Ensuring API contract not broken between versions of various services

● Monitoring, tracing and root cause analysis to ensure end-to-end performance across large number of services

● Low utilization of multiple distributed systems

Service quality & continuity

● Fault tolerance and healing (in an always-on environment)

Security ● Secrets (key) management across large number of services

● Incident detection and remediation


ANATOMY OF A MODERN APP

App Functions & Logic Big Data + Analytics Engines

Data Storage Message QueueBig Data Processing

X

X X... ... ... ... X

Anything else

Two-level scheduling via frameworks

DC/OS - AggregationVMs Azure, AWS, or GCPServers

Single logical datacenter via distributed systems kernel

DC/OS - Container Orchestration


MESOSPHERE DC/OS, SIMPLIFYING THE OPERATION OF NEXT GENERATION TECHNOLOGIES, AT MASSIVE SCALE

Services & Containers

Mesosphere DC/OS

Any InfrastructureBuild Apps once in DC/OS, and run it anywhere

Runs distributed apps anywhere as simply as running apps on your laptop.

Your favorite services, container formats, and those yet to come.