building the future of digital television and enterprise database management with mongodb at...

28
Swisscom Cloud Offerings – mongoDB as a Service Lukas Lehmann MongoDB Days Germany Munich, October 2015

Upload: mongodb

Post on 13-Apr-2017

647 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Swisscom Cloud Offerings – mongoDB as a ServiceLukas LehmannMongoDB Days GermanyMunich, October 2015

Page 2: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Agenda

• Managed Service Status Quo• Swisscom Application Cloud• Version 1.0 mainly VM based• Version 2.0 container based• Feature Requests• Case study IP TV

© S

wis

scom

Page 3: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Managed desires vs product based offering

Heterogeneous environment Homogenous environment

Different DesirableDifferentDifferent

OnePredefined

OneOne

OSSizes

Hardware profilesStorage backend ©

Sw

issc

om

Page 4: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

https://developer.swisscom.com

@Swisscom_Dev

Page 5: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Version 1.0October 2015

Page 6: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Big PictureCreate Service Process I

6

AppCloud User

Services Network

Cloud Foundry Network

Portal or CLI

Cloud Foundry

cf create service ent-mongodb

© S

wis

scom

Page 7: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Big PictureCreate Service Process II

7

AppCloud User

Services Network

Cloud Foundry Network

Portal or CLI

Cloud Foundry

Service Manager

cf create service ent-mongodb

© S

wis

scom

Page 8: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Big PictureCreate Service Process III

8

AppCloud User

Services Network

Cloud Foundry Network

Portal or CLI

Cloud Foundry

Service ManagerManagement Node 1

MMS  HTTP  ServiceChange config

cf create service ent-mongodb

© S

wis

scom

Page 9: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Big PictureCreate Service Process IV

9

AppCloud User

Services Network

Cloud Foundry Network

Portal or CLI

Cloud Foundry

Service ManagerManagement Node 1

MMS  HTTP  Service

Data Volume

MongoDB Node

MMS  Automation  Agent

Change config

Get config

MongoDB 1

cf create service ent-mongodb

- One MongoDB per VM spawn up by automation agent

© S

wis

scom

Page 10: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Detail View MongoDB Management 10

AppCloud User

Services Network

Cloud Foundry Network

Portal or CLI

Cloud Foundry

Service ManagerManagement Node 1

MMS  HTTP  Service

Data Volume

MongoDB Node

MMS  Automation  Agent

Change config

Get config

MongoDB 1

cf create service ent-mongodb

OpsManager setup

Data Volume

Management Node 1

MMS  HTTP  Service

MMS  DB  Primary

Management Node 2

MMS  DB  Sec.

Management Node 3

MMS  DB  Sec.

Monitoring  Agent

MongoDB Node

MMS  Automation  Agent

© S

wis

scom

Page 11: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Access MongoDB from Cloud Foundry11

AppCloud User

Services Network

Cloud Foundry Network

Portal or CLI

Cloud Controller

Service ManagerManagement Node 1

MMS  HTTP  Service

Data Volume

MongoDB Node

MMS  Automation  Agent

MongoDB 1

cf create service ent-mongodb

DEA

App              (Container)

App connects directly to service

Data Volume

MongoDB Node

MMS  Automation  Agent

MongoDB   2

© S

wis

scom

Page 12: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Service Broker functioncreate service mongodb

12

AppCloud User

Cloud Foundry Network

Portal or CLI

Cloud Foundry

Service Manager Management Node 1

MMS  HTTP  Service

Data Volume

MongoDB Node

MMS  Automation  Agent

Change config

Get config

MongoDB 1

cf create service ent-mongodb

- One MongoDB per VM spawn up by automation agent

Detail view creationCreates new standalone MongoDB on a free node

in current mms group config

Portal orCLI

Cloud Controller

Service Broker

MMS HTTP Service

MongoD

Create Service(HTTP) Create Service(HTTP)

© S

wis

scom

Page 13: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Service Broker functioncreate service mongodb

13

AppCloud User

Cloud Foundry Network

Portal or CLI

Cloud Foundry

Service Manager Management Node 1

MMS  HTTP  Service

Data Volume

MongoDB Node

MMS  Automation  Agent

Change config

Get config

MongoDB 1

cf create service ent-mongodb

- One MongoDB per VM spawn up by automation agent

Detail view bindingCreates a new user in db with native mongodb command

Portal orCLI

Cloud Controller

Service Broker

MMS HTTP Service

MongoD

Create Service(HTTP) Create Service(HTTP)

Bind service (HTTP) Bind service (HTTP)

© S

wis

scom

Page 14: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Backup functionality

18.1

0.15

14

Services Network

Service Manager

Management Node 1

MMS  HTTP  Service

Data Volume

MongoDB Node

MongoDB

Trigger backup executionNew snapshot

OpsManager 2.0 preview

Management Node 2

Backup  Deamon

Take snapshot(sync Opslog )

Automation  Agent

Sync data toexternal S3 Storage

© S

wis

scom

Page 15: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Restore functionality15

Services Network

Service Manager

Management Node 1

MMS  HTTP  Service

Trigger restore executionRestore snapshot

OpsManager 2.0 preview

Management Node 2

Backup  Deamon

Download andrestore snapshot

Data Volume

MongoDB Node

MongoDB

Automation  Agent

Sync data fromexternal S3 Storage

© S

wis

scom

Page 16: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Version 2.0(Future concept)

Page 17: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Automation Agent in Docker Container17

AppCloud User

Services Network

Cloud Foundry Network

Portal or CLI

Cloud Foundry

Service Manager

Management Node 1

MMS  HTTP  Service

Vol. Service. 1

Flocker node

Create new Container/w automation agent

Update config

Flocker API

Agent Docker

Automation  Agent(service container)

Vol. Service 4

Vol. Service 3

Vol. Service 2

Vol. Service 1

Attach volume to VM (container)

Get config

Container previewAutomation agent

in Container

cf create service ent-mongodb

© S

wis

scom

Page 18: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Why Containers?

• Less overhead• More efficiency• More flexibility• Move towards generic solution

© S

wis

scom

Page 19: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Custom Feature Request

• Swisscom and others? as Customer need the following features toimplement the solution:

– Ops Manager Backup/Restore function via API like described in slidesabove

– Official support from MongoDB for containers i.e. Docker– Less hostname dependency

– Supporting ability for service discovery

© S

wis

scom

Page 20: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Mongo DB onSwisscom TV 2.0

Markus ZehnderMongo DB Days GermanyMunich, October 2015

Page 21: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Agenda

• What is Swisscom TV 2.0• Requirements• Why we chose Mongo DB• Architecture• QA

© S

wis

scom

Page 22: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Swisscom TV 2.0 in brief

• Over 250 channels, including 100 HD channels• Replay available for 7 days on over 250 channels• Record as many programms as you like, even those

Shown in the past• Video Store with subscription option• Over 800k Customers described• “Best Multiscreen TV Service” in 2015

© S

wis

scom

Page 23: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Swisscom TV 2.0 in the cloud

Access  your  recordings   from  any  device  whenever  you  like  and  wherever  you  are

Secure  data  in  Switzerland

Open  and  flexible  platform

Cloud  recordingRecord  as  many  programmes  as  you  like  simultaneously

Environmentally-­‐friendlybox  with  a  longer   service  life ©

Sw

issc

om

Page 24: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Requirements

• EPG, VOD, Radio, etc. metadata need to be stored• Pictures are needed as well in the DB• Metadata size > 10GB, Pictures size > 20GB• Data is generally static, but can change several times a day• Amount of devices which will access the data > 1Mio.• DB needs to be highly available

© S

wis

scom

Page 25: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Why we chose Mongo DB

• Data is unstructured, so hard to store it in a relational DB• It is easy to transform the XML Data(Source) into JSON-Format• Mongo DB is extremly fast in reading data• Open Source• Easy to scale horizontally

© S

wis

scom

Page 26: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

© S

wis

scom

Page 27: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Summary

• Technical View– Data flexibility– Easy to scale horizontally– Error resilient cluster functionality

• Get used to MongoDB – Easy2go installation docs– Great pre-sales/consulting team

© S

wis

scom

Page 28: Building the future of Digital Television and Enterprise Database Management with MongoDB at Swisscom

Q & A

© S

wis

scom