the state of trove - meetupfiles.meetup.com/1709331/the state of trove - april 2016.pdfopenstack...

26
The State of Trove Chicago Cloud Computing Meetup April 12, 2016 Amrith Kumar, CTO, Tesora

Upload: others

Post on 20-May-2020

21 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

The State of TroveChicago Cloud Computing Meetup

April 12, 2016Amrith Kumar, CTO, Tesora

Page 2: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

What’s this presentation about?

• What’s OpenStack

• What’s OpenStack Trove and Tesora DBaaS Platform

• What databases are supported

• What capabilities are supported

• Trove architecture

• Getting started

• Learning more

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup2

Page 3: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Who am I?

• A contributor to OpenStack Trove (since ~Icehouse)

– A member of the Trove core team

• Wrote the book on Trove

– Along with Doug Shelley (also of Tesora)

• Contact information

– Amrith Kumar ([email protected])

– On IRC ‘amrith’

• Catch me on #openstack-trove or #openstack-dev

– http://www.tesora.com

– For more information: [email protected]

– We’re hiring: [email protected]

• Tweet along with this presentation

– @tesoracorp

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup3

Page 4: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Some “warm-up” questions

• How many of you have used OpenStack?

• How many of you have used OpenStack Trove?

• What databases do you use in your company?

• How many of you have used cloud services from Amazon

– How many of you have used Amazon RDS?

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup4

Page 5: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Why DBaaS?

• Let’s look at some changes

– In the IT landscape

– In the application development landscape

• And how DBaaS is the emerging solution for a lot of companies

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup5

Page 6: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Today’s Database Challenges

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup6

“I just don’t

understand these

developers...”

“I only need it for

a couple of weeks”

“I’ll just use AWS”

“I need my

environment NOW”

“I need a NoSQL DB

for my app to scale”

“I have to release it

next month or else”

Developer IT Guy

Page 7: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Today’s Database Challenges

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup7

“These Ops guys don’t get it...”

“We have no idea what they are putting on the

public cloud”

“I know that they are putting our

customer data at risk”

“Why can’t they just use Oracle?”

“My budget and team aren’t

getting any bigger”

“We need time to do it right”

Developer IT Guy

Page 8: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

A Solution: Database as a Service

• The delivery of database software &

related storage “as-a-service”

• Available on-demand, without any

hardware or software installation

or configuration

• A fully managed service maintained &

administered by the service provider

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup8

Page 9: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Amazon is demonstrating the importance of DBaaS

• DynamoDB was the fastest growing service in AWS history in 2012

– Werner Vogels, Amazon CTO, AWS Blog June 2012

• Redshift is now the fastest growing AWS service ever

– Werner Vogels, Amazon CTO, The Register, April 2015

• 45% of Amazon customers have implemented and are expanding use of RDS

– Jeffrey Hammond, Forrester Blog, September 2013

• AWS database business currently on a $1 billion revenue run rate

– Andy Jassy, the SVP of AWS - TechCrunch, October 2015

• Amazon’s #1 hiring focus – 84 open positions in DBaaS in November 2015

– Deutsche Bank Markets Research - NetworkWorld, November 2015

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup9

Page 10: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

But, what if …

• You aren’t on Amazon’s cloud?

– Private cloud (in your own datacenter)

– You are a cloud service provider operating your own cloud

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup10

Page 11: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

What is OpenStack

The OpenStack Mission: to produce the ubiquitous Open Source Cloud

Computing platform that will meet the needs of public and private

clouds regardless of size, by being simple to implement and massively

scalable.

OpenStack is open source, openly designed, openly developed by an

open community.

https://wiki.openstack.org/wiki/Main_Page

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup11

Page 12: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

OpenStack Trove Mission Statement

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup12

The OpenStack Open Source Database as a Service Mission:

To provide scalable and reliable Cloud Database as a Service provisioning functionality for both relational and non-relational database engines, and to continue to improve its fully-featured and extensible open source framework.

https://wiki.openstack.org/wiki/Trove

Page 13: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

What is OpenStack Trove?

• Provisioning

– Launching a new database instance

• Complex Database Topologies

– Clustering, Replication

• Automation

– Backup & Restore, Failover, Resizing, Cluster Scaling

• Multiple Database Technologies, Common API’s

– Relational, Non-Relational, … (mostly FOSS)

• Management Interface

– CLI, REST API, Web based UI

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup13

Page 14: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Complete Database Lifecycle Management

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup14

Manage• Manage schemas

• Create replicas for

scale & availability

• Backup/restore

Provision• On demand

• Wide DB selection

• Clusters & single

instances

Tune• Manage log files

• API’s to tune fleets of servers,

not just single instances

• Sane defaults

Secure• Automated patch management

• Users/permissions

• Restricted root access

Page 15: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

A word about Tesora

• Tesora, the Trove company

• Leading contributor to Trove

• Makers of Tesora “DBaaS Platform”

– Enterprise product based on Trove

– Additional capabilities

– Additional datastores

– Support and Services

• Located in Boston and Toronto

– We’re hiring

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup15

Page 16: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

OpenStack and Tesora DBaaS Platform releases

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup16

• An OpenStack release every 6 months

• A Tesora DBaaS Platform release every 3 months• One coincides with the

OpenStack release, and• One between

OpenStack releases

Next two releases

Page 17: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Multi-database – support for 13 different databases

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup17

SQL NoSQL

Page 18: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Trove in a Nutshell

• Database as a Service for OpenStack

• API’s for both development

and operations

• Self service database provisioning

• Full database lifecycle management

• Multi-database support

• Both Relational and NoSQL

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup18

Page 19: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

A typical OpenStack Service

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup19

Some service

Service API

REST Endpoint

Component Service 2

Component Service 1

Component Service 3Persistent State

Message Bus

Page 20: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

The Trove Architecture

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup20

Glance Storage

Guest ImageOperating System

Database Software

Trove Guest Agent

Trove

Trove API

Trove Conductor

Trove Task Manager

Nova

Cinder

Swift

Neutron

Keystone

Glance

Application

Nova Instance

Operating System

Database Software

Trove Guest Agent

Storage

Page 21: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

The data plane and the management plane

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup21

Page 22: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Datastore-agnostic code in Trove

Controller and Dashboard

Datastore specific code isolated

to guest agents

Trove Multi-Datastore Architecture

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup22

Trove Controller

Trove Dashboard (Horizon)

Guest Agent

Guest Agent

Guest Agent Guest Agent

Guest Agent Guest Agent Guest Agent

Guest Agent Guest Agent

API

Task Manager

Conductor

Page 23: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

What’s new in Mitaka

• Cassandra clustering, backup & restore, configuration groups, user

functions

• CouchDB backup and restore, user functions

• DB2 backup and restore

• Improvements to Mongo Cluster grow/shrink support

• Extend MySQL replication to include MariaDB GTID replication

• Percona XtraDB Cluster grow/shrink support, root enable

• Vertica configuration groups, cluster grow/shrink

• Improved Ceilometer notifications

• Bug fixes

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup23

Page 24: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

What’s on deck for Newton

• Here are some projects currently under consideration

– Improvements to usability, guest image creation

– Improvements to upgrade

– Extend persistent storage to include more than Cinder/Ephemeral

– Hbase support (code is already available for review)

– Python 3 support

– Trove “Superconductor”

– Management client for Trove, use the OpenStack client

– Trove capabilities API

– Improvements in modularity between guest agent and image

– Trove v2 API

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup24

Page 25: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Learn More about Trove

• Trove Wiki – https://wiki.openstack.org/wiki/Trove

• Trove Source – https://git.openstack.org/cgit/openstack/trove

• On IRC - #openstack-trove

• Getting Started Videos – http://tesora.com/videos/

• Download Tesora Platform - http://tesora.com/downloads

• Trove Day

– http://tesora.com/troveday

– http://slideshare.net/tesoracorp

• LinkedIn - OpenStack Trove Group

4/12/2016Intro to OpenStack Trove & DBaaS -

Chicago Cloud Computing Meetup25

Contact information

Contact [email protected]@tesoracorp

Contact [email protected]@amrithkumarIRC: amrith

Page 26: The State of Trove - Meetupfiles.meetup.com/1709331/The State of Trove - April 2016.pdfOpenStack Trove Mission Statement 4/12/2016 Intro to OpenStack Trove & DBaaS - Chicago Cloud

Thank You!