open%source database ecosystem in2016 - percona · 2016-10-05 · open%source database ecosystem...
TRANSCRIPT
![Page 1: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/1.jpg)
Open Source DatabaseEcosystem in 2016
Peter Zaitsev3 October 2016
![Page 2: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/2.jpg)
2
Great things are happening with Open Source Databases
It is great Industry and Community to be a part of
![Page 3: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/3.jpg)
3
Why ?
![Page 4: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/4.jpg)
4
Data Continues Exponential Growth
Source: IDC, http://situationalintelligence.net/
![Page 5: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/5.jpg)
5
It’s not humans it’s Devices
Source: IDC, http://situationalintelligence.net/
![Page 6: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/6.jpg)
6
For Decades we…
Used Proprietary Relational Databases to Manage Structured Data
![Page 7: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/7.jpg)
7
It does not work!
Too expensive
Too Inefficient
Too Inflexible
![Page 8: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/8.jpg)
8
As Result
Top Internet Applications have embraced Open
Source Databases long ago
Traditional Enterprises are catching up too
![Page 9: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/9.jpg)
9
Benefits of Open Source for Business
No Software Vendor Lock-
InMore
Flexibility More
Compatibility
Faster Innovation
![Page 10: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/10.jpg)
10
Is not Open Source Free as in Beer ?
Free for Developer != Free for Business
Total Cost of Ownership reported to be 3-10x less
![Page 11: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/11.jpg)
11
So
It is not surprise Open Source Databases are gaining momentum!
![Page 12: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/12.jpg)
12
Gartner: State of Open Source RDBMS 2015
By 2018 70%+ of all Newly developed applications will run on Open Source Databases
80% of existing applications are candidates to be migrated to Open Source Database
50% of existing RDBMS instance will be converted to Open Source RDBMS
![Page 13: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/13.jpg)
13
Black Duck Open Source Survey 2016
“Open Source Database Adoption is second only to Adoption of Open Source Operating Systems”
![Page 14: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/14.jpg)
14
DB-Engines: Gap Is closing
![Page 15: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/15.jpg)
15
New Categories Dominated by Open Source
![Page 16: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/16.jpg)
16
Fast Change of Momentum
![Page 17: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/17.jpg)
17
Truly International Innovation
All Top Open Source Database Systems have Globally Distributed Development Teams
![Page 18: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/18.jpg)
18
Open Source Innovation at Percona Live
Keynotes from Open Source Innovators
• MySQL, MariaDB, Facebook
In-Depth Technical Presentations
• MongoDB, Redis, RocksDB, PostgreSQL
![Page 19: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/19.jpg)
19
Trying Something New
Invited Developers and Ecosystem Members to talk about technologies which inspire them
![Page 20: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/20.jpg)
PostgreSQLThe World’s Most Advanced Open Source Database
![Page 21: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/21.jpg)
21
What does that mean for…
… people who work with PostgreSQL• It supports transactions in a proper way• It is flexible
…people who never work with PostgreSQL• It is old-school and difficult to use• You need to be a PostgreSQL hacker to use it
![Page 22: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/22.jpg)
22
PostgreSQL Evolution
Inspired by https://momjian.us/main/writings/pgsql/past_present_future.pdf
![Page 23: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/23.jpg)
23
2016 is a year of
• PostgreSQL 9.6 release• PostgreSQL 9.5 release is production ready• Both are very impressive in regard of performance and features• Postgres is in all kinds of industries• PostgreSQL community activity grows• More user-oriented conferences and meetups• Increased enterprise adoption gives a lot of feedback from users
![Page 24: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/24.jpg)
MongoDBLeading Open Source Document Oriented Database
![Page 25: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/25.jpg)
25
MongoDB Ecosystem
![Page 26: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/26.jpg)
RethinkDBOpen Source Database for Real-Time Web
![Page 27: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/27.jpg)
27
What is RethinkDB?
• Open-source database for building realtime web applications.• NoSQL database that stores schemaless JSON documents.• Distributed database that is easy to scale.• High availability database with automatic failover and robust fault tolerance.
• Supports both pull and push models – Changefeeds.• Map-reduce.• Geospatial queries and GeoJSON.• The second most popular database on GitHub.
![Page 28: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/28.jpg)
28
RethinkDB is good for…
• Collaborative web and mobile apps.• Streaming analytics apps.• Multiplayer games.• Realtime marketplaces.• Connected devices.
![Page 29: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/29.jpg)
29
Current State
• Initial release: July 2009• Open-sourced: November 2012• RethinkDB 2.3.x• Users and permissions.• TLS encrypted connections.• 10x better performance for distributed joins.• Windows beta.
• Latest release: 2.3.5• Improved the efficiency of the on-disk garbage collector to reduce the risk of excessive file growth.
• Improved the latency of read queries under heavy write loads.• Improved the Raft election timeout logic to avoid infinite Raft election loops.
![Page 30: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/30.jpg)
30
Who uses RethinkDB in production?
• NASA• Jive• Narrative• Cmune• SocialRadar• Mediafly• Wise.io• Platzi
![Page 31: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/31.jpg)
31
Agile web-development with RethinkDBtomorrow at 12:20pm
![Page 32: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/32.jpg)
ClickHouseHigh-Performance Distributed DBMS for Analytics
(Blazing Fast Open Source Analytics Database for Petabytes of Data)
![Page 33: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/33.jpg)
33
Faster that you can imagine
• Column-oriented• 100x faster than typical RDBMS• Distributed queries• Massively parallel• SQL
![Page 34: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/34.jpg)
34
Linearly scalable
Features
• Petabytes of data in one cluster• Multi-Datacenter• Awesome data compression• High-availability
Main Yandex.Metrica Cluster
• 3 Pb• 6 Datacenters• 422 Nodes• 17.2 trillions of rows (17 200 000 000 000)• 20 billions rows inserted daily in realtime
![Page 35: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/35.jpg)
35
Production proven
• More than 20 projects inside Yandex• 4+ Years in production• Highly reliable• No single point of failure• No major downtime events or data loss for years
![Page 36: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/36.jpg)
36
Opensource
• Opensourced at June 2016• License: Apache 2.0• Tens of companies already using
ClickHouse• Ready to go!
https://github.com/yandex/clickhousehttps://clickhouse.yandex
![Page 37: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/37.jpg)
TarantoolOpen Source NoSQL Database running in LUA application server
![Page 38: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/38.jpg)
38
Tarantool: battering ram tool
Open source, open government
● simplified BSD license● first release October 2010● In-memory database and
application server● ACID transactions
![Page 39: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/39.jpg)
39
Why another database?
Database visionary Jim Gray:It’s time for a complete rewrite
● lock-free transaction processing as in Gray et al paper circa 2008
● 1 000 000 transactions per second on a single core
● a database for the most volatile/hot data
![Page 40: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/40.jpg)
40
An application server
Get your data in RAM. Get compute close to data. Enjoy the performance.
● OpenResty of the database world
● tons of modules: JSON, http, YaML, PostgreSQL, MySQL, GIS, MQTT, ect
![Page 41: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/41.jpg)
41
Database features
● document data model● compression, lowest memory footprint● transactions, secondary keys● log streaming replication● online backup
![Page 42: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/42.jpg)
42
The community
![Page 43: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/43.jpg)
ProxySQLHigh Performance Open Source Proxy for MySQL and MariaDB
![Page 44: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/44.jpg)
Also….We Have Announcement to Make
![Page 45: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/45.jpg)
45
RocksDB is Fantastic!
Source: https://github.com/facebook/rocksdb/blob/master/USERS.md
![Page 46: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/46.jpg)
46
MyRocks is coming to Percona Server
![Page 47: Open%Source Database Ecosystem in2016 - Percona · 2016-10-05 · Open%Source Database Ecosystem in2016 Peter%Zaitsev 3 October 2016. 2 Great things are happening with Open Source](https://reader030.vdocuments.net/reader030/viewer/2022041019/5ecd53907b8a796bf06b961a/html5/thumbnails/47.jpg)
47
Thank You Sponsors!!
FOUNDATION