scale db preso for boston my sql meetup (9/2009)
TRANSCRIPT
Dial 712-338-7116Access Code: 789-140-794
ScaleDBThe cloud database
ScaleDB – Strictly Confidential ScaleDB
The Problem
• The cloud enables you to provision storage and compute power, but not database services…until now.
• ScaleDB “cloud-enables” open source databases, making them dramatically easier to provision, manage, scale and maintain in the cloud.
ScaleDB – Strictly Confidential ScaleDB
64 MB/s
(Shared)
The Cloud is Disrupting Databases
1.25 MB/s each
64 MB/s 200-400 MB/s each1.25 MB/s each1.25 MB/s each1.25 MB/s eachShared Nothing Shared Disk
Cloud Computing and Virtualization are two of Gartner’s
Top 10 Disruptive Technologies 2008-2012
1.25 MB/s each
ScaleDB – Strictly Confidential ScaleDB
Extending Open Source Databases
Single Instance DBMS
ScaleDB – Strictly Confidential ScaleDB
Extending Open Source Databases
Single Instance DBMS Shared-Disk Clustered DBMS
Centralized
Lock Manager
ScaleDB – Strictly Confidential ScaleDB
Shared-Disk Advantages
Shared-Disk Clustered DBMS
Centralized
Lock Manager
* High-availability / fail-over
* Cluster-level load balancing
* No partitioning or slaves
* Data consistency
ScaleDB – Strictly Confidential ScaleDB
Server 1
OSS DBMS
ScaleDB
VM
The Virtualized Cloud Database
Local Disk
OSS DBMS
Storage Engine
My SQL Server Server 2
OSS DBMS
ScaleDB
VM
Shared Storage
OSS DBMS
ScaleDB
VM
OSS DBMS
ScaleDB
VM
OSS DBMS
ScaleDB
VM
ScaleDB – Strictly Confidential ScaleDB
Central
Cluster Manager
Each NodeScaleDB API
Transaction Manager
IndexManager
DataManager
Buffer Manager
Lock Manager
Local Lock Manager
Global Lock Coordinator
Log Manager
RecoveryManager
Storage Manager
Global Recovery Manager
Global LockManager
Global BufferManager
Operating System Interface
Storage DevicesStorage Devices
ScaleDB’s Internal ArchitectureApplications
Direct
ScaleDB – Strictly Confidential ScaleDB
ScaleDB: Multi-Table Indexing
B-tree: Only indexes the data in tablesIndex #1
#1 #2
Index #2 Index #3 Index #4 Index #5
#3 #4 #5
ScaleDB Index
#1
#2
#3
#4
#5
ScaleDB: Indexes the data and relationships
…so what?
ScaleDB – Strictly Confidential ScaleDB
Conventional Databases & Joins
Col_ID# Col_Name Col_Budget Col_Description
Colleges
001 Agriculture $1,234,567 Nice place to visit
002 Arts $5,432,567 Sports not so good
003 Business $9,999,666 Cool logo
004 Education $3,234,567 Ugh Worcester
005 Engineering $8,238,568 Serious work
006 Law $7,237,767 Jumpy students
007 Liberal Arts $9,898,777 Pretty campus
008 Medicine $5,987,004 In Texas
Students
56-8033 008 Mike Hogan Caucasian
56-8045 008 Moshe Smith Caucasian
56-8044 008 Sally Shadmon Native American
56-8055 008 Billy Fleegle African American
56-8037 008 Saul Goode African American
56-8122 008 Tim Collins Polynesian
56-8233 008 Sam Gee Asian
56-8334 008 Rod Paulino Asian
Enrollment
008 4455 56-8037 B+
008 4455 56-8033 C
008 4455 56-8045 B+
008 4456 56-8044 A-
008 4456 56-8122 B-
008 4454 56-8233 C
008 4455 56-8334 F
008 4454 56-8055 D
Coll_ID# Coll_Name Coll_Budget Coll_Description Student_ID# College_ID# Student_Name Student_Desc College_ID# Dept_ID# Student_ID# Grade
Colleges Index(s) Students Index(s) Enrollment Index(s)
Query Result:008 Medicine $5,987,004 In Texas | 56-8037 Saul Goode African American | 4455 B+ |
Join Join
ScaleDB – Strictly Confidential ScaleDB
Col_ID# Col_Name Col_Budget Col_Description
Colleges
001 Agriculture $1,234,567 Nice place to visit
002 Arts $5,432,567 Sports not so good
003 Business $9,999,666 Cool logo
004 Education $3,234,567 Ugh Worcester
005 Engineering $8,238,568 Serious work
006 Law $7,237,767 Jumpy students
007 Liberal Arts $9,898,777 Pretty campus
008 Medicine $5,987,004 In Texas
Students
56-8033 008 Mike Hogan Caucasian
56-8045 008 Moshe Smith Caucasian
56-8044 008 Sally Shadmon Native American
56-8055 008 Billy Fleegle African American
56-8037 008 Saul Goode African American
56-8122 008 Tim Collins Polynesian
56-8233 008 Sam Gee Asian
56-8334 008 Rod Paulino Asian
Enrollment
008 4455 56-8037 B+
008 4455 56-8033 C
008 4455 56-8045 B+
008 4456 56-8044 A-
008 4456 56-8122 B-
008 4454 56-8233 C
008 4455 56-8334 F
008 4454 56-8055 D
Coll_ID# Coll_Name Coll_Budget Coll_Description Student_ID# College_ID# Student_Name Student_Desc College_ID# Dept_ID# Student_ID# Grade
ScaleDB & Joins
Query Result:008 Medicine $5,987,004 In Texas | 56-8037 Saul Goode African American | 4455 B+ |
College
Students
Enrollment
ScaleDB’s multi-table index is relationship-aware
A Single
Index
LookupDepartments
Courses
ScaleDB Index
Enrollment
ScaleDB – Strictly Confidential ScaleDB12
Time per query(seconds)
Number of attribute/value pairs
DB/2 (B-tree)
ScaleDB index
Time vs. Query complexity8
7
6
5
4
3
2
1
0
Early Results
0 2 4 6 8 10
35-Times faster than IBM DB2 (6 attribute pairs)
ScaleDB – Strictly Confidential ScaleDB
Customer Value Proposition
• Runs on low-cost cloud infrastructures (e.g. Amazon)
• High-availability
• Dramatically easier set-up & maintenance
• No partitioning/repartitioning
• No slave and replication headaches
• Simplified tuning
• Scales up/down without interrupting your application
• Data consistency
• Lower TCO
ScaleDB – Strictly Confidential ScaleDB
Cloud Vendor Value Proposition
• Supports Service Level Agreements
• High-availability (less downtime, faster recovery)
• Shifts relationship from dedicated hardware to SLA = profits
• Compatible with Virtualization (separates data/computing)
• More portable across computing infrastructure
• Enables dynamic allocation of computing and storage
• Reduces Management Overhead
• Reduced tuning and partitioning support
• No manual slave promotion or replication
• DBMS request routing is dynamic not fixed
ScaleDB – Strictly Confidential ScaleDB
Join Our Beta Program
• Ideal for:
• Large data sets/transaction volume
• Indexing on long keys (e.g URLs)
• Joins (the more complex the better)
• How to Join Our Beta:
• Go to www.scaledb.com and click “Try it Now!”
• http://scaledb.com/Try-it-Now.html