a practical introduction to oracle nosql database - oow2014

Oracle NOSQL DatabaseA Practical Introduction – [CON8062]

Product ManagementOracle NOSQL DatabaseOctober 01, 2014

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |


Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.


Program Agenda

What is Oracle NOSQL, who uses it, how much does it cost

Cluster setup, high availability, visual tooling

Schema, data loading,

Query ( CLI, SQL, API’s )

Advanced Features and future

1

2

3

4

5


What is Oracle NOSQL Database

Oracle Confidential – Internal/Restricted/Highly Restricted 5

101100101001001001101010101011100101010100100101

ReliableFlexibleFastSimple

advanced Key-Value database designed as cost effective, high performance solution for simple operations on collections of data with built in high availability and elastic scale-out.


2009

• Servicing major Financials, LinkedIn, Amazon

2010

• Scaling out BerkeleyDBNoSQL Database

2011

• Nov 2011, version 1.0 released

2012

• Dec 2012, version 2.0 released

• Oracle Eco Integrated

2013

• Quarterly releases, version 2.1 released

2014

• Version 3.0

• Hosted NoSQL

• Big Data SQL

CustomersIn Production

Oracle SolutionsEngineered

SystemsNoSQL DatabaseIn development

BerkeleyDB Oracle Cloud

Oracle NOSQL DatabaseFrom startups to enterprise ready


• NOSQL Features

– Elastic

– BASE Operations

– Tables / JSON / Binary

– Online management

• Differentiators

– ACID transactions

– Online rolling upgrades

– Oracle technology integrated (tools & solutions)

– Commodity & Engineered systems

– Streaming large object support

Oracle NOSQL Database - Enterprise Ready

– Data Center Support

– Secondary Indexes

– Secure Access

– Flexible schema

Best NOSQL choice for any company using Oracle products


Finance

• Large credit card network provider

• Fraud rule and history management

• 6,500 ops/sec, 85% update on read

Manufacturing

• Large airline manufacturer

• Developing next generation planes

• 750K key inserts/sec, 6TB per hour

8

Telecoms

• Large mobile telecom operator

• Mobile personalized advertizing

• 24,000 ops/sec, 100% update on read

Gaming

• Real-time, live event platform provider

• Sports wagering for William Hill, BetVictor

• 600 concurrent feeds, 400 events/feed

Oracle NOSQL Database customer success…

……many more


Oracle NOSQL Database Subscription Model

• Business-friendly support service

– Oracle NoSQL Database Community Edition

• Open Source AGPL Edition

– Support is now available for Community Edition

• Price is $2,000/year per server

• No upfront license fee

• Provides for full Oracle support policy response

• Purchase online via the Oracle Store

– Offers affordable support option for startups

– Provides Oracle expertise for production deployment

9

Oracle Store

https://shop.oracle.com/

https://shop.oracle.com/


Oracle NOSQL DB Licensing

• Community -or- Enterprise Edition

– Enterprise Edition• Closed Source. Standard Oracle License

– Community Edition has all of the basic functionality and APIs. Gets you started

– Enterprise Edition for large, production, multi-data center, Oracle integration-centric customers and/or non-GPL compliant customers.

10


• Enterprise ready- for Administrators and Developers

• Integrated - into Oracle software stack of tools and solutions

• Engineered appliance – fast deployment and comprehensive support

Oracle NOSQL Database product missionTransitioning NOSQL from Startup to Enterprise


Program Agenda

What is it, who uses it, how much does it cost


Schema, data loading,



1

2

3

4

5


Cluster TopologySmart Topology

Agents

A

A

A

Machine1

Machine2

Machine3

Replica Group1 Replica Group2 Replica Group4Replica Group3

R1

R2

R2

R1 R4

R4

R3

R3

M4

M1

M2

M3DD

D

D

Application

NoSQL Driver

D

D


• Simple setup via Resource Declaration (no replica group definition)

• Automatic HA process placement (DBA assist)

• Oracle Enterprise Manager (unified SQL and NoSQL resource view)

Enterprise ReadyCluster creation


• Automated write availability - master re-election on failure

• Cloud ready tooling and standards based alerting (html5, jmx, snmp)

• Automated process rebalancing on recovery - DBA-less recovery

Enterprise ReadyHigh availability and active monitoring


Program Agenda



Schema, data loading



1

2

3

4

5


Email Example – RDBMS SchemaER Diagram


Parent/child Parent/child

Value Value Value Value

Email Example – NOSQL SchemaHierarchical key space, table meta layer


• Simple, scripted DDL (familiar SQL concepts)

• Rich modeling: Collections, Records, Primitives, Embedding, Linked (powerful modeling)

• Strongly typed data, loosely coupled applications (governance with agility)

Enterprise ReadyTable creation


• Easy CLI based data loading from CVS, JSON formats

• High speed bulk loading – ODI / Oracle Connectors (Map Reduce)

• Data load from cluster wide snapshots

Enterprise ReadyData Loading


Program Agenda






1

2

3

4

5


Email ExampleQueries



Query by primary key

Query by secondary index

Queries with ordered results

kv-> get table -name user -field userId -value 1

kv-> get table -name user -index emailIndex -field email -value [email protected]

kv-> get table -name user -index ageIndex -field age -start 12 -end 20

kv-> get table -name user -index emailIndex

Range Queries


Email ExampleQueries



Intersection Queries (JOIN)

kv-> get table -name User.Folder.Message -field userId -value 1 -field folderId -value 2


• Easy CLI adhoc query (Dev prototype, DBA examine)

• Range and aggregate operators (advanced filtering, indexes, store wide ordered)

• Scriptable and exportable results (predictable, repeatable, sharable)

Enterprise ReadyCLI queries


• Simple Oracle integration

• All SQL tools available thru Oracle Database

• Foundation for unified query of Big Data SQL

Enterprise ReadySQL based queries


• Simple Eclipse based, multi-language development

• Flexible Table, AVRO, Key-Value API with adhoc query

• Powerful operators, primary/secondary indexing

Enterprise Ready and Developer friendlyTable API based queries


Program Agenda






1

2

3

4

5


0

1

2

3

4

5

6

7

8

0

10,000

20,000

30,000

40,000

50,000

60,000

70,000

80,000

144 (48x3) 20% 40% 60% 80% 216 (72x3) 216* (72x3)

Ave

rage

Lat

ency

(m

s)

Thro

ugh

pu

t (o

ps/

sec)

Replicas (RG x RF)

95/5 Read/Update Throughput

Throughput (ops/sec) Read Latency (ms) Update Latency (ms)

• 144 -> 216 nodes

• 4% initial reduction

• 9% final gain

• Linear scalability

Engineered for Linear ScalingBig Data Appliance


• 216 nodes

• 15 minutes to software upgrade

• Scriptable automation

• Linear scalability

0

2.5

5

7.5

10

12.5

15

17.5

72 (24x3) 144 (48x3) 216 (72x3)

Tim

e to

Up

grad

e (m

in)

Total Nodes

Online Rolling Upgrade

Engineered for Rolling UpgradesBig Data Appliance


Oracle NoSQL Database

Terracotta

Read Latency

Enterprise ReadyPredictable performance beats in-memory grids


• Authentication (truststore)

• Wire line encryption (SSL)

• At rest encryption (eCryptfs)

• Oracle Wallet (key management)

• Upcoming security integrations

• Kerberos, Database Vault, Auditing, Masking, Label Security

Enterprise ReadyDefense in Depth Security


Data WarehouseData Reservoir +

Oracle Big Data Connectors

Oracle DataIntegrator

Oracle Advanced Analytics

Oracle

Database

Oracle Spatial & Graph

Cloudera Hadoop

Oracle R

Distribution

Oracle NoSQL

Database

Oracle Industry Models

OracleGoldenGate

Oracle DataIntegrator

Oracle Event Processing

Oracle Event Processing

Apache Flume

OracleCoherence

Oracle Advanced Analytics

Oracle Database

Oracle Spatial & Graph

Oracle Industry Models

Integrated with Oracle Software


2014

• Version 3.0,

• Hosted NoSQL

• Big Data SQL

2015

• Release 4.0, seamless management

• IoT platform infrastructure

• Analytic enablement

2016

• NoSQL Everywhere -DMS

• Cloud burst automation

• Data Contexts

++ +++ ++++

Ubiquitous DataBig Data AgilityOracle Cloud

Oracle NOSQL DatabaseFrom enterprise product to market leading NOSQL


• Enterprise ready- for Administrators and Developers

• Integrated - into Oracle software stack of tools and solutions

• Engineered appliance – fast deployment and comprehensive support

Oracle NOSQL DatabaseFrom enterprise product to market leading NOSQL


Safe Harbor Statement

The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

a practical introduction to oracle nosql database - oow2014

Engineering