nosql databases for enterprises - nosql now conference 2013

NoSQL Technology and Enterprise applications – Where the Rubber Meets the Road

Dave Segleau

Director Product Management, Oracle


Agenda

How we got here

Where we are today

What’s important

Sample Use Cases


NoSQL and Big Data Where did it come from?

SQL

JDBC,

ODBC

General

Purpose

Managed

Schemas

Security,

Backups

Analytics

…

Distributed

Processing

Distributed,

Replicated

File System

Driver

Application

NoSQL databases

Flexible

Schemas

Sharded,

Replicated

Database

High Speed,

Simple Ops

More Flexible Schema

Management

Globally Distributed,

“Always On” data

Competitive Advantages

of “Fast Data”

Lower TCO,

commodity HW scale-out


Oracle NoSQL Database Where is it used?

Simple Data

Management

Globally Distributed,

“Always On” data

Competitive Advantages

of “Fast Data”

Lower TCO,

commodity HW scale-out

ERP

EAM

Inventory

Control

Accting

& Payroll

Process

Mgmt

Business

Analytics

CRM

…

Driver

Application Real Time

Event

Processing

Distributed,

Web-scale

Applications

Online

Gaming

…

Mobile Data

Management

Sensor Data

Capture


The NoSQL Landscape

Pioneers –

Built their own

Global Enterprise Technology Adopters Source: NoSQL Market Forecast 2013-2018 by Market Research Media

Oracle has invested in

NoSQL as a key data

management technology


What is Oracle NoSQL Database?

SOCIAL

BLOG

SMART

METER

1011001010010

0100110101010

1011100101010

100100101

VALUE VARIETY VELOCITY VOLUME

Non-relational database designed for cost effective simple queries of

high volume, velocity & variety data. Provides high performance & availability

data storage of Big Data’s simple data using a scale-out of servers design.


Oracle NoSQL Database Distributed, Scalable, Highly Available, Key-Value Database

Simple Administration

Flexible Data Model

Predictable Performance

ACID Transactions at scale

Transparent Integration

Commercial grade software and support

Application

Storage Nodes

Datacenter B

Storage Nodes

Datacenter A

Application

Driver

Application

Driver

Application


What’s Really Important?

Technical Feature Importance Why

Storage Model Not really Will merge over time

Specific Features Somewhat Application requirements?

Performance Somewhat Rapid changes, YMWV

Integration Critical Long term, Repetitive cost

Reliability/Support Critical Early products, Product

direction

Predictability Critical Production reqs & SLAs


Query NoSQL data from Oracle Database

Access NoSQL data from Hadoop for DW and analytics

Share data with Coherence for extensible in-memory cache grid

Persist history & event streams for processing with OEP

Store & query RDF data using Oracle RDF for NoSQL

Integration Oracle NoSQL Database: Integrated out of the box


Reliability & Support

Decades of widespread, reliable deployment experience

15+ years of mission-critical non-relational database technology

Oracle Support available for both Enterprise and Community Edition

Oracle NoSQL Database: Enterprise-Grade Software & Support


Predictability Oracle NoSQL Database: Designed for Predictability - Insert Test

0

50000

100000

150000

200000

250000

300000

350000

400000

450000

0.2 1.8 3.5 5.2 6.8 8.5 10.2 11.8 13.5 15.2 16.8 18.5

Th

rou

gh

pu

t (o

ps

/se

c)

Time (minutes)

Insert Performance

Oracle NoSQL … Other NoSQL …


Predictability Oracle NoSQL Database: Designed for Predictability

0

1

2

3

4

5

6

7

8

0

10,000

20,000

30,000

40,000

50,000

60,000

70,000

80,000

144 (48x3)

20% 40% 60% 80% 216 (72x3)

216* (72x3)

Avera

ge L

ate

ncy (

ms)

Th

rou

gh

pu

t (o

ps

/se

c)

Nodes (Shards x RF)

95/5 Read/Update Throughput

Throughput (ops/sec) Read Latency (ms) Update Latency (ms)


Oracle NoSQL Database When it really matters

Integration

Predictability



Agenda

How we got here

Where we are today

What’s important

Sample Use Cases


Point Flexibility Point

Web-Scale

Transaction Processing

High velocity, volume,

variety, data capture and

update

Web browsing, E-Retail,

Online Gaming, CDR

processing, Sensor data

capture

Web-Scale

Personalization

Guaranteed low latency

simple lookups for end-

customers and users

Advertising, Product

Recommendations, Online

Catalogs, Social Media,

Profile Management,

Personalization

Real-Time

Event Processing

Real time events trigger

rules that perform low

latency lookups

Medical Monitoring, Factory

Automation, Quality of

Service, Oil & Gas, Geo-

location Tracking

Oracle NoSQL Database Use Case Summary


NoSQL for Web Commerce Customer Service Call center routing and context retrieval

Objectives

Solution

Benefits

Web commerce customer service

Enable call center routing and dispatch

Improved product up-sell and cross-sell

Oracle NoSQL database for customer

profile data capture and access

Build repository for unstructured and

variable data record formats

Deploy distributed database for world-wide

access

Easy to use flexible data formats

Horizontally scalable, low latency database

Predictable performance

Geographically distributed enterprise access

NoSQL DB Driver

Application

Customer Service

Customer Profiles

End Customers

Click-2-Call


NoSQL for Customer Experience Management Brand enhancement and loyalty enrichment

Objectives

Solution

Benefits

Centralized view of customer data within

federated database environment

Dynamic, customer influence tactics

Oracle NoSQL database for central

repository of meta data for customer

activity, scheduling and “next generation

experience” events

Oracle database for financial data,

reservation and property management

Simple, flexible data format

Highly scalable with predictable performance

Enterprise support, technology commitment and

roadmap

NoSQL DB Driver

Event Scheduling

Application

Staff & End Customers

Customer Profiles

Customer Care & End

Customers

Reservation Systems


360 Degree Customer Profile Managing what you know

Legacy Transactional

Systems

Driver

Web Service Application

Customer Service

360 View Customer Profiles

End Customers

Click-2-Call

Recommendation

Engine


360 Degree Customer Profile

Major Key

Minor Key

Value

Customer ID

Purchases

Date JSON

Date JSON

Web Traffic

Date JSON

Date JSON

Profile JSON

Interests JSON

Future?


Real-Time Event Processing

Event

Processing

Incoming

Stream

Event

Buffer

Long-Term

Storage


NoSQL for Fraud Scoring Financial Services coordinated theft prevention

Objectives

Solution

Benefits

Application Data Ingestion

Tra

nsa

ctio

n A

uth

ori

za

tio

n

Pro

ce

sso

r

Combine data sources for complex scoring

Detect, alert analyst with low latency

Handle burst seasonal transaction volumes

Oracle Coherence cluster for real time

transaction object management

Oracle NoSQL Database for fraud model

and customer profile management

Oracle Database for statistics and fraud

modeling-related data

Simple data model, flexible transactions

Scalable, Low Latency data management

Easy configuration and administration

Enterprise Support

NoSQL DB Driver


Engineered System

Commodity Cluster

Deployment Options


Oracle NoSQL Database

Predictability


Integration

When you need:

Web-Scale Transaction Processing


Web-Scale Personalization

For Applications that do:


Appendix


Choose the RIGHT tool for the job

Hadoop Distributed File

System (HDFS) Oracle NoSQL Database Oracle Database

File System Key-Value Database Relational Database

No inherent structure Simple data structure Complex data structures, rich SQL

High volume writes High volume random reads and

writes High volume OLTP with 2-PC

Limited functionality,

roll-your-own applications

Simple get/put high speed storage,

flex configuration

Security, Backup/Restore, Data life

cycle mgmt, XML, etc.

Batch Oriented Real-Time, web-scale specialized

applications

General purpose SQL platform,

multiple applications, ODBC, JDBC


Web-Scale Transaction Processing

Driver

Application

Acquire Analyze Organize

Enterprise

Data Warehouse

Salient Aspects

•NoSQL DB for High velocity, high

volume, high variety, transactional

data capture

•Hadoop and Data Warehouse for

analytics

•Applications: Web browsing, Web

Retail, CDR processing, Sensor data

capture


Web-Scale Personalization

Salient Aspects

• Platform for real-time content delivery

• Content & market segmentation is acquired

and analyzed in Hadoop & RDBMS

• NoSQL provides low latency content lookup

and delivery to end-customers or users

• Applications: Advertising, Product

Recommendations, Online Catalogs, Social

Media, Profile Management,

Personalization

Multi-Reporting

Dimensional

Driver

Application

Acquire, Analyze, Prepare Content Delivery

Business Users End Customers



Salient Aspects

• Real time events trigger rule execution in

Oracle Event Processor

• OEP rules perform low latency lookups

to Oracle NoSQL DB for additional data

• Applications: Utilities, Medical

Monitoring, Factory Automation, Quality

of Service, Oil & Gas Exploration, Geo-

location Tracking

Driver

Rule Action

Low Latency

Lookups


NoSQL for Social, Online Betting Real-time, In-Play Gaming Platform

Objectives

Scalable in-play sports betting platform

Increase new business revenue

Improve operational efficiency

Solution

Match in-play bets with incoming events

Promote interaction between customers

Scale system with customers and events

Feeds MySQL database for revenue

tracking and operational reporting

James Anthony Chief Technology Officer

Passoker

“Oracle NoSQL Database enabled the rapid,

scalable processing of incoming XML, ensuring

high available and guaranteed event ordering.”

NoSQL DB MySQL

Accounting &

Operations

Event Capture

& Store Customers

Real-Time, In-Play Sports Betting

Providers

XML App


NoSQL for Web Scale Retail Dynamic catalog and customer insight profiling

Objectives

Solution

Benefits

Handle exponential growth in products and

customers with highly dynamic profiles

Defend competitive margins – new players

Oracle NoSQL database for rich customer

profile management, product catalog

browsing and shopping cart management

Oracle Database for financial transactions,

inventory and order fulfillment, business

analytics and insight

Easily manage volatile, evolving data formats

Scalable, Low Latency data management

Flexible transaction options

Online, easy configuration and administration

E-Retail & Order Fulfillment Delivery Order Processing

NoSQL DB Driver

Application


NoSQL for Data Scalable PaaS Subscription Web-Scale services infrastructure for financial industry

Objectives

Provide special purpose application

server services to financial institutions

Provide cost competitive subscriptions

Solution

Oracle NoSQL Database for unstructured

data capture and application object

persistence

Oracle Database for business analytics and

insight into the data collected

NoSQL DB Driver

Application

Alex Korotkoff Chief Executive Officer

EngineON

“Oracle NoSQL DB delivers high availability, scalability

and performance for our customers who are dealing with

unprecedented data volume, velocity and variability

challenges.”


NoSQL for Customer Loyalty Coupon redemption, Vendor recommendations

Objectives

Scalable customer loyalty portal

New multi-channel consumer model

Improve operational efficiency

Solution

Personalized multi-channel coupon

generation and redemption

Cross-promote affiliated vendors

Scale system with customers and

participating retailers

NoSQL DB Driver

Application

Retail Partners

Customer

Profiles

End Customers

Available Coupons Market Segmentation

Frank Puechl Senior Data Architect

PAYBACK

“Oracle NoSQL DB handles high volumes of

customer loyalty operations every day, minimizing

the load to our OLTP Oracle RAC Database.”

http://www.payback.net/


NoSQL in Oracle Communications Mgmt Elastic Charging Engine

Objectives

Improve billing and revenue management

Calculate charges for any service combo

Provide scalable CDR processing

Solution

Benefits

Coherence cluster for real time event rating

NoSQL database for rated event

persistence and consumption by

downstream systems

Coherence memory optimization using

NoSQL database for out of band data

Manages rapid growth in data volumes

Cost effective High Performance and Scalability

Integrated with Oracle Coherence

NoSQL DB Driver

Application Data Ingestion

OC

M R

ate

d E

ve

nt s

Pro

ce

sso

r

nosql databases for enterprises - nosql now conference 2013

Technology

oracle andor

nosql technology

nosql landscapepioneers

analytics share data

velocity variety data

nosql market forecast

replicated database

valuenonrelational database