database platform discussion.pdf

25
Database Platform Discussion

Upload: wongwsw

Post on 11-Jul-2016

22 views

Category:

Documents


1 download

TRANSCRIPT

Database Platform Discussion

IBM Solution

Main Data Centers DR CenterDB replications

Site A site B

Pros Built-in DR engine without additional components

Simple architecture, no data consistency handling across sites

Cons Required double storage spaces

Standby supports only read only or idle configuration

Data need to be partitioned for site A and site B

A A1(idle) A2 (idle)

BB1(idle) B2 (idle)

Option 1

IBM Solution

Geographically Dispersed Cluster (GDPC)

Option 2

IBM Solution

DR

(Passive)

Site 1

(Active)

Database

Replication

HADR

M1, M2 M3, M4 M3, M4M1, M2

Site 2

(Active)

Geographically Dispersed Cluster + database replication

A A A”

Pros Database handles all data synchronization across site1, site2 and DR

Single database

Cons Require dark fibre or 10GB Ethernet between site 1 and site 2

Require additional site ( site3 ) as judge to split brain

IBM Solution

55

BCOM- Internet Payment System收付通宝, Inter-banks payment systems二代支付- Cross site cluster

Mbr1

Mbr3

Mbr2

Mbr4

CFsec

CFprim

N kms

Dark Fiber or 10 Gb WAN

Database

Log Log Log Log

Fiber ChannelGPFS Shared Storage (logical view)

Physical Storage site 'A' Physical Storage site 'B'

Infiniband

GPFS replication between sites

Ethernet

3rd site

tie-breaker

Reference of using GDPC

IBM Solution

6

BTMU - Retail Banking Application- 1TB compressed database size- 3 years production

6

2core

84GB Memory2core

84GB Memory

Reference of using virtualization

IBM Solution

7

HKEx – server environment

Two Intel Quad-Core E5450 Processors

12GB RAM

locally-attached 145GB (SAS + RAID1)

Red Hat Enterprise Linux 5.3

2 HP VRAIDs from 8 physical disk drives

VRAID 0 for Transaction log file system

VRAID 1 for database file system

HP DL360 G5 Server SAN Storage server

LUN0

LUN1-A

LUN0

LUN1-A

LUN0

LUN1-A

LUN0

LUN1-A

LUN0

LUN1-B

LUN0

LUN1-B

LUN0

LUN1-B

LUN0

LUN1-B

RSS1

RSS2

VRAID0

VRAID1

* This disk layout is an assumption based on the information

provided by the cust :

2 HP VRAIDs( VRAID0 and VRAID1) from 8 physical disk

drives.

*

HP Server and Storage in customer site is used

DB2 achieved

30% more transaction

than Oracle per min

On same hardware

Reference of using DB2 with high transaction requirement

IBM Solution

Longevity in Transaction Processing Performance

Benchmarks are often a game of leapfrog

DB2 has demonstrated sustained superiority over competitors

8

Results as of Nov 20, 2014

IBM Solution

Features Desription Similar to Oracle Feature

BLU In-memory columnar capabilities Exadata - storage IO

pureScale Active-Active RAC

Data Partitioning Feature Database partitioning No offer

Optim Performance Manager Extended Edition Performance monitoring Tuning Pack

Optim Query Workload Tuner Workload monitoring Workload manager

Optim Configuration Manager Configuration Admin Configuration Pack

InfoSphere Optim pureQuery Runtime for LUW Query optimization No offer

Warehouse Model Packs Data Warehouse Model No offer

WHS SQW ETL tool Data Integrator

WHS Mining & text Analytics Data Minining Data Minining

Cognos 10.2 5 Users BI front end OBIEE

WHS Cubing Services BI Cube OBIEE Cube

InfoSphere Data Architect Capabilities Data Modeler Designer

solidDB & solidDB UC In memory database cache Times Ten

IBM Mobile Database Sync Mobile database Mobile Server

pureXML Storage XML database XML type

Time Travel Query Database auditing Auditing expert

Compression Compression Adv. CompressionRow & Column Access Control Security Adv. Security

Label Based Access Control Security Label Security

SQL Replication Replication DB Link

Federation Capabilities DB Feberation cross database Transparent Application Gateway

Websphere MQ Message Queue MessageQ

High Availability Disaster Recovery Log shipping Data Guard

Tivoli System Automation Clustering software Veritas

Multi-temperature Storage Hot/Warm/Cold multi-tierdata storage No offer

Materialized Query Tables MQT MQV

Multi-Dimensional Clustering Storage clustering No offer

Table Partitioning Table Partition Partioning Feature

Scan Sharing Scan result sharing Exadata - scan sharing

DB2 Workload Management (WLM) Query workload priorization Workload manager

MQ Replication / CDC CDC Golden Gate

Simple Package with all Enterprise level functions

IBM Solution

Virtualization Licensing

With SQL Server you have two options

1. License all virtual cores for a VM (min 4 core licenses) – can end up licensing more

cores than exist on a machine

2. License all physical cores on a machine (Enterprise Edition only)

With DB2

– Sub-Capacity Licensing allows for licensing of only the physical cores used by DB2

– With Workgroup can run unlimited VMs of DB2 on up to 16 sockets

10

IBM Solution

Small applications

HA pair

Server options in DB2

• Database replication pairs

DR or remote site

requirement

HA pair

• Share disk + cluster software

Idle Active

IBM Solution

Server options in DB2

PPRC/Q-rep

Continous availbility

Concurrent Access Cluster

SAN

Data node Data node Data node

SAN

Data node Data node Data node

•Support rolling fixpak upgrade and non-interrupt member addition in v10

•Support PPRC ( active-passive ) and Q-rep ( active-active )

•Extended Purescale provides cross site clustering within 30Km

Concurrent Access Cluster

IBM Solution

Roadmap for RDBMS

IBM Solution

DB2 with BLU AccelerationRich capability integrated with IBM DB2 10.5

What is DB2 with BLU Acceleration?

In-memory analytic database

Multiple IBM innovations

– In-memory processing

– Columnar storage

Multiplatform: Supports AIX, Linux, zLinux, Windows

Ready for Analytics with no tuning effort

•Analyze more data faster and more

efficiently

•Fast Answers. Simply Delivered.

IBM Solution

© 2014 IBM Corporation15

Hardware

Software

Admin

Data

Software

Admin

Data

Data

Layer

Gu

essw

ork

, O

ve

rhe

ad

, R

isk

✓ No Guesswork

✓ Smallest Risk

✓ Guaranteed Uptime

Roll-Your-Own Hosted

Database as a Service

Data

Warehouse

✓ No Tuning

✓ Truly Agile

✓ Appliance Simplicity

Data Warehouseas a Service

Server Options (New Cloud option)

IBM Solution

Performance

IBM Solution

10 timesperformance

increase to 30,000

orders per second

IBM Solution

Benchmark Result

Goal : Achieve not less than 30k/sec with 100000000 records

Result from IBM : 97k/sec

•Thread 8 completed, wrote 12501000 recs in 1024354ms

•Thread 3 completed, wrote 12501000 recs in 1025968ms

•Thread 2 completed, wrote 12501000 recs in 1026454ms

•Thread 1 completed, wrote 12501000 recs in 1027078ms

•Thread 7 completed, wrote 12501000 recs in 1026548ms

•Thread 4 completed, wrote 12501000 recs in 1030068ms

•Thread 6 completed, wrote 12501000 recs in 1030140ms

•Summary: W 8 3000 (O=22224000 U=22224000 Q=22224000 T=11112000

Z=44448000) 100008000 1030140 97000

IBM Solution

Row compression – Performance

Compression Ratio for HKEx testing tablesTable RowsNo Comp(MB)

Comp(MB)

Ratio(%)

tblOrder_cm 22,224,000 5,428 880 84

tblTlog1_cm 5,556,000 1,551 225 85

tblTlog2_cm 5,556,000 1,551 225 85

tblTlog3_cm 5,556,000 1,551 225 85

tblTlog4_cm 5,556,000 1,551 225 85

tblTlog5_cm 5,556,000 1,551 225 85

tblTlog6_cm 5,556,000 1,551 225 85

tblTlog7_cm 5,556,000 1,551 225 85

tblTlog8_cm 5,556,000 1,551 225 85

tblTrade_cm 11,112,000 2,413 510 79

Total 77,784,000 20,249 3,190 84

With the following compression ratio, we find overall performance from

65k/sec to 97k/sec

IBM Solution

Database Management

IBM Solution

Deep Compression

Adaptive Compression is an enhancement to the Classic Row Compression

Benefits

• *60% storage space savings over Classic

Row Compression

• Reduce I/O

• Faster queries

TABLE

Static tablelevel

dictionary

Dynamic page level dictionary

Dynamic pagelevel dictionary

Dynamic pagelevel dictionary

DB2 pageDB2 page

DB2 page

• Better compression ratios than Classic Row Compression• Over time reduces need of a REORG as page-level dictionaries

adapt to data skew over time

IBM Solution

Relational

Interface

DB2

XML

Interface

Hybrid Engine for native XML data support

DB SERVER

CLIENT

SQL/XML

XQuery

Relational

XML

DB2 Client /

Client

Application

DB2 Storage:

Engine

Hybrid

IBM Solution

PL/SQL

CompilerPL/SQL

DB2 Server

SQL PLDB2

CompilerDB2 Engine

Hybrid Engine for native multiple language

IBM Solution

Workload Management

DefaultWorkload

Work action set

Superclass MAINSC

SubclassSCHIGH

SubclassSCMED

SubclassSCLOW

Tablespace

Cold

Tablespace

Warm

Tablespace

Hot

Map statement to service class (Predictive)

SQL compiler predicts what data (and table spaces) will be touched by the SQL

statement and builds the list of data tags

List of data tag will define the initial service class placement

4,5,6

1,2,3

7,8,

9

IBM Solution

Manageability of Aging Data

Partition

Automatic

Storage

Table

space

Storage

Group

Physical Disk

2012Q1 2011Q4 2011Q3 2011Q2 2011Q1 2010Q4 … 2006Q3

Partitioned Table Sales

Table Space 14

SG_HOT

spath: /hot/fs1

Table Space 13Table Space 12Table Space 11

spath: /warm/fs1spath: /warm/fs2

SG_WARM

Table Space 10 Table Space

9

Table Space 1

spath: /cold/fs1spath: /cold/fs2spath: /cold/fs3

SG_COLD

SSD RAID Array FC/SAS RAID Array SATA RAID Array

New