database platform discussion.pdf
TRANSCRIPT
IBM Solution
Main Data Centers DR CenterDB replications
Site A site B
Pros Built-in DR engine without additional components
Simple architecture, no data consistency handling across sites
Cons Required double storage spaces
Standby supports only read only or idle configuration
Data need to be partitioned for site A and site B
A A1(idle) A2 (idle)
BB1(idle) B2 (idle)
Option 1
IBM Solution
DR
(Passive)
Site 1
(Active)
Database
Replication
HADR
M1, M2 M3, M4 M3, M4M1, M2
Site 2
(Active)
Geographically Dispersed Cluster + database replication
A A A”
Pros Database handles all data synchronization across site1, site2 and DR
Single database
Cons Require dark fibre or 10GB Ethernet between site 1 and site 2
Require additional site ( site3 ) as judge to split brain
IBM Solution
55
BCOM- Internet Payment System收付通宝, Inter-banks payment systems二代支付- Cross site cluster
Mbr1
Mbr3
Mbr2
Mbr4
CFsec
CFprim
N kms
Dark Fiber or 10 Gb WAN
Database
Log Log Log Log
Fiber ChannelGPFS Shared Storage (logical view)
Physical Storage site 'A' Physical Storage site 'B'
Infiniband
GPFS replication between sites
Ethernet
3rd site
tie-breaker
Reference of using GDPC
IBM Solution
6
BTMU - Retail Banking Application- 1TB compressed database size- 3 years production
6
2core
84GB Memory2core
84GB Memory
Reference of using virtualization
IBM Solution
7
HKEx – server environment
Two Intel Quad-Core E5450 Processors
12GB RAM
locally-attached 145GB (SAS + RAID1)
Red Hat Enterprise Linux 5.3
2 HP VRAIDs from 8 physical disk drives
VRAID 0 for Transaction log file system
VRAID 1 for database file system
HP DL360 G5 Server SAN Storage server
LUN0
LUN1-A
LUN0
LUN1-A
LUN0
LUN1-A
LUN0
LUN1-A
LUN0
LUN1-B
LUN0
LUN1-B
LUN0
LUN1-B
LUN0
LUN1-B
RSS1
RSS2
VRAID0
VRAID1
* This disk layout is an assumption based on the information
provided by the cust :
2 HP VRAIDs( VRAID0 and VRAID1) from 8 physical disk
drives.
*
HP Server and Storage in customer site is used
DB2 achieved
30% more transaction
than Oracle per min
On same hardware
Reference of using DB2 with high transaction requirement
IBM Solution
Longevity in Transaction Processing Performance
Benchmarks are often a game of leapfrog
DB2 has demonstrated sustained superiority over competitors
8
Results as of Nov 20, 2014
IBM Solution
Features Desription Similar to Oracle Feature
BLU In-memory columnar capabilities Exadata - storage IO
pureScale Active-Active RAC
Data Partitioning Feature Database partitioning No offer
Optim Performance Manager Extended Edition Performance monitoring Tuning Pack
Optim Query Workload Tuner Workload monitoring Workload manager
Optim Configuration Manager Configuration Admin Configuration Pack
InfoSphere Optim pureQuery Runtime for LUW Query optimization No offer
Warehouse Model Packs Data Warehouse Model No offer
WHS SQW ETL tool Data Integrator
WHS Mining & text Analytics Data Minining Data Minining
Cognos 10.2 5 Users BI front end OBIEE
WHS Cubing Services BI Cube OBIEE Cube
InfoSphere Data Architect Capabilities Data Modeler Designer
solidDB & solidDB UC In memory database cache Times Ten
IBM Mobile Database Sync Mobile database Mobile Server
pureXML Storage XML database XML type
Time Travel Query Database auditing Auditing expert
Compression Compression Adv. CompressionRow & Column Access Control Security Adv. Security
Label Based Access Control Security Label Security
SQL Replication Replication DB Link
Federation Capabilities DB Feberation cross database Transparent Application Gateway
Websphere MQ Message Queue MessageQ
High Availability Disaster Recovery Log shipping Data Guard
Tivoli System Automation Clustering software Veritas
Multi-temperature Storage Hot/Warm/Cold multi-tierdata storage No offer
Materialized Query Tables MQT MQV
Multi-Dimensional Clustering Storage clustering No offer
Table Partitioning Table Partition Partioning Feature
Scan Sharing Scan result sharing Exadata - scan sharing
DB2 Workload Management (WLM) Query workload priorization Workload manager
MQ Replication / CDC CDC Golden Gate
Simple Package with all Enterprise level functions
IBM Solution
Virtualization Licensing
With SQL Server you have two options
1. License all virtual cores for a VM (min 4 core licenses) – can end up licensing more
cores than exist on a machine
2. License all physical cores on a machine (Enterprise Edition only)
With DB2
– Sub-Capacity Licensing allows for licensing of only the physical cores used by DB2
– With Workgroup can run unlimited VMs of DB2 on up to 16 sockets
10
IBM Solution
Small applications
HA pair
Server options in DB2
• Database replication pairs
DR or remote site
requirement
HA pair
• Share disk + cluster software
Idle Active
IBM Solution
Server options in DB2
PPRC/Q-rep
Continous availbility
Concurrent Access Cluster
SAN
Data node Data node Data node
SAN
Data node Data node Data node
•Support rolling fixpak upgrade and non-interrupt member addition in v10
•Support PPRC ( active-passive ) and Q-rep ( active-active )
•Extended Purescale provides cross site clustering within 30Km
Concurrent Access Cluster
IBM Solution
DB2 with BLU AccelerationRich capability integrated with IBM DB2 10.5
What is DB2 with BLU Acceleration?
In-memory analytic database
Multiple IBM innovations
– In-memory processing
– Columnar storage
Multiplatform: Supports AIX, Linux, zLinux, Windows
Ready for Analytics with no tuning effort
•Analyze more data faster and more
efficiently
•Fast Answers. Simply Delivered.
IBM Solution
© 2014 IBM Corporation15
Hardware
Software
Admin
Data
Software
Admin
Data
Data
Layer
Gu
essw
ork
, O
ve
rhe
ad
, R
isk
✓ No Guesswork
✓ Smallest Risk
✓ Guaranteed Uptime
Roll-Your-Own Hosted
Database as a Service
Data
Warehouse
✓ No Tuning
✓ Truly Agile
✓ Appliance Simplicity
Data Warehouseas a Service
Server Options (New Cloud option)
IBM Solution
Benchmark Result
Goal : Achieve not less than 30k/sec with 100000000 records
Result from IBM : 97k/sec
•Thread 8 completed, wrote 12501000 recs in 1024354ms
•Thread 3 completed, wrote 12501000 recs in 1025968ms
•Thread 2 completed, wrote 12501000 recs in 1026454ms
•Thread 1 completed, wrote 12501000 recs in 1027078ms
•Thread 7 completed, wrote 12501000 recs in 1026548ms
•Thread 4 completed, wrote 12501000 recs in 1030068ms
•Thread 6 completed, wrote 12501000 recs in 1030140ms
•Summary: W 8 3000 (O=22224000 U=22224000 Q=22224000 T=11112000
Z=44448000) 100008000 1030140 97000
IBM Solution
Row compression – Performance
Compression Ratio for HKEx testing tablesTable RowsNo Comp(MB)
Comp(MB)
Ratio(%)
tblOrder_cm 22,224,000 5,428 880 84
tblTlog1_cm 5,556,000 1,551 225 85
tblTlog2_cm 5,556,000 1,551 225 85
tblTlog3_cm 5,556,000 1,551 225 85
tblTlog4_cm 5,556,000 1,551 225 85
tblTlog5_cm 5,556,000 1,551 225 85
tblTlog6_cm 5,556,000 1,551 225 85
tblTlog7_cm 5,556,000 1,551 225 85
tblTlog8_cm 5,556,000 1,551 225 85
tblTrade_cm 11,112,000 2,413 510 79
Total 77,784,000 20,249 3,190 84
With the following compression ratio, we find overall performance from
65k/sec to 97k/sec
IBM Solution
Deep Compression
Adaptive Compression is an enhancement to the Classic Row Compression
Benefits
• *60% storage space savings over Classic
Row Compression
• Reduce I/O
• Faster queries
TABLE
Static tablelevel
dictionary
Dynamic page level dictionary
Dynamic pagelevel dictionary
Dynamic pagelevel dictionary
DB2 pageDB2 page
DB2 page
• Better compression ratios than Classic Row Compression• Over time reduces need of a REORG as page-level dictionaries
adapt to data skew over time
IBM Solution
Relational
Interface
DB2
XML
Interface
Hybrid Engine for native XML data support
DB SERVER
CLIENT
SQL/XML
XQuery
Relational
XML
DB2 Client /
Client
Application
DB2 Storage:
Engine
Hybrid
IBM Solution
PL/SQL
CompilerPL/SQL
DB2 Server
SQL PLDB2
CompilerDB2 Engine
Hybrid Engine for native multiple language
IBM Solution
Workload Management
DefaultWorkload
Work action set
Superclass MAINSC
SubclassSCHIGH
SubclassSCMED
SubclassSCLOW
Tablespace
Cold
Tablespace
Warm
Tablespace
Hot
Map statement to service class (Predictive)
SQL compiler predicts what data (and table spaces) will be touched by the SQL
statement and builds the list of data tags
List of data tag will define the initial service class placement
4,5,6
1,2,3
7,8,
9
IBM Solution
Manageability of Aging Data
Partition
Automatic
Storage
Table
space
Storage
Group
Physical Disk
2012Q1 2011Q4 2011Q3 2011Q2 2011Q1 2010Q4 … 2006Q3
Partitioned Table Sales
Table Space 14
SG_HOT
spath: /hot/fs1
Table Space 13Table Space 12Table Space 11
spath: /warm/fs1spath: /warm/fs2
SG_WARM
Table Space 10 Table Space
9
Table Space 1
…
…
spath: /cold/fs1spath: /cold/fs2spath: /cold/fs3
SG_COLD
SSD RAID Array FC/SAS RAID Array SATA RAID Array
New