db-02 what’s new in the openedge ® rdbms angelo tracanna, sr manager, openedge data management...

DB-02DB-02What’s New in the What’s New in the OpenEdgeOpenEdge®® RDBMS RDBMS

Angelo Tracanna, Sr Manager, OpenEdge Data Management Products Tom Harris, Director, RDBMS DevelopmentBrian Werne, Sr Manager, SQL Development

© 2005 Progress Software Corporation2Sim

plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess

DB-02 What’s New in the OpenEdge RDBMS

AgendaAgenda

Objective: Overview of OpenEdge RDBMS

– Not technical

– Roadmap is covered in DB-09 (RDBMS roadmap)

Topics

– OpenEdge RDBMS

– OpenEdge SQL

– Benchmarks

– How Big Is Your Database?

Questions


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


We might Reference “10.1A”We might Reference “10.1A”

Delays sometimes happen… Until it ships, it’s “futures” We will color code 10.1A references in RED, We’ll also underline in case red looks like

everything else..


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


D I S C L A I M E R

Under DevelopmentUnder Development

This talk includes information about potential future products and/or product enhancements.

What I am going to say reflects our current thinking, but the information contained herein is preliminary and subject to change. Any future products we ultimately deliver may be materially different from what is described here.

D I S C L A I M E R


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


“Customers want to reduce complexity, lower administrative overhead, reduce human error,

and support larger and more databases”

Forrester Research, September 2004


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


OpenEdge RDBMS VisionOpenEdge RDBMS Vision

Data management that you’ll never outgrow and

that never requires administration


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


OpenEdge RDBMS GoalsOpenEdge RDBMS Goals

Reduce operating costs Make it invisible, self-administeringOnline schema changesBetter defaults

Make apps more competitive

High ScalabilityData Type SupportTurnkey replication solutionIntegrated auditing

Make apps easier to develop & deploy

Referential integrity (SQL)JTAEasier deployment of batch schema changes

Data management that you’ll never outgrow

Complete 24x7 capabilitiesNo growth limitationsSelf-sustaining


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


OpenEdge RDBMSOpenEdge RDBMS

Engine

Utilities

Language Support


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


What Have You Done For Me Lately?What Have You Done For Me Lately?PerformancePerformance

“NeoSynergy saw a 20-25% performance increase when using R10 and Type II

storage areas.”

Allen Green, NeoSynergy


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


PerformancePerformance

Can use both Type I & Type II Areas “Type II” Storage Areas

– Better IO performance, space allocation– Higher concurrency during allocation– 40% more thruput for DB intensive apps

YMMV, transportation, meals, and accommodations not included

Type II Areas are now used for temp tables


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess



Improved buffer locking protocol Object Locking for lock table Improved txn end & disconnect concurrency

– Per user lock chains – faster disconnects More index build enhancements Utilities upgraded to exploit Type II areas

– Binary D/L

– Table Move

– Index Build


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess



Record Packing Factor configurable (area/table)

_proutil <db> setTableTossLimit <table> value

_proutil <db> dispTossCreateLimits <area num>

Object number: 11, type: 1, Toss Limit: 100, Create limit: 75

Object number: 12, type: 1, Toss Limit: 150, Create limit: 75


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


High-Availability-Online ChangesHigh-Availability-Online Changes

Schema Changes– Add table, sequence

– 10.1A Add field/column, index

– 10.1A Activate/deactivate index

– 10.1A Add Extents Turn off after-imaging


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


High AvailabilityHigh Availability

Fathom™ Management Support new platforms

– SOL64, AIX 64, WINDOWS XP Collections - logically group resources User defined rules Scheduling flexibility


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


High AvailabilityHigh Availability

Fathom Replication - Availability Improved– Network loss detection

– Apply ai files through replication

– Create target DB from online source backup

Failover Clusters– Bundled into Enterprise

RDBMS


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess



Engine

Utilities

Language Support


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


UtilitiesUtilitiesDatabase Version ChangeDatabase Version Change

Convert from V9 to OpenEdge 10 “release family”– New schema tables

– Physical schema changes

– Follows 5 minute conversion rule


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


UtilitiesUtilities

Index Rebuild– Rebuild by area, table or schema

_proutil <db> -C idxbuild table <table> Binary dump w/o index 10.1A Rebuild active/deactive indexes


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


UtilitiesUtilities

Dbtool– reconciles 4gl char variable width discrepancy

with OpenEdge SQL VARCHAR semantics

– Very fast cursory validation of all data blocks

– Scanned 1,174,740,013 records (240GB) in 2hr

– about 25 sec per gigabyte...


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess



Engine

Utilities

Language Support


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


Language SupportLanguage Support

4GL Temp-tables utilize Type II Storage Areas– Fast empty/drop

– Use “empty temp-table <name>”

– Space overhead mitigated by increasing -Bt

Fast Table Scan (OpenEdge SQL)


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess



Data Type Support for 4GL– BLOB

– CLOB

– DateTime

– DateTime with Timezone


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


Application SupportApplication Support

Security– Optional SSL for communications:

4GL client <-> database server OpenEdge SQL client <-> database

server


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


AgendaAgenda

Topics

– OpenEdge RDBMS

– OpenEdge SQL

– Benchmarks

– How Big Is Your DataBase?

– Questions


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


OpenEdge SQLOpenEdge SQL

SQL Engine

Network

BI Support


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


CorVu 5 Existing ProductsCorVu 5 Existing Products

CorBusiness– Business Analytics

– CorPortfolio, HyperVu

CorStrategy– Scorecarding


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


CorVu 5 New ProductsCorVu 5 New Products

CorPlanning– Financial planning

CorRisk– Risk management

CorIncentive– Incentive management

NEW

NEW

NEW


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


Crystal XICrystal XI

Crystal Reports– Professional– Developer

Crystal Reports Server– CR Developer– Web engine for 5 Concurrent users

Business Objects Enterprise– Professional– Auditing / Explorer / LiveOffice Add-on– Premium


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess



Engine

Network

BI Support


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


OpenEdge SQL – Network LayerOpenEdge SQL – Network Layer

Faster client/server performance– Less network traffic

– Streamlined protocol Base for future streamlining

Effect: Progress v9 -> OpenEdge 10 + 100%


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess



Engine

Network

BI Support


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess



Data Type Support for OpenEdge SQL– BLOB

– CLOB

– TimeStamp (DateTime)

– TimeStamp with TimeZone (DateTime-TZ )

Internal datatype for future 64-bit support


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


Application SupportApplication Support

Security– Optional SSL for communications:

OpenEdge SQL client <-> database

Database

SQL Server

Sql client Network message


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


OpenEdge SQL - Engine EnhancementsOpenEdge SQL - Engine Enhancements

Optimizer improvements for BI / reporting– Better performance with outer joins

– Improved cost estimation with parameterized queries

– Improved join order planning – smarter cost estimation


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


OpenEdge SQL EnhancementsOpenEdge SQL Enhancements

Improved optimizer statistics with schema changes in v10 – index and column.

Enhanced ODBC/JDBC drivers (v4.1) Coming soon: Type 4 JDBC drivers and

Wire ODBC drivers


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


OpenEdge SQL EnhancementsOpenEdge SQL Enhancements

Configurable lockwait timeout

DDL - schema changes– partial ALTER TABLE

– Online schema phase 3

Type II areas enhancements– Fast table scans/drops


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


OpenEdge SQL - Statement cachingOpenEdge SQL - Statement caching

Similar statement are executed by common prepared statement– Select * from Sales where date =‘06/05/2005’;– Select * from Sales where date =‘07/15/2004’;

Automatic optimization for statements on a connection

Patterns of statements

Database

SQL Server

Sql client

Select *from pub.sales where date = ‘06/05/2005’

8765 General Motors 1235143 Toyota Mfg, Inc. 4228123 Chrysler Motors 274… … …

Select *from pub.sales wheredate = ‘07/15/2004’

3205 Laval Motors 689


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess



91A 91B 91C 91D08 10B02

Average 90.112 90.69 86.45 7.712 4.603

• 1,082 similar SQL queries (seconds)

• 5 runs of all 1,082 queries – like last year

• NT-NT local test setup

• Tiny result set, mimics web catalog queries


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


AgendaAgenda

Topics

– OpenEdge RDBMS

– OpenEdge SQL

– Benchmarks


– Questions


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


Performance Benchmark Performance Benchmark V8, V9 & OpenEdge 10 SummaryV8, V9 & OpenEdge 10 Summary

Progress v8 -> OpenEdge 10 + 43% Progress v9 -> OpenEdge 10 + 10 %

– OLTP load Out-of-box + 5% Type II Storage Areas + 24%

– Admin Utilities Out-of-box + 7% Type II Storage Areas - 3%

Full results available in White Paper FIXED


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


SQL Benchmark SQL Benchmark

Progress v9 -> OpenEdge 10

– Insert with Index + 35%

– Update with Index + 26%

– Scan select + 56%


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


AgendaAgenda

Topics

– OpenEdge RDBMS

– OpenEdge SQL

– Benchmarks


– Questions


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


1 TB OpenEdge DB - “A nice test 1 TB OpenEdge DB - “A nice test database”database”

Servers

JDBC4GL

BKUP

REPL

IDX-C

RDBMS

OpenEdge10.1A Linux

NetApp FAS270

d "Cust Trade History Area":18,128 /d2/hydra/hydra_18.d1 f 2200000

Hydra Test SystemSimulates an equity trading houseThe database contains customersEach customer starts with 10 accountsEach account owns equitiesEquity: stock, bond, currency, fundThese are NOT real equities!


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


OpenEdge RDBMS VisionOpenEdge RDBMS Vision

Data management that you’ll never outgrow and

that never requires administration


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


10.X – A Base For Online Operations10.X – A Base For Online Operations

Easy to Get To Faster Scalable Highly available Future releases continue to enhance

performance & high availability Maximizes your competitive advantage

Tom after hours??


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


Questions?Questions?


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


Thank you for Thank you for your time!your time!


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


Database-Related SessionsDatabase-Related SessionsSession Date

Database Roadmap Tuesday, 2:15 pm

Connectivity Solutions from DataDirect

Tuesday, 4:45 pm

Pick an Index, Any Index Wednesday, 9:00 am

Understanding Virtual System Tables Wednesday, 10:15 am

Sometimes a Great Notion: Breaking the Logjam

Wednesday, 1:00 pm

Developing Performance-oriented ODBC/JDBC OpenEdge Applications

Wednesday, 2:15 pm

JTA Transactions in the RDBMS; What’s Going on Down There?

Wednesday, 3:30 pm


plify

you

r bu

sin

ess

Sim

plify

you

r bu

sin

ess


db-02 what’s new in the openedge ® rdbms angelo tracanna, sr manager, openedge data management...

Documents