understanding why customers will move to db2 for z/os v8

IBM Software Group

®

Understanding Why Customers Will Move to DB2 for z/OS V8

Mark DePledgeDatabase Sales [email protected]

IBM Software Group

Agenda DB2 for z/OS V8

History

Features (30k feet) Why customers are moving to V8 Migration Planning Workshop DB2 Why customers are moving to V8 Exploiting DB2 V8 with Tools

IBM Software Group

V1.1 V1.2 V

1.3 V2.1 V

2.2 V2.3 V

3 V4 V

5 V6 V

7 V8

1983 1992 1993 1995 1997 1999 2001 2004

Brief DB2 History

Referential Integrity

PackagesData SharingT2 IndexesStored ProceduresCPU Parallel

UniversalDatabase

TriggersUDFUDTLOBsData Spaces

Parallel IOHiperspaces

Online ReorgTCPIPSysplexParallelism

GUI ToolsStore Proc LanguageRexx

SQLEnhancementsStats HistoryUtility Wildcards

MemoryAvailabilityPerformanceSQL

Bre

akthrou

ghs

VLDBNew

Workloads Unicode

Long Names

SequentialPrefetch

ExplainSequentialDetection

IBM Software Group

DB2 for z/OS Version 8 is

Reengineered for e-business Reengineered for e-business On DemandOn Demand

Reengineering & Renaissance

Breaking the Limits

SQL Function & DB2 family

Performance Enhancements

Continuous Availability

VLDB

Indexing Improvements

Utilities

WebSphere, Java, & Distributed

SAP, PeopleSoft, & Siebel

•Unicode Catalog (mostly)•Unicode, ASCII, and EBCDIC tables•Large Memory Addressing•Long Name Support•Multilevel Security with Row Level Granularity (MLS)•Server Location Aliases•Client Location Aliases

•Unicode Catalog (mostly)•Unicode, ASCII, and EBCDIC tables•Large Memory Addressing•Long Name Support•Multilevel Security with Row Level Granularity (MLS)•Server Location Aliases•Client Location Aliases

IBM Software Group


Breaking the Limits




VLDB


Utilities



DB2 for z/OS Version 8 is •64 bit addressing

•16 EB of storage•1TB per Bufferpool

•No Hiperpools or Dataspaces

•Indexes increased to 2000 bytes•128TB Tables (32K page)•4096 Partitions•2 MB SQL Statements•225 way joins•93 Active & 10000 Archive Logs


•64 bit addressing•16 EB of storage

•1TB per Bufferpool•No Hiperpools or Dataspaces

•Indexes increased to 2000 bytes•128TB Tables (32K page)•4096 Partitions•2 MB SQL Statements•225 way joins•93 Active & 10000 Archive Logs

IBM Software Group


Breaking the Limits




VLDB


Utilities



DB2 for z/OS Version 8 is •Common Table Expressions•Multi-row Fetch•Multi-row Insert•Wide Cursor Positioned Update / Delete•GET DIAGNOSTICS•Insert within Select•Sequences•Dynamic Scrollable Cursors•Current Package Path•Scalar Fullselect Expressions•Materialized Query Tables•XML Publishing•Volatile Table Attribute•SQL Procedure Language improvements•Multiple Distincts in a Select•New Special Registers to distributed threads•GETVARIABLE function

•For MLS & other info•Encryption Built In Functions•CARDINALITY clause•READ ONLY using KEEP UPDATE LOCKS•IS NOT DISTRINCT FROM…


•Common Table Expressions•Multi-row Fetch•Multi-row Insert•Wide Cursor Positioned Update / Delete•GET DIAGNOSTICS•Insert within Select•Sequences•Dynamic Scrollable Cursors•Current Package Path•Scalar Fullselect Expressions•Materialized Query Tables•XML Publishing•Volatile Table Attribute•SQL Procedure Language improvements•Multiple Distincts in a Select•New Special Registers to distributed threads•GETVARIABLE function

•For MLS & other info•Encryption Built In Functions•CARDINALITY clause•READ ONLY using KEEP UPDATE LOCKS•IS NOT DISTRINCT FROM…

IBM Software Group


Breaking the Limits




VLDB


Utilities





•Indexing improvements•NUDS on NICS•Cost Based Parallel Sorting•Star Join with Sparse Indexes•Enhanced Trigger operation•SQL Cardinality clause•REPORT(ONCE)•Dynamic Statement Cache Explain•Temp Tables ON COMMIT DROP•Data Sharing Improvements

•Batched GBP writes•Reduced False Contention

•Intelligent Visual Explain•Multi-row Fetch used for distributed connections•Materialized Query Table•WLM task control for Stored Procedures•BP Page Fixing

•Indexing improvements•NUDS on NICS•Cost Based Parallel Sorting•Star Join with Sparse Indexes•Enhanced Trigger operation•SQL Cardinality clause•REPORT(ONCE)•Dynamic Statement Cache Explain•Temp Tables ON COMMIT DROP•Data Sharing Improvements

•Batched GBP writes•Reduced False Contention

•Intelligent Visual Explain•Multi-row Fetch used for distributed connections•Materialized Query Tables•WLM task control for Stored Procedures•BP Page Fixing

IBM Software Group


Breaking the Limits




VLDB


Utilities



•Schema Evolution•Several changes which required a DROP are now online ALTERs•Adding Partitions•Rotating Partitions•Alter CLUSTERing•Tables & Indexes•Add index column•Dependent Indexes & Views handled•Sequence / Identity attributes

•Partitioning Improvements•Utility Enhancements•Improved LPL Recovery•Online ZParms•Sliding Scale SQTY

•Schema Evolution•Several changes which required a DROP are now online ALTERs•Adding Partitions•Rotating Partitions•Alter CLUSTERing•Tables & Indexes•Add index column•Dependent Indexes & Views handled•Sequence / Identity attributes

•Partitioning Improvements•Utility Enhancements•Improved LPL Recovery•Online ZParms•Sliding Scale SQTY



IBM Software Group


Breaking the Limits




VLDB


Utilities





•4096 Partitions•Data Partitioned Secondary Indexes (DPSI's)•Unbundling Partitioned / Clustering Indexes•Online Schema Evolution

•Add Partitions•Rotate Partitions•Data Type Change

•Performance/Optimization

•4096 Partitions•Data Partitioned Secondary Indexes (DPSI's)•Unbundling Partitioned / Clustering Indexes•Online Schema Evolution

•Add Partitions•Rotate Partitions•Data Type Change

•Performance/Optimization

IBM Software Group


Breaking the Limits




VLDB


Utilities




h

•Unlike Type Indexable Predicates•Reverse scan of an Index•NOT PADDED columns for

•Varying length index columns•Indexes only access

•2000 byte indexes•No partitioning index needed for partitioned tables

•Table Controlled Partitioning

•Partitioning and Clustering indexes do not have to be the same•Data Partitioned Secondary Indexes

•Enhanced recovery, locking concurrency, data sharing, eliminated BUILD2 phase.

•Unlike Type Indexable Predicates•Reverse scan of an Index•NOT PADDED columns for

•Varying length index columns•Indexes only access

•2000 byte indexes•No partitioning index needed for partitioned tables

•Table Controlled Partitioning

•Partitioning and Clustering indexes do not have to be the same•Data Partitioned Secondary Indexes

•Enhanced recovery, locking concurrency, data sharing, eliminated BUILD2 phase.


IBM Software Group


Breaking the Limits




VLDB


Utilities



DB2 for z/OS Version 8 is •System Level Backup•System Level Recovery with PIT option•REPAIR VERSION•Automatic Restart•REBALANCE•SORTKEYS / SORTDATA defaults•DFSort used by V8 Utilities•Catalog SHRLEVEL REFERENCE Online REORG•Online REORG w/DISCARD•Load / Unload delimited output•SCOPE PENDING•Runstats NUDS on NICS•Runstats Purge Dynamic Statement Cache•Accounting Data Aggregation

•System Level Backup•System Level Recovery with PIT option•REPAIR VERSION•Automatic Restart•REBALANCE•SORTKEYS / SORTDATA defaults•DFSort used by V8 Utilities•Catalog SHRLEVEL REFERENCE Online REORG•Online REORG w/DISCARD•Load / Unload delimited output•SCOPE PENDING•Runstats NUDS on NICS•Runstats Purge Dynamic Statement Cache•Accounting Data AggregationReengineered for e-business Reengineered for e-business

On DemandOn Demand

IBM Software Group

•Encrypt data on the wire•Extended DESCRIBE•SQL CANCEL•READ ONLY using KEEP UPDATE LOCKS•IS NOT DISTRINCT FROM…•Type2 & Type4 Java Drivers•TCPIP Improvements


Breaking the Limits




VLDB


Utilities




•Encrypt data on the wire•Extended DESCRIBE•SQL CANCEL•READ ONLY using KEEP UPDATE LOCKS•IS NOT DISTRINCT FROM…•Type2 & Type4 Java Drivers•TCPIP Improvements


IBM Software Group


Breaking the Limits




VLDB


Utilities



DB2 for z/OS Version 8 is •Long object names•Unicode table and SQL support•Scalar Fullselect•Sequences•Common Table Expressions and Recursive SQL•Multiple DISTINCT clauses•Group By expression•Literals and Predicates longer than 255 bytes•SQL statements greater than 32K bytes•Materialized Query Tables•Transparent ROWID for LOBs

•Long object names•Unicode table and SQL support•Scalar Fullselect•Sequences•Common Table Expressions and Recursive SQL•Multiple DISTINCT clauses•Group By expression•Literals and Predicates longer than 255 bytes•SQL statements greater than 32K bytes•Materialized Query Tables•Transparent ROWID for LOBs


IBM Software Group

Prerequisites Summary

zSeries Architecture (z800, z890, z900, z990) 64 bit exploitive z/OS 1.3 or above

Data Sharing improvements require z/OS 1.4 (with CFLevel 12)

System Level Backup / Recovery & Multilevel Security require z/OS 1.5 Migrate from DB2 for z/OS and OS/390 V7 Unicode Conversion Services enabled DSNHDECP customized for EBCIDIC, ASCII, and Unicode No Type1 Indexes Other prerequisites by feature Other assessments required

CCSIDs in V7 Language assessments

IBM Software Group

V8 Packaging & Changes (continued)

z/OS Application Connectivty (T4)

DB2 UDB for z/OS

Base Engine No-Charge Features

QMF

Enterprise

QMF TSO/CICS

DB2 Management Clients Package Includes:

DB2 Connect PE 8.1 *Control CenterDevelopment CenterReplication CenterCommand Center

z/OS Enablement for Control CenterDB2 Administration Server for z/OS (DAS)DB2 Visual Explain (CD/Rom)

Base Includes: Base (msys, Rexx) IRLM 2.2 ODBC/JDBC/SQLJ

JDBC (legacy+T2)DB2 Extenders

Text Extender (stabilized)Audio, Video, Image Extender (stabilized)XML Extender

QMF Classic

DB2 Management

Clients Package

Net.Data V7

(stabilized)

QMF Distributed

Net SearchExtender V7(stabilized)

-QMF for WebSphere-For workstation: - QMF for WebSphere - QMF for Windows - QMF VIsionary Studio

-QMF TSO/CICS- QMF for WebSphere- QMF High Performance Option (HPO)-For workstation: - QMF for WebSphere - QMF for Windows - QMF VIsionary Studio

* Note: Orders placed on or after November 12, 2004 will receive DB2 Connect PE 8.2

No-Charge / Optional

Priced /Optional

z/OS Application

Connectivity (T4)

DB2 UDB for z/OS

Base Engine No-Charge Features

QMF

Enterprise

QMF TSO/CICS

DB2 Management

Clients Package

Includes:

DB2 Connect PE 8.1 *

Control Center

Development

Center

Replication Center

Command Center

z/OS Enablement for

Control Center

DB2 Administration

Server for z/OS (DAS)

DB2 Visual Explain

(CD/Rom)

Base Includes:

Base ( msys, Rexx)

IRLM 2.2

ODBC/JDBC/SQLJ

JDBC (legacy+T2)

DB2 Extenders

Text Extender

(stabilized)

Audio, Video, Image

Extender

(stabilized)

XML Extender

QMF

Classic

DB2 Management

Clients Package

Net.Data V7

(stabilized)

QMF

Distributed

Net Search

Extender V7

(stabilized)

- QMF for WebSphere

-For workstation:

- QMF for WebSphere

- QMF for Windows

- QMF Visionary Studio

-QMF TSO/CICS

- QMF for WebSphere

- QMF High Performance

Option (HPO)

-For workstation:

- QMF for WebSphere

- QMF for Windows

- QMF Visionary Studio

* Note: Orders placed on or after November 12, 2004 will receive DB2 Connect PE 8.2

No-Charge / Optional

Priced /

Optional

IBM Software Group

Migrating to V8 More formalized than prior migration Migration occurs in three phases Only from DB2 for z/OS & OS/390 V7

Acquire and run DSNTIJP8 through the V7 maintenance stream and run against your V7 system early to discover items needing correction / change.

This is the same as DSNTIJPM delivered with V8. Reestablish the V7 IVP Assess ISV Package and Tooling Requirements Training

Technical Conferences

IDUG

Onsite DB2 for z/OS V8 Migration Planning Wworkshop

Health Checks / Solution Assurance Reviewss

IBM Software Group

Migrating to V8 Develop compatibility and coexistence goals Establish performance baselines Develop the project plan Plan for memory, CPU, and DASD increases, but also learn

about several features that will reduce / eliminate increases in all three categories

IBM Software Group

Compatibility Mode (CM)Fallback maintenance is required to enter CM (and other prereqs)

Can last as long as necessaryNo new function availableRun tests to ensure that no regression is taking place

V7 and V8 Data Sharing coexistence supported

Fallback to V7 is allowedMinimize time in CM with SAP

Enable New Function Mode (ENFM)

New Function Mode (NFM)

Migration ModesMigrating to V8

V8 Binaries/V7 Catalog V7 changes to V8 Catalog New V8 Feature

In CM you get:•64 bit•Hiperpools / Dataspaces converted to primary bufferpools•Bufferpool page fixing option•New access paths•New V8 Utilities (EXCEPT System Backup & Recovery)

•No new SQL function

IBM Software Group

Compatibility Mode (CM)Fallback maintenance is required to enter CM (and other prereqs)

Can last as long as necessaryNo new function availableRun tests to ensure that no regression is taking place

V7 and V8 Data Sharing coexistence supported

Fallback to V7 is allowedMinimize time in CM with SAP

Enable New Function Mode (ENFM)

Convert DB2 so that it is ready to support new functions

ƒ Series of ALTERS and ONLINE REORGS of the Catalog and Directory

ƒ Process can be halted and restarted

ƒ This is a group wide event - no V7 allowed even if ENFM not running

ƒ However, no fallback to DB2 V7 is alowed once this job is started

New Function Mode (NFM)Administrator runs a job that triggers the ability to use new features of V8

No Fallback allowed to V7No Returning to CMCan return to ENFM

ƒ No change to the catalog data or structure

Migration ModesMigrating to V8

V8 Binaries/V7 Catalog V7 changes to V8 Catalog New V8 Feature

IBM Software Group

V8 Interesting Coffee Topics Parts of V8 design has been in work since 1999 V8 Utilities use of DFSort

DB2 UDB for z/OS Utilities Suite has a license to use DFSort when invoked by the utilities

Must have access to DFSort R14 plus APAR PQ68263 applied

ISPF APAR OA07685 for Unicode browsing V8 IVP cannot be run until in New Function Mode

possibly

Cocktail Material

IBM Software Group

V8 Interesting Myths In V8, you will have to convert your application’s stored data to

Unicode. Convert only if you have the need to store international data.

Unicode will always double your storage requirement. Original UCS-2 stored everything in 2 bytes, but UTF-8 is very

similar to ASCII. Unicode does not affect me.

SQL & programs are prepared in Unicode. Once I start migrating to V8, I can’t go back.

Understand how and when fallback can be performed during a V8 migration and what options are available. Practice!

Migration is completely different in V8. In some ways, yes. In other ways, it is what we have been doing all

along.

IBM Software Group

V8 Interesting Myths V8 requires more CPU, Memory, and Disk

Maybe, but there are a number of items that will improve / reduce resource requirements with minimal or no changes

• Multi-row Fetch for distributed connections

• Bufferpool page fixing

Others will require some work, but no application changes

• Drop indexes no longer needed (reverse scan & partitioning)

• Alter / Rebuild indexes on variable length columns (NOT PADDED)

• REORG Tablespaces to match VSAM CI size to the DB2 page size

V7 16kPage size

VSAM4k

VSAM4k

VSAM4k

VSAM4k

V8 16kPage size

VSAM16k

Disk & IODisk & CPU

IO

CPUCPU

Savings!

IBM Software Group

DB2 for z/OS Migration Planning Workshop To help customers navigate through the DB2 for z/OS V8 information /

resources available To communicate prerequisites early in the decision making process To offer the opportunity to exchange ideas To bring a project focus to migration

IBM Software Group

Migration Planning Workshop - Checklists

Functional InventoryComponentsPrerequisitesMigration ConsiderationsRelease Incompatibilities

IBM Software Group

Migration Planning WorkshopFunctional Inventory2 pages representing the DB2 V8 featuresGeneral categorizationsTool used for survey conducted in December for 2004 attendeesHelps build business justification or just summarize the wealth of feature in V8

IBM Software Group

Migration Planning WorkshopComponents

Simple listing of FMIDs, PSP Bucket Information, and DescriptionsManuals providedHow to order manuals

IBM Software Group

Migration Planning WorkshopPrerequisitesListing of prerequisites, the associated requirement, and detailed notesMost of the checklist time is spent on these last three documents

IBM Software Group

Migration Planning WorkshopMigration Considerations

Items to watchMay not be required, but may impact your environment

IBM Software Group

Migration Planning WorkshopRelease IncompatibilitiesItems requiring evaluation when migratingPay special attention to internal and external toolingAlso include informational items

IBM Software Group

V8 Project Planning - Assumptions

Consider this a framework or skeleton - suggestionsUse for ideas in your own environmentTasks will be moveable to a degreeOverlay “freezes” based on your production schedulesEnvironments with many subsystems or data sharing in each environment (many Development, many Productions, etc) will likely needs more consideration analysis.

The plan contains dependencies, but no resource leveling

IBM Software Group

Installation of Code

CompatibilityMode

Enable NewFunction Mode

NewFunction Mode

V8 Project Planning

SandboxEnvironment

IBM Software Group

The Functional Inventory, Subsystem Defaults, and Migration Considerations are especially useful. I also like the open forum approach so that different

companies can explain their environment – a way to exchange ideas.

Customer CommentsVery good level set of V8 features. Will help with our V8 migrations. Very productive day & workshop. Thanks for the reference materials. Time was very well spent.

The project plan will come in handy with the administrative tasks. I took the 3 day transition class a few months back. This was a nice refresher course prior to installation.

The migration project plan was very good. It was not part of the transition class.

St. Louis, MO

St. Louis, MO

Pittsburgh, PA

Pittsburgh, PA

IBM Software Group

DB2 V8 Migration Penetration

1 2 3 4

2004 Quarter

V4

V5

V6

V7

V8

As of 12/17/2004

IBM Software Group

Why are customers migrating from the Field Information received on

approximately 30 customersDirect customer responses

Peer information sharing

FEATURE

Large Memory Support, 64-bit Addressing, VSCR 9.57%

Staying Current 6.38%

SAP, PeopleSoft, and Siebel General (ISV Driven) 5.32%

SQL Function & DB2 Family General 5.32%

Schema Evolution General 4.26%

Partitioning Improvements 4.26%

DPSI's (Enhanced Recovery, Locking, Data Sharing, & Eliminated BUILD2) 4.26%

Table Control Partitioning 4.26%

NOT PADDED Indexes (Varying Length & Index Only)3.19%

Performance Improvements General 3.19%

Fitting into other project timelines 3.19%

Long Name Support 3.19%

Multi-row Fetch 3.19%

Multi-row Insert 3.19%

2 MB SQL Statements 2.13%

Online ZParms 2.13%

SE: Sequence & Identity Attributes 2.13%

Sequences 2.13%

Online Reorg Discard 2.13%

Reverse scan of an index 2.13%

IBM Software Group



SQL Function & DB2 family 17%

Continuous Availability 16%

Indexing Improvements 12%

Reengineering & Renaissance 11%

Breaking the Limits 11%

SAP, PeopleSoft & Siebel 10%

VLDB 9%

No Category 6%

Performance Enhancements 5%

Utilities 3%

WebSphere & Java & Distributed 1%

IBM Software Group

DB2Tools

Database AdministrationDB2 Administration ToolDB2 Object Comparison ToolIBM Data Encryption for IMS and DB2 Databases

Utilities and Utility Management

DB2 Utilities SuiteDB2 Automation ToolDB2 High Performance Unload (z/OS and Multiplatform)

Application ManagementDB2 Bind ManagerDB2 Path CheckerDB2 Data Archive ExpertDB2 Information Integrator Classic Federation for z/OS

DB2 Table Editor (z/OS and Multiplatform)

DB2 Test Database GeneratorDB2 Web Query Tool (z/OS and Multiplatform)

Performance ManagementDB2 Performance Expert (z/OS and Multiplatform)

DB2 Performance MonitorDB2 Buffer Pool AnalyzerDB2 Query MonitorDB2 SQL Performance AnalyzerDB2 Omegamon for DB2

Recovery ManagementDB2 Archive Log AcceleratorDB2 Change Accumulation ToolDB2 Log Analysis ToolDB2 Object RestoreDB2 Recovery Expert (Multiplatform)IBM Application Recovery for IMS and DB2 Data Bases

DB2 DATA BASE TOOLS

Data ReplicationDB2 Data PropagatorInformation Integrator – Q Based Replication

IBM Software Group

New Replications Solutions for DB2 - Q Replication

ControlControl

FederationEngine

Log based

Source

Admin

WebSphere MQ

Capture

Target

Apply

StoredProcedure

Control

FederationEngine

Log based

Source

WebSphere MQ

Capture

Utilities

XML

• Availability, Event, Offload, Distributed

IBM Software Group

IBM Software Group

V8 Utilities Exploitation

IBM Software Group

IBM Software Group

! DB2 Tools To Leverage and Exploit DB2

IBM Software Group

References

Public web presentations http://www-306.ibm.com/software/data/db2/os390/presentations.html

http://www-306.ibm.com/software/data/db2/zos/index.html

Thank You!

understanding why customers will move to db2 for z/os v8

Documents