carolina yalamova ndb ltd

IBM Software Group

®

Carolina YalamovaNDB Ltd.

IBM Business IntelligenceIBM Business Intelligence

IBM Software Group | DB2 Information Management


Anatomy of Business Intelligence Solutions

TransactionOperationalDemographicLifestyleFinancialEconomicGovernmentAssociations

Data DiscoveryCustomer segmentationDemand & forecastingAffinity merchandisingProduct & customer profitability

Fraud patterns & profiles

Business ActionsCustomer retention programs

Where to advertiseOptimize mailing listMaximize store layoutCross-product marketingImproved risk profilesFunds allocation


Source: IDC,The Financial Impact of Business Analytics study, Nov. 2002% ROI Achieved

1-50 51-100 101-500 501-1000 1000+

30

25

20

15

10

5

%

% of Clients

Achieving This

ROI

Average ROI = 431%

Why Should Customers Do BI projects Now?


End-User's productivity

Source: Gartner Group

Collect Data

Analyse Data

Determine Decision

Plan Scenario

Act on Plan

0 10 20 30 40

Percent of Time Spent on Activity

0 10 20 30 40

Without BI Applications With BI Applications


Business Intelligence Architecture

Operational Databases

Extract, transform, merge, load

Line of Business Data Marts

Enterprise Data Warehouse

End User Analytic Tools Query &

ReportingData

MiningSpatial

metadataETL

A single version of the truth

Slices of data for departments

End userDelivery & analysis

Clean it upConsolidate

Production


MOLAP, HOLAP, ROLAP

IBM Software Group

®

IBM Business Intelligence

Software Overview


Information IntegrationDB2

Ad

min

istration

Data M

inin

g

OL

AP

ET

L

Scalab

ility

SQL XML PMML

The DB2 Framework for Business Intelligence

Build BI function into the database, as part of an integrated BI platform, exposed solely through open, standard interfaces, and collaborating with partners for other layers of the BI architecture


IBM Products Mapping

Operational Databases

Extract, transform, merge, load

Line of Business Data Marts

Enterprise Data Warehouse

End User Analytic Tools Query &

ReportingData

MiningSpatial

metadataETL

DB2 ESEDB2 Query PatrollerDB2 Cube ViewsDB2 DPF

DB2 OLAP Server

Intelligent MinerSpatial ExtendersOffice ConnectQMFAlphablox

DB2 WH CenterDB2 WH ManagerDB2 II

Production

IBM Software Group

®

IBM Business IntelligenceIBM Business Intelligence

DB2DB2


Fast Data Access - Multidimensional Clustering Data is organized on disk based on dimensions

Eg. store data on disk by Region and Year

Queries skip portions of table that we know don’t qualify

i.e. no need to scan 1997 data if query is asking for 2000

Data automatically clustered Never need to recluster data (i.e. no REORG)

Customer Quote: “The new multidimensional data clustering capability

has improved performance of our most complex queries by up to 30 times while removing the need for additional reorganization.”

Ken Ross, Senior Vice President and CTO, Thomson West

yearregion

DimensionBlock Index on Region

DimensionBlock Index on Year

East, 1993

East, 1996

North, 1996

North, 1997

North, 1998

South, 1999

Data stored

Point1D Range

2D RangeCell

ANDingORing

MultiJoin0

10

20

30

40

50

60

70

MDC nonMDC


Multi-Dimensional Clustering Advisor The MDC advisor feature of the DB2 Design Advisor recommends MDC

clustering dimensions, including coarsifications on base columns in order to improve workload performance

This includes potentially recommending generated columns that define coarsification of dimensions.

Cost benefit analysis includes impact of MDC on Insert/Update/Delete activity against dimensions (which may cause records to move cells).

Cost benefit analysis also models the potential negative effect of MDC caused by table expansion.

The MDC advisor has a goal to select MDC solutions that result in a moderate table expansion

Benefit: Competitive Advantage, Customer Requirement


Oracle ServerDB2 Server

Fast Data Access - Materialized Query Tables

Caches results for faster data access Cache automatically maintained as base data is modified Queries automatically rerouted to use MQTs that qualify

MQTs can cache data from other platforms Including Oracle, Microsoft and other data sources

Table 1 Table 2 Table 3 OracleTable 1

MQT_1 MQT2


Materialized Query Table Advisor An advisor to recommend creation (and removal) of Materialized Query Tables

(formerly known as AST's in DB2) based on submitted SQL workload Very difficult to choose the correct MQTs to create without the help of this wizard

Much more complex than deciding which indexes to create Includes enhancements to the index wizard

allow indexes and MQTs to be recommended together (including recommendations for indexes on MQTs).

"db2advis" command with added flags to allow index and MQT recommendations

This feature procedure will also be accessible using a GUI interface.

Benefit: Competitive Advantage, Customer Requirement

IBM Software Group

®


OLAP Server


DB2 OLAP Server

DB2

source dataMulti-dimensional Cubes

DB2 OLAP Server

DB2 OIS

Partitioning option

High concurrency

option

SQL interfaceEssbase APIMS Excel macrosCurrency conversions

Analyzer, Brio, or

Windows Client


DB2 OLAP Server v8 Summary

Hybrid Analysis -- cubes with performance of DB2 OLAP with transparent link to highly scalable relational detail data

Integration Server Parallelism

ƒ Load, Calc, ExportOLAP Miner -- end user tool to discover unknown trends and opportunities

Enterprise Services for high availabilityƒ load balancing, ƒ connection pooling, ƒ clustering ƒ failover capabilities

Administration Services -central management of OLAP Servers from anywhere in the enterprise


DB2 OLAP Server- Benefits

Best in class OLAP

Easy to build summaries and hierarchies to match corporate structure & goalsNavigate complex data dimensions fast to make complex business decisions wide range of ISV support

Business CalculationsRich library of functions makes it easy to define advanced & sophisticated business logic and relationships

Hybrid analysisSummaries end & detail data begins where YOU want it toMatch details & summaries to usage patterns for productivityDrill down & through is seamless for end users

Distributed cubesCreate virtual linked cubes for unified view of the businessProvides load balancing & removes single point of failure

DTG

Benefit

IBM Software Group

®


DB2 Warehouse Center DB2 Warehouse Center //DB2 Warehouse ManagerDB2 Warehouse Manager


ETL - Data Warehouse Center / DB2 Warehouse Manager

Data sourcesData sources

VSAM files DB2 SAP IMS

Data WarehouseODS

Process Modeling Data Extraction Data Loading Process Modeling Data Extraction Data Loading Data Transformation Data Cleansing Data Transformation Data Cleansing

Data Movement Job Scheduling Metadata Data Movement Job Scheduling Metadata

OLAPCubes Data Marts

ORACLEInformixSybase Web Linux

Data Warehouse Center / DB2 Warehouse Manager


DB2 Data Warehouse Manager and Center

DB2 Data Warehouse Centerƒ DBA administration consoleƒ Access to most RDBMS's & flat filesƒ Schedules and monitors database tasksƒ 150+ prebuilt data transformationsƒ Parallel extracts & transforms

DB2 Warehouse Manager adds:ƒ Extracts & transformations on remote servers

via agentsƒ Information Catalog end user metadata

Information Catalog

DB2 Warehouse Manager

DB2 Warehouse Center

extract, transform, load, schedule, administrate

Internet

File Edit View

Help

Tools

BackForward Stop Home

SearchRefresh

x History Mail

Print

Address: http://the_call_center/customer/lookup

07/02/2001 19:29:20

WPS v1.2 - The Cutting EdgeWPS v1.2 - The Cutting Edge

home

1 cust-nbr2 acct-code3 first name4 last name5 street6 city7 zip8 country

1 cust-number2 acct_type3 F-name4 L-name5 street6 city7 postal_code8 country

DB23m

Metadata

IBM

ETL agents


DB2 Warehouse Manager - Benefits

DTG

Benefit

SQL/Java extracts & transformations

Leverage existing programming skills -- nothing proprietaryStandards based transforms are portable to applicationsReduced training costs now & in future

Parallel extracts & transforms

High performance gets you through the processing "night"Scalability to match your workload

ETL Server agents Processing at the source spreads the workload, avoids bottlenecks, and saves hardware costs

No licenses costs for agents on servers saves money

150+ transforms Pre built transforms cover majority of tasks so you don't have to write or maintain as much software - less code, less cost

Accelerates programmer productivity

IBM Software Group

®


Query Patroller


Query Patroller

Intercept query from the clientGoverns & Throttles Queries

ƒ Ask DB2 the cost in resourcesƒ Queue SQL based on user's priorityƒ Release SQL to run

Graphical tools to Administer and Report

ƒ Charge Back & Trend Statistics

Flexible result set options ƒ Queue handling of reports returned

Interoperates with end user tools

Data WarehouseData Warehouse

an

sw

ers

explain

sSQL 14SQL 15SQL 21SQL 23

QueryQuery

PatrollerPatroller

DB2DB2

OptimizerOptimizer

answer setsqueued

queues


Query Patroller Benefits

Benefit

Manages SQL traffic into DB2

Ensure smooth use of RDBMS resources, maximizing throughput, and making best use of server; prevents unnecessary server upgrades

SQL query result set "caching"

let's users submit queries and pick up results later without locking up the workstation

answer sets can be shared between users reducing need to run the query once per user

Historical analysis reports

analyze trends to forecast when upgrades may be neededanalyze patterns to detect problems and minimiz

Prioritize user queries

ensure time critical business tasks get doneminimize performance impact of long running queries, ensuring uses with short, quick reports get through

IBM Software Group

®


Office Connect


Office Connect

repository

ApplicationDatabases

HTML sources

JDBC/ HTTP

Web EditionDesign time

ODBC/ HTTP

ODBC

JDBC

HTTP

Client Browser Servlet Engine

TomcatWebSphere

Office Connect Servlet

TomcatApache

HTTP Server

A B C D E F G H I J K L M N

1 Profit Actual Cola

2 Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Tot

3 New York 262 245 259 276 295 357 370 368 312 247 236 271 3498

4 Florida 367 340 366 397 434 547 564 563 465 348 324 390 5105

5 Virginia 68 63 67 73 78 99 104 104 86 64 63 73 942

demo pg6Microsoft Excel - Sales forecast.txt

B100% 10

File Edit View Insert Format Tools Data Window Essbase HelpABC A

ZArial I


Office Connect - Benefits

Uses Microsoft Excel as Query Tool

query tool already installed on 95% of desktops so no additional user fees for toolsuser is already skilled in use of XL so no training costsBasic reporting capability easy to learn and share with othersusable by professionals who don't have a lot of computer skills

Web Based Servercan scale up to handle 1000s of users with minimal administration costs

Repository for Spreadsheets

lets users share query spreadsheets over the intranet or internet

DTG

Benefit

IBM Software Group

®


DB2 Cube Views


DB2 Cube Views = an OLAP Accelerator

DB2

DB2 Cube Views

Applications

Query & Reporting

Tools

ROLAPServers

DOLAPServers

MOLAP Engines

Net present value, allocations, write back, etc.

Business Functions & Operators

ApplicationsBI Tools

Business Functions

& Operators

Business Functions

& Operators

OLAP servers

DTG


What Are DB2 Cube Views?Wizard to design & generate cube views

ƒ Wizard for cube definition, metadata modeling, and optimization

Multi-dimensional metadata inside DB2ƒ Import/export utilities for metadata exchange a objects, relationsƒ described in XML for ease of useƒ Used to generate the Materialized Query Table(s)

Application Programming interfaceƒ SQL & XML based interfaces from DB2 to tools & applicationsƒ CLI, ODBC, JDBC, stored proceduresƒ OLAP Web services

MQT


Cube Models & CubesCube Models & Cubes


BridgesBridges

1

XML

DB2 Stored DB2 Stored ProcedureProcedure

DB2DB2Hyperion

BUSINESS OBJECTS

1

XML

Simple interfaceƒ Stored Procedure and XML document

Bridge into and out of DB2ƒ Enables end to end flow of dimensional metadata

Cube Views


materialized query tables

rows & columns

Query ResultsQuery Results

Data loadingData loading

Hybrid Hybrid AnalysisAnalysis

Cube BuildCube Build

Drill throughDrill through

DB2 OLAP Server

MQT's for ƒ Faster cube loadƒ Faster drill through reportsƒ Faster hybrid analysisƒ Faster Ad-hoc analysisƒ Faster reporting

Aggregates are required for OLAPAggregates are required for OLAP


Performance AdvisorPerformance Advisor

.

Aurora Model

OLAP MetadataOLAP Metadata

Base TablesAdministrator Catalog Tables

Time & Space constraintsOptimization hints

Model Information

Data Samples

StatisticsQuery history

MQT's

IBM Software Group

®


Data Mining


What is Data Mining?

Data Mining summarises a set of methods to analyse very large data sets,which discover,

from the innumerable amounts of detail data, new and unknown structures and patterns then present them such that they efficiently support

the decision process to provide business advantage.

or... finding out useful things in your data that you didn't know!

"The secret to business is knowingsomething that someone else doesn't." Aristotle Onassis


DB2 Intelligent Miner Modeling DB2 Intelligent Miner Modeling

DB2 Intelligent Miner ScoringDB2 Intelligent Miner Scoring

DB2 Intelligent Miner VisualizationDB2 Intelligent Miner Visualization

DB2 OLAP MinerDB2 OLAP Miner

IBM Data Mining Products


Data Mining Techniques

Clustering (Demographic and Neural)

? What logical groups exist?Associations

? What are the linkages among events?

Classification ? Can I determine which category an event will fit?? What are the major factors that influence the

occurence of the event?Regression

? How much?

Prediction

Discovery


IM Modeling IM Visualization IM Scoring

Model applied real time in applications

Analyst defines model and runs the analysis …

… using data from the data warehouse

XML

Model can be viewed standalone or over the web

XML

DB2 OLTP, DW or ODS

Data Mining Functions in DWE


Data Mining with IM DB2 Functions Preprocess your data

? With any SQL statement, Warehouse transformers, create VIEWs Use IM Modeling SQL types and methods

? Define mining parametersCall IM Modeling stored procedure

? Do the mining runCall IM Visualization

? Visualize and analyse the resulting mining modelUse IM Scoring function in SQL or Java bean

? Apply the model to new data

IBM Software Group

®


DB2 Data Warehouse Edition


What is DB2 Data Warehouse Edition?

A strategy for ensuring more BI function is easily available to more customers

ƒ Simplify: Make it easy to use, easy to buy, easy to understand

A collection of engines and tools to build data warehouses and analytic applications:

ƒ DB2 UDB Data Warehouse Enterprise Edition

ƒ DB2 UDB Data Warehouse Standard Edition ƒ DB2 UDB Data Warehouse Base Edition

A pricing strategy to remove cost as a barrier to BI successThe foundation for Information On Demand

ƒ via the Real Time data warehouse


Data Warehouse Standard EditionWhat Is in the Box?

Value

DB2 UDB Workgroup Unlimited Query Performance

DB2 Cube Views OLAP summary reporting

DB2 Intelligent Miner Modeling Mine the DB for patterns

DB2 Intelligent Miner Visualization Visualize the patterns

DB2 Intelligent Miner Scoring Score consumer accounts based on the buying behavior patterns detected

Office Connect Professional Web Edition Query & reporting via XL spreadsheets

DB2 AlphaBlox As easy as A,B,C,D,E

DB2 Warehouse Center Extract, transform and load production data into DB2


DB2 Data Warehouse Standard Edition Pricing

metric Unit price $K

DB2 UDB Workgroup Unlimited V8.1 CPU 7.5

DB2 Cube Views V8.1 CPU 7.5

DB2 Intelligent Miner Modeling V8.1 server 45.0

DB2 Intelligent Miner Visualization V8.1 server 15.0

DB2 Intelligent Miner Scoring V8.1 CPU 15.0

Office Connect Professional Web Edition V4.0 10 users 2.5

DB2 Warehouse Center V8.1 CPU 0

Total of unit list prices 92.5

DWE Std Edition Price CPU 23.75

Total Savings for one CPU / single server $68.75

DTG


Data Warehouse Enterprise EditionWhat Is in the Box?

Value

DB2 UDB Enterprise Server Edition Query Performance

DB2 Cube Views OLAP summary reporting

DB2 Intelligent Miner Modeling Mine the DB for patterns

DB2 Intelligent Miner Visualization Visualize the patterns

DB2 Intelligent Miner Scoring Score consumer accounts based on the buying behavior patterns detected

Office Connect Enterprise Web Edition Query & reporting via spreadsheets

DB2 Warehouse Manager Standard Edition

Extract, transform and load production data into DB2

DB2 AlphaBlox As easy as A,B,C,D,E

DB2 Query Patroller Manage queries for throughput

DB2 Data Partitioning Feature Scalability via scale-out (clusters)

DB2 Information Integrator Standard Edition (limited to ETL only)

Access to heterogeneous data for DB2 Warehouse Manager


DB2 Data Warehouse Enterprise Edition Pricing

metric Unit price $K

DB2 UDB Enterprise Server Edition V8.1 CPU 25.0

DB2 Cube Views V8.1 CPU 7.5

DB2 Intelligent Miner Modeling V8.1 server 45.0

DB2 Intelligent Miner Visualization V8.1 server 15.0

DB2 Intelligent Miner Scoring V8.1 CPU 15.0

Office Connect Enterprise Web Edition V4.0 CPU 9.2

DB2 Warehouse Manager V8.1 CPU 7.5

DB2 Query Patroller V8.1 CPU 7.9

DB2 Data Partitioning Feature V8.1 CPU 7.5

DB2 Information Integrator Standard Ed. V8.1 CPU ETL restricted use

Total of unit list prices CPU 139.6

DWE Price CPU 75.0

Total Savings for one CPU & single server $64.6

DTG


DB2 Data Warehouse Enterprise Edition Competitive List Prices

Per CPU prices DB2 DWE Oracle 10G SQL Server Teradata

RDBMS * $40K $20K $77K

Cluster partitions/RAC * $20K none *

ETL * $5K/seat * ** $77K

Data mining * $20K limited $32.7K

Query management * * * ** $22.7K

Information Integration * none none none

Table partitioning * $10K Yukon n/a

MS-Excel connectivity * * * none

OLAP * $20K * none

Web App server n/a $20K n/a n/a

Data loaders * * * $40K*

1 CPU costs $50K $135K $20K $249K

16 CPUs list price $800K $2085K n/a $1895K

DTG

* = Included n/a = not applicable ** = per server or site


DB2 Data Warehouse Standard Edition Competitive List Prices

Per CPU prices DB2 DWE *** Oracle 10g Std Ed.

SQL Server Teradata

RDBMS * $15K $20K $50K

ETL * $5K/seat * ** $77K

Data mining * none limited $32.7K

MS-Excel connectivity * * * none

OLAP * none * none

Web App server n/a $10K n/a n/a

Data loaders * * * ** $40K

1st CPU costs $15K $30K $20K $199K

4 CPUs List Price $60K $120K $80K $447.8K

DTG

* = Included n/a = not applicable ** = per server or site *** = 4 CPU maximumNote: Oracle 10G Std One Edition has 2 CPU limit for $5K/CPU

IBM Software Group

®

DTG

DB2


Alphablox Acquisition July 2004 What is Alphablox

Company in Mountain View, California

Develops & sells a platform for building customized analytic applications

Strong sales into OLAP applications

DTG


Component-Based Architecture

Rapid and open application development platform Pre-built components for analytic and alerting functionality Components for efficient customization

J2EE Framework …ties it all together


Alphablox Categories (Analytics)

Infrastructure

Data Access

Presentation &

Manipulation

Grid Blox Chart Blox

Toolbar BloxSpreadsheet Blox

Present BloxReporting Blox

Forms Blox Page Blox

Repository BloxStatus Blox

Data Blox Stored procedures BloxMDBQuery Blox

DTG

IBM Software Group

®


Why IBM for BI


Mean 5 Year Cost of Licenses and Support

Cumulative Software CCO

$0

$1,411

$2,822

$4,234

$5,645

$7,056

$8,467

1 2 3 4 5

Tho

usan

ds

Year of Operation

IBM DB2 NCR Teradata Oracle


When you think about BI Vendor, consider IBM's Business Intelligence Values Market leader in BI

Best of breed BI solutions

End-to-end BI solutions

Long term Strategic partner

Safe secure choice

Lowest TCO

Most innovative HW and SW technology


Solutions for Your Industry


Go With a Winner: DB2 BI

“DB2 UDB for Unix and Windows is a very capable platform, easily equal to or better than any other in this market based on scalability, flexibility, and price/performance.” Feb 2004

“IBM DB2 8.1 hit the Bull’s-Eye. Analytic SQL is good; OLAP is comprehensive, open, and flexible; and data mining is powerful.”Patricia Seybold Group, Nov 2003

#1

Per

form

ance

0 20 40 60 80 100

Teradata

IBM

Oracle

Microsoft

SybaseNetezza

Sand

Presence

HP Compaq

20

40

60

80

100

0

LEADERLEADER

FOLLOWERFOLLOWER

CHALLENGERCHALLENGER

Feb 2004

MetaSpectrum Feb 2004

#1

carolina yalamova ndb ltd

Documents