mioaug bi ebus

8/6/2019 Mioaug Bi Ebus

1/12

2003-4, David Fuston and FMT Systems I nc.

1

2004, FMT Systems Inc. All rights reserved.

Integrating people, processes, and technology!TM

David FustonSenior Oracle Applications ConsultantFMT Systems, Inc.www.fmtsystems.comOffice: 248.246.1555Direct: [email protected]

Business Intelligence andOracles E-Business Suite How Does It Fit Together?

16 March 2004

Michigan OAUG Quarterly Meeting



FMT Systems Summary

q FMT Systems is a solutions company that delivers completebusiness integration and process management solutions

allowing companies to integrate their people with businessprocesses and technology effectively and efficiently. Oursolutions work in unison with your enterprise applications,projects, and people. The value that our products and servicescan bring to your enterprise project and bottom line include:n faster ROI on current and future investments in technology and

people

n reduced implementation time

n increased worker productivity. Resulting from streamlining thetraining/education process, increased communication, accessibilityto the real-time information where and when needed

n more efficient implementation of organizational transition initiatives

n increase collaboration on process efficiencies within and outside ofan organization

n fewer delays in decision making



David Fuston Short Bio

q Technical and functional consultant with over 18 years ofexperience in applications development, IT management, andfinancial controller positions for Fortune 500 and World 200companies.

q Oracle Beta Tester since 1997 for numerous programs, suchas Applications 11i, Financial Analyzer 6.x, 9iAS Discoverer,Discoverer 10g, Warehouse Builder 9i, and Oracle 8i/9i

q Specialize in staff augmentation for Oracle Applications 11ifinancial (GL, AP, AR, FA, BIS, DBI) and manufacturing (PO,OM, INV) implementations, including data warehousing,business intelligence and reporting

q Officer, speaker, and sponsor in OAUG, BI/DW SIG,OracleWorld, AppsWorld, IOUG, ODTUG, NCOAUG, SCOUG,KCOUG, and CSOAUG

q Teaching and training role started in 1984 as a manufacturingplant zero defects trainer utilizing the Phillip Crosby QualityCollege methods.



Agenda

q What BI is and Terminology

q Marketplace

q Oracles Corporate Performance Management

n EDW

n BIS and DBI

n Oracle Sales Analyzer

n Oracle Financial Analyzer and EPB

n 9iAS Discoverer

n Reports

q Questions



Business Intelligence Definition

Business IntelligenceThe processes,technologies, and tools needed to turn datainto information, information intoknowledge, and knowledge into plans thatdrive profitable business action. Business

intelligence encompasses data warehousing,business analytic tools, andcontent/knowledge management.

THE DATA WAREHOUSING INSTITUTEwww.dw-institute.com



BI Analytical Applications

q Packaged Analytic Application The buy optionAvendor-supplied package that provides domain-specificanalytics. It contains an integrated set of analytic tools,data models, ETL mappings, business metrics, predefinedreports, and best practice processes that accelerate thedeployment of an analytic application in a given domainor across multiple domains.

q Custom Analytic Application The build optionAnanalytic application that is primarily built using tools,code, or customizable templates to provide the exactlook, feel, and functionality desired by an organization forits analytic environment.

THE RISE OF ANALYTIC APPLICATIONS: BUILD OR BUY?TDWI REPORT SERIES by Wayne W. Eckerson


2/12


2



Recent BI Trends

q Shift from departmental to enterprise-wide

q BI Systems pressured to operate in (near) Real-Time

q Interoperability and integration is key trouble spotn BI and DW embedded in Applications

n BI use in Portals BI dashboards access the DW

n BI has expanded from the traditional On Line AnalyticalProcessing (OLAP) to now include Query and Reporting,ETL, Data Mining, and Data Visualization.

q Return on Investment (ROI) for analyticapplications range from 17% to more than2,000% per IDC December 2002 study, document#dg20021202.



Why Separate BI Environment?

q Empowers end-users to do own analysis

q Frees up IS/IT backlog of report requests

q Ease of useeasy selection of data

q Drill-down

q Limited knowledge of SQL or tables required

q Exception Analysis

q Variance Analysis

q Easy rotation

q Formula calculations

q Aggregate data



Why Consider a Data Warehouse?

q Standard Oracle Reports dont meet business requirementsq Visibility and Simplification of Reports from multiple data

sourcesq Custom reports take too long to produceq Inability to drill down from summary data to consistent details

for clean, accurate, and timely dataq Many Resources tied up in reportingneed daily production

reports and exception reporting in dashboards, scorecards,alerts

q Data manipulation is required, extensive use of Excelq No tools or time to do detailed analysisq Data is not accuratelittle to no integration of data across

organizations, nor business areasq Multiple data sources, complex table structuresno central

repository for business and technical informationq Views are not performing wellq Multiple versions of the truth in meetingsno single set of

business rules nor definitions



Typical BI Analytical App Architecture



Agenda

qWhat BI is and Terminology

qMarketplace

q Oracles Corporate PerformanceManagement (BI)n EDW

n BIS and DBI



n 9iAS Discoverer

q Questions



The Data Warehouse Institutehttp://www.dw-institute.com/marketplace/index.asp

q Administration & Operations (135) : Performance & Usage Management,Database Management, Capacity Planning, More

q Analytic Applications & Development Tools (298) : Development Tools,Visualization Tools, Business Performance Management, More...

q

Business Analytics (245) : Data Mining, Query & Reporting, OLAP,Business Analytics Suites, More...

q

Business Intelligence Services (123) : Consultants/Systems Integrators,Analytic Service Providers for Data Warehouse, More...

q Data Integration (184) : Data Quality and Cleansing, DW Mapping &Transformation, Meta Data Management, More...

q Data Warehouse Design (31) : Data Modeling & Analysis, DataWarehousing Toolsets, More...

q

Information Delivery (98) : Enterprise Information Portals, Broadcasting,Wireless Data Analysis, More...

q

Infrastructure (89) : Relational Database Management Systems,Multidimensional Databases, More...


3/12


4/12


4



Multiple BI tools for Multiple BI needs



Match User Types to BI functionality



Gartner definition of BI skills required



Market Share for OLAP vendorshttp://www.olapreport.com/Market.htm

NOTE: These figures include OLAP server and client software, applications and OLAPconsulting, whether performed by the software author or third-parties.



Agenda


q Marketplace

q Oracles Corporate PerformanceManagement (BI)

n

EDWn BIS and DBI



n 9iAS Discoverer

q Questions


5/12


6/12


6



Strategy to Extend EDW

q Create custom business views for customfacts and dimensions

q Create custom facts and dimensions (inOWB)

q Create mappings for populating customfacts and dimensions (using OWB)

q Create EUL for custom facts anddimensions (using OWB)

q Export EUL from OWB

q Create ad hoc workbooks



Buy versus Build in Oracle(Data Warehouse Infrastructure)

q Packaged Analytic Applications using Oracle

n Oracle EDW

n DecisionPoint Applications

n Jaros Analytics

n Noetix NETS

q Custom Analytic Applications using Oracle

n Do-it-Yourself with Discoverer & OWB



Common Challenges in all DW packages

q Summary and detail data need to matchevent based ortime based, sync modules or whole app, at what frequency,under what conditions

q Performance considerations for Apps DBviews on same boxor separate box copy, multiple years in OLTP versuswarehouse, historical data load into OLTP or warehouse attime of upgrade or system conversion

q Capture the transient detail (ex: net changes to orders) orsnapshots for reports such as shipment backlog, inventoryturns, AR days sales outstanding, etc.

q Ability to create summary or aggregate tables and/or cubesand then have these tables be visible to client end-user toolfor query performance

q Partitioning of data for both archive, backup, and data roll-off strategies



Common Challenges in all DW packages

q Metadata shared, such as Common Warehouse MetaModel(CWM), amongst transformation engine, database, and clientfront-end toolload once, report many times strategy

q Time/date stamps on different systems in different formatsand using different data types need to be merged into asingle fact table

q Data Warehouses are never done, ultimately becoming thehistorical repository in lieu of upgrading data in Oracle Apps

q Integration of multiple data sources (Oracle and non-Oracle)happens at least 85% of the time in a BI/DW project

q No single BI end-user tool will fit with the needs and wantsfor multiple groups of end-users, with requirements such assimple 2-D reporting, ad-hoc query, traditional 3-D OLAPwith drill and rotate, CPM, BAM, data mining, and forecasting

what if models



Common Best Practices in all DW packages

q Do not use virtual DW, i.e, do not directly accessOLTP tables, use views as insulation

q Do not code ETL functions by handuse thepackaged tools and functions

q Integrate components of the DW architecture with

central metadataq Use end-user client tools that integrate with the

metadata and pre-computed aggregates

q Architecture of complete DW includes conformingdimensions for multiple business areas (i.e., datamarts) for cross-module drill down



Differences in DW packages

q ETL process, non-Oracle data, data scrubbing andtransformations

n EDW uses OWB and supports non-Oracle data loaded intoOracle Apps via API, or custom loads via OWB into EDW

n Noetix uses no ETL, has only Oracle Apps as source out-of-the-box, other sources are custom

n DPA uses a proprietary ETL against Oracle Apps and cancustomize for non-Oracle sources

n Jaros uses Informatica PowerMart as OEM for any datasource out-of-the-box, with mappings provided for OracleApps


7/12


7



Differences in DW packages (continued)

q Common Warehouse MetaModel (CWM)n EDW has partial CWM with OWB metadata, but not with

Discoverer EUL, which is an additional extract and loadn Noetix uses central repository in MS SQL Server, but it is

not CWM compliant, must be loaded into your datamodeling tool, and then shares metadata with WebQueryor loads Discoverer EUL

n DPA uses a proprietary metadata repository, which mustloaded into your data modeling tool, and then sharesmetadata with DecisionCast, or loads Discoverer EUL,Business Object Universe, etc.

n Jaros uses CA Erwin for data modeling, InformaticaPowerMart for central metadata repository, sharesmetadata natively with Jaros Dashboard, BusinessObjects, Cognos, Brio, MicroStrategy, Hyperion, or loadsDiscoverer EUL



Agenda


q Marketplace


n EDW

n BIS and DBI



n 9iAS Discoverer

q Questions



CorporatePerformanceManagement

CorporatePerformanceManagement

Daily Business IntelligenceDaily Business Intelligence

DataWarehouse

DataWarehouse

WhatHappened?

Report &Query tools

Why didit happen?

OLAP Tool

What willHappen?

DataMining

What MightHappen if?

OLAP ToolExecuteHypothesis

OperationalIntegration

Monitor and Change

BSC, Strategy Tools

The Business Intelligence Process



BIS Release and Architecture

q BIS 1.x patch on Apps11.0

q BIS 2.x released withApps 11i

q BIS 3.x/4.x EmbeddedData Warehouse

q BIS 5.0 Daily BusinessIntelligence for11.5.8+

q Version 1-2n Database Views on OLTP

q Version 3-4n Data Warehouse tables

q Version 5n Materialized Views



Business Intelligence System

q First shipped in 1998

q Uses standard Oracle Apps security profiles

q Covers GL, AP, AR, HR, PO, Projects,Manufacturingprocess and discrete modules

q Standard advise on performance problemssetup

BIS on a separate instanceq Currently in maintenance mode

q Uses Discoverer technology under the covers



Daily Business Intelligence

q First shipped as Early Adopter in February 2003

q Has roughly 10+ Early Adopters using versions 5.0, 5.1, and6.0

q Uses same HTML server as Performance Analyzer andEnterprise Planning and Budgeting, not same as Discoverer

q Covers GL, AP, AR, PO, PR, CRM, Sales, HR, contracts,marketing, iStore and services modules; Partial coverage for

supply chain and discrete mfgq Supports 9i OLAP database option, similar to Discoverer 10g

q Uses same security model as Oracle Apps if installed in sameinstance

q Designed to be intuitive, and therefore no end user trainingshould be necessary


8/12


8



DBI limitations

q Since materialized views must be synchronized on a

schedule (time or event driven), each html page in viewermust have all data updated at same time from daily refresh

q Not allowed to extend or customize views or viewer; mustwait for next release which includes a designer and toolkit;in meantime, you can create EUL on top of materializedviews and use Discoverer for customizations

q Requires 9iR2 (9.2.04), 11.5.8+ (really 11.5.9), prefer RACfor performance reasons; if do not have RAC, then can use abigger box or create a copy instance for reporting only

q Oracle consulting must be engaged when participating inearly adopter program; expect 3-6 weeks to get up andrunning on multiple modules; GA is expected with 11.5.10

q If need to incorporate external data sources, you arecurrently outside of DBI support



Agenda


q Marketplace


n EDW

n BIS and DBI



n 9iAS Discoverer

q Questions



Oracle8 Data WarehouseOracle8 Data Warehouse

ExpressObjects

Spread-sheets

WebBrowser

Data AccessAnd

Integration

Unlimited,Logical Views

PowerfulAnalysis

Easy To UseQuery &Analysis

Express Product Architecture

External Data

Express ApplicationsOSA OFA

Corporate RDBMS Legacy Systems

Express Clients

Oracle Express Server 6.xOracle Express Server 6.x

Other Tools



Oracle Sales Analyzer

q Server-centric Approach for the ExpressDatabases

q Read-only Application

q Ability for End-users to Create Custom Measuresand Aggregates

q Ability to Deploy in Any OLAP Mode:

n ROLAP

n MOLAP

n HOLAP

q Not Tightly Integrated with Any of the Modules ofthe E-Business Suite



Oracle Financial Analyzer

q Distributed Approach in Using Express

q Allows Users the Autonomy to Create andManipulate Own Scenarios of Data

q Ability to Write Data Backn Budgets and Forecasts

q Ability to Create Asymmetric Reports

q OFA integrates with the Oracle GeneralLedger via GL Link

q Custom Facts (FDIs), But Knowledge ofExpress Language Needed may be needed



OFA Architecture

Extract Files

SuperPersonal

SuperShared

Analyst

Sub-AdminSharedBudget

Analyst Budget

Sub-Admin

Personal

PayablesReceivables

OracleGeneralLedger

Oracle Financial Analyzer

ADI

Drill - DownTo GL

Through ADI

Drill-down

Data

Structures


9/12


9



OFA GL Link Limitations

q Supported in Oracle GL 10.7 (6.3 only), 11, and 11in Limitations on some new features not available with link to

10.7q Drill to GL detail

n Uses Oracle ADI

q Budget Write-back Redirectn Write Back to New Budget

n Avoid Overwriting Previous Iterations

q Can Switch to Different GL Instance (new in 6.3) in sameExpress OFA instance

q Solve Profile after Balance Loadn Will only solve the portion of the database that has new data

q Option to Create Attributes Between 2 GL Dimensions DuringBalance Loadn Can then be used on worksheets



OFA Recommendations

q Analyze How Many Dimensions Are Really Needed

q Maintain Hierarchies in Oracle GL, If Possible

q Use GL Link to Load Structures, But May Need toWrite Custom Load for Data Size Issue

q Use GL Link to Load Actuals, Custom Code to TakeThat Information and Load Into Other FDI InOrder to Customize Structures

q Any Customization Would Require aKnowledgeable Express SPL Resource

q Use Models to Create Balance Sheet or IncomeStatement If COA Not Capable, or need what if scenarios in budgeting or forecasting



Enterprise Planning and BudgetingIntegrated Business Processes

Define Identify KPIs

Develop plans based oncorporate strategy

Analyze Multi-dimensional what-if

Variance

Profitability

User defined annotations

Create Identify organization

Map plans to budget lines

Develop hierarchies

Develop financial models

Distribute Streamlined automated process

Budget lines by Org

Notify managers

Submit & Approve Adopt budget

Notify managers

Document/post

Define Distribute Analyze Submit ApproveCreate

Manage & Continuous Planning Budget book and monthly pack reporting

Variance analysis

Exception analysis

Reforecast



Existing Apps Next Generation Apps

Dimensions, attributes Moved to relational db

hierarchies, levels, data

Reports and graphs Queries ? new Query Builder Bean syntax

Layout ? moved to BI Beans Catalog

Formatting ? unlikely to be preserved

Models, custom aggs, Converted to use new Calculation templates

custom measures, FDIs

Data loaders Rewritten in SQL to load to relational db

Data entry Converted to report, enabled for data entry

User scoping Scoping reta ined, no need for un ique OS IDs

What Happens In Migration to EPB?



Existing Apps Next Generation Apps

Users and security Oracle Apps user profiles and responsibility

Solve definitions, solve Defined by associating business processes

groups with data source, input and output levels,

calculations and allocation rules**Saved Selections Selection Objects in BI catalog

Folders, reports, graphs Objects in BI catalog

Worksheets, data entry Not Migratedcreated via business process

Spreadsheet add-in Export to MS Excel supported**

What Happens In Migration to EPB?



Which version of Oracle Appsdoes EPB require?

q Delivered as part of Oracle Applications, but can berun standalone

q Delivered as a patch to Oracle Applications 11.5.9 --Included as part of the rapid install for 11.5.10

q Backports of EPB to 11.5.8 or earlier are nottechnically feasible

q Requires Oracle9i Database 9.2.0.4 plus OLAP Option

q If a customer has 10.7 or 11.0.x or no OracleApplications, then the product can be a standalonesolution


10/12


10



Migration From OFA and OSA

q OFA and OSA 6.4 will be supported until mid 2008 with

error correction support until end of 2006q Oracle will provide a migration path for existing customers

of OFA and OSA to migrate their implementations to EPB

q These are migration tools, not a one-click upgrade

n Should I migrate or re-implement?

q OSA ROLAP customers will need to convert their warehouseschema into EPB form as part of migration

q Migration paper onhttp://www.oracle.com/applications/cpm



Integration Through EPB Schema

q Enterprise Planning and Budgeting

q General Ledger

q More planned: Applications

n Performance Analyzer

n Activity Based Management

n Public Sector Budgeting

q More Planned: Sources

n Projects

n Fixed Assets

n Human Resources

n Grants



Agenda


q Marketplace


n EDW

n BIS and DBI



n 9iAS Discoverer

q QuestionsIntegrating people, processes, and technology!TM


Discoverer

q Ad-hoc Query Tool Used to Analyze Data on the flyFrom Oracles Relational Database

q Integration With Oracle Warehouse Builder, OracleReports, Oracle Express Products, and OracleDesigner

q Uses Drill-down and Pivoting

q Discoverer Manager defines the following 4 typesof drills:n Item to item drills (item hierarchies)

n Date to date drills (date hierarchies)

n Drill to detail item class (hyperdrills)

n External application drills (hyperdrill plug-ins)



Discoverer for Windows and the Web

Discoverer

Desktop

Discoverer

Administrator

Discoverer

Plus

(Applet)

Discoverer

Viewer

Discoverer Services

DiscovererServlet

Discoverer End User Layer (EUL)

Relational

Database

HTTP

SQL*Net

IIOP



Oracle Discoverer with Data Warehouses

q OWB can generate Discoverer metadata

q OWB and Discoverer Bridge can

n Access OWB meta layer

n Create Discoverer export file (*.EEX )

q Discoverer imports EEX files into an EUL


11/12


11



OSA, OFA, and Discoverer Share

q Tables and graphs

q Drag-and-drop rotation

q Drill-down/up

q Easy to use interface

q Cache data

q Conditional formatting (color-coding)



Discoverer Advantages

q Simple SQL custom calculations

qMore flexible reporting (subtotals, etc.)

q Operates directly against relational datasource

q Transactional view available

q Record-based selection

qMore intuitive for users that know SQL



Discoverer Limitations

q Disadvantage - Need For Users to KnowUnderlying DB structures and/or SQL

qWeak security, either public or private,unless installed as part of Oracle Apps



Discoverer Integration Methods

q Four possible methods:

n Create EUL against Business Views

n Oracle BIS/DBI

n Create Datamart

n Enterprise Data Warehouse



Create EUL against Business Views

q Easiest and Fastest DIY approach

q Captures Flexfield information

q Up to date information

q Performance may be an issue



Create Datamart

q Distill critical Applications tables into adatamart - most difficult DIY approach

q Requires extensive knowledge ofApplications schema

q Snapshot of data that needs to berefreshed

q Challenging to preserve flexfields

q Better performance


12/12


12



Applications Certification DIY approach

q Discoverer 3i, 4i and 9.0.2 work againstOracle Applications 11i, 11.0 and 10.7

q 11.5.7+ rapid install contains Discoverer(as part of iAS 1.0.2.2.2)



Applications Certification out of the boxapproach

q Customers who use BIS/EDW are certifiedto use 4i against 11i if iAS 1.0.2.2.2installed on separate machine (metalinknote 139516.1, ARU 1834171)

q Customers who use BIS/EDW and want iAS1.0.2.2.2 in same Apps Oracle Home canuse the 11.5.7+ rapid install



Common Reasons for Failures in BI/DW

q Attempted integration of stand-alone packages ortools which do not share common metadata

q Coding of extraction/transformation/loadprocedures by hand

q Populate DW with dirty source data

q DBA(s) that have OLTP and normalized tableexperience, but no dimensional star schemaexperience

q Inability to respond to change requests from users

q Lack of flexibility in query, analysis, and reportingtools

q Failure to meet the needs of the business



Common Reasons for Failures in BI/DW

q Lack of ERP data source expertise at table levelq Lack of enterprise wide DW architecture and

infrastructureETL tool, central metadatarepository, metadata exchange interface, datamodeling tool, and end user tools

q Lack of defined process stepsdefine businessneeds, specify architecture, select tools, and thenimplement

q Let the ERP package dominate the DWq Did not anticipate performance and/or scalability

issuesq Lost audit trail, data integrity, or ability to

reconcile during data transformation/scrubbing



QUESTIONS?



David FustonSenior Oracle Applications ConsultantFMT Systems, Inc.www.fmtsystems.comOffice: 248.246.1555Direct: [email protected]

Business Intelligence andOracles E-Business Suite How Does It Fit Together?

16 March 2004Michigan OAUG Quarterly Meeting

mioaug bi ebus

Documents