obiee with essbase

7/26/2019 OBIEE With Essbase

1/65

T : +44 (0) 8446 697 995 or(888) 631 1410 (USA) E : [email protected] W: www.rittmanmead.com

Mark Rittman, Technical Director, Rittman MeadOracle Openworld 2012, San Francisco, September 2012

How to Integrate OBIEE11g and Essbase/EPM

Saturday, 29 September 12
http://www.rittmanmead.com/http://www.rittmanmead.com/mailto:[email protected]:[email protected]


2/65


Mark Rittman

Mark Rittman, Co-Founder of Rittman Mead

Oracle ACE Director, specialising in Oracle BI&DW

14 Years Experience with Oracle Technology

Regular columnist for Oracle Magazine

Author of forthcoming Oracle Press book on OBIEE 11gWriter for Rittman Mead Blog :

http://www.rittmanmead.com/blog

Email : [email protected]

Twitter : @markrittman

mailto:[email protected]:[email protected]://www.rittmanmead.com/bloghttp://www.rittmanmead.com/bloghttp://www.rittmanmead.com/http://www.rittmanmead.com/mailto:[email protected]:[email protected]


3/65


About Rittman Mead

Oracle BI and DW gold partner

World leading specialist partner for technical excellence, solutions delivery andinnovation in Oracle BI

Approximately 30 consultants worldwide

All expert in Oracle BI and DWUK based

Offices in US, Europe (Belgium) and India

Skills in broad range of supporting Oracle tools:

!OBIEE

!OBIA

!ODIEE!Essbase, Oracle OLAP

!GoldenGate

!Exadata



4/65


Oracle Business Intelligence 11gR1

The latest release of Oracles business intelligence platform

Replacement for Discoverer; full platform for analytics and dashboards

Now at version 11.1.1.6.2 BP1 / 11.1.1.6.4; originally derived from Siebel Analytics

11gR1 new features focused on OLAP analysis, visualizations, manageability



5/65


Web-Based Delivery of Analytics and Analysis

Users access information and analytics through role-based dashboards

Can also publish reports to PDF, distribute, or access through MS Office



6/65







7/65







8/65


Web-Based Authoring Tools for Power Users

Reports and analyses are created using web-based tools

Point-and-click creation of tables, pivot-tables, charts, maps, gauges



9/65


Web-Based Authoring Tools for Power Users

Reports and analyses are created using web-based tools

Point-and-click creation of tables, pivot-tables, charts, maps, gauges



10/65


Integration with E-Business Suite and Other Applications

OBIEE 11.1.1.6.x is the platform for Oracle Business Intelligence applications

Pre-built reports, dashboards and analytics for EBS and other applications

Pre-built dimensional data warehouse and ETL routines

Extensible and open design



11/65


Mobile and Other Advanced Visualizations

Mobile client for Apple iPad and iPhone

Delivery of reports and alerts via email, cell, pager etc

High-density visualizations via a thin-client web dashboard

Integration with MS Office and Open Office through SmartView



12/65


All Built Using Shared Common Enterprise Information Model

All reporting tools can take their data from a shared metadata layer

Defined as dimensional model, embeds common calculations and drill paths

Subject-area and row-level security

Three-layer design to provide

abstraction from underlyingcomplicated source systems

Simplificationof the Data ModelIntegrationof Disparate DataSources

Addition of Business Logicand Calculations



13/65


OBIEE 11g Features for Hyperion Users

Essbase as a data source for Oracle BI Repository

Oracle Answers as a front-end for Essbase, HFM

Integration of Essbase and relational data into drill-through models

Oracle BI Repository as a data source for Essbase Studio

Plus access to OBIEE dashboards & reporting!Wide range of graphs and other visualizations

!Mapping and spatial integration

!Scorecards and KPIs

!Web Service and Application Integration

!Access to EBS, PSFT, Siebel and SAP data

through Oracle BI Applications



14/65


Supported Essbase/Hyperion Releases

Oracle Essbase 9.3.3+, 11.1.1.3.500, 11.1.2+

HFM 9.3.3, 11.1.1.3, 11.1.2.x

Planning - tbc

See Oracle Fusion Middleware Supported System Configurations doc on OTN

! http://www.oracle.com/technetwork/middleware/ias/downloads/fusion-certification-100350.html

http://www.oracle.com/technetwork/middleware/ias/downloads/fusion-certification-100350.htmlhttp://www.oracle.com/technetwork/middleware/ias/downloads/fusion-certification-100350.htmlhttp://www.oracle.com/technetwork/middleware/ias/downloads/fusion-certification-100350.htmlhttp://www.oracle.com/technetwork/middleware/ias/downloads/fusion-certification-100350.htmlhttp://www.rittmanmead.com/http://www.rittmanmead.com/mailto:[email protected]:[email protected]


15/65


Essbase Integration with OBIEE

OBIEE can connect to multidimensional as well as relational sources

!Microsoft Analysis Services, SAP B/W, Essbase

Import process converts the multidimensional view into a relational view

Essbase cubes, dimensions, hierarchies converted to a logical relational star schema

Essbase data can then be combinedwith data from sources

OBIEE 11g introduces new OLAP querycapabilities making Answers a first-classad-hoc query tool for Essbase cubes

Other use case is to bring in budget,

forecast data etc from Essbaseand use to enhance relational data



16/65


New in OBIEE 11.1.1.6.2 BP1

Just released - Essbase as an OBIEE aggregate persistence target

Store OBIEE aggregates in an ASO cube,automatically created and populated byembedded Essbase Studio

Closer integration around the install,management with EM

Narrow focus - aggregate persistence -but pointer to further integration

More details later on...



17/65


New Essbase Cube and Metadata Features in OBIEE 11gR1

Essbase outlines are still imported in and converted to relational stars

However outlines are now handled better

!Accounts dimensions keep their hierarchy

!Parent-child (value-based) hierarchies are supported

!Alias tables supported!UDAs supported

No longer any need to recreate as outlineevolves (additional generations, members)

Makes OBIEE a more practical reportingenvironment for financial-style Essbase cubes



18/65


Importing an Essbase Cube Step 1 : Review Essbase Outline

Review the Essbase outline using Essbase Administration Services

Be aware of the number and type of dimensions

Check usage of alias tables, UDAs etc

Be sure to use correct Essbase versions

!Other releases will partially work, butdrilling etc may not work



19/65


Importing an Essbase Cube Step 2 : Select Metadata Import

Using BI Administration tool, select File> Import Metadata

Enter connection details for Essbase Server (requires Essbase Client to beinstalled on server and desktop)

Select cube for import, check Import UDAsif UDAs are present in cube



20/65


Importing an Essbase Cube Step 3 : Review Import

Review imported cube metadata

!Accounts dimension is now a hierarchy

!Single measure dimensioned by alldimensions

!

Columns still based on outlinedimension generations



21/65


Importing an Essbase Cube Step 4 : Convert To Parent-Child

Imported level-based hierarchies can be convered to value-based

!Protects against outline evolution, new levels (generations) being added

Right-click on dimension, select Properties> Levels,then change Hierarchy Typeto Value



22/65


Importing an Essbase Cube Step 5 : Add Alias Columns

Where aliases are present in the outline, these can be brought through to OBIEE

Right-click on dimension, select Create Columns for Alias Table

Select alias to create column for; alias then appears in physical database



23/65


Importing an Essbase Cube Step 6 : Create Remainder of Model

Once physical model is created, drag and drop over to business model andmapping layer, and then presentation layer

Essbase data is then readyfor reporting on using Answers



24/65


New Essbase Reporting Features in OBIEE 11g

OBIEE 11g comes with a number of improvements for reporting against Essbase

Hierarchical column provide OLAP-styledrilling against Essbase cubes

Selection steps and hierarchical promptsprovided member-based selections

UDAs can be used in filters

Value-based hierarchies remove needto query specific levels to selectmembers for analysis



25/65


Essbase and Hierarchical Columns

Essbase cubes now use Hierarchical Columns by default

Full drill into detail (symmetric / asymmetric drilling)

Combine with regular attribute columns

Works across bothrelational and OLAP sources

!MOLAP and ROLAPanalysis combined



26/65


P&L-Style Reports

Though Financial Reporting is the most suitable tool for P&L-style reports, Answersusing hierarchical columns can reproduce a lot of their functionality



27/65


Access to OBIEE Graphing, Visualisations

Full access to all OBIEE visuals, maps, graphs, dashboard objects, scorecards etc



28/65


Selection Steps and Essbase

The OBIEE 11g Selection Steps feature can be used to select membersbased on a hierarchy

Select individual members, drill into hierarchy

Select members based onposition in a hierarchy

!Select Children Of

!Select Ancestors of

!Keep/Remove members



29/65


30/65


Filtering against UDAs

User-Defined Attributes can be accessed via filters

!UDAs are not displayable like columns, they instead act as filters

Add filter based on UDA = 1 (true) or false (0)



31/65


Displaying Aliases

Aliases appear in the subject area just like other columns

!Have to be imported into the RPD, see previous steps

Can be used just as any other column



32/65


Handling Essbase Alternate Hierarchies

Alternate hierarchies can be imported from Essbase ASO cubes (not BSO)

Dimension must be multiple hierarchy enabled in the outline

Multiple hierarchies are then imported into the RPD and created separately, based off ofthe same logical dimension table

1

2

3



33/65


Handling Attribute Dimensions

Attribute dimensions are imported into the RPD just like regular Essbase dimensions

Can be queried in analyses alongside regular dimension members/logical columns

Typically attribute dimensions are nested within the parent dimensionwithin the presentation layer of the RPD

Can be queried separate from the parent dimension, or alongside it

1

2

3



34/65


Essbase Security and Filters

Data filters and Meta Filters are respected by OBIEE

SSO integration between Workspace and OBIEE Presentation Server removed in 11g

SSO still possible but requires external solution (until 11.1.1.6+?)

!Shared Services and OBIEE both connecting to same external LDAP server

!

External SSO over both OBIEE and EPM products



35/65


OBIEE 11g Integration with Workspace and Shared Services

OBIEE 10g could be integrated with EPM Workspace to create a single portal

Oracle BI Server authenticated against Shared Services using Custom Authenticator

Point-to-Point SSO between Workspace and OBIEE (via CSS Token)

But this doesnt work with OBIEE 11g :-(



36/65


OBIEE 11g / Shared Services Integration Options

Ideal solution is to connect OBIEEs WLS security services to the LDAPdirectory that was linked to Shared Services (OID, AD etc)

!Assumes users, groups not stored in Shared Services Native Directory

Replace the Workspace/OBIEE point-to-point SSO with an overall SSO solution

!Oracle Access Manager, etc

Still no solution for Workspace/OBIEEportal integration (post 11.1.1.7?)



37/65


Alternative Solutions for OBIEE / Shared Services Integration

If its not possible to share the same LDAP directory, other alternatives are possible

For example (example requires OBIEE 11.1.1.5+):

!Use the HSS Security API to sync Native Directory entries to tables

!Use SQLAuthenticator WLS adapter to perform authentication against user tables

!

Use BISQLGroupProvider authenticator to obtain group membership from thesetables

Sync from Shared Services toDB tables every 5 mins

Still Need to manually create andmap application roles

Also still does not address SSOrequirement though (orWorkspace/OBIEE portal integration)



38/65


HSS Security Java API: Example Code for Extracting Groups Mbrs

protected void dumpNativeGroupMembers (String URL,String USER, String PASSWORD) { try{ DriverManager.registerDriver(new OracleDriver()); Connection conn = DriverManager.getConnection(URL,USER,PASSWORD); conn.setAutoCommit(false); CSSGroupIF[] cssGroupIF = cssAPI.getGroups(context, principal, "*"); CSSUserIF cssuser; CSSGroupIF cssgroup; String []user = null; String []group = null; Statement stmt = conn.createStatement(); stmt.executeUpdate("DELETE GROUPS"); stmt.executeUpdate("DELETE GROUPMEMBERS"); for (int i=0; i


39/65


New in OBIEE 11.1.1.6.2 BP1 : Aggregate Persistence in Essbase

OBIEEs Administration tool has theability to define aggregates, and thenpersist them in an RDBMS

Repository then uses these aggregatesto speed up dashboard queries

Basis of the Summary Advisor used withOracle Exalytics In-Memory Machine

Latest OBIEE bundle patch enablesstorage of these aggregates in anEssbase ASO database, usingheadless Essbase Studio Oracle BI Server

Component

PhysicalSQL, MDX

PhysicalMDX

BI Presentation ServerComponent

Oracle BI RepositoryLogical BusinessModel

Read model

Logical SQL Results

HTTP(S)

User requestsfrom dashboard,ad-hoc queries etc

Pre-computed aggregateddata, stored in an Essbase

ASO database

Detail-level, and dynamically-calculatedaggregate data



40/65


So How Does Aggregate Persistence in Essbase Work?

1. Developer/Administrator selects slice of business model to aggregate

2. Aggregate Persistence Wizard then creates a logical SQLscript

3. Script is processed by BI Server using nqcmd and the BI Server ODBC client

4. BI Server uses Essbase Studio dmaservlet to create ASO outline, and rules file

5. Detail-level data sourced via BI Server logical model through to source databases

Oracle BI RepositoryLogical BusinessModel

Oracle BI ServerComponent

nqcmd scriptcontaining logicalDDL and DML forcreating and populatingaggregate tables

Logical SQL

via BI ServerODBC interface

PhysicalSQL, MDX

Create outline

Read model Add aggregates

Essbase Studio dmaservlet

XML request SQL queries

Data load viaEssbase rules file

Essbase Server

Developer usesBI Administratortool to selectaggregates forcreation, with anoutput of a logicalSQL script for DDLand DML

1

2

3

4

5



41/65


Combined Install of OBIEE and Essbase with 11.1.1.6.2 BP1

OBIEE 11.1.1.6, and the 11.1.1.6.2 BP1 bundle patch, include Essbase + administrationtools as part of the install bundle, but these are not by default enabled

Needs to be patched to 11.1.1.6.2 BP1, then installed using options in a reponse file

Configures Essbase as part of the OBIEE domain, with EAS and Studio also available

Narrow use-case : only for Aggregate Persistence, cannot scale-up, repurpose etc

[DATAMART_AUTOMATION]ESSBASE_STUDIO_URL = "http://localhost:9080/dma/dmaservlet";ESSBASE_SERVER = "localhost";DMA_DATABASE = "DMA_DB";

http://localhost:9080/dma/dmaservlethttp://localhost:9080/dma/dmaservlethttp://www.rittmanmead.com/http://www.rittmanmead.com/mailto:[email protected]:[email protected]


42/65


New Capabilities Provided by OBIEE 11g

Horizontal (Drill-Across) and Vertical (Drill-down) Integration with Relational Data

MapViewer Integration

Scorecards and KPIs

BI Publisher

Action Framework

Integration with EBS and other application data



43/65


Drill-Across and Drill-Through To Relational Data

! One of the most powerful features in the OBIEE it is ability to combine data sources

! Multiple data sources presented as a single logical dimensional model

! In terms of Essbase and HFM integration there are three main use-cases:

1.Providing drill-down from an Essbase-based model to detail-level relational data

2.Displaying relational attributes and descriptive data alongside Essbase measures

3.Combining Essbase and relational measures into a single business model



44/65


Setting up Vertical Federation (Drill-to-Relational Detail)

Initially map in Essbase source (using wizard), then introduce relational data into model

Be aware of Essbase unique naming requirements (may need to prefix relational name)

Create level-based logical dimensionto indicate hierarchy levels

Set content (hierarchy) level for Essbaseand Relational sources to indicategranularity (how detailed they are)

BI Server will then automatically switchbetween Essbase and Relational sources,depending on how detailed the report gets



45/65


Reporting at Aggregated (Essbase) Level

Reports that then run at the aggregated level will automatically use Essbase

This is because it is mapped in to the Customer dimension at a higher (non-leaf) level

With set [Channel3] as '[Channel].Generations(3).members' set [Customers5] as '[Customers].Generations(5).members'select { [Measures].[Amount] } on columns, NON EMPTY {crossjoin ({[Channel3]},{[Customers5]})} properties

ANCESTOR_NAMES, GEN_NUMBER on rowsfrom [SH.SH]



46/65


47/65


48/65


Setting up Horizontal Federation (Relational alongside Essbase)

You may have actuals data in a relational database, and forecast/budget data inEssbase

It would be useful to report on these in a combined business model

Measures of the same dimensionality can goin the same fact table

Measures of differing dimensionality go inseparate fact tables

Users see a single combined data source

Oracle BI Server combines the data at runtime

!New in 11g - can use LOOKUP functionto retrieve relational descriptors etc



49/65


Displaying Essbase & Relational Data Together on Dashboards

Relational and Essbase data can be displayed together in analyses, dashboards

Navigation can be set up between Essbase aggregated data and relational detail



50/65


So Can OBIEE Replace WebAnalysis, Planning, Financial Mgmt etc?

OBIEE analyses, dashboards can replace all functional aspects of Web Analysis

FR is still preferable for non-trivial financial reports



51/65


... and What Issues Are Still Outstanding?

A number of minor, and major, issues are still outstanding for Essbase / EPM users

Some are minor and will be addressed with bug fixes, enhancements

!Requirement for multiple WLS homes, EM environments

!Some early-release bugs around value-based hierarchies, drilling, formulas etc

!Make sure you are on the latest release, with all patches - currently 11.1.1.6

Some are just limitations of how things work

!Cannot federate value-based hierarchies

!Slower queries and analysis compared to Smartview + Essbase Add-in

Some are fundamental and require re-engineering of OBIEE

!Complex and fragmented MDX when using hierarchical columns

!Excessively expensive MDX when using selection steps



52/65


The Hierarchical Columns and Pivoting Issue

Hierarchical columns generate one logical query per grouping

For SQL queries, these are combined into a single SQL statement

For Essbase queries, each grouping generates its own MDX query, plus others

1

2

3

4

5



53/65


Issue Compounded by > Hierarchical Column

Issue becomes worse when >1 hierarchical column & pivoting is included in analysis &

Many more sub-groupings are created leading to excessivly expensive SQL

Workaround #1 : Size your system to expect greater numbers of small MDX queries

Workaround #2 : Try to limit analyses to a single hierarchical column on row-edge

Workaround #3 : Enable caching - 11g subquery caching can significantly improve perf.

=58 separate MDX queries



54/65


The Selection Steps Issue

Selection steps (member steps) are used extensively in 11g for Essbase data

Provides an Essbase-like environment for filtering, selecting and calculating data

1

2

3



55/65


Selection Steps Multiply the Number of Physical MDX Generated

Issue is that selection steps will multiple the number of physical MDXs sent to Essbase

! Issues also affects relational sources, but SQLs are usually combined into one

# logical SQLs = (# steps in Dim1 x # steps Dim 2 x # steps Dimn) + Grand Total SQL

# MDX queries = 1 or 2 per logical SQL

Coupled with hierarchical columns & pivoting, can cause excessive MDX query load



56/65


57/65


The Value-Based Hierarchy Issue (or Gotcha)

Value-based (Parent-Child) hierarchy support are a useful addition in OBIEE 11g

Allows member searches to work against single logical column

More natural way of holding member data for Essbase users



58/65


Value-Based Hierarchies and Vertical Federation

Given the benefits of value-based hierarchies for changing outlines, customersoften enable them for all dimensions in OBIEE 11g ...

... and then want to set up drill-to-detail analyses using vertical federation

... which require defined levels to join logical table sources together

... which value-based hierarchies do not have

Workaround : Analyze Essbase and Relational separately, link by actions thatpass hierarchical column selection values through hidden attribute columns



59/65


New Ways of Doing Things

Most Essbase users access data through the Excel Add-in

Uses Query-by-Example approach to retrieve data

Combined with Excel flexibility, gives lots of options to access data

To produce similar reports, different approaches are required with OBIEE

!Use of FILTER and time-series functions

!Adaptation for structured cross-tab style interface vs. free-form Excel



60/65


Combining OBIEE Functions and Essbase Data

Time-offsets can be generated using OBIEE Time-Series functions

!AGO, TODATE, PERIODROLLING

Intersections of dimension members (Accounts, Scenarios) using FILTER function

Combine OBIEE analytic functions with Essbase member references

Requires learning OBIEE function syntax and combining with Essbase skills



61/65


OBIEE Analytic Function Examples

! FILTER(measure USING expr)

!Allows you to filter genericmeasure by dimension member,i.e. measure by Profit account,and Budget scenario

AGO, TODATE, PERIODROLLING

!Generate year-to-date,period ago, rolling total

!Pushes down to equivalent MDX

EVALUATE, EVALUTE_AGGR

! Leverage native MDX functions



62/65


63/65


Summary

OBIEE 11g introduces a number of new features Essbase customers were waiting for

!Proper OLAP analysis with hierarchical member selection

!Support for value-based hierarchies, so that outline changes dont need re-import

!Support for multiple aliases, UDAs, multiple hierarchies, filters etc

OBIEE also provides many additional features that will benefit Essbase customers

!Mapping, scorecards, better visualizations

!Action Framework, integration with Fusion Middleware

But the 11g release also brings its own new issues

!Excessive number of MDX statements for pivoting OLAP-style queries

!Selection steps can exacerbate this issue by exponentially adding more MDX queries

!Value-based hierarchies have their own gotchasDont try to 100%-replace Excel Add-in With OBIEE

! Tools are complementary, have their own strengths

!Be prepared to learn OBIEE dev techniques as well as Essbase ones



64/65


More Information

Thank you for attending this presentation

More information can be found at http://www.rittmanmead.com

Contact us at [email protected] or [email protected]

Look out for our book, Oracle Business Intelligence Developers Guide due Q1 2012

Follow-us on Twitter (@rittmanmead) or Facebook (facebook.com/rittmanmead)

mailto:[email protected]:[email protected]:[email protected]:[email protected]://www.rittmanmead.com/http://www.rittmanmead.com/http://www.rittmanmead.com/http://www.rittmanmead.com/mailto:[email protected]:[email protected]


65/65

obiee with essbase

Documents