8/3/2019 Rolta Tusc Biapps Ioug 04282011

1/35

BI Applications Performance

Tuning & Security

Copyright 2009 Rolta International, Inc., All Rights Reserved

Chandu Vellala & Ahsan ShahIndianapolis Oracle Users Group April 28, 2011

8/3/2019 Rolta Tusc Biapps Ioug 04282011

2/35

Chandu VellalaBI Applications Practice LeadCell: (312) 399-5792Email: vellalac@tusc.com

Ahsan ShanSenior OBIEE/ETL Lead

Cell: (262) 893-1301Email: shaha@tusc.com

8/3/2019 Rolta Tusc Biapps Ioug 04282011

3/35

BI Applications Tuning - Agenda

Architecture & Challenges

Tuning Methodology (Holistic Approach) Pre-Tuning Checklist Oracles Delivered tuning strategy?

reven ng per ormance ssues Tuning Diagnostic tools Tuning Examples (Decision Flowcharts) Advanced Tuning Considerations Q&A

8/3/2019 Rolta Tusc Biapps Ioug 04282011

4/35

BI Applications Architecture

OLTP TIER ETL TIER OBIEE TIER

INFA Repository DAC Repository

Scheduler

Dashboards & Reports

jdbc

mcmd

ERP App/Web Servers

ETL Client Tools DAC ClientOBIEE Admin Tool

BI APPS DW

Answers/Webcat

BI Server

Presentation Server

BI Publisher

OLTP Source System

ETL Server DAC Server

RPD WEBCATpmcmd

jdbc

jdbc

Ahsan Shah

8/3/2019 Rolta Tusc Biapps Ioug 04282011

5/35

BI Applications Tuning Areas

Network Tuning OS Tuning

ETL Tuning OBIEE Tuning

DAC

8/3/2019 Rolta Tusc Biapps Ioug 04282011

6/35

BI Apps Tuning Challenges

What & Where do you need to tune?o Multiple Tiers = Multiple Potential Bottlenecks

oDB, ETL/DAC, OBIEE, Network, OSo Multiple Technologies require Multiple Skill-sets

o Informatica, DAC, OBIEE, DB

Who will tune?o Identifying Proper Resources to Tune

oDBA, ETL Developer, OBIEE Admin, OSServer Admin,

When should you tune?o Establishing Performance Benchmarkso Setting Business Expectations & Priorities

8/3/2019 Rolta Tusc Biapps Ioug 04282011

7/35

Holistic Approach to Tuning

Systematic End to End Approach

Methodology to accurately find the bottlenecks vs.throwing resources at the issue

a o o s as mpor an as w a o

Enables effective coordination of team thatmaintains the BI Applications environments

Enables proper communication between IT andBusiness to set Benchmarks. Common definition ofRunning Slow

8/3/2019 Rolta Tusc Biapps Ioug 04282011

8/35

BI Apps Delivered Tuning

Parallel processing via DAC algorithms

Aggregate/Snapshot Fact Tables Preconfigured Indexes (Query/Bitmap, ETL) Kimball Dimensional Modeling Approach

Index Management via DAC Bulk load option during full loads Heavy lifting pushed to ETL tier

8/3/2019 Rolta Tusc Biapps Ioug 04282011

9/35

Pre-Tuning Checklist Installation/Configuration is done as per Oracle Docs

o Server/Hardware Sizing (RAM, 32/63 bit)o DW DB configuration (init.ora)o Storage Considerationso Clustering/Load Balancing

Relevance of data being extractedo DAC Parameters control history being extracted

_ _

o PRUNE DAYS (# of days to check for incremental changes)Ability to recreate the issue

o Are business users using acceptable OBIEE filters?

Setting baselines and benchmarks

Are ETL loads run at proper timeframeso Avoid running ETLs during other heavy processes or network activity

Is the issue a ETL or Query Issue?Cursory check on OBIEE report/dashboard design

8/3/2019 Rolta Tusc Biapps Ioug 04282011

10/35

Proactive TuningProper indexing for all custom tables in DAC

o Bitmap indexes (Query)o ETL indexes

Proper Informatica session level parameter valueso Follow same format as vanilla (DTM Buffer size, Commit Interval..etc)

Proper balance of OBIEE vs ETL designo OBIEE is NOT intended for heavy aggregation

o ETL tier should handle most aggregation

Test Performance before deploying to PRODProper OBIEE design for Dashboards/Reports

o Appropriate filters, # of reports per dashboard

End User training on using proper filters & columnsEnable OBIEE caching for frequently run requests

8/3/2019 Rolta Tusc Biapps Ioug 04282011

11/35

Diagnostic Tools DAC

o DAC Run History, Task Detailo DAC Server Logs

INFORMATICAo Client Tools (Monitor)o Session & Server Logs

o Usage Tracking (performance diagnostics)o OBIEE Server Logs

o BI Presentation Server log (sawlog0.log)o BI Server logs (NQQuery.log)

DATABASEo OEMo SQL Trace

NETWORK OS

8/3/2019 Rolta Tusc Biapps Ioug 04282011

12/35

IS PERFORMANCE

BAD ACROSS ALLENVIRONMENTS?

PROBLEM: Report X on Dashboard Y is

running very Slow.

ISPERFORMANCE

BAD AT ALLTIMES OR

SPECIFIC TIMES

ISPERFORMANCE

BAD FOR ALLUSERS OR

SPECIFIC USERS

POSSIBLE CAUSE: DACIndexes not in Sync across

POSSIBLE CAUSE: NetworkActivity

POSSIBLE CAUSE: Row levelSecurity causing performance

PRE-TUNINGCHECK:Proper

Installation,DB Settings

environments

Diagnostic Tool: DAC, OBIEEServer Log

Diagnostic Tool: OBIEE UsageTracking, Network Monitoring

Tool

degradation for certain users

Diagnostic Tool: OBIEEServer Logs

Does Physical Querygenerated from BI

Server run in ashorter time whenrun directly against

DB?

POSSIBLE CAUSE: OBIEEPresentation Server

Bottleneck

Diagnostic Tool: OBIEEServer Logs

POSSIBLE CAUSE: DBBottleneck

Diagnostic Tool: SQL Trace,Explain Plan

NO

YESOBIEE

TUNING

STEPS

DBTUNING

STEPS

8/3/2019 Rolta Tusc Biapps Ioug 04282011

13/35

DAC Run History

8/3/2019 Rolta Tusc Biapps Ioug 04282011

14/35

DAC Task Detail

8/3/2019 Rolta Tusc Biapps Ioug 04282011

15/35

Informatica Session Log

BUSY %

8/3/2019 Rolta Tusc Biapps Ioug 04282011

16/35

OBIEE Session Log

8/3/2019 Rolta Tusc Biapps Ioug 04282011

17/35

OBIEE Usage Tracking Tracks Longest Running Queries Average Stats by User, Subject Area

8/3/2019 Rolta Tusc Biapps Ioug 04282011

18/35

Advanced Tuning ConsiderationsETL

o Load Balance Informatica Serverso DB Hintso NOARCHIVELOG mode for Initial Loado Push large lookups to SQ transformationo Disable cache for large lookupso Distribute across multi le stora e devices RAID

o Edit Informatica Session Parameterso Drop/Recreate table for very large updates via bulk option

QUERYo Partitioning (recommended for tables >20 mil records)o Materialized Viewso Caching (seeding cache)o OBIEE Clusteringo adjust DB parameter based on bottlenecks

8/3/2019 Rolta Tusc Biapps Ioug 04282011

19/35

8/3/2019 Rolta Tusc Biapps Ioug 04282011

20/35

OBI Applications Security - Agenda

Levels of Security

User AuthenticationUser AuthorizationNon-SSO, SSO, and Integrated scenarios

mp emen ng a a ccess ecur yImplementing Object Level SecurityWeb Catalog Security Best PracticesQ&A

8/3/2019 Rolta Tusc Biapps Ioug 04282011

21/35

Levels of Security User Authentication

The process used to verify the identity of aUser who tries to access the system

User AuthorizationThe process that determines what objectsa User has access to in BI, and verifies if

the User has been granted sufficientprivileges to perform the requested action

on the specified object

8/3/2019 Rolta Tusc Biapps Ioug 04282011

22/35

User Authentication Basic Internal OBIEE Authentication

User/Pwds stored inside the OBI Repository

External Database Login Authentication

Non-SSO Authentication usin LDAP or

External Table Small User community

SSO Authentication Using LDAP or External

Table Typically from Company Portal Integrated SSO between Transaction and

BI Apps using LDAP or External Table

8/3/2019 Rolta Tusc Biapps Ioug 04282011

23/35

User Authorization Implemented using Security Groups

defined in the OBI Administration Tool

The Roles or Responsibilities of theuser from the source system is mapped by

name to the security group that isdefined in the OBIEE Administration Tool

Also defined as Presentation ServicesGroups in the Web Catalog where

Permissions and Privileges are setup

8/3/2019 Rolta Tusc Biapps Ioug 04282011

24/35

Non-SSO Authentication using LDAP

8/3/2019 Rolta Tusc Biapps Ioug 04282011

25/35

SSO Authentication using LDAP

8/3/2019 Rolta Tusc Biapps Ioug 04282011

26/35

Integrated Environments using

SSO (Authentication)

8/3/2019 Rolta Tusc Biapps Ioug 04282011

27/35

Implementing Authorization

(Data Access Security)

Defined in the Oracle BI AdministrationTool

dimension that the users are authorized toaccess. For e.g.

Set ID filter

Business Unit filter

Department ID filter

Typically defined for a security group

8/3/2019 Rolta Tusc Biapps Ioug 04282011

28/35

Integrated Apps Authorization

Example GROUP=Financial Analyst; AR Manager; APManager

8/3/2019 Rolta Tusc Biapps Ioug 04282011

29/35

Data Access Security (Admin Tool)

8/3/2019 Rolta Tusc Biapps Ioug 04282011

30/35

Implementing Authorization

(Object Level Security) Defined in 2 locations

OBI Administration ToolOBI Presentation Catalog

to access:Subject Areas/ Presentation Tables / Columns

Dashboards/Reports/ Catalog Folders

Permissions and Privileges for objects andaccess to functions in BI Presentation Services

8/3/2019 Rolta Tusc Biapps Ioug 04282011

31/35

Object Security - Repository

(OBIEE Administration Tool)

8/3/2019 Rolta Tusc Biapps Ioug 04282011

32/35

Object Security - Web Catalog

(Presentation Services Administration)

8/3/2019 Rolta Tusc Biapps Ioug 04282011

33/35

Object Security - Web Catalog

(Presentation Services Administration)

8/3/2019 Rolta Tusc Biapps Ioug 04282011

34/35

Web Catalog Security - Best practices

Assign permissions through Presentation Services groupmembership, even if you want to assign permissions for asingle user

Set the permission to the Group folder for the appropriategroups to Read

For groups that are going to be modifying the dashboards anddashboard content accessible to the group, set the permissions

For each Subject Area, grant Read permissions to thecorresponding Subject Area folder within the Requests folder

For groups that should be able to save requests for public useagainst a given Subject Area, grant them Full Control to theSubject Area folder and everything it contains, and likewise forthe Common folder

To make sure that only members of the designatedPresentation Services groups have access to PresentationCatalog folders, folder content, and Dashboards

8/3/2019 Rolta Tusc Biapps Ioug 04282011

35/35