rolta tusc biapps ioug 04282011

8/3/2019 Rolta Tusc Biapps Ioug 04282011

1/35

BI Applications Performance

Tuning & Security

Copyright 2009 Rolta International, Inc., All Rights Reserved

Chandu Vellala & Ahsan ShahIndianapolis Oracle Users Group April 28, 2011


2/35

Chandu VellalaBI Applications Practice LeadCell: (312) 399-5792Email: [email protected]

Ahsan ShanSenior OBIEE/ETL Lead

Cell: (262) 893-1301Email: [email protected]


3/35

BI Applications Tuning - Agenda

Architecture & Challenges

Tuning Methodology (Holistic Approach) Pre-Tuning Checklist Oracles Delivered tuning strategy?

reven ng per ormance ssues Tuning Diagnostic tools Tuning Examples (Decision Flowcharts) Advanced Tuning Considerations Q&A


4/35

BI Applications Architecture

OLTP TIER ETL TIER OBIEE TIER

INFA Repository DAC Repository

Scheduler

Dashboards & Reports

jdbc

mcmd

ERP App/Web Servers

ETL Client Tools DAC ClientOBIEE Admin Tool

BI APPS DW

Answers/Webcat

BI Server

Presentation Server

BI Publisher

OLTP Source System

ETL Server DAC Server

RPD WEBCATpmcmd

jdbc

jdbc

Ahsan Shah


5/35

BI Applications Tuning Areas

Network Tuning OS Tuning

ETL Tuning OBIEE Tuning

DAC


6/35

BI Apps Tuning Challenges

What & Where do you need to tune?o Multiple Tiers = Multiple Potential Bottlenecks

oDB, ETL/DAC, OBIEE, Network, OSo Multiple Technologies require Multiple Skill-sets

o Informatica, DAC, OBIEE, DB

Who will tune?o Identifying Proper Resources to Tune

oDBA, ETL Developer, OBIEE Admin, OSServer Admin,

When should you tune?o Establishing Performance Benchmarkso Setting Business Expectations & Priorities


7/35

Holistic Approach to Tuning

Systematic End to End Approach

Methodology to accurately find the bottlenecks vs.throwing resources at the issue

a o o s as mpor an as w a o

Enables effective coordination of team thatmaintains the BI Applications environments

Enables proper communication between IT andBusiness to set Benchmarks. Common definition ofRunning Slow


8/35

BI Apps Delivered Tuning

Parallel processing via DAC algorithms

Aggregate/Snapshot Fact Tables Preconfigured Indexes (Query/Bitmap, ETL) Kimball Dimensional Modeling Approach

Index Management via DAC Bulk load option during full loads Heavy lifting pushed to ETL tier


9/35

Pre-Tuning Checklist Installation/Configuration is done as per Oracle Docs

o Server/Hardware Sizing (RAM, 32/63 bit)o DW DB configuration (init.ora)o Storage Considerationso Clustering/Load Balancing

Relevance of data being extractedo DAC Parameters control history being extracted

_ _

o PRUNE DAYS (# of days to check for incremental changes)Ability to recreate the issue

o Are business users using acceptable OBIEE filters?

Setting baselines and benchmarks

Are ETL loads run at proper timeframeso Avoid running ETLs during other heavy processes or network activity

Is the issue a ETL or Query Issue?Cursory check on OBIEE report/dashboard design


10/35

Proactive TuningProper indexing for all custom tables in DAC

o Bitmap indexes (Query)o ETL indexes

Proper Informatica session level parameter valueso Follow same format as vanilla (DTM Buffer size, Commit Interval..etc)

Proper balance of OBIEE vs ETL designo OBIEE is NOT intended for heavy aggregation

o ETL tier should handle most aggregation

Test Performance before deploying to PRODProper OBIEE design for Dashboards/Reports

o Appropriate filters, # of reports per dashboard

End User training on using proper filters & columnsEnable OBIEE caching for frequently run requests


11/35

Diagnostic Tools DAC

o DAC Run History, Task Detailo DAC Server Logs

INFORMATICAo Client Tools (Monitor)o Session & Server Logs

o Usage Tracking (performance diagnostics)o OBIEE Server Logs

o BI Presentation Server log (sawlog0.log)o BI Server logs (NQQuery.log)

DATABASEo OEMo SQL Trace

NETWORK OS


12/35

IS PERFORMANCE

BAD ACROSS ALLENVIRONMENTS?

PROBLEM: Report X on Dashboard Y is

running very Slow.

ISPERFORMANCE

BAD AT ALLTIMES OR

SPECIFIC TIMES

ISPERFORMANCE

BAD FOR ALLUSERS OR

SPECIFIC USERS

POSSIBLE CAUSE: DACIndexes not in Sync across

POSSIBLE CAUSE: NetworkActivity

POSSIBLE CAUSE: Row levelSecurity causing performance

PRE-TUNINGCHECK:Proper

Installation,DB Settings

environments

Diagnostic Tool: DAC, OBIEEServer Log

Diagnostic Tool: OBIEE UsageTracking, Network Monitoring

Tool

degradation for certain users

Diagnostic Tool: OBIEEServer Logs

Does Physical Querygenerated from BI

Server run in ashorter time whenrun directly against

DB?

POSSIBLE CAUSE: OBIEEPresentation Server

Bottleneck

Diagnostic Tool: OBIEEServer Logs

POSSIBLE CAUSE: DBBottleneck

Diagnostic Tool: SQL Trace,Explain Plan

NO

YESOBIEE

TUNING

STEPS

DBTUNING

STEPS


13/35

DAC Run History


14/35

DAC Task Detail


15/35

Informatica Session Log

BUSY %


16/35

OBIEE Session Log


17/35

OBIEE Usage Tracking Tracks Longest Running Queries Average Stats by User, Subject Area


18/35

Advanced Tuning ConsiderationsETL

o Load Balance Informatica Serverso DB Hintso NOARCHIVELOG mode for Initial Loado Push large lookups to SQ transformationo Disable cache for large lookupso Distribute across multi le stora e devices RAID

o Edit Informatica Session Parameterso Drop/Recreate table for very large updates via bulk option

QUERYo Partitioning (recommended for tables >20 mil records)o Materialized Viewso Caching (seeding cache)o OBIEE Clusteringo adjust DB parameter based on bottlenecks


19/35


20/35

OBI Applications Security - Agenda

Levels of Security

User AuthenticationUser AuthorizationNon-SSO, SSO, and Integrated scenarios

mp emen ng a a ccess ecur yImplementing Object Level SecurityWeb Catalog Security Best PracticesQ&A


21/35

Levels of Security User Authentication

The process used to verify the identity of aUser who tries to access the system

User AuthorizationThe process that determines what objectsa User has access to in BI, and verifies if

the User has been granted sufficientprivileges to perform the requested action

on the specified object


22/35

User Authentication Basic Internal OBIEE Authentication

User/Pwds stored inside the OBI Repository

External Database Login Authentication

Non-SSO Authentication usin LDAP or

External Table Small User community

SSO Authentication Using LDAP or External

Table Typically from Company Portal Integrated SSO between Transaction and

BI Apps using LDAP or External Table


23/35

User Authorization Implemented using Security Groups

defined in the OBI Administration Tool

The Roles or Responsibilities of theuser from the source system is mapped by

name to the security group that isdefined in the OBIEE Administration Tool

Also defined as Presentation ServicesGroups in the Web Catalog where

Permissions and Privileges are setup


24/35

Non-SSO Authentication using LDAP


25/35

SSO Authentication using LDAP


26/35

Integrated Environments using

SSO (Authentication)


27/35

Implementing Authorization

(Data Access Security)

Defined in the Oracle BI AdministrationTool

dimension that the users are authorized toaccess. For e.g.

Set ID filter

Business Unit filter

Department ID filter

Typically defined for a security group


28/35

Integrated Apps Authorization

Example GROUP=Financial Analyst; AR Manager; APManager


29/35

Data Access Security (Admin Tool)


30/35

Implementing Authorization

(Object Level Security) Defined in 2 locations

OBI Administration ToolOBI Presentation Catalog

to access:Subject Areas/ Presentation Tables / Columns

Dashboards/Reports/ Catalog Folders

Permissions and Privileges for objects andaccess to functions in BI Presentation Services


31/35

Object Security - Repository

(OBIEE Administration Tool)


32/35

Object Security - Web Catalog

(Presentation Services Administration)


33/35

Object Security - Web Catalog

(Presentation Services Administration)


34/35

Web Catalog Security - Best practices

Assign permissions through Presentation Services groupmembership, even if you want to assign permissions for asingle user

Set the permission to the Group folder for the appropriategroups to Read

For groups that are going to be modifying the dashboards anddashboard content accessible to the group, set the permissions

For each Subject Area, grant Read permissions to thecorresponding Subject Area folder within the Requests folder

For groups that should be able to save requests for public useagainst a given Subject Area, grant them Full Control to theSubject Area folder and everything it contains, and likewise forthe Common folder

To make sure that only members of the designatedPresentation Services groups have access to PresentationCatalog folders, folder content, and Dashboards


35/35

rolta tusc biapps ioug 04282011

Documents