bi cockpit administration

97
Rudolf Hennecke, SAP Technology RIG Raghu Ganesh, SAP Technology RIG Feb 2011 As of SAP NetWeaver BW 7.0 Enhancement Package 1 (including outlook to SAP NetWeaver BW 7.30) SAP NetWeaver BW Administration Cockpit Technical Content BI Statistics

Upload: szeraoui1595

Post on 21-Oct-2015

113 views

Category:

Documents


8 download

TRANSCRIPT

Page 1: BI Cockpit Administration

Rudolf Hennecke, SAP Technology RIGRaghu Ganesh, SAP Technology RIG

Feb 2011

As of SAP NetWeaver BW 7.0 Enhancement Package 1 (including outlook to SAP NetWeaver BW 7.30)

SAP NetWeaver BW

Administration Cockpit

Technical Content

BI Statistics

Page 2: BI Cockpit Administration

© SAP 2010 / Page 2

1. Administration Cockpit & Technical Content

2. Query Runtime Statistics

2.1. Migration & Maintenance

2.2. Performance Analysis

2.3. Usage Analysis

2.4. Tips & Tricks

3. Data Load Statistics

4. Data Load Status

5. Administration Cockpit and Technical Content – Update for BW 7.30

6. Further Information

Agenda

Page 3: BI Cockpit Administration

© SAP 2010 / Page 3

Alert

Management

System (ALM)

SAP NetWeaver Administration and BI

Alert

Management

System (ALM)

Computing Center

Management System

(CCMS)

Central

Performance

History (CPH)

Process

Chains (RSPC)

Technical

Content for

BI Statistics

SAP NetWeaver Portal

SAP NetWeaver

Administrator

SAP

Solution

Manager

SAP Web Application Server

Web AS ABAP & Java

BI

Administration

Cockpit

SAP NetWeaver BW

BI Checks

(RSRV)

BI Suite, BI

Platform & Data

Warehousing

Universal

Work List

BI Content

for CCMS

Computing Center

Management System

(CCMS)

BI Content Web

Application for

CCMS

Data Alert Scope of this presentation

Page 4: BI Cockpit Administration

© SAP 2010 / Page 4

BI Administration Cockpit Motivation

Easy administration

for complex

Enterprise Data

Warehouses

using the

BI Administration Cockpit

Page 5: BI Cockpit Administration

© SAP 2010 / Page 5

BI Administration Cockpit Scope

Support the BI administrator in

Performance optimization

Monitor BI system usage

Status tracking

…in the areas of

Enterprise Data Warehousing

Enterprise Query, Reporting and Analysis

Business Planning and Analytical Services

…by providing a central point of entry with

cockpits

Real-time monitors

Runtime Statistics

Cross system monitoring

…including context-specific

Drill-down to details

Processing options

Exceptions (optional)

…using proven technology

BI Queries

BI Web Applications

SAP NetWeaver Portal

…to make administration

easier and faster

…and thus to lower the TCO

Page 6: BI Cockpit Administration

© SAP 2010 / Page 6

BI Administration Cockpit

Overview

Central access to most important BI

monitoring information

Monitoring of

multiple BI systems

in one view

Flexible filtering of

relevant information

Context menu for

access to more

detailed information

or BI Transaction

Exception definition for

intuitive display of critical

monitoring data (optional)

Graphical display

Page 7: BI Cockpit Administration

© SAP 2010 / Page 7

BI Administration Cockpit

Architecture

BI

Suite

BI

PlatformData

Warehousing

Queries

BI Web Applications

SAP NetWeaver BW

InfoProviders / MultiProviders

Query Runtime

StatisticsData Load

Statistics

Data Load

Status

DataSources

iViews iViews

SAP NetWeaver Portal

Portal

Pages iViews

SAP NetWeaver 7.0 BI

technology

(software component

SAP_BW)

Technical Content for SAP

NetWeaver BW (software

component BI_CONT,

release 7.0.3), The

Technical Content is

entirely based on SAP BW

3.x functionality not

requiring BI_JAVA.

Business Package „BI

Administration 1.0“ (Patch

2) from the Portal Content

Portfolio. BI Administration

Cockpit can run in a

central or in a local portal.

Page 8: BI Cockpit Administration

© SAP 2010 / Page 8

BI Administration Cockpit

Main building blocks

BI

Suite

BI

PlatformData

Warehousing

Queries

BI Web Applications

InfoProviders / MultiProviders

Query Runtime

StatisticsData Load

Statistics

Data Load

Status

DataSources

iViews iViewsPortal

Pages iViews

BI Statistics

Detailed Runtime Statistics Data collection for various BI

Objects in Data Warehousing, Enterprise Reporting and Planning

Technical Content (InfoProviders and DataSources)

Central Data Basis for BI Administration Cockpit and BI system

load transaction ST03

Persistent Data Storage and Remote Access to BI Statistics

Information

Technical Content (Web Application and Queries)

Flexible analysis of statistics data and sophisticated

presentation of information (graphs, charts, tables)

BI Administration Cockpit (Business Package)

Single point of entry and integration with other (non BI related)

portal content (example: Universal Work List)

Page 9: BI Cockpit Administration

© SAP 2010 / Page 9

Overview on Technical Content

Technical Content: general objects

BI Objects that are required for running the SAP NetWeaver BW system

Analysis Authorizations, BI Trace Tool, Personalization,… Shipped as part of BI Technology (software component SAP_BW) and

installed automatically

Some objects are already installed in the XPRA phase during the upgrade

Most objects are installed when you call the Data Warehousing Workbench (DWB) for the first time.

Important Notes

834280 Installing technical BI Content after upgrade

1069134 Improved monitoring RSTCO_ADMIN

1008758 Automatic installation of technical BI Content

Technical Content: BI Statistics (focus of this presentation)

Monitoring Performance and Status of BI Objects

Main focus of this presentation

Shipped as part of BI Content (software component BI_CONT)

Page 10: BI Cockpit Administration

© SAP 2010 / Page 10

New Technical Content for BI Statistics

Main enhancements

New Technical Content for new and enhanced BI Statistics

New Query Runtime Statistics

Process Chain and DTP Statistics

BI Object Request and Process Status

Technical Content for direct access and analysis on persistent data

Per default, queries from the Technical Content filter on reading from

persistent InfoProviders only

Reading from Virtual Providers can be enabled on query level by customers

Technical Content on detailed and aggregated level

For Query Runtime Statistics

New maintenance for query statistics data collection

Enabling statistics and selection of detail level for statistics

Data load statistics are collected automatically for IPs and process chains

No maintenance necessary (as of SAP NetWeaver 7.0 BI, SPS9 and SAP

Note 952191)

For DTP – set STATON = „X‟ in RSDDSTATOBJLEVEL for TLOGOTP =

„DTPA‟ and this is done automatically by the installation program.

Page 11: BI Cockpit Administration

© SAP 2010 / Page 11

VirtualProviders in Technical Content

Real-time Analysis of BI statistics data through VirtualProviders in Technical

Content (example: Query Runtimes Statistics):

0TCT_C01

Standard InfoCube

0TCT_DS01

0TCT_VC01

VirtualProvider

0TCT_MC01

BI Statistics Tables

(database view)

Access to VirtualProvider

Disabled in Technical Content Queries

used in the BI Administration Cockpit

Can be enabled in customer defined

queries on Technical Content by removing

restriction on characteristic 0INFOPROV

Enabled in ST03 queries accessing the

Technical Content

Frequent loading of delta data is

recommended (guideline: once a day)

few remaining delta data in BI

Statistics Tables

fast (virtual) query access!

Periodical delta

updates (loading)

Transfer next potential

delta at query runtime

Page 12: BI Cockpit Administration

© SAP 2010 / Page 12

BI Administration Cockpit

Configuration steps

SAP NetWeaver BW

SAP NetWeaver PortalConfiguration steps

(executed from IMG, Transaction SPRO)

7. Set Up Call to BI Administration Cockpit

6. Install Business Package 'BI Administration 1.0„ (Patch 2)

5. Connect BI System and Portal (See note 917950)

4. Schedule Technical Content Process Chains (only

needed if not done in step 1)

3. Check Updating of Statistics

2. Assign the BI Administrator Role

1. Activate the new technical content in SAP NetWeaver BW

(automatic activation, no manual activation needed)

BI Statistics

Technical

Content for SAP

NetWeaver BW

Business Package

“BI Administration

1.0”

Available with installation or upgrade to

SAP NetWeaver 7.0 BI

Please find additional information on the

individual steps in the configuration IMG.

Page 13: BI Cockpit Administration

© SAP 2010 / Page 13

BI Administration Cockpit

IMG for Configuration

Configuration of the

BI Administration Cockpit

(Transaction SPRO)

This activity starts transaction

RSTCC_INST_BIAC

which links the report

RSTCC_ACTIVATEADMINCOCKPIT_NEW

for automatic installation of the Technical

Content

activating all the Technical Content objects

that are assigned to role

SAP_BW_BI_ADMINISTRATOR, including

the relevant data flows and process chains

Prerequisite:

Software component BI_CONT 7.0.3 with

latest Support Package

It is recommended to install BI_CONT 7.0.3

as BI_CONT 7.0.2 is out of maintenance!

Page 14: BI Cockpit Administration

© SAP 2010 / Page 14

BI Administration Cockpit

Scope of automatic installation report

Activation of all Technical Content for

given source system (including activation

of direct access for VirtualProviders). If

source system is not the MYSELF

connection the RFC connection has to be

established in advance.

Automatic Scheduling of Init Process

Chains 0TCT_C0_INIT_P01 and

0TCT_C2_INIT_P01 if flag set.

Automatic daily scheduling of specified

Delta Process Chains (if time is set).

Option to create transport request for

transport to production. It is not

recommended to install the Technical

Content directly on production systems.

Instead you should transport the Technical

Content from development in order to allow

for proper change management.

Page 15: BI Cockpit Administration

© SAP 2010 / Page 15

Process Chains in Technical Content

Overview

0TCT_MD_S_FULL_P01 loads text for objects like „Process

Status‟, „BI Object type‟, „Process Type‟

0TCT_MD_C_FULL_P01 loads attributes & text for objects like

„Process Variants‟, „Process Chain‟

Master Data - loads attributes & text for objects like „Process Variants‟, „Process Chain‟

0TCT_C0_INIT_P01 Query Runtime Statistics

0TCT_C2_INIT_P01 Data Load Statistics

Initialization loads - Need to run only once (Immediate scheduling)

0TCT_C0_DELTA_P01 Query Runtime Statistics - Delta

0TCT_C2_DELTA_P01 Data Load Statistics - Delta

Delta Loads - These process chains can be scheduled for periodic execution

Process chains - to load BI Statistics data to the Technical Content

Report RSTCC_ACTIVATEADMINCOCKPIT_NEW activates the process chains

Alternatively they can get scheduled manually

Page 16: BI Cockpit Administration

© SAP 2010 / Page 16

BI Administration Cockpit

Best Practice Architecture central monitoring

SAP NetWeaver BW

Central Monitoring System

SAP NetWeaver Portal

BI Statistics

Business Package

“BI Administration 1.0”

Technical Content

DataSources

InfoProviders

SAP NetWeaver BW

Local System 1

SAP NetWeaver Portal

BI Statistics

Business Package

“BI Administration 1.0”

Technical Content

DataSources

InfoProviders

SAP NetWeaver BW

Local System n

SAP NetWeaver Portal

BI Statistics

Business Package

“BI Administration 1.0”

Technical Content

DataSources

InfoProviders

Optional objects in

local systems

Only if central

system is

monitored itself

Page 17: BI Cockpit Administration

© SAP 2010 / Page 17

BI Administration Cockpit – Central Note

SAP Service Marketplace note

934848 “Collective note: (FAQ) BI Administration Cockpit”

Prerequisites for running the Technical Content and the BI Administration

Cockpit

General comments on installation

Specific comments on the installation steps to be performed

Tips on Running and Maintaining the Technical Content

Important corrections

Page 18: BI Cockpit Administration

© SAP 2010 / Page 18

1. Administration Cockpit & Technical Content

2. Query Runtime Statistics

2.1. Migration & Maintenance

2.2. Performance Analysis

2.3. Usage Analysis

2.4. Tips & Tricks

3. Data Load Statistics

4. Data Load Status

5. Administration Cockpit and Technical Content – Update for BW 7.30

6. Further Information

Agenda

Page 19: BI Cockpit Administration

© SAP 2010 / Page 19

Query Runtime Statistics in SAP NetWeaver 7.0

Front end / OLAP Statistics and Data Manager Statistics …

Splitting the BW 3.x OLAP statistics into Frontend / OLAP statistics and Data Manager statistics

Serial execution (Front-End/OLAP) vs. parallel execution (Data Manager, mostly)

Many different events (FE/OLAP) vs. small number of events (DM)

Statistic detail levels

Introducing statistic detail levels on query level

Customize the level of detail of statistic data collection for a certain object

Event Concept

Introducing the concept of the Event ID (characteristic)

Flexible and extensible framework

Enhanced coverage of BI functionality

Enhanced: BEx Web, Planning

New: BI Accelerator

Page 20: BI Cockpit Administration

© SAP 2010 / Page 20

Decentralized Statistics Data Storage (1)

RSDDSTATINFO

RSDDSTATHEADER

RSDDSTATEVDATA

RSDDSTATEVENTS

RSDDSTATAGGRDEF

RSDDSTATDM

Page 21: BI Cockpit Administration

© SAP 2010 / Page 21

Decentralized Statistics Data Storage (2)

… use the new DB_VIEWS to display

statistics data:

RSDDSTAT_OLAP

RSDDSTAT_DM

Page 22: BI Cockpit Administration

© SAP 2010 / Page 22

BI Statistics framework – new event concept

Event ID

At many different events in processing, runtime information gets collected

Common concept used in query runtime, planning and warehouse management statistics

Guarantees flexibility for further extensions

Is the basis for end to end runtime monitoring of processing in SAP NetWeaver BW

Depending on the event, the time is measured from start to end point or only at end point (time since last end point)

Excerpt from table

RSDDSTATEVENTS

Page 23: BI Cockpit Administration

© SAP 2010 / Page 23

Query Runtime Statistics - Overview (example)

BI Web Application

containing two web

items

Query 1 Query 2

InfoCube 1 InfoCube 2DS Object 3

Aggregate BI Accelerator

Front end

OLAP

Data Manager

Page 24: BI Cockpit Administration

© SAP 2010 / Page 24

Query Runtime Statistics - Overview (example)

User Session (SESSIONUID)

User Step 1 (STEPUID)

Query 1 Query 2

Step 2

Data Manager (DMUID)

InfoCube 2, BI Accelerator Index

Web Items, Web Application

InfoCube 1, Aggregate 1

DS Object 3

Front end / OLAP statistics

(RSDDSTAT_OLAP)

Data Manager statistics

(RSDDSTAT_DM)

Waiting time

OLAP, Cache, Master Data

Event 1: 2,324 sec. ‚2„ ‚3„ ‚4„

∑ = total runtime of the

navigation step in your

BI web application, your

workbook or your front

end

Event ID = ‘000009000’

Page 25: BI Cockpit Administration

© SAP 2010 / Page 25

Administration Cockpit: Query Runtime Statistics

Page 26: BI Cockpit Administration

© SAP 2010 / Page 26

Administration Cockpit: Query Runtime Statistics

This Workset provides an overview of the statistics of the query runtime.

The Workset includes three pages with the following information:

1. BI Application Statistics with the iViews:

– Short-Term Trends in Total Runtimes of BI Applications

– Long-Term Trends in Total Runtimes of BI Applications

– Runtimes of BI Applications

– Deviations in Runtimes of BI Applications

– BI Application Type Selection

2. BI Application Object Statistics with the iViews:

– Short-Term Trends in Total Runtimes of BI Application Objects

– Long-Term Trends in Total Runtimes of BI Application Objects

– Runtimes of BI Application Objects

– Deviations in Runtimes of BI Application Objects

– BI Application Object Type Selection

3. InfoProvider Statistics with the iViews:

– Short-Term Trends in Total Runtimes of InfoProviders

– Long-Term Trends in Total Runtimes of InfoProviders

– Runtimes of InfoProviders

– Deviations in Runtimes of InfoProviders

– InfoProvider Type Selection

Page 27: BI Cockpit Administration

© SAP 2010 / Page 27

Technical Content for Query Runtime Statistics:

Queries

Technical content queries for analyzing the runtime of …

Queries

BI Web Applications

… each with various key figures (excerpt) …

Ø Frontend-time

Ø OLAP-time

Ø DM-time

Ø Planning time

… being calculated as …

Averages, Long Term & Short Term Deviations, Rankings

…and displayed in different time intervals:

Hours per day, Days per month, Weeks per quarter

Page 28: BI Cockpit Administration

© SAP 2010 / Page 28

Technical Content for Query Runtime Statistics:

Data Flow

0TCT_C01

0TCT_DS01

0TCT_VC01

0TCT_MC01

0TCT_CA1

0TCT_DSA1

0TCT_VCA1

0TCT_MCA1

Front-End and OLAP

Statistics (Aggregated)

RSDDSTAT_OLAP

(database view) Use Cases Average Query Runtimes

Predefined runtime categories

Drilldown to navigation step

Monitor query activity

(example: navigations / day)

Use Cases

New InfoProvider for High level monitoring on day /

query level (high aggregation)

Additional flag for marking initial query executions

(in comparison to subsequent navigations)

DataSource 0TCT_DSA1 is available since SP 16 of

SAP_BW / Technical Content on top is available since

BI_CONT 7.0.3 SP 8

Front-End and OLAP

Statistics (Highly

Aggregated)

New!

Page 29: BI Cockpit Administration

© SAP 2010 / Page 29

Technical Content for Query Runtime Statistics:

Data Flow – contd…

0TCT_C02

0TCT_DS02

0TCT_VC02

0TCT_MC02

RSDDSTAT_DM

(database view)

Data Manager Statistics

(Details)Front-End and OLAP

Statistics (Details)

0TCT_C03

0TCT_DS03

0TCT_VC03

0TCT_MC03

RSDDSTAT_OLAP

(database view)Use Cases Advanced query runtime monitoring and

troubleshooting

No automatic data loading (not contained

in standard TCT process chains)

Data Loading to be activated on custom

basis

Use Cases

MultiProvider runtimes

Query performance tuning using the

BI Accelerator or Aggregates

Page 30: BI Cockpit Administration

New Technical Content InfoProvider 0TCT_CA1

Further links

Documentation

http://help.sap.com/saphelp_nw70ehp1/helpdata/en/91/2698bad6ee48b9882e05516

313d636/frameset.htm

Important SAP Notes

1367575 Time characteristics incorrect for 0TCT_DSA1

1335415 BI Application name missing for 3.X Workbook and Templates

1246611 BIAC:BI Admin Cockpit - Usage Statistics

New Technical Content for Query Usage Statistics

http://help.sap.com/saphelp_nw70/helpdata/en/26/9ef41d14dc424183b4807538be8e

1e/frameset.htm

• Further information on custom implementation of custom counters on the next

slides

© SAP 2010 / Page 30

Page 31: BI Cockpit Administration

© SAP 2010/ Page 31

Table RSDDSTAT_DMData in BI Statistic Tables

Technical Content for Query Runtime Statistics:

Details

Table RSDDSTAT_OLAP

Data in Technical Content

InfoCube

0TCT_C02(Detailed)

InfoCube

0TCT_C01

(Aggregated) (Detailed)

InfoCube

0TCT_C02

InfoCube

0TCT_CA1

(Highly

Aggregated)

all details all details

Page 32: BI Cockpit Administration

© SAP 2010 / Page 32

BI Application / BI Application Object

Runtimes for Application and Application Objects are displayed

In this eg: a Web-template displays 2 diff: queries

Statistics pertaining to each of the objects are extracted

Please note that

OLAP & Data Manager times for the individual queries could be displayed.

Front End Time for the Web-template is also displayed.

BI Application BI Application

Object

Front End

Time

OLAP

Time

Data Manager

Time

Web Template

Count

Query

Count

Web Template 1 4,07 1

Web Template 1 Query 1 0,23 0,60 1

Web Template 1 Query 2 0,81 0,70 1

Page 33: BI Cockpit Administration

© SAP 2010 / Page 33

Query Runtime Statistics: Aggregation in

Extraction

BI statistics data is aggregated within DataSource 0TCT_DS01 which populates

the main Technical Content InfoCube 0TCT_C01 (Aggregated Query Runtime

Statistics)

Data is assigned to aggregated key figures using the HANDLETP (Handle type) and the

EVENTID (Event ID) of the BI statistics data

Page 34: BI Cockpit Administration

© SAP 2010 / Page 34

1. Administration Cockpit & Technical Content

2. Query Runtime Statistics

2.1. Migration & Maintenance

2.2. Performance Analysis

2.3. Usage Analysis

2.4. Tips & Tricks

3. Data Load Statistics

4. Data Load Status

5. Administration Cockpit and Technical Content – Update for BW 7.30

6. Further Information

Agenda

Page 35: BI Cockpit Administration

© SAP 2010 / Page 35

Maintenance of the query statistic data collection

(1)

…accessible from the Data Warehousing Workbench Tools

or using transaction RSDDSTAT

For Queries, InfoProviders,

Web Templates, Workbooks

Switch Statistics data

collection on or off

Set the statistic detail level

‚0„ = Aggregated data only

‚1„ = No detail on data manager

‚2„ = Detail on all levels

Page 36: BI Cockpit Administration

© SAP 2010 / Page 36

Maintenance of the query statistic data collection

(2)

Default settings for statistic data collection

For newly created queries: InfoProvider default

All new queries of this InfoProvider will inherit the setting

If no InfoProvider setting exists: custom system default for all queries

Extras Change Default or

Change entry „Default Value“ in list

If no (custom) system default exists: (Delivered) System Default:

D = „X‟ = On,

Statistic Detail level: D = „1‟ (Only Front End/Calculation Layer Data)

Statistic Data Management

Please review the (delivered) system default and disable statistic data collection where performance monitoring is not necessary

Example: InfoProviders with low data volume

Setting Statistic Detail Level „2‟ for all queries will result in large amounts of data in statistic data collection tables (rule of thumb: ~ 30 - 40 records per query navigation step)

Frequent transfer to Technical Content InfoProviders recommended

Frequent deletion of Statistics Data (in transaction RSDDSTAT) recommended

Page 37: BI Cockpit Administration

© SAP 2010 / Page 37

Maintenance of the query statistic data collection

(3)

Statistics Detail Level setting

„0‟ - Aggregated Data: System writes only one OLAP event (event 99999) for the query.

Contains the contains the cumulative times within the OLAP processing of the query.

System does not record data from the aggregation layer of the analytic engine or aggregation information.

„1 - Only Front End/Calculation Layer Data:

System records all OLAP events, but does not separate data from the aggregation layer of the analytic engine.

System writes only the general data manager event 9000 in the OLAP context as well as the aggregation information.

„2‟ - All: The system records all data from the area for front end and calculation layer

Also, records data from the area for the aggregation layer and aggregation information.

„9‟ - No Data: The system does not record any data from the front end and calculation layer or from the aggregated event 99999.

But it does record data for the BEx Web templates and workbooks, depending on the setting.

For more details, please click here

Page 38: BI Cockpit Administration

© SAP 2010 / Page 38

Deletion of Query Runtime Statistics

Estimated data volume in query runtime statistics

Depending on the detail statistics level 30 – 80 records may be written per navigation step to the BI Statistics Tables (for those InfoProviders and Queries where statistics data collection is turned on)

Example: 500 Users / day with each 6 navigation steps in average = 500 x 6 x 30 = 90.000 records / day in BI Statistics Tables

1. Manual deletion of statistics data

In transaction RSDDSTAT. Dates to be deleted are selected.

Using program RSDDSTAT_DATA_DELETE (for query runtime statistics only in 7.0x, in

addition for data warehouse management statistics with BW 7.30)

2. Automatic deletion during data load

Per default, with a delta load for query runtime statistics, data of the last 30 days is

deleted out of the BI Query Runtime Statistics Tables where the corresponding Query

Runtime DataSource extracts from. This time frame can be customized using the

TCT_KEEP_OLAP_DM_DATA_N_DAYS parameter in the RSADMIN table.

Please see following SAP Notes for more information

891740 Query runtime statistics: Corrections for extractors

1095411 BIAC: Reduction in Data volume in QT Statistics Tables

Page 39: BI Cockpit Administration

© SAP 2010 / Page 39

Migration mandatory

3.x InfoCube 0BWTC_C02 will not receive any new data as source table RSDDSTAT is not used for statistics data collection anymore

Please note that data in the obsolete table RSDDSTAT can get deleted through the reports RSDDK_STA_DEL_DATA and RSDDK_STA_DEL_DATA_TO_DATE

No migration: Technical content 3.x still valid

With SAP NetWeaver 7.0, table RSDDSTATAGGRDEF has been enhanced. The technical content 3.x is currently not reflecting this update but can still be used. For more details and best practices on using this statistical information in BW Monitoring please refer to the slide “System usage statistics -Number of usages of characteristics in queries”

Technical Content for Query Runtime Statistics

Migration

0BWTC_C02

BW Statistics - OLAP

0TCT_C01

Front-End and OLAP Statistics

0BWTC_C03

BW Statistics

- OLAP, Detail Navigation

0TCT_C02 0TCT_C03

Data Manager Statistics

Page 40: BI Cockpit Administration

© SAP 2010 / Page 40

Query Runtime Statistics Key Figures in 3.x and

7.x

More information on

http://help.sap.com/saphelp_nw70/helpdata/en/43/e39fd25ff502d2e10000000a1553f7/frameset.htm

Page 41: BI Cockpit Administration

© SAP 2010 / Page 41

Query runtime statistics extraction

Improvements in SAP NetWeaver 7.00 SP19

Motivation and Scope

The query runtime statistics in the BW System (view RSDDSTAT_OLAP) contains more

information than needed for query runtime performance analysis in Technical Content

Through improvements in the Technical Content extraction (DataSources 0TCT_DS01 and

0TCT_DSA1) only data relevant for query runtime performance analysis will get extracted

Relevant data in this context includes all navigation steps recorded in the BI Statistics which

are directly attached to a navigation step in the BW Analytic Engine (OLAP).

Aim: only statistics data linked to real user interaction and navigation gets transferred to

TCT InfoProviders.

Hence, focusing on relevant data allows to decrease the data volume in Technical Content

InfoProviders (performance) while at the same time easing analysis on query runtimes

Availability and Information

Please find more detailed information in the SAP Notes 1237091 and 1250182

Availability of this improvement with SAP NetWeaver BW 7.00 SPS 17 (SP19)

Documentation is available here

Page 42: BI Cockpit Administration

© SAP 2010 / Page 42

Query runtime statistics extraction

Improvements in SAP NetWeaver 7.00 SP19

0TCT_DS010TCT_DSA1

Data in BI Statistics Tables (view RSDDSTAT_OLAP)

Technical Content Data Sources

Data transferred to Technical Content InfoProviders

Customizing on step category Table RSTCTEXTRACT

1. At extraction time every navigation step (UID) from the BI Statistics tables get assigned to a “step category” (OLAP, MDX, APPL, …). More information in SAP Note 1237091.

2. Customizing table RSTCTEXTRACT defines which step categories and therefore navigation steps (UIDs) will get transferred to the Technical Content InfoProviders. Default is “OLAP” and “MDX”

Page 43: BI Cockpit Administration

© SAP 2010 / Page 43

Query runtime statistics extraction

Data Manager / External read interface (RSDRI)

0TCT_DS010TCT_DSA1

Data in BI Statistics Tables (view RSDDSTAT_OLAP)

Technical Content Data Sources

Data transferred to Technical Content InfoProviders

Customizing on step category Table RSTCTEXTRACT

1 .In Query Runtime Statistics many entries appear containing “RSDRI” in the object name. This is the result of BW internal read operations on InfoProviders through the “Data Manager” Interface. These are typically not directly related to end user query execution and often carry high runtimes.

2 . These BI statistic records get assigned to step category „EXTN‟ which per default gets not transferred to Technical Content InfoProviders.

RSDRI

BW Query

For more information on the Data Manager Interface please refer tohttp://help.sap.com/saphelp_nw70ehp1/helpdata/en/4e/ca104211625933e10000000a155106/frameset.htm

3. If you want to include this data in Technical Content Reporting please change the respective setting in table RSTCTEXTRACT and check SAP Note 1051080 which gives further information on RSDRI use cases and how these get recorded in BI Statistics.

Page 44: BI Cockpit Administration

© SAP 2010 / Page 44

1. Administration Cockpit & Technical Content

2. Query Runtime Statistics

2.1. Migration & Maintenance

2.2. Performance Analysis

2.3. Usage Analysis

2.4. Tips & Tricks

3. Data Load Statistics

4. Data Load Status

5. Administration Cockpit and Technical Content – Update for BW 7.30

6. Further Information

Agenda

Page 45: BI Cockpit Administration

© SAP 2010 / Page 45

Analysis of BI Statistics data in SAP NetWeaver 7.0

New set of BI

Statistics tables

Direct analysis

of RSDDSTAT*

ST03 BI System Load

New and enhanced

Technical Content

Query Monitor

(RSRT)

BI Administration Cockpit

Ad hoc Analysis in

(new) BEx Web and

(new) BEx Analyzer

New: Persistent

data storage and

direct access

New: ST03 based

on Technical

Content

New: Ad hoc

analysis of

statistics data

BI Integrated

Planning

Perf. Toolset

Page 46: BI Cockpit Administration

© SAP 2010 / Page 46

Analysis of Query Runtime Statistics: ST03

Analysis views for different BI

areas

Header information:

• Timeframe

• Source system (Default: MYSELF)

Precondition:

EXPERT mode

Timeframe selection

(User-defined is possible)

Based on Technical Content for BI Statistics

Accessing persistent data (0TCT_C*) and real-time data from BI

Statistics through VirtualProviders (0TCT_VC*)

See note 964418: Adjusting ST03N to new BI-OLAP statistics in Release 7.0

Page 47: BI Cockpit Administration

© SAP 2010 / Page 47

Analysis of Query Runtime Statistics: Query

Monitor

In the Query Monitor (transaction RSRT) detailed query runtime statistics can be

displayed:

Data Manager: Runtime of

all (parallel) “sub” queries:• InfoProvider (<InfoProvider>)

• BI Accelerator (<InfoCube>$X)

• Aggregate (1xxxxx)

Front-End and OLAP :

detailed list of all (sequential)

events

BWA Access: Details of BWA

times

Page 48: BI Cockpit Administration

© SAP 2010 / Page 48

Analysis of Query Runtime Statistics: Profiling

In the (new) BEx Web, experts / administrators can display query runtime

statistics of the current user session using the expert mode ‚profiling„.

&profiling=X

Page 49: BI Cockpit Administration

© SAP 2010 / Page 49

Analysis of Query Runtime Statistics: BEx Analyzer

This setting is used for ad hoc analysis of runtime statistics in BEx Analyzer itself and

does not interfere with settings made in transaction RSDDSTAT in order to collect

runtime statistics in RSDDSTAT* tables.

Ad-hoc Analysis of Statistics

Select “Collect statistics” „‟

Need to login again for the changes to take effect

More details on Note: 1083462

Page 50: BI Cockpit Administration

© SAP 2010 / Page 50

Analysis of Query Runtime Statistics: Integrated

Planning

BI Integrated Planning Performance

Toolset

Available as of note 1035990 (Report

ZBPPOIP)

It is planed to deliver this report within a

ST-A/PI (Solution Manager Plug In)

Release

Note 1171082 - Planning functions:

Statistic events for measuring runtime.

Available from SAP BI 7.0 SP19

Event IDs for Planning services –start

from 50000

Page 51: BI Cockpit Administration

Query runtime statistics - BW Accelerator

Counter for read accesses

■ In systems that are linked to an SAP NetWeaver BW Accelerator (BWA) server, statistics are generated for

each InfoCube to see whether the query reads the data from the BWA or not. In addition, the reasons why the

query may not read from the BWA are listed. The data is written to the database table RSDDSTATBIAUSE.

■ This statistics data cannot and should not be a detailed runtime analysis of a query or a BI system. The

query runtime statistics can be used for this. These new statistics enable you to investigate the BWA usage

quickly and easily.

■ Currently, there is no Technical Content available for this statistics data. Analysis is done on table

RSDDSTATBIAUSE itself. For more details please refer to SAP Note 1159260.

© SAP 2010 / Page 5110

Table Field Description

INFOPROV Name of the InfoCube from which the data is read

CALDAY Calendar day. One entry is generated and counted for each InfoCube, each day.

BIA_USED Counter, the BIA index of the InfoCube is used

BIA_TECHINA Counter, the BIA index of the InfoCube is active and filled, however it currently has the status "Inactive“ (cannot be used for

queries) since certain data loading processes are running (for example, change run, delete request, and so on).

BIA_INA Counter, the BIA index is active and filled, however it is manually set to the status "Inactive" or the user is prevented

from using the BIA by the system parameters.

DB_FALLBACK Counter, the BIA index is active and filled, however, currently the DB fallback is active and all queries read from the database.

BIA_NOTPOSSIBLE Counter, this query cannot read from the BIA data. This may be a manual change in the query properties, the selection in the

debug options in RSRT, reading from an open request in the InfoCube, reading with the characteristics

RequestID, ChangeID or RecordTP in the drilldown or in the Filter.

NO_BIA Counter, there is (currently) no BIA index for this InfoCube.

Page 52: BI Cockpit Administration

© SAP 2010 / Page 52

1. Administration Cockpit & Technical Content

2. Query Runtime Statistics

2.1. Migration & Maintenance

2.2. Performance Analysis

2.3. Usage Analysis

2.4. Tips & Tricks

3. Data Load Statistics

4. Data Load Status

5. Administration Cockpit and Technical Content – Update for BW 7.30

6. Further Information

Agenda

Page 53: BI Cockpit Administration

© SAP 2010 / Page 53

New Technical Content - BI Usage Statistics

The BI Usage Statistics workset provides an overview of the statistics of BI usage in terms of the Application and Application Objects

The Workset includes two pages with the following information:

1. BI Application Object Usage Statistics

– No: of BI Application Object Executions per User

– No: of Executions per BI Application Object

2. BI Application Usage Statistics

– No: of BI Application Object Executions per User

– No: of Executions per BI Application Object

For more information please refer to

http://help.sap.com/saphelp_nw70/helpd

ata/en/26/9ef41d14dc424183b4807538b

e8e1e/frameset.htm

SAP Note 1223907 BIAC:BI Admin

Cockpit - Usage Statistics

Page 54: BI Cockpit Administration

© SAP 2010 / Page 54

New Technical Content for Usage Statistics:

Queries

Technical content queries for analyzing…

…details on BI Usage

In terms of BI Applications and BI Application Objects

In terms of the Users

…Objects and Object Types

No: of times specific objects have been executed

No: of times specific object types have been accessed

…Users and their usage

Idea about the frequent users of the system

…managing roles

Depending on the usage patterns

Page 55: BI Cockpit Administration

© SAP 2010 / Page 55

System usage statistics

Example on different counters

Examples on counters (for selected timeframe)

Number of (distinct) users 2

Number of user sessions 4

Number of BI Application executions 8

Number of (initial) query executions 12

Number of query navigation steps 28

Time / Day

User

Session

BI Application(Web Template,

Workbook)

Query

Navigation Step

User 1

User 2

Page 56: BI Cockpit Administration

© SAP 2010/ Page 56

System usage statistics

Best practice implementation of different counters

Number of (distinct) users

Implemented in query as key figure with exception aggregation on user or

alternatively with DataStore Object using key figures with update mode ‚overwrite„.

The same logic would apply to „number of distinct queries“ (using the BI Application

Object = Query) in the exception aggregation.

Number of user sessions

Implemented with DataStore Object (Session UID in key).

Implementation in query as key figure with exception aggregation on „Session UID“

might be critical in terms of performance.

Number of BI Application executions

Total number (COUNT): Implemented with queries using key figure 0TCTWTCOUN

out of InfoProvider 0TCT_MC01.

Total number of different BI Application executions (COUNT DISTINCT): This can be

implemented in a query as key figure with exception aggregation on „BI Application“

(to be tested on performance) or alternatively with a DataStore Object.

Page 57: BI Cockpit Administration

© SAP 2010 / Page 57

System usage statistics

Best practice implementation of different counters

Number of (initial) query executions (= BI Application Object)

An „Initialization / Navigation Flag“ (0TCTINITFL) is available in InfoProvider

0TCT_CA1 since BW 7.00 SP16.

The first call of a given query in a user session is marked with 0TCTINITFL = „ „. All

subsequent call in the same user session (= navigation) will have 0TCTINITFL = „X„.

Number of query navigation steps (= BI Application Object)

Total number (COUNT): Implemented with key figure 0TCTQUCOUN available in

InfoProvider 0TCT_MC01 and 0TCT_CA1.

Total number of different query executions (COUNT DISTINCT): This can be

implemented in a query as key figure with exception aggregation on „BI Application

Object“ (to be tested on performance) or alternatively with a DataStore Object.

Number of usages of a characteristic in queries (1)

This analysis can be undertaken based on InfoCube 0BWTC_C03 from the 3.x

Technical Content (underlying table RSDDSTATAGGRDEF).

Please find additional information on this scenario on the next page

Page 58: BI Cockpit Administration

System usage statistics

Number of usages of characteristics in queries

© SAP 2010 / Page 58

Number of usages of a characteristic in queries (2)

However this InfoCube does not contain information on the Query name or the

InfoProvider in case the Query is built on a MultiProvider. If this is required, please

consider a customer extraction (join through STEPUID) on views / tables

RSDDSTATAGGRDEF, RSDDSTAT_DM and RSDDSTAT_OLAP.

Also, this Table and InfoProvider miss details on the characteristic values used. This is

planned for future releases.

RSDDSTATAGGRDEF and 0BWTC_C03 only receive data if query statistics detail level

is ‚2„ and if corresponding InfoProvider is not indexed through the BW Accelerator. More

information on this can be found in SAP Note 1094100 “NetWeaver BW Accelerator:

Continuous improvements”.

If you require RSDDSTATAGGRDEF also in case the query uses the BW Accelerator

please implement SAP Note 1155135 “Data from RSDDSTATAGGRDEF recorded even

if you use the BIA”.

Page 59: BI Cockpit Administration

© SAP 2010 / Page 59

1. Administration Cockpit & Technical Content

2. Query Runtime Statistics

2.1. Migration & Maintenance

2.2 Performance Analysis

2.2. Usage Analysis

2.4. Tips & Tricks

3. Data Load Statistics

4. Data Load Status

5. Administration Cockpit and Technical Content – Update for BW 7.30

6. Further Information

Agenda

Page 60: BI Cockpit Administration

© SAP 2010 / Page 60

Query Runtimes Statistics

Monitoring DBSEL and DBTRANS

0TCTNDBSEL: Selected records (from DB or BI Accelerator)

0TCTNDBTRA: Transferred records (from DB or BI Accelerator)

These two key figures indicate the aggregation (factor) that took place before data was

handed over to the Analytical Engine. This is important for improving the performance of your

aggregates and your data modeling in general

0TCTNDBSEL / 0TCTNDBTRA should be monitored using InfoProvider 0TCT_MC03

Prerequisite: statistics detail level for query is set to ‚2„ in statistics customizing)

0TCTNDBSEL / 0TCTNDBTRA in 0TCT_MC01 are only meaningful if query data was

selected out of one InfoProvider only. In case of „PartProvider“ queries within a MultiProvider,

data will be aggregated (results not meaningful). Example:

Transferred

3608860

3600000

260

8600

Selected

144000000

4000000

135000000

5000000

MultiProvider PartProvider Technical Content

0TCT_MC01

0TCT_MC03

0TCT_MC03

0TCT_MC03

Page 61: BI Cockpit Administration

© SAP 2010 / Page 61

Time Zones in BI Statistics and Technical Content

LOCAL = System time zone, customized in transaction STZAC, can be displayed in System Status

UTC = Coordinated Universal Time = Greenwich Mean Time (GMT)

Query Runtime

Statistics

Data Load

Statistics

Used in both

Page 62: BI Cockpit Administration

© SAP 2010 / Page 62

Alert

Management

System (ALM)

Alerting in the Technical Content for BI Statistics

Computing Center

Management System

(CCMS)

Central

Performance

History (CPH)

Process

Chains (RSPC)

Technical

Content

SAP NetWeaver Portal

SAP NetWeaver

Administrator

SAP

Solution

Manager

SAP Web Application Server

Web AS ABAP & Java

SAP NetWeaver BW

BI Checks

(RSRV)

BI Suite, BI

Platform &

Data

Warehousing

Universal

Work List

BI Content

Data Alert

BI Content Web

Application for

CCMS

BI

Administration

Cockpit

In the preconfigured BI Administration Cockpit

/ Technical Content no alerting functionality is

available, but customer specific alerting can be

set up easily using Exception Broadcasting on

top of the Technical Content Queries.

Recommendation: Copy Standard Technical

Content Queries to your own namespace and

add alerting capabilities as described on the

following slides.

Page 63: BI Cockpit Administration

© SAP 2010 / Page 63

Implementing Exception Broadcasting -1-

Application Server

BEx Broadcaster

BEx Query with ExceptionCentral Alert

Framework

BI

Send a Short Text

via SMS or Pager

Send a Long Text

via E-Mail or Fax

Other Applications

Send an Alert to

the UWL

Integration of Exception Reporting

Searching queries for exceptions that have occurred

Distribution of exceptions that have occurred by e-mail or with the Alert Framework

Page 64: BI Cockpit Administration

© SAP 2010 / Page 64

Implementing Exception Broadcasting -2-

Query Designer

BEx Broadcaster

1. Create Exception…

2. Create Broadcasting Section…

Broadcast whenever

a certain exception

takes place

Broadcast only for

specific exception

level

Page 65: BI Cockpit Administration

© SAP 2010 / Page 65

Sorting / Filtering using importance customizing

Assigning Importance to BI Object

To achieve custom sorting and filtering in queries based on technical content

– Eg: “Show most Important InfoProviders at the top of the list

Steps to follow

– Maintain importance in transaction RSTCIMP

– Transfer importance customizing to InfoObject 0TCTBWOBJCT (attribute

0TCTIMPRTNC) using DataSource 0TCTBWOBJCT_ATTR.

– Display attribute 0TCTIMPRTNC can now be used queries for sorting or filtering.

Page 66: BI Cockpit Administration

© SAP 2010 / Page 66

Query Runtimes Statistics: Value helps

Through the new EVENTID concept much more detail and additional information is available in BI Statistics and Technical Content.

Example:

Runtime for value helps in query definition and query execution

In Technical Content, this information can be analyzed through MultiProvider 0TCT_MC02 (0TCT_MC01 containing the information as part of the „Not Assigned“ time.

RSDDSTAT_OLAP

HANDLETP F4

EVENTID 6001

INFOPROV 0SD_C03

OBJNAME 0CALMONTH

OBJPROP M

EVTIME 0,02574

All EVENTIDs = ‚000006*„ describe the

HANDELTP ‚F4„ in detail. In this case, 6001

means ‚Value Help: Read Data from DB‟

Within the object properties, the origin of

the data can be analyzed (Q = Posted

values for query navigation, D = Values in

InfoProvider, M = Values in Master Data)

Page 67: BI Cockpit Administration

© SAP 2010 / Page 67

Query runtimes statistics: SEM-BCS (Consolidation)

Through the new query runtime statistics data storage, improved monitoring for

VirtualProvider based query access in SEM-BCS (Consolidation) is possible.

Excerpt from Table RSDDSTAT_OLAP

Table RSDDSTAT_DM

Details on Data Manager

Data in BI Statistic Tables 0BCS_VC11

VirtualProvider

0BCS_C11

InfoCube for

direct update

reads

from

3,8 sec of which 1,4 sec are due to

reading from 0BCS_C11

6.156 records from DB, 564 transferred to

0BCS_VC11, 82 transferred to OLAP

Example

Page 68: BI Cockpit Administration

© SAP 2010 / Page 68

1. Administration Cockpit & Technical Content

2. Query Runtime Statistics

2.1. Migration & Maintenance

2.2. Performance Analysis

2.2. Usage Analysis

2.4. Tips & Tricks

3. Data Load Statistics

4. Data Load Status

5. Administration Cockpit and Technical Content – Update for BW 7.30

6. Further Information

Agenda

Page 69: BI Cockpit Administration

© SAP 2010 / Page 69

Administration Cockpit: Data Load Statistics

Page 70: BI Cockpit Administration

© SAP 2010 / Page 70

Administration Cockpit: Data Load Statistics

This Workset provides an overview of the length of the load process and process chains, as well as the length and number of data records from InfoPackages and data transfer processes.

The Workset includes four pages with the following information:

1. Process Chain Statistics with the iViews:

– Short-Term Trends in Total Runtimes of Process Chains

– Long-Term Trends in Total Runtimes of Process Chains

– Total Runtimes of Process Chains

– Deviations in Total Runtimes of Process Chains

2. Process Statistics with the iViews:

– Short-Term Trends in Total Runtimes of Processes

– Long-Term Trends in Total Runtimes of Processes

– Total Runtimes of Processes

– Deviations in Total Runtimes of Processes

3. InfoPackage Statistics with the iViews:

– Short-Term Trends in Total Runtimes of InfoPackages

– Long-Term Trends in Total Runtimes of InfoPackages

– Total Runtimes of InfoPackages

– Deviations in Total Runtimes of InfoPackages

4. DTP Statistics with the iViews:

– Short-Term Trends in Total Runtimes of DTPs

– Long-Term Trends in Total Runtimes of DTPs

– Total Runtimes of DTPs

– Deviations in Total Runtimes of DTPs

Page 71: BI Cockpit Administration

© SAP 2010 / Page 71

New Technical Content for Data Load Statistics:

Queries

Technical content queries for analyzing…

…performance details of process chains

Ø Total runtime

Run-times data load, data update, activation, compression, aggregation, attribute change

…performance details of Data Transfer Processes

Ø Total runtime, Ø Number of records, Ø Amount of data

Run-times of each step type

…performance details of InfoPackages

Ø Total runtime , Ø Number of records, Ø Amount of data

Run-times of each action type

Page 72: BI Cockpit Administration

© SAP 2010 / Page 72

Data Load Statistics in SAP NetWeaver 7.0

DataSource

Source system

InfoProvider

Transformation

InfoSource

InfoPackage

Transformation

DataSource 3.x

InfoSource 3.x

Transfer Rules

Update Rules

InfoPackage

InfoProvider

InfoPackage

Statistics data for SAP BW 3.x

data flow technology

Detailed Statistics data

for new data flow

InfoPackage

Statistics

Statistics data on

process chains

DTP

Process Chain

Statistics

DTP

DTP

statistics

All other

warehouse

management

processes

InfoPackage

Statistics

Source system

NEWNEWDrill

down

Page 73: BI Cockpit Administration

© SAP 2010 / Page 73

New Technical Content for Data Load Statistics:

Data Flow

0TCT_C21

0TCT_DS21

0TCT_VC21

RSPCLOGCHAIN

RSPCPROCESSLOG

0TCT_MC21

0TCT_C22

0TCT_DS22

0TCT_VC22

RSDDSTATDTP

RSBKREQUEST

0TCT_MC22

0TCT_C23

0TCT_DS23

0TCT_VC23

RSDDSTATWHM

0TCT_MC23

Process (Chain) Statistics DTP Statistics InfoPackage Statistics

Page 74: BI Cockpit Administration

© SAP 2010 / Page 74

Migration recommended

3.x InfoCube will still contain data, migration recommended as of new data model and new

InfoObjects used

No migration: Technical content 3.x still valid

Technical Content for Data Load Statistics:

Migration

0BWTC_C05

BW Statistics - WHM

0TCT_C23

InfoPackage Statistics

0BWTC_C04

BW Statistics - Aggregates

0BWTC_C05

BW Statistics: Deleting Data from InfoCubes

0BWTC_C06

BW Statistics: Condensing InfoCubes

Page 75: BI Cockpit Administration

© SAP 2010 / Page 75

1. Administration Cockpit & Technical Content

2. Query Runtime Statistics

2.1. Migration & Maintenance

2.2. Performance Analysis

2.2. Usage Analysis

2.4. Tips & Tricks

3. Data Load Statistics

4. Data Load Status

5. Administration Cockpit and Technical Content – Update for BW 7.30

6. Further Information

Agenda

Page 76: BI Cockpit Administration

© SAP 2010 / Page 76

Administration Cockpit: Data Load Status –

Processes

Page 77: BI Cockpit Administration

© SAP 2010 / Page 77

Administration Cockpit: Data Load Status –

Requests

Page 78: BI Cockpit Administration

© SAP 2010 / Page 78

Administration Cockpit: Data Load Status

This Workset provides an overview of the status of the loading process and process chains,

and also of the requests (and data records) in the InfoProviders and InfoObjects.

The Workset includes three pages with the following information:

1. Process Status with the iViews:

– Process Chain Status

– Process Status

– Process Type Selection

2. BI Object Request Status with iViews:

– InfoCube Status

– DataStore Object Status

– Master Data Status

– PSA Table Status

3. InfoProvider Request Status with the iViews:

– InfoCube Correctness

– Aggregate Rollup

– DataStore Object Correctness

– DataStore Object Activation

Page 79: BI Cockpit Administration

© SAP 2010 / Page 79

Technical Content for Data Load Status: Queries

Technical content queries for analyzing…

… status details of

InfoCubes, DataStore objects, Master data (only flexible update)

PSA tables

… with various key figures and characteristics …

Total numbers of requests, Last request, Time-stamp of last change

… each for the several criteria

All requests

Qualitatively not OK (ranking criterion, not for PSA)

Technically not OK (filter criterion)

Not activated (only for DataStore objects)

Not compressed (only for InfoCubes)

Not aggregated (only for InfoCubes)

Page 80: BI Cockpit Administration

© SAP 2010 / Page 80

Technical Content for Data Load Status: Queries

Technical content queries for analyzing…

… status details of …

Process Chains, Data Transfer Processes, InfoPackages, DataStore object activations,

InfoCube compressions, Hierarchy and Attribute change runs and various other processes

… with the following status information …

Status (red, yellow, green) (ranking criterion)

Ended with error

Still running

Ended successfully

Not yet started

Page 81: BI Cockpit Administration

© SAP 2010 / Page 81

Technical Content for Data Load Status: Data Flow

0TCT_DS11

0TCT_VC11

RSMDATASTATE

RSMDATASTATE_EXT

0TCT_MC11

0TCT_DS12

RSPCLOGCHAIN

RSPCPROCESSLOG

0TCT_MC12

BI Object Request Status Process Status

0TCT_VC12

Page 82: BI Cockpit Administration

© SAP 2010 / Page 82

Migration recommended

3.x InfoCubes will still contain data, migration recommended as of new data model and

direct access capabilities

Technical Content for Data Load Status: Migration

0BWTC_C06

BW Data Slice0TCT_C11

BI Object Request Status

0BWTC_C07

Requests in the InfoCube

Page 83: BI Cockpit Administration

© SAP 2010 / Page 83

1. Administration Cockpit & Technical Content

2. Query Runtime Statistics

2.1. Migration & Maintenance

2.2. Performance Analysis

2.2. Usage Analysis

2.4. Tips & Tricks

3. Data Load Statistics

4. Data Load Status

5. Administration Cockpit & Technical Content - Update for BW 7.30

6. Further Information

Agenda

Page 84: BI Cockpit Administration

Administration and Technical Content

Overview

New Monitors in BW Administration Cockpit

Database usage in SAP NetWeaver BW e.g. in MB by InfoProviders).

Enhanced Usability through Xcelsius Integration of monitors

Further Enhancements of the technical content

OLAP cache and SAP NetWeaver BW Accelerator usage

Queries which display the OLAP usage, Cache memory and

SAP NetWeaver BW Accelerator status.

RDA Monitoring

Display the status of usage and free capacity of RDA daemons in the system

Integration of technical content into Solution Manager, thereby offering the

BW monitoring solution through a central system monitoring solution

This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of m erchantability, fitness for a particular purpose, or non-infringement.

© SAP 2010 / Page 84

Page 85: BI Cockpit Administration

New TCT InfoProviders in BW 7.30

New Technical Content InfoProviders

0TCTHP24 - Real Time Daemon Statistics

0TCT_MC05 - OLAP Statistics: Cache type Memory Consumption

0TCT_MC06 - OLAP Statistics: Cache vs SHM

0TCT_C14 - Report Availability Status

Information about Queries (Reports) which do not have up-to-date data available in

underlying Data Targets due to various reasons

Reasons can be

– Error when loading to PSA or to DataTarget

– Requests not rolled up

– Process Chain was scheduled to start and it did not start due to several reasons

0TCT_C15 - BW InfoProviders with inconsistent and incomplete data

Data required for “alerts” in the dashboards

Dashboard shows name/type of the object, reason for error etc

0TCT_C25 - Database Volume Statistics

0TCT_C31 - BWA Statistics: CPU Consumption

0TCT_C32 - BWA Statistics: InfoProvider Memory ConsumptionThis presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of m erchantability, fitness for a particular purpose, or non-infringement.

© SAP 2010 / Page 85

Page 86: BI Cockpit Administration

BW Administration Cockpit in Xcelsius

Overview

Monitors in the Xcelsius based BW Administration Cockpit

Alerts: BW InfoProviders with erroneous requests

Performance Monitoring: Daily Query Performance and Weekly Process Chain Performance

BW Usage Statistics: DB Usage, Query Usage, Top Users, BWA / DB / OLAP usage

This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of m erchantability, fitness for a particular purpose, or non-infringement.

© SAP 2010 / Page 86

Page 87: BI Cockpit Administration

BW Administration Cockpit in Xcelsius

Prerequisites and Details

Prerequisites

Technical Content exists (installed via Transaction RSTCT_INST_BIA)

0TCT* Process Chains are executed (see transaction above or RSPC)

User is assigned to role SAP_BW_BI_ADMINISTRATOR

BI-Java is in place and BEx Web is configured

Xcelsius communicates to BW through the BICS Connection

Access

Launch Administration Cockpit in Xcelsius via transaction RSTC_XCLS

Technical Content involved

Preconfigured dashboards 0XCLS_0TCT_REPORTING_DETAIL,

XCLS_0TCT_PC_DETAILS, 0XCLS_0TCT_BW_MONITOR that are shipped with above role

These involves several new 0TCT* queries but use standard 0TCT* InfoProviders

This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of m erchantability, fitness for a particular purpose, or non-infringement.

© SAP 2010 / Page 87

Page 88: BI Cockpit Administration

New Technical Content for Database Volume

Overview and Motivation

1. A new technical content with SAP NetWeaver BW 7.30 (0TCT_C25) provides information on data volumes of various BI objects

2. The Database Volume can be analyzed according to InfoArea, Application Component, BI Objects types and BI specific table classifications.

3. Use Case 1: Support of housekeeping activities like Archiving, periodic PSA and Change Log deletion, etc.

4. Use Case 2: Service Level Agreement Monitoring of implemented reporting scenarios for cross charging of cost to business departments

This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement.

© SAP 2010 / Page 88

Page 89: BI Cockpit Administration

Administration Cockpit

Database Volume Statistics

This Workset provides

overview of the size of the BW database, as well as the rate of growth of database sizes on a periodic basis

Also provides an insight into the BW size in terms of InfoAreas, Object Types and Table Types.

The Workset includes 2 pages with the following information:

1. BI Data Distribution By Hierarchies

– BI Data Distribution By InfoArea

2. BI Data Distribution – Object/Table Types

– BI Data Distribution By Object Types

– BI Data Distribution By Table Types

This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement.

© SAP 2010 / Page 89

Page 90: BI Cockpit Administration

Database Volume Statistics

Example Cockpit built with Technical Content

This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of m erchantability, fitness for a particular purpose, or non-infringement.

© SAP 2010 / Page 90

Page 91: BI Cockpit Administration

Database Volume Statistics

Data Model

Aim of the data model is to analyze DB growth and

size from a BW perspective, using typical BW

taxonomy and dependencies

Hierarchical display of InfoArea (for

InfoProviders) and Application Component (for

Datasources)

Database table size (possibility of analyzing the

DB size using the actual DB size after DB

compression) Logical DB Size(number of rows *

record width)

Table Name e.g. /BIC/FZSALES01

Table Type InfoCube F Fact table

BW Object Type InfoCube

Deriving BW Object Information from the underlying database table name

© SAP 2010 / Page 91

InfoProvider Name “ZSALES01”

InfoArea “ZSALES”

This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of m erchantability, fitness for a particular purpose, or non-infringement.

Page 92: BI Cockpit Administration

Technical Content for Query Runtime Statistics

Overview

0TCT_C01

0TCT_DS01

0TCT_VC01

0TCT_MC01

0TCT_CA1

0TCT_DSA1

0TCT_VCA1

0TCT_MCA1

Front-End and OLAP

Statistics (Aggregated)

RSDDSTAT_OLAP

(database view) Use Cases Average Query Runtimes

Predefined runtime categories

Drilldown to navigation step

Monitor query activity

(example: navigations / day)

Use Cases New InfoProvider for High level monitoring on day / query level (high aggregation) DataSource 0TCT_DSA1 is available since SP 16 of SAP_BW / Technical Content on top is available since BI_CONT 7.0.3 SP 8

Front-End and OLAP

Statistics (Highly

Aggregated)

This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement.

© SAP 2010 / Page 92

Page 93: BI Cockpit Administration

Technical Content for Query Runtime Statistics

News

Additional functionality with BW 7.0 SP 16

■ Flag in 0TCT_CA1: Initial Execution / Navigation Flag (0TCTINITFL). The first call of a given

query in a user session is marked with 0TCTINITFL = „ „. All subsequent call in the same

user session (= navigation) will have 0TCTINITFL = „X„.

Additional functionality with BW 7.30

■ Flag in 0TCT_CA1: Number of cells sent to front end as key figure in 0TCT_CA1

(0TCTNOCELL)

■ Flag in 0TCT_C01 and 0TCT_CA1 which differentiates between pure OLAP Cache access

and Data Manager access (Characteristic 0TCTOLAP_DM with the potential values “01”

BWA access, “02” Cache Read, “03” DB Access)

This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of m erchantability, fitness for a particular purpose, or non-infringement.

© SAP 2010 / Page 93

Page 94: BI Cockpit Administration

© SAP 2010 / Page 94

1. Administration Cockpit & Technical Content

2. Query Runtime Statistics

2.1. Migration & Maintenance

2.2. Performance Analysis

2.2. Usage Analysis

2.4. Tips & Tricks

3. Data Load Statistics

4. Data Load Status

5. Administration Cockpit & Technical Content – Update for BW 7.30

6. Further Information

Agenda

Page 95: BI Cockpit Administration

© SAP 2010 / Page 95

Further information

Documentation BI Query Runtime Statistics

http://help.sap.com/saphelp_nw7.0/helpdata/en/43/e37f8a6df402d3e10000000a1553

f7/frameset.htm

Documentation BI Administration Cockpit

http://help.sap.com/saphelp_nw7.0/helpdata/de/44/08a75d19e32d2fe10000000a114

66f/frameset.htm

Frequently Asked Questions on the Administration Cockpit / Technical Content

http://www.sdn.sap.com/irj/sdn/index?rid=/webcontent/uuid/d0f1c624-d433-2c10-

adab-b08a3b675ca0

Central Collective Note on the Administration Cockpit / Technical Content

https://service.sap.com/sap/support/notes/934848

Page 96: BI Cockpit Administration

© SAP 2008 / Page 96

Thank you!

Page 97: BI Cockpit Administration

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice.

Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.

Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation.

IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, zSeries, eServer, z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered trademarks of IBM Corporation.

Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.

Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries.

Oracle is a registered trademark of Oracle Corporation.

UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.

Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc.

HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology.

Java is a registered trademark of Sun Microsystems, Inc.

JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape.

SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries.

Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects Software Ltd. in the United States and in other countries.

All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary.

The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior written permission of SAP AG.

This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains only intended strategies, developments, and functionalities of the SAP® product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note that this document is subject to change and may be changed by SAP at any time without notice.

SAP assumes no responsibility for errors or omissions in this document. SAP does not warrant the accuracy or completeness of the information, text, graphics, links, or other items contained within this material. This document is provided without a warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability, fitness for a particular purpose, or non-infringement.

SAP shall have no liability for damages of any kind including without limitation direct, special, indirect, or consequential damages that may result from the use of these materials. This limitation shall not apply in cases of intent or gross negligence.

The statutory liability for personal injury and defective products is not affected. SAP has no control over the information that you may access through the use of hot links contained in these materials and does not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages.

© 2011 SAP AG. All Rights Reserved