new features in obiee 12c

www.RedPillAnalytics.com [email protected] @RedPillA © 2016 RED PILL Analytics

What’s New With Oracle Business Intelligence 12c

2

Michelle Kolbemedium.com/@datacheesehead @mekolbe linkedin.com/in/michellekolbe

[email protected]

http://www.redpillanalytics.com

mailto:[email protected]?subject=

http://twitter.com/RedPillA

http://medium.com/@datacheesehead

http://linkedin.com/in/michellekolbe

mailto:[email protected]?subject=

© 2014 RED PILL Analytics

Who is Red Pill Analytics?


Red Pill Analytics: Ownership

4

Stewart Bryson

Oracle ACE Director

Previously From:Rittman Mead

Informix Software

Data Warehousing & Business Intelligence

since 1996

Kevin McGinley

Oracle ACE Director

Previously From:Accenture

BI Consulting Group

Data Warehousing & Business Intelligence

since 1997


mailto:[email protected]


©2016 RED PILL Analyticswww.redpillanalytics.com [email protected] @RedPillA

CAPACITYANALYTICS

SINGLE DOSESCHECKMATE

WHAT WE DO

BI Development as a Service

Agile Development

Cloud Enabled

Continuous Integration

Support

Check-in & Automate

True Multi-User Development

Full Source Control

Continuous Integration

Hosted or On-Premise

Strategy & Roadmap

Architecture

Prototyping

Infrastructure

Training


mailto:[email protected]?subject=Presentation

https://twitter.com/RedPillA


Red Pill Analytics Sessions at UTOUG Training Days 2016

7

Regression Testing with Ease: The Baseline Validation Tool Stewart Bryson Tuesday 9:45 - 10:45 am in MFEC 223

Performance Analytics: Visualizing the Power of the AWR Warehouse Stewart Bryson Tuesday 1:30 - 2:30 pm in MFEC 223

What’s New With OBIEE 12c and BICS Michelle Kolbe Tuesday 3:00 - 4:00 pm in MPDC 105





12c Enhancements, Changes, New Features

• Installation, Configuration, Architecture• Upgrade• System And Lifecycle Management• Data Sources And BI Server• Front-End Enhancements• Data Visualization And Mashups

8





Front-End Enhancements


Alta UI

10

Dashboards Answers





Home Page Refinements

11

“Classic” Home Page New Home Page





Search

12

Search for content Search for data





Enhanced Sorting For Graphs / Pivot Tables

13





Heat Matrix View

14

Percentile Binning ResultContinuous Color Fill





View Properties Access In Compound Layout

15

You no longer need to edit view to tweak properties!





Data Visualization And Mashups


Oracle Data Visualization (Visual Analyzer)

• Separately licensed add-on to OBIEE

• Designed for true ad-hoc analysis, data exploration, data discovery

• Uses curated subject areas and/or uploaded spreadsheets as data sources

17





Oracle Data Visualization (Visual Analyzer)

• Separately licensed add-on to OBIEE

• Designed for true ad-hoc analysis, data exploration, data discovery

• Uses curated subject areas and/or uploaded spreadsheets as data sources

18





Mashups

• Requires ODV license• Upload spreadsheets and join to subject areas in ODV

• Extend facts and dimensions• Once uploaded and joins defined in ODV, Answers users can benefit from using the files as XSA’s

• Data can be refreshed manually in ODV

20





Repository


Filtering on Aggregate Persistence

• Allows for “Fragmented Aggregates”• Can add WHERE clause to aggregate build• Useful for Popular data sets like Current Year

22





Changes to Time Dimensions

• Can assign a sequence number to Time Dimensions• Improves performance of time series calculations

23





Command Line•New utilities:

• Upload Repository• Download Repository• List Repository Variables• Update Repository Variables• List Connection Pool• Update Connection Pool• Rename Users• Delete Users• Rename Application Role• Delete Application Role

24





Installation, Configuration and Architecture


Eating Their Own Dog Food


Installation Overview And Changes

27

Step Change from 11g to 12c

Download Software Fewer files, smaller download, RCU is included

Run BIFoundation Installer Install only; configuration done separately

Create database repository Can run RCU 11g-style, or generate scripts to be run by DBA later

Configure BI Domain Full offline configuration results in faster creation of the domain

Scale out (optional) Command line scripts to clone domain





Singleton Data Directory With High Availability

28

Oracle BI Domain - Server 1 Oracle BI Domain - Server 2

Shared Storage (e.g. NFS)

Config Config

Singleton Data Directory

Nod

e M

anag

er Admin Server Managed Server

BI System Components Nod

e M

anag

er Admin Server Managed Server

BI System Components

bi-environment.xml bi-environment.xml

Service Instance

Singleton Data Directory contains the Service Instance BI Content for the

cluster





File System Changes

• No more ‘instances’ folder • No more Oracle_BI1 folder • user_projects contains most of what you’re looking for

29





Other Architecture Changes

• Separation of Environment Metadata and Configuration• Single source of truth for both – no environment info in RCU DB

schemas• Reduced dependency on hardwired server names in configuration• One place to edit environment and/or configuration• Most files can be edited directly by customer using any tool including

Chef / Puppet• Removal of OPMN process control

• Nodemanager used throughout to control components

30





Goodbye, Old Friend


BISystemUserSecurity GUIDs

Complicated SSL Configuration


Upgrades


Validate Upgrade

• Install new OBIEE 12c instance• Upgrade from 11.1.1.7 (latest patch) or 11.1.1.9• 12c Upgrade Utility

• Copy bi-migration-tool.jar file from 12c to 11g machine• Run utility to generate an upgrade bundle• Move upgrade bundle to 12c machine and import using bi-migration-

tool.sh• Run Baseline Validation Tool

34





Upgrade Process

35

OBIEE 11gProduction

Migration Tool Utility

BI Application

Archive (BAR)

OBIEE 12c

Baseline report with Validation

12c report with Validation

Tool

Compare Output & Fix Discrepancies

12c Production





See into Your Upgrade Future


Baseline Validation Tool (BVT)

• Free tool provided separately by Oracle

• Runs a set of tests against two compatible systems• Within and between 11g/12c

• Multiple layers of comparison• Produces output reports with test results

37





BVT In Action• Compare some or all:

• Data results (Reports & Dashboards)

• Logical query results• Catalog contents• Visual output

• Run tests for:• Major upgrades• Minor patches• Migrate new content to prod

38

Run tests against current system to create a baseline

Upgrade, apply patch, or migrate content to new system

Run same tests on the new system and compare to baseline

Apply fixes as needed





System and Lifecycle Enhancements


Enterprise Manager - FMW 12c

40

No deployments tab!





BI Application Archive (BAR)• Contains OBIEE content in a single file (RPD, Catalog, Security Roles)• Also manages

dependencies between other BI Modules (future)

• Does not contain database objects nor data

• Used for:• Backup/Restore• Environment Migration• Upgrades• Cloning Service Instances

41

Other StuffJAZN Data / RolesCatalogRPD

BI Application Archive (BAR)





Pluggable Architecture

42

Oracle BI Enterprise Edition 12c

Start with a single instance of OBIEE






43


Metadata Modules (Optional)Metadata Modules designed to be static (OBIA for instance)Start with a single instance of OBIEE






Individual Service Instances provide customization “stripes” to Modules

44


Service Instance 1

Metadata Layer

Catalog Content

Authorization

Service Instance 3

Metadata Layer

Catalog Content

Authorization

Service Instance 2

Metadata Layer

Catalog Content

Authorization







Individual Service Instances provide customization “stripes” to Modules

45


Service Instance 1

Metadata Layer

Catalog Content

Authorization

Service Instance 3

Metadata Layer

Catalog Content

Authorization

Service Instance 2

Metadata Layer

Catalog Content

Authorization






Non-Pluggable Architecture (so far in 12.2.1)

Singleton Service Instance (SSI) with Metadata, Content and Authorization

46


Singleton Service Instance (SSI)

Metadata Layer

Catalog Content

Authorization

Service Instance 3

Metadata Layer

Catalog Content

Authorization

Service Instance 2

Metadata Layer

Catalog Content

Authorization






Deployments

• Recommended: use BAR functionality• Alternatively:

• data-model-cmd.sh / data-model-cmd.cmd• Params:

• uploadrpd• downloadrpd• updateconnectionpool• updaterpdvariables

47





Data Sources and BI Server


External Subject Areas (XSA)

• Subject Area defined outside of the RPD

• Can be joined to an RPD Subject Area, much like a federated BI Server query

• Can be persisted to a database cache

• Used in new Advanced Analytics capabilities, Oracle Data Visualization, and Answers*

49

*Can’t be defined in Answers - only consumed





Big Data SourcesCloudera Impala

• Native MPP Query Engine• Built for low latency queries

• DataDirect Connect ODBC driver required/provided

• OBIEE generates Impala specific optimized SQL queries

• Also made available in 11.1.1.9

50

Apache Spark• Native Spark SQL connectivity to report and to analyze Big Data in Apache Spark

• Alternate Option to persist results in XSA Cache for future queries

• Not available in 12.2.1; coming in future 12c update





Advanced Analytics: Built-in Functions Using R

51





Advanced Analytics Setup (Basic)• Install R on OBIEE Server

• Oracle_Home/bi/bifoundation/advanced_analytics• Uncompress r-installer.tar.gz, r-installer.tar• Edit proxy.txt if necessary• sudo ./RInstaller.sh install

• Install R packages• sudo ./RInstaller installpackages

• Edit NQSConfig.ini• Advanced Analytics Script Section• R_EXECUTABLE_PATH = “/usr/bin/R”; (or other install location)

• Other steps/prerequisites required for Solaris/Windows

52





Custom R Functions Using EVALUATE_SCRIPT• R scripts stored on the server can be called using EVALUATE_SCRIPT

• Scripts are stored on the server in a directory defined in NQSConfig.ini

• Scripts contain parameters, output definition, and options for execution

• Built-in functions are implemented in the same way, but stored in a different place

• R generates a csv file that the BI Server treats like an XSA

53





In-Memory Enhancements To BI Server

54

Feature Benefit

Native XSA Cache Better performance for mashup data

Default sortsize 4mb to 64mb Faster OBIEE query performance

Reduced memory usage for variable length data More efficient deployment, more memory for data

Compression of temporary work data More efficient deployment, more memory for data

Smaller and faster sort for aggregates and group by handling Faster query performance

Single pass totals and subtotals for Pivots Faster query performance





Text Here

Do your surveys!

www.surveymonkey.com/r/TD2016sesSession id: 4.6

http://www.surveymonkey.com/r/TD2016ses

new features in obiee 12c

Technology