how to leverage obiee within a big data architecture
DESCRIPTION
If you've invested in OBIEE and want to start exploring the use of Big Data technology, this presentation talks about how and why you might want to use OBIEE as the common visualization layer across both.TRANSCRIPT
![Page 1: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/1.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |Oracle Confidential – Internal/Restricted/Highly Restricted
How to Leverage Your Investment in OBIEE Within a Big Data ArchitectureKevin McGinleyOracle ACE DirectorOwner and Co-founderRed Pill AnalyticsJuly 9, 2014
![Page 2: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/2.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Safe Harbor StatementThe following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Oracle Confidential – Internal/Restricted/Highly Restricted
2
![Page 3: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/3.jpg)
![Page 4: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/4.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
How To Leverage Your Investment In OBIEE Within A Big Data
Architecture
4
KEVIN MCGINLEY
@kevin_mcginleymedium.com/@kevin_mcginley linkedin.com/in/kevinmcginley
![Page 5: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/5.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
About Red Pill Analytics
Capacity AnalyticsAgile Cloud Development for Oracle BI & Analytics
CheckmateDevOps for Oracle BI
Single DosesTraining + Strategy + Solutioning + Infrastructure + Support
5
![Page 6: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/6.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Real Time BI with Kevin & Stewart
• 19 episodes over the last 2 years
• Featured guests from the Oracle BI, EPM, and Big Data industries
• Published on iTunes and YouTube
6
![Page 7: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/7.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Contents
• Connect OBIEE To Hive
• Typical Big Data Architecture Today
• Why Integrate OBIEE With Big Data?
7
![Page 8: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/8.jpg)
Connect OBIEE To Hive
![Page 9: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/9.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
What Is Hive?
• RDBMS table structures
• ETL capabilities in Hadoop
• SQL-like layer above HDFS
• Auto MapReduce coding
9
Storage
Filesystem(HDFS)
NoSQL(HBase)
Workload Management
MapReduce
Batch SQL(Hive)
Metadata
![Page 10: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/10.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
A Basic Hive Table & Query
10
![Page 11: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/11.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Connect OBIEE To Hive
11
OBIEE
HiveQL via ODBC
Storage
Filesystem(HDFS)
NoSQL(HBase)
Workload Management
MapReduce
Batch SQL(Hive)
Metadata
![Page 12: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/12.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Steps
• Configure odbc.ini
• Download BI Admin tool ODBC drivers for Hive
• Create ODBC DSN
• Import data structures and create metadata
• Update database type
12
![Page 13: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/13.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Configure odbc.ini
13
odbc.ini file location
Configure a DSN connection for Hive database
![Page 14: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/14.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Create ODBC DSN
14
Choose the Hive driver for the ODBC DSN
![Page 15: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/15.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Create ODBC DSN
15
Set the Host and Port the same as
odbc.ini fileSet the default database name to the Hive database
![Page 16: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/16.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Create ODBC DSN
16
Test the connection
![Page 17: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/17.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Import Data Structures And Create Metadata
17
Create new or import into
existing RPD
![Page 18: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/18.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Import Data Structures And Create Metadata
18
Select the newly created DSN for
Hive
Add the user and password
![Page 19: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/19.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Import Data Structures And Create Metadata
19
Most of these won’t apply; keep
the defaults
![Page 20: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/20.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Import Data Structures And Create Metadata
20
Select the database or
tables like normal
![Page 21: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/21.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Update Database Type
21
Double-click the database
Imported table structure
![Page 22: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/22.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Update Database Type
22
Change database type to Apache
Hadoop
![Page 23: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/23.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Update Database Type
23
You are prompted to edit the
connection pool
Select Yes
![Page 24: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/24.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Update Database Type
24
Verify the call interface is ODBC 2.0
![Page 25: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/25.jpg)
Typical Big Data Architecture Today
![Page 26: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/26.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
OLTP Data Is Loaded Into Data Warehouse
26
Enterprise Data
Old
Sou
rces
![Page 27: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/27.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Experimenting With New Data Sources In Hadoop
27
Big DataEnterprise
Data
Old
Sou
rces
New
Sources
![Page 28: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/28.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Different Visualization Tools
28
Big DataEnterprise
Data
Old
Sou
rces
New
Sources
Visualization Tools
Visualization Tools
![Page 29: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/29.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Constant Data Movement Back And Forth
29
Big DataEnterprise
Data
Old
Sou
rces
New
Sources
Visualization Tools
Visualization Tools
![Page 30: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/30.jpg)
Why Integrate OBIEE With Big Data?
![Page 31: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/31.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Common Visualization Tool = Less Data Movement
31
Big DataEnterprise
Data
Old
Sou
rces
New
Sources
Visualization Tool
![Page 32: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/32.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Three Main Reasons To Use OBIEE Across Both
• Streamline data access through common tools
• Provide Hadoop access to users without programming skills
• Federate queries across Hadoop & Oracle database to avoid constant data movement
32
![Page 33: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/33.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Federate OBIEE Across RDBMS and Hadoop
33
Hive Table
Oracle Table
Oracle Table
Oracle Table
Oracle Table
![Page 34: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/34.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Full Business Model & Presentation Layer
34
![Page 35: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/35.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Easy Report Creation
35
![Page 36: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/36.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Pros
• Easier data visualization capabilities
• Drag-and-drop ease of access
• No new skills to learn
• Centralized data access
36
![Page 37: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/37.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
Cons
• Queries against Hive are slower than against Oracle
• Some data/metadata modeling and manipulation is required
• Might be throw-away work
37
![Page 38: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/38.jpg)
www.redpillanalytics.com [email protected] @RedPillA © 2014 RED PILL Analytics
The Future?
38
OBIEE
Storage
Filesystem(HDFS)
NoSQL(HBase)
Workload Management
MapReduce
Batch SQL(Hive)
Metadata
Interactive SQL(Impala)
![Page 39: How To Leverage OBIEE Within A Big Data Architecture](https://reader036.vdocuments.net/reader036/viewer/2022081413/5471d884b4af9f9d0a8b4cea/html5/thumbnails/39.jpg)
Questions?