45573405 oracle data integrator introduction

8/11/2019 45573405 Oracle Data Integrator Introduction

1/27

Session -I

Oracle Data Integrator

Introduction

Created By : Gourav Atalkar

Reviewed By: Amit Sharma

Contact Point :bispsolutions.wordpress.com


2/27

Agenda

What is Oracle Data Integrator?

Why Oracle Data Integrator?

Overview of ODI 11g Architecture

Overview of ODI 11g ComponentsAbout Graphical Modules

Types of ODI Agents

Overview of Oracle Data Integrator Repositories


3/27

Why Oracle Data Integrator ?

ELT Architecture provides high performance.

Active integration enables real time data warehousing and

operational data hubs.

Declarative design improves developer productivity.

Knowledge modules provides flexibility and extensibility.

ODI combines three style of data integration: data based, event

based and service based

ODI shortens implementation times with its declarative designapproach.


4/27

Conventional Integration process: ETL

Source

Order

Correction

files

Integration Process

Transform

Extract Transform Load

Target

Errors

Sales

Machine Machine

Machine


5/27

ELT

1) Extract: Extracting the data from various sources.

2) Load: Loading the data into the destinations target.

3) Transform: Transforming data according to a set of business

rules.

Extract

Load

Conventional ETL Process Next Generation ELT Architecture

Extract

LoadTransform


6/27

Oracle Data Integrator Architecture

Master

Repository Work

Repository

Repositories Sources and Targets

Legacy Files DBMS

JVM

Run-time WS

Stand Alone

Agent

Desktop

JVM ODI Studio

Designer

Operator

Topology

Security

Java EEApplicatio

n

ODI SDK

Web Logic 11g/Application Server

FMW Console

Data Sources Connection Pool

Servlet Container

Java EE

Application

ODI SDKODI

Console

Run-time

WS

Stand Alone

Agent

Web Service

Container

Public

WS

DataServi

ce

ODI Plug-in


7/27

Oracle Data Integrator Components

ODI Studio Components:

Designer Navigator

Operator Navigator

Topology Navigator

Security Navigator

ODI Agent

ODI ConsoleODI Repositories


8/27

Oracle Data Integrator Studio

Repository

Designer Navigator:

Reverse Engineering

Develop ProjectsRelease Scenario

Operator Navigator:

Operate Production

Monitor sessions

Operator Navigator:

Define the

infrastructure of the IS.

Security Navigator:

Manage user

privileges.


9/27

Designer Navigator


10/27

Designer Navigator

Designer Navigator is the GUI for defining metadata and rules fortransformation and data quality. It uses this information to

generate scenarios for production, and designer is where all the

project development take place. Designer navigator is the core

module for developers and metadata administrators.

Designer handles the following:

Models: Description of the data and application structure.

Projects: The developments of various ODI objects.


11/27

Operator Navigator

Toolbar

In Operatornavigator you can

monitor execution

of ODI objects

This monitoring

sessions stepsenables you to

perform debugging


12/27

Operator Navigator

Operator navigator is used to manage and monitor ODI inproduction. It is designed for production operators and

displays the execution logs with error counts, the number of

rows processed, execution statistics, and so on. At design time,

developers use operator navigator for debugging purpose.

Through the Operator navigator, you can manage your

interface execution in the sessions, as well as the scenario in

the production.

The operator navigator stores this information in a work

repository while using the topology define in the master

repository.


13/27

Topology Navigator

Toolbar

Technology

tree

In ODI Topology manageryou set the architecture of

your information system,

technologies server

information, schemas and

repositories.

Workspace to

define Topologyobjects


14/27

Topology Navigator

Topology Navigator manages the physical and logicalarchitecture of the infrastructure. Server, schemas, and agents

are registered in the ODI Master Repository-a major ODI

component that contains information about the topology of the

companysIT resources, security, and ODI resource.

Using the topology navigator, you can define the topology of your

information system to ODI so that it can be accessed by other

ODI modules. Topology navigator enables you to manage

repositories. The topology navigator store this information in a

master repository.


15/27

Security Navigator

Object Tree

In security navigator , you manage

objects, profiles, users and their

privileges and hosts.

Workspace to define

objects, profiles,

users and hosts.


16/27

Security Navigator

Security Navigator manages users and their privileges in ODI. It

is used to create profiles and provide rights to users to access

ODI objects and features. This navigator is usually used by

security administrators.

It is used to assign user rights for method on generic objects and

to fine tune these rights on the objects instances.


17/27

What is an Agent ?

An agent is a run time component of ODI that orchestrates theintegration process.

It is a lightweight java program that retrieves code from the

repository at the run time.

At design time developer generate scenario from the business

rule that they have designed. The code of these scenario is then

retrieved from the from the repository by the agent at run time.

This agent then connects to the data servers and orchestrates

the code execution on these servers.


18/27

Oracle data Integrator Agent

Agents are lightweight java

processes that orchestrates the

execution of objects at run time.

Agent can do one of thefollowing:

-Execute objects on demand

-Execute according to predefined

schedules.


19/27

Oracle data Integrator Agent

Two Types of agents: Java EE and standalone

The agents comes in two different types:

The java Enterprise Edition(Java EE; formerly J2EE) agent

can be deployed as a web application and benefit from thefeature of an application server.

The standalone agent runs in a simple java machine and can

be deployed where needed to perform the integration flow.

Both agents are multithreaded java programs that support

load balancing and can be distributed across the information

system.


20/27

Using the Two Types of agents

Deploying a Java EE agent in a Java application server(Oracle WebLogic Server):

1) In ODI, define the Java EE agent in the Topology Navigator.

2) In ODI, create the WLS template for the Java EE Agent.

3) Deploy template directly using WLS configuration Wizard.

Using a stand alone Agent:

1) Launch an agent.

2) Display scheduling information.

3) Stop the agent.

Advantages of Java EE agents over Standalone agents:1) High Availability

2) Multiple agents, using Coherence.


21/27

Example of standalone agent

Designer Navigator:

Reverse Engineering

Develop Projects

Release Scenario

Operator Navigator:

Operate Production

Monitor sessions

Repository

Standalone Agent

Information System

Java Any Platform

Java Any Platform

RDBMS


22/27

ODI Console

ODI Console provides web access to Repositories. It enables userto navigate projects, models, logs and so on. Business user,

developer, Operators, and administrators use their Web browsers

to access ODI Console. The ODI console replaces Metadata

navigator of previous version.


23/27

Oracle Data Integrator Repositories

Two Types of repositories are included into the ODI.

-Master Repository

-Work Repository

*Development Repository* Execution Repository

Work Repositories are always attached to a single Master

repository


24/27

Master and Work Repositories

Security

Topology

Versioning

Model

Project

Execution

Execution

Master Repository

Execution RepositoryWork Repository(Development) (Production)


25/27

Master and Work Repositories

Master Repository: It is the data structure containing the

information about the Topology of the companys IT resources,

security, and version management of projects and data models.

This repository stored on a relational database accessible inclient/server mode from the different ODI modules.

Work Repository: It is the data structure containing the

information about the data model, projects and their use.This

repository stored on a relational database accessible inclient/server mode from the different ODI modules.


26/27

Question


27/27

Thank You

Contact Us: http://learnhyperion.wordpress.com

http://[email protected]
http://learnhyperion.wordpress.com/http://[email protected]/http://[email protected]/http://learnhyperion.wordpress.com/

45573405 oracle data integrator introduction

Documents