oracle data warehouse pack - sematec · oracle data warehouse pack (data warehouse fundamentals...
TRANSCRIPT
Oracle Data Warehouse Pack (Data warehouse Fundamentals Oracle + Oracle Data Integrator Student Guide 1,2)
Data warehouse Fundamentals Oracleنام دوره:
ساعت 16مدت دوره:
:آنچه شما یاد خواهید گرفت ✓
یک و نگهداری جمع آوری ، ، ساخت ، طراحی مربوط به برنامه ریزی با مواردو انبار داده را می آموزند اولیهمفاهیم دانشجویاندر این دوره،
و مزایای پارتیشن بندی را می بندی پایگاه داده اوراکل را یادگرفته اصول اولیه معماری پارتیشن همچنینو آشنا خواهند شدانبار داده موفق
و انتقال واکشی،و همچنین عملیات کاهش دهند را خگویی برای عملیات فشرده تا زمان پاس کردهمزایای عملیات موازی را بررسی . شناسند
materialized از استفاده مزایای مورد در اولیه اصولآموزند. می ( راETL)فاز های اوراکل داده پایگاه داده انباره یک به داده بارگذاری
view همچنین در سطح باال یاد می گیرند که چگونه بازنویسی کوئری می تواند عملکرد ورا آموخته ها داده انبار عملکرد بهبود برای را اوراکل
برخی از مفاهیم پیاده سازی انبار داده را شناسایی را بررسی می کنند و Data Mining و OLAP دانشجویان ، در ادامه کوئری را بهبود بخشد
Oracle Warehouse Builder ،Analytical Workspaceداده مانند به طور خالصه از برخی از ابزارهای موجود انباره و می کنند
Manager و Oracle Application Express استفاده می کنند.
یاد می گیرید:دانشجویان بعد از پایان این دوره ✓
اصطالحات و مفاهیم پایه ی انبار داده را توضیح دهید •
موفق شناسایی کنید داده انبار یک ازیس پیاده برای اوراکل ابزارهای از برخی و فناوری •
ها توصیف کنید داده بارگیری و تبدیل استخراج، ابزارهای و ها روش •
کنیدبرخی از ابزارها برای دسترسی و تجزیه و تحلیل داده های انباره داده شناسایی •
ار داده را توصیف کنیدو بازنویسی کوئری در یک انب materialized viewsمزایای پارتیشن بندی، عملیات موازی، •
پیاده سازی و مسائل سازمانی در مورد پروژه انبار داده را توضیح دهید •
مخاطبین ✓
افزار نرم دهندگان توسعه •
پشتیبانی مهندس •
داده انبار دهنده توسعه •
عملیاتی اجرای •
داده انبار مدیر •
انبار داده تحلیلگر •
توسعه دهنده •
پروژه مدیر •
اهداف دوره ✓
داده انبار پایه مفاهیم توضیح و تاصطالحا تعریف •
ها داده لود و تبدیل استخراج، ابزارهای و ها روش توصیف •
انبارداده داده تحلیل و تجزیه و دسترسی برای ابزارها از برخی شناسایی •
شناسایی فناوری و برخی از ابزارهای اوراکل برای پیاده سازی یک انبار داده موفق •
یری و هدف نهایی یک انبار دادهتعریف هدف پشتیبانی تصمیم گ •
و بازنویسی کوئری در یک انبار داده materialized viewمزایای پارتیشن بندی، عملیات موازی، توصیف •
توضیح پیاده سازی و مسائل سازمانی در مورد پروژه انبار داده •
و بازنویسی کوئری برای بهبود عملکرد انبارداده materialized viewاستفاده از •
داده انبار یک پیاده سازی برای نیاز مورد فناوری از برخی با آشنایی توسعه •
باشدسرفصل ها دوره فوق شامل موارد زیر می ✓
• Introduction
o Objectives
o Questions about You
o Lesson Agenda
o Course Objectives
o Prerequisites and Suggested Prerequisites
o Suggested Course Schedule
o Lesson Agenda
o Some of the Sample Schemas Used in the Course
o Sales History (sh) Schema
o Class Account Information
o Appendixes in the Course
o SQL Environments Available in the Course
o Entering SQL Statements Using Oracle SQL*Plus
o What Is Oracle SQL Developer?
o Creating Schema Objects
o Data Warehousing Tools Used in this Course
o Lesson Agenda
o Oracle 11g Useful Documentation
o Continuing Your Education
o Oracle Technology Network (OTN)
o Oracle by Example (OBE)
o Oracle Warehouse Builder OBEs
o Analytic Workspace Manager (AWM) OBEs
o Oracle Application Express (APEX) OBEs Technical Support Summary
o Summary
• Data Warehousing, Business Intelligence, OLAP, and Data Mining
o Objectives
o Lesson Agenda
o Evolution of BI
o Early Management Information Systems
o Analyzing Data from Operational Systems
o Why OLTP Is Not Suitable for Analytical Reporting
o Data Extract Processing
o Issues with Data Extract Programs
o Productivity Issues with Extract Processing
o Data Quality Issues with Extract Processing
o Data Warehousing and Business Intelligence
o Technological Solutions for Data Warehousing
o Advantages of Warehouse Processing Environments
o Business Intelligence (BI): Definition and Purpose
o What Is Business Intelligence?
o The User Dilemma
o Problem: Multivendor, Uninterested Environment
o The Optimal Information Platform for Business Intelligence
o The Optimal Information Platform
o Success Factors for a Dynamic Business Environment
o Business Drivers for Data Warehouses
o Business Intelligence: Requirements
o Lesson Agenda
o OLAP: Overview
o Typical Example of an OLAP Query
o The Dimensional Model
o Measures
o Measure Types
o Dimensions
o Example of Dimensions in a Report
o Sharing Dimensions
o Hierarchy
o Hierarchy: Example
o Level
o Hierarchy Types
o Attributes
o Attributes and Levels: Examples
o Dimensional Model Summarized
o Physical Layers of a Data Warehouse
o Managing the Data Warehouse
o Oracle OLAP: Part of an Integrated DW Platform
o What Is Oracle OLAP?
o Oracle OLAP Option: 11g Highlights
o ROLAP Versus MOLAP
o Oracle Data Mining: An Overview
o Oracle Data Mining: Interfaces
o Summary
• Defining Data Warehouse Concepts and Terminology
o Objectives
o Lesson Agenda
o Data Warehouse: Definition
o Data Warehouse Properties
o Subject Oriented
o Integrated
o Time Variant
o Nonvolatile
o Changing Warehouse Data
o Data Warehouse Versus OLTP
o Enterprise-Wide Data Warehouse
o Data Warehouses Versus Data Marts
o Dependent Data Mart
o Independent Data Mart
o Typical Data Warehouse Components
o Lesson Agenda
o Warehouse Development Approaches
o “Big Bang” Approach
o Top-Down Approach
o Bottom-Up Approach
o Incremental Approach to Warehouse Development
o Data Warehousing Process Components
o Methodology
o Architecture
o Extraction, Transformation, and Loading (ETL)
o Implementation
o Operation and Support
o Phases of the Incremental Approach
o Strategy Phase Deliverables
o Introducing the Case Study: Roy Independent School District (RISD)
o Summary
• Business, Logical, Dimensional, and Physical Modeling
o Objectives
o Lesson Agenda
o Data Warehouse Modeling Issues
o Data Warehouse: Design Phases
o Phase 1: Defining the Business Model
o Defining the Business Model: Performing Strategic Analysis
o Defining the Business Model: Creating the Business Model
o Business Requirements Drive the Design Process
o Using a Business Process Matrix
o Identifying Business Measures and Dimensions
o Determining Granularity
o Identifying Business Definitions and Rules: Example
o Documenting Metadata
o Business Metadata Elements
o Metadata Documentation Approaches
o Phase 2: Designing the Logical Model
o Lesson Agenda
o Phase 3: Defining the Dimensional Model
o Data Warehouse Schemas
o Star Schema Model
o Star Dimensional Modeling
o Advantages of Using a Star Dimensional Model
o Snowflake Schema Model
o Third Normal Form (3NF)
o Fact Table: Characteristics
o More on Fact less Fact Tables
o Identifying Base and Derived Measures
o Fact Table Measures
o Dimension Table: Characteristics
o Translating Business Dimensions into Dimension Tables
o Slowly Changing Dimensions
o Slowly Changing Dimension (SCD): An Example
o Types of Database Keys
o Using Time in the Data Warehouse
o Time Dimension
o Identifying Hierarchies for Dimensions
o Using Hierarchies to Drill on Data and Aggregate Data
o Using Data-Modeling Tools
o Phase 4: Defining the Physical Model
o Translating a Dimensional Model to a Physical Model
o Architectural Requirements
o Making the Right Choice
o Storage and Performance Considerations
o Summary
• Database Sizing, Storage, Performance, and Security Considerations
o Objectives
o Lesson Agenda
o Sizing the Database and Other Storage Requirements
o Estimating the Database Size
o Validating Database Size Assumptions
o Testing Load Sampling
o Oracle Database Architectural Advantages
o Lesson Agenda
o Why Data Partitioning Is Needed
o Data Partitioning
o Benefits of Partitioning
o Oracle’s Partitioning Strategies
o Partition Performance Benefits: Partition Pruning
o Indexing
o B-Tree Index
o Bitmap Indexes
o Bitmap Index: Example
o Comparing B-Tree and Bitmap Indexes
o Other Index Properties
o Optimizing Star Queries: Tuning Star Queries
o Optimizing Star Queries: Star Transformation
o Star Query: Example
o Lesson Agenda
o Parallelism
o Degree of Parallelism (DOP)
o Operations That Can Be Parallelized
o Parallel Execution Server Pool
o PARALLEL Clause: Examples
o Using Summary Data
o HP Oracle Exadata Storage Server Hardware
o Exadata Storage Deployment
o Exadata Key Benefits for Data Warehousing
o Security in Data Warehouses
o Oracle’s Strategy for Data Warehouse Security
o Oracle-Supplied Technology and Tools for Implementing VPD
o Summary
• The ETL Process: Extracting Data
o Objectives
o Lesson Agenda
o Extraction, Transformation, and Loading (ETL) Process
o ETL: Tasks, Importance, and Cost
o Extracting Data
o Examining Data Sources
o Production Data
o Archive Data
o Internal Data
o External Data
o Mapping Data
o Lesson Agenda
o Extraction Methods
o Change Data Capture Mechanism in Oracle Database
o Extraction Techniques
o Designing Extraction Processes
o Maintaining Extraction Metadata
o Possible ETL Failures
o Maintaining ETL Quality
o Oracle’s ETL Tool: Oracle Warehouse Builder
o Oracle-Supported Features for ETL
o Oracle’s Solution for ETL: Oracle Streams, Replication, and Message Queuing
o Summary
• The ETL Process: Transforming Data
o Objectives
o Lesson Agenda
o Transformation
o Remote Staging Model
o On-Site Staging Model
o Data Anomalies
o Transformation Routines
o Transforming Data: Problems and Solutions
o Multipart Keys Problem
o Multiple Local Standards Problem
o Multiple Files Problem
o Missing Values Problem
o Duplicate Values Problem
o Element Names Problem
o Element Meanings Problem
o Input Formats Problem
o Referential Integrity Constraints Problem
o Name and Address Problem
o Name-and-Address Processing in Oracle Warehouse Builder
o Quality Data: Importance and Benefits
o Quality: Standards and Improvements
o Data Quality Guidelines
o Data Quality: Solutions and Management
o Lesson Agenda
o Transformation Techniques: Merging Data
o Transformation Techniques: Adding a Date Stamp
o Transformation Techniques: Adding Keys to Data
o Summarizing Data
o Maintaining Transformation Metadata
o Data Ownership and Responsibilities
o Transformation Timing and Location
o Choosing a Transformation Point
o Monitoring and Tracking
o Designing Transformation Processes
o Transformation Tools
o Data Transformation
o Multistage Data Transformation
o Pipelined Data Transformation
o Oracle’s Enhanced Features for Transformation
o Application of the MERGE Statement in Data Warehousing: Example
o Multitable INSERT Statements
o Advantages of Multitable INSERTs
o Oracle’s Enhanced Features for Transformation
o Summary
• The ETL Process: Loading Data
o Objectives
o Lesson Agenda
o Loading Data into the Warehouse
o Transportation in a Data Warehouse
o Transportable Tablespaces
o Initial Load and Refresh
o Data Refresh Models: Extract Processing Environment
o Data Refresh Models: Warehouse Processing Environment
o Building the Loading Process
o Data Granularity
o Loading Techniques
o Loading Technique Considerations
o Loading Techniques Provided by Oracle: SQL*Loader
o Loading Techniques Provided by Oracle
o Using External Tables
o Benefits of Using External Tables
o Creating External Tables
o Example of Defining External Tables
o Defining External Tables Using SQL*Loader
o Creating and Loading an External Table Using ORACLE_DATAPUMP: Example
o Lesson Agenda
o Postprocessing of Loaded Data
o Indexing and Sorting Data
o Unique Indexes
o Creating Derived Keys
o Summary Management
o Filtering Data
o Verifying Data Integrity
o Steps for Verifying Data Integrity
o Standard Quality Assurance Checks
o Summary
• Refreshing the Warehouse Data
o Objectives
o Lesson Agenda
o Developing a Refresh Strategy for Capturing Changed Data
o User Requirements and Assistance
o Load Window Requirements
o Planning the Load Window
o Scheduling the Load Window
o Capturing Changed Data for Refresh
o Choosing a Method for Change Data Capture
o Wholesale Data Replacement
o Comparison of Database Instances
o Time- and Date-Stamping
o Database Triggers
o Using a Database Log
o Refresh Mechanisms in the Oracle Database
o Lesson Agenda
o Applying the Changes to Data
o Overwriting a Record
o Adding a New Record
o Adding a Current Field
o Limitations of Methods for Applying Changes
o Maintaining History: Techniques
o History Tables and One-to-Many Relationships Versioning
o Preserving Complete History
o Purging and Archiving Data
o Oracle-Supported Techniques for Purging Data
o Oracle-Supported Techniques for Archiving Data
o Final Tasks
o Publishing Data
o Summary
• Materialized Views
o Objectives
o Lesson Agenda
o The Need for Summary Management
o Using Summaries to Improve Performance
o Summary Management
o Summary Navigation
o Managing Historical Summary Data in the Warehouse
o Summary Management Using the Oracle Database
o Using Materialized Views for Summary Management
o Using Summaries Without Materialized Views: Example
o Using Materialized Views for Summary Management: Example
o Determining Which Materialized View to Create
o Creating a Materialized View Using the CREATE SQL Statement: Example
o Available Refresh Modes When Creating a Materialized View
o Manual Refresh Using the DBMS_MVIEW Package Procedures
o Using the DBMS_MVIEW Package: The Available ON DEMAND Refresh Methods
o Refreshing at Scheduled Time: Using the START WITH and NEXT Clauses
o Query Rewrite Overview
o Cost-Based Query Rewrite Process
o Conditions Required for Oracle to Rewrite a Query
o Query Rewrite
o Lesson Agenda
o What Are Dimensions?
o A dimension is a structure that categorizes data to enable users to answer business questions.
o What Are Dimension Objects?
o Why Are Dimensions Important?
o Dimensions and Hierarchies
o Dimension Example
o Defining Dimensions and Hierarchies
o Dimensions with Multiple Hierarchies
o Summary
• Leaving a Metadata Trail
o Objectives
o Defining Warehouse Metadata
o Metadata Users
o Types of Metadata
o Examining Metadata: ETL Metadata
o Extraction Metadata
o Transformation Metadata
o Loading Metadata
o Examining Metadata: End-User Metadata
o End-User Metadata: Context
o Historic Context of Data
o Types of Context
o Developing a Metadata Strategy
o Defining Metadata Goals and Intended Usage
o Identifying Target Metadata Users
o Choosing Metadata Tools and Techniques
o Choosing the Metadata Location
o Managing the Metadata
o Integrating Multiple Sets of Metadata
o Managing Changes to Metadata
o Additional Metadata Content and Considerations
o Common Warehouse Metamodel
o Oracle Warehouse Builder: Compliance with OMG-CWM
o Summary
• Data Warehouse Implementation Considerations
o Objectives
o Project Management
o Requirements Specification or Definition
o Logical, Dimensional, and Physical Data Models
o Data Warehouse Architecture
o ETL Considerations
o Reporting Considerations
o Security Considerations
o Metadata Management
o Testing the Implementation
o Post-Implementation Change Management
o Some Useful Resources and White Papers
o Summary
Oracle Data Integrator Student Guide 1,2نام دوره:
ساعت 44مدت دوره:
:آنچه شما یاد خواهید گرفت ✓
Oracle Data Integrator کارایی باال با حجم وام نیازهای یکپارچه سازی داده را با است که تمپلت فرم جامع یکپارچه سازی داده یک
RDBMS برای تیدیل و بارگذاری داده ها از موتورهای Oracle Data Integratorدهد م میاستفاده از فرایندهای یکپارچه سازی انجا
.به منظور طراحی و پیاده سازی انباره داده مورد استفاده قرار گیرد ETLتواند به عنوان ابزار پیاده سازی و می کند می استفاده متفاوتی
یاد می گیرید:دانشجویان بعد از پایان این دوره ✓
برای انجام تیدیل داده ها در میان پلت فرم های مختلف استفاده کنید Oracle Data Integrator از •
طراحی کنیدELT ، روش ها و بسته ها برای انجام انجام تبدیالت داده ODI نقشه هایاز •
انجام دهیدرا ODIدر و تنظیم امنیت ODI مدیریت منابع •
پلت فرم های مختلف را انجام دهید یکپارچه سازی داده ها و تبدیل در میان •
.استفاده کنید ELT ، بسته ها و کارهای برای تعریف رویه هاODI از رابط گرافیکی •
نگهداری کنید و تنظیم را ODI کاربره چند و امن محیط یک •
را انجام دهید CDCپیاده سازی ODIبا استفاده از •
:مخاطبین ✓
کار و کسب تحلیلگران •
داده مدلسازان •
داده انبار یرمد •
داده پایگاه مدیران •
فنی مشاور •
:اهداف دوره ✓
ODI توصیف مفاهیم مدل •
Oracle Data Integrator 12c توصیف معماری •
برای ادغام داده ها ODI کاربرد مفاهیم توپولوژی •
ELT ، بسته ها و برنامه های بار برای تبدیل داده ، روش هاODI طراحی نقشه های •
ODI اده و اعمال کیفیت داده باجستجو، رسیدگی د •
ODI و تنظیم امنیت با ODI مدیریت منابع •
ODI با CDC پیاده سازی •
• Introduction to Integration and Administration o Course Objectives
o Lesson Objectives
o Agenda
o Why Oracle Data Integrator?
o Conventional Integration Process: ETL
o Extract Load Transform (E-LT)
o ODI Architecture and Components
o ODI Architecture
o ODI Components: Overview
o Using ODI Studio
o Designer Navigator (Work Repository)
o Operator Navigator (Work Repository)
o Topology Navigator (Master Repository)
o Security Navigator (Master Repository)
o What Is an Agent?
o ODI Agents
o Three Types of Agents: Java EE, Standalone, Collocated Standalone
o Using the Three Types of Agents
o Standalone Agent: Example
o ODI Console
o Enterprise Manager FMW Console
o Management Pack for ODI for Enterprise Manager Cloud Control
o Management Pack for ODI for EM CC ODI Home Page
o Agenda
o ODI Repositories
o Master and Work Repositories
o Repository Setup: Example
o Repository Setup: Multiple Master Repositories
o Components: Global View
o Possible ODI Methodology
o Checklist of Practice Activities
o Starting Oracle Data Integrator
o Using Online Help
o Summary
• Administering ODI Repositories o Objectives
o Agenda
o Initial Repository Administration Tasks
o Steps to Set Up ODI Repositories
o 1.Run Repository Creation Utility
o 1a. Create Schemas
o 1b. Create Passwords and Tablespaces
o 2. Connect to the Master/Work Repository
o 3. Create a Wallet
o Connecting to the Master/Work Repository
o Exporting the Master Repository
o Importing the Master Repository
o Creating a Work Repository
o Changing the Work Repository Password
o Quiz
o Summary
o Checklist of Practice Activities
o Practice 2-1: Creating and Connecting to ODI Master and Work Repositories
• ODI Topology Concepts o Objectives
o Agenda
o What Is Topology?
o What Is in the Topology?
o Agenda
o What Is a Data Server?
o Data Servers: Examples
o Important Guideline 1
o What Is a Physical Schema?
o Physical Schemas: Properties
o Technology Terminology Among Vendors
o Important Guideline 2
o Agenda
o Infrastructure for Two Production Sites: Example
o ODI Design: Physical Architecture of the Two Production Sites
o Logical Schemas and Contexts
o What Is a Logical Schema?
o Important Guideline 3
o Logical Versus Physical Architecture
o Design Time Versus Run Time
o What Is a Context?
o A Context Maps a Logical to a Physical Schema
o Defining Contexts
o Mapping Logical and Physical Resources
o Agenda
o ODI Physical Agents
o Creating a Physical Agent
o ODI Agent Parameters
o Launching a Stand-Alone Agent: Examples
o Stopping the ODI Agent
o Deploying and Configuring a Java EE Agent
o Load Balancing: Example
o Important Guideline 5
o Infrastructure with Agents: Example
o Defining Agents: Example
o Special Case: Fragmentation Problem
o Special Case: Important Guideline 6
o Special Case: Defining the Physical Architecture
o Special Case: The Infrastructure
o Special Case: Physical Architecture in ODI
o Agenda
o Planning the Topology
o Matrix of Logical and Physical Mappings
o Summary
• Describing the Physical and Logical Architecture o Objectives
o Agenda
o What Topology Navigator Contains
o Topology Navigator: Overview
o Review: Context Connects Logical to Physical
o Objects You Create in the Practice
o Defining a Context
o Agenda
o Physical Architecture View
o Prerequisites for Connecting to a Server
o Important Note
o Creating a Data Server
o Creating a Data Server: JDBC
o JDBC Driver
o JDBC URL
o Creating a Data Server: JNDI
o Testing a Data Server Connection
o Creating a Physical Schema
o Agenda
o Logical Architecture and Context Views
o Creating a Logical Schema
o Creating a Logical Agent
o Editing a Context to Link Logical and Physical Agents
o Summary
• Setting Up a New ODI Project o Objectives
o Agenda
o What Is a Project?
o Oracle Data Integrator Projects: Overview
o How to Use ODI Projects in Your Work
o Creating a New Project
o Agenda
o What Is a Folder?
o Creating a New Folder
o Organizing Projects and Folders
o Agenda
o What Is a Knowledge Module?
o Types of Knowledge Modules
o Which Knowledge Modules Are Needed?
o Knowledge Modules: Examples
o Importing Knowledge Modules
o Replacing Existing KMs
o Knowledge Module Editor
o Editing a Knowledge Module
o Agenda
o Exporting and Importing
o Exporting an Object
o Importing an Object
o ID Numbers: Overview
o Import Types
o Choosing the Import Mode
o Import Report
o Agenda
o What Is a Marker?
o Tagging Objects with Markers
o Removing Markers
o Marker Groups
o Project and Global Markers
o Creating a Marker Group
o Summary
• Oracle Data Integrator Model Concepts o Objectives
o What Is a Model?
o Agenda
o Relational Model
o Relational Model: Tables and Columns
o Relational Model: Keys
o Relational Model: Foreign Keys
o Relational Model: Constraints
o Relational Model: Indexes
o Relational Model Support in ODI
o Additional Metadata in ODI
o Flex Fields
o Agenda
o What Is Reverse-Engineering?
o Methods for DBMS Reverse-Engineering
o Other Methods for Reverse-Engineering
o Standard Versus Customized Reverse-Engineering
o Reverse-Engineering Life Cycle
o Agenda
o Creating a Model by Reverse-Engineering
o Step 1: Creating and Naming a New Model
o Note: Creating and Naming a New Model
o Step 2: Defining a Reverse-Engineering Strategy
o Step 3: Starting the Reverse-Engineering Process
o Using RKM for Customized Reverse-Engineering
o Selective Reverse-Engineering
o Step 4: Fleshing Out Models
o Shortcuts
o Smart Export and Import
o Summary
• Organizing ODI Models and Creating ODI Datastores o Objectives
o Agenda
o What Is a Model Folder?
o Creating a Model Folder
o What Is a Submodel?
o Creating a Submodel
o Organizing Datastores into Submodels
o Setting Up Automatic Distribution
o Agenda
o Creating Datastores
o Creating a Datastore in a Model
o Adding Columns to a Datastore
o Agenda
o What Is a Constraint in ODI?
o Constraints in ODI
o Creating a Mandatory Column
o Agenda
o Creating a Key
o Checking a Key
o Creating a Reference
o Creating a Simple Reference
o Creating a Complex Reference
o Checking a Reference
o Agenda
o Creating a Condition
o Checking a Condition
o Agenda
o Audit/Explore: When and Why
o Audit/Explore Process: Overview
o Agenda
o Displaying the Contents of a Datastore
o Viewing the Distribution of Values
o Analyzing the Contents of a Datastore
o Agenda
o Defining Business Rules in ODI
o From Business Rules to Constraints
o Deducing Constraints from Data Analysis
o Testing a Constraint
o Auditing a Model or Datastore
o Reviewing Erroneous Records
o Summary
• ODI Mapping Concepts o Objectives
o Agenda
o What Is a Mapping?
o Business Rules for Mappings
o Where Are the Rules Defined?
o Agenda
o What Is an Expression?
o What Is a Join?
o What Is a Filter?
o What Is a Lookup?
o What Is a Set?
o What Are Some of the Others?
o New with Patch: Pivot and Unpivot
o Agenda
o How Does ODI Implement Business Rules?
o Business Problem
o Implementing the Rules
o Integration Process
o Process Details
o Process Implementation: Example
o Process Implementation: Example
o Process Implementation: Example
o Agenda
o What Is the Staging Area?
o Execution Location
o Agenda
o From Business Rules to Processes
o Knowledge Modules
o What Is a Knowledge Module?
o Code Generation
o KM Types Used in Mappings
o Agenda
o Purpose of a Mapping
o What Is an Expression?
o Creating a One-to-One Mapping
o Creating and Naming a Mapping
o Defining the Target Datastore
o Multiple Targets
o Defining the Source Datastore
o Connecting the Ports to Make the Map
o Defining the Expressions
o Valid Expression Types
o Saving the Mapping
o Running the Mapping
o Summary
• Designing Mappings o Objectives
o Agenda
o Multiple-Source Datastores
o Creating a Join Manually
o Advanced Joins
o Types of Joins
o Setting Up a Join
o Creating Lookups
o Using Lookups
o Agenda
o Filters in ODI
o Defining a Filter Manually
o Setting Up a Filter
o Agenda
o Physical Mapping Diagram
o Flow in the Physical Diagram
o What Defines the Flow?
o Scenario
o Basic Process
o Agenda
o Purpose of a Staging Area
o Placing the Staging Area
o Important Note
o Specifying the Staging Area
o Agenda
o Options for Expressions
o Setting Options for Expressions
o Disabling an Expression
o Enabling a Mapping for Inserts or Updates
o Agenda
o Execution Location and Syntax
o Why Change the Execution Location?
o Changing the Execution Location
o ODI Mapping Execution Simulation
o Agenda
o Which KMs for Which Flow?
o Knowledge Modules: Additional Information
o Identifying IKMs and LKMs
o IKMs and LKMs: Strategies and Methods
o Specifying an LKM
o Specifying an IKM
o Common KM Options
o Flow: Example 1
o Flow: Example 2
o Flow: Example 3
o Summary
• Mappings: Monitoring and Troubleshooting o Objectives
o Agenda
o Operator Navigator: Viewing the Log
o Using Operator Navigator
o Hierarchy: Sessions, Steps, Tasks
o Viewing Details of Sessions, Steps, and Tasks
o Monitoring Execution of an Mapping
o Troubleshooting a Session
o Identifying the Error
o Reviewing the Code
o Fixing the Code and Restarting the Session
o Fixing the Mapping
o Keys to Reviewing the Generated Code
o Agenda
o Common Errors and Symptoms
o Important Note
o Tips for Preventing Errors
o Using Attribute Panel for Quick Edits
o Summary
✓ Designing Mappings: Advanced Topics 1
o Objectives
o Agenda
o Business Rules in Mappings
o Business Rule Elements
o More Elements
o Expression Editor
o Agenda
o Using a Variable in Code
o Binding Versus Substitution
o Case Sensitivity
o Agenda
o Defining a Dataset
o Using Set-Based Operators
o Example of SET: UNION
o Agenda
o Types of Sequences
o Support for Native Sequences
o Creating a Native Sequence
o Referring to Sequences
o Note: Sequences Updated by Agent
o Using Standard Sequences in Mappings Correctly
o Using ODI Standard Sequences in Mappings
o Populating Native Identity Attributes
o Sequences: Best Practices
o Automatic Temporary Index Management
o Tracking Variables and Sequences
o How Variable and Sequence Tracking Works
o Variable Actions
o Definition Tab of Session Step or Session Task
o Summary
• Designing Mappings: Advanced Topics 2 o Objectives
o Agenda
o Partitioning
o Definition in Datastore After Reverse-Engineering
o Using Partitioning in a Mapping
o Agenda
o Reusable Mappings
o Using Reusable Mappings: Example
o Derived Select (Subselect) for Reusable Mappings
o Agenda
o What Is a User Function?
o Why Use User Functions?
o Properties of User Functions
o Using User Functions
o Creating a User Function
o Defining an Implementation
o Syntax and Implementations
o User Functions at Design Time
o User Functions at Run Time
o Note: Functions in Execution Log
o Agenda
o Using Substitution Methods
o Substitution Methods: Examples
o Agenda
o Description of KM Steps
o Details of the Steps
o Setting KM Options
o Developing Your Own KM: Guidelines
o Complex File Technology
o Summary
• Using ODI Procedures o Objectives
o Agenda
o What Is a Procedure?
o Procedure: Examples
o Creating Procedures: Overview
o Agenda
o Creating a New Procedure
o Agenda
o Creating a Command
o Arranging Tasks in Order
o Which Parameters Should Be Set?
o Valid Types of Commands
o More Elements
o Why Use a Source Command?
o Agenda
o Types of Options
o Creating a New Option
o Making a Command Optional
o Using an Option Value in a Command
o Agenda
o Procedure Execution
o Using the Operator Navigator to View Results
o Summary
• Using ODI Packages o Objectives
o Agenda
o What Is a Package?
o Creating a Package
o Agenda
o Creating and Naming a Package
o Package Diagram
o Package Diagram Toolbar
o Agenda
o Package Steps
o Creating a Package Step
o What Is an ODI Tool?
o Creating an ODI Tool Step
o Tool Steps: Best Practices
o Agenda
o Sequencing Steps
o A Simple Package
o Sequencing Package Steps
o Agenda
o Executing a Package
o Agenda
o Basic Step Types
o Advanced Step Types
o Agenda
o Creating Model, Submodel, and Datastore Steps
o Models, Submodels, and Datastore Steps
o Agenda
o Creating a Variable Step
o Variable Steps
o Agenda
o Controlling Execution
o Error Handling
o Creating a Loop
o The Advanced Tab
o Summary
• Step-by-Step Debugger o Objectives
o Agenda
o Overview
o Agenda
o Process Overview
o Starting a Session in Debug mode
o Specifying Debug Properties
o Control Execution Flow
o Screen Step Numbering
o Agenda
o New Functionalities
o Benefits for End Users
o Agenda
o Debug Toolbar
o Toolbar: Current Cursor
o Toolbar: Get Data
o Toolbar: Step Into
o Toolbar: Run to Task End
o Toolbar: Run to Next Task
o Toolbar: Run to Step End
o Toolbar: Run to Next Step
o Toolbar: Pause
o Toolbar: Resume
o Summary
• Managing ODI Scenarios o Objectives
o Agenda
o What Is a Scenario?
o Properties of Scenarios
o Agenda
o Scenario-Related Tasks
o Generating a Scenario
o Regenerating a Scenario
o Generation Versus Regeneration
o Executing a Scenario from the GUI
o Executing a Scenario from a Command Line
o Executing a Scenario from a Package
o Exporting a Scenario
o Agenda
o Preparing Scenarios for Deployment
o Automating Scenario Management
o Scheduling the ODI Scenario
o Scheduling ODI Scenario with External Scheduler
o Managing Schedules
o Summary
• Using Load Plans o Objectives
o Should You Organize Executions with Load Plans?
o What Are Load Plans?
o Load Plan Editor 5 Load Plan Steps
o Defining the Restart Behavior
o Are Load Plans Substitutes for Packages or Scenarios?
o Benefits of Using Load Plans
o Handling Failed Load Plans
o Summary
• Enforcing Data Quality with ODI o Objectives
o Agenda
o Why Data Quality?
o When to Enforce Data Quality
o Data Quality in Source Applications
o Data Quality Control in the Integration Process
o Data Quality in the Target Applications
o Agenda
o Data Quality Business Rules
o From Business Rules to Constraints
o Agenda
o Data Quality System: Overview
o Static and Flow Controls: Differences
o Data Quality Control: Properties
o Synchronous Control
o What Is a Constraint?
o What Can Be Checked?
o Enforcing Data Quality in a Mapping
o Agenda
o Setting Up Static or Flow Control
o Enabling Static or Flow Control
o Agenda
o Setting the Physical Options
o Setting the Logical Options
o Agenda
o Selecting Which Constraints to Enforce
o Selecting Which Constraints to Check
o Differences Between Control Types
o Agenda
o Reviewing Erroneous Records
o EnterpriseDataQuality Tool
o Using the EDQ Tool
o Summary
• Working with Changed Data Capture o Objectives
o Why Changed Data Capture?
o CDC Techniques
o Changed Data Capture in ODI
o Journalizing Components
o CDC Infrastructure in ODI
o Simple Versus Consistent Set Journalizing
o Limitations of Simple CDC Journalizing: Example
o Consistent CDC Journalizing
o Consistent CDC: Infrastructure
o Setting Up Journalizing
o Setting CDC Parameters: Example
o Adding a Subscriber: Example
o Starting Journal: Example
o Journalizing Status
o Viewing Data/Changed Data: Example
o Using Changed Data
o Oracle GoldenGate Integration
o Oracle GoldenGate Integration in ODI 12c
o Summary
• Advanced ODI Administration o Objectives
o Agenda
o Introduction to ODI Security Navigator
o Security Concepts: Overview
o Defining Security Policies
o Creating Profiles
o Using Generic and Nongeneric Profiles
o Built-in Profiles
o Creating Users
o Assigning a Profile to a User
o Assigning an Authorization by Profile or User
o Defining Password Policies
o Setting User Preferences
o ODI Security Integration: Overview
o Implementing External Authentication (OPSS)
o Implementing External Authentication (OPSS): Switching the Authentication Mode
o Implementing External Password Storage
o Agenda
o Types of ODI Reports
o Generating Topology Reports
o Generated Topology Report: Example
o Version Comparison Report: Example
o Generating Object Reports
o Agenda
o Integration of ODI with Enterprise Manager
o Java EE Agent and Enterprise Manager Configuration with WebLogic Domain: Overview
o Using ODI Console: Example
o Summary