oracle data warehouse pack - sematec · oracle data warehouse pack (oracle data warehouse...

30
Oracle Data Warehouse Pack (Oracle Data warehouse Fundamentals + Oracle Data Integrator Student Guide 1,2) ﻧﺎم دوره:Data warehouse Fundamentals Oracle ﻣﺪت دوره:16 ﺳﺎﻋﺖ آﻧﭽﻪ ﺷﻤﺎ ﯾﺎد ﺧﻮاﻫﯿﺪ ﮔﺮﻓﺖ: در اﯾﻦ دوره، داﻧﺸﺠﻮﯾﺎن ﻣﻔﺎﻫﯿﻢ اوﻟﯿﻪ اﻧﺒﺎر داده را ﻣﯽ آﻣﻮزﻧﺪ و ﺑﺎ ﻣﻮارد ﻣﺮﺑﻮط ﺑﻪ ﺑﺮﻧﺎﻣﻪ رﯾﺰي ، ﻃﺮاﺣﯽ ، ﺳﺎﺧﺖ، ﺟﻤﻊ آوري و ﻧﮕﻬﺪاري ﯾﮏ اﻧﺒﺎر داده ﻣﻮﻓﻖ آﺷﻨﺎ ﺧﻮاﻫﻨﺪ ﺷﺪ و ﻫﻤﭽﻨﯿﻦ اﺻﻮل اوﻟﯿﻪ ﻣﻌﻤﺎري ﭘﺎرﺗﯿﺸﻦ ﺑﻨﺪي ﭘﺎﯾﮕﺎه داده اوراﮐﻞ را ﯾﺎدﮔﺮﻓﺘﻪ و ﻣﺰاﯾﺎي ﺎرﺗﯿﺸﻦ ﺑﻨﺪي را ﻣﯽ ﺷﻨﺎﺳﻨﺪ. ﻣﺰاﯾﺎي ﻋﻤﻠﯿﺎت ﻣﻮازي را ﺑﺮرﺳﯽ ﮐﺮده ﺗﺎ زﻣﺎن ﭘﺎﺳﺨﮕﻮﯾﯽ ﺑﺮاي ﻋﻤﻠﯿﺎت ﻓﺸﺮده را ﮐﺎﻫﺶ دﻫﻨﺪ و ﻫﻤﭽﻨﯿﻦ ﻋﻤﻠﯿﺎت واﮐﺸﯽ، اﻧﺘﻘﺎل و ﺑﺎرﮔﺬاري داده ﺑﻪ ﯾﮏ اﻧﺒﺎره داده ﭘﺎﯾﮕﺎه داده اوراﮐﻞﻓﺎز ﻫﺎي) ETL را( ﻣﯽ آﻣﻮزﻧﺪ. اﺻﻮل اوﻟﯿﻪ در ﻣﻮرد ﻣﺰاﯾﺎي اﺳﺘﻔﺎده ازmaterialized view اوراﮐﻞ را ﺑﺮاي ﺑﻬﺒﻮد ﻋﻤﻠﮑﺮد اﻧﺒﺎر داده ﻫﺎ را آﻣﻮﺧﺘﻪ و ﻫﻤﭽﻨﯿﻦ در ﺳﻄﺢ ﺑﺎﻻ ﯾﺎد ﻣﯽ ﮔﯿﺮﻧﺪ ﮐﻪ ﭼﮕﻮﻧﻪ ﺑﺎزﻧﻮﯾﺴﯽ ﮐﻮﺋﺮي ﻣﯽ ﺗﻮاﻧﺪ ﻋﻤﻠﮑﺮد ﮐﻮﺋﺮي را ﺑﻬﺒﻮد ﺑﺨﺸﺪ ، در اداﻣﻪ داﻧﺸﺠﻮﯾﺎنOLAP وData Mining را ﺑﺮرﺳﯽ ﻣﯽ ﮐﻨﻨﺪ و ﺑﺮﺧﯽ از ﻣﻔﺎﻫﯿﻢ ﭘﯿﺎده ﺳﺎزي اﻧﺒﺎر داده را ﺷﻨﺎﺳﺎﯾﯽ ﻣﯽ ﮐﻨﻨﺪ و ﺑﻪ ﻃﻮر ﺧﻼﺻﻪ از ﺑﺮﺧﯽ از اﺑﺰارﻫﺎي ﻣﻮﺟﻮد اﻧﺒﺎره داده ﻣﺎﻧﻨﺪOracle Warehouse Builder ، Analytical Workspace Manager وOracle Application Express اﺳﺘﻔﺎده ﻣﯽ ﮐﻨﻨﺪ. داﻧﺸﺠﻮﯾﺎن ﺑﻌﺪ از ﭘﺎﯾﺎن اﯾﻦ دوره ﯾﺎد ﻣﯽ ﮔﯿﺮﯾﺪ: اﺻﻄﻼﺣﺎت و ﻣﻔﺎﻫﯿﻢ ﭘﺎﯾﻪ ي اﻧﺒﺎر داده را ﺗﻮﺿﯿﺢ دﻫﯿﺪ ﻓﻨﺎوري و ﺑﺮﺧﯽ از اﺑﺰارﻫﺎي اوراﮐﻞ ﺑﺮاي ﭘﯿﺎده ﺳﺎزي ﯾﮏ اﻧﺒﺎر داده ﻣﻮﻓﻖ ﺷﻨﺎﺳﺎﯾﯽ ﮐﻨﯿﺪ روش ﻫﺎ و اﺑﺰارﻫﺎي اﺳﺘﺨﺮاج، ﺗﺒﺪﯾﻞ و ﺑﺎرﮔﯿﺮي داده ﻫﺎ ﺗﻮﺻﯿﻒ ﮐﻨﯿﺪ ﺑﺮﺧﯽ از اﺑﺰارﻫﺎ ﺑﺮاي دﺳﺘﺮﺳﯽ و ﺗﺠﺰﯾﻪ و ﺗﺤﻠﯿﻞ داده ﻫﺎي اﻧﺒﺎره داده ﺷﻨﺎﺳﺎﯾﯽ ﮐﻨﯿﺪ ﻣﺰاﯾﺎي ﭘﺎرﺗﯿﺸﻦ ﺑﻨﺪي، ﻋﻤﻠﯿﺎت ﻣﻮازي،materialized views و ﺑﺎزﻧﻮﯾﺴﯽ ﮐﻮﺋﺮي در ﯾﮏ اﻧﺒﺎر داده را ﺗﻮﺻﯿﻒ ﮐﻨﯿﺪ ﭘﯿﺎده ﺳﺎزي و ﻣﺴﺎﺋﻞ ﺳﺎزﻣﺎﻧﯽ در ﻣﻮرد ﭘﺮوژه اﻧﺒﺎر داده را ﺗﻮﺿﯿﺢ دﻫﯿﺪ ﺗﺎرﯾﺦ ﺑﻪ روزرﺳﺎﻧﯽ : ﺷﻬﺮﯾﻮر97

Upload: others

Post on 22-Mar-2020

76 views

Category:

Documents


3 download

TRANSCRIPT

Oracle Data Warehouse Pack

(Oracle Data warehouse Fundamentals + Oracle Data Integrator Student Guide 1,2)

Data warehouse Fundamentals Oracle نام دوره:

ساعت 16مدت دوره:

:خواهید گرفتآنچه شما یاد

و جمع آوري ، ، ساخت ، طراحی مربوط به برنامه ریزي با مواردو انبار داده را می آموزند اولیهمفاهیم دانشجویاندر این دوره، مزایاي و بندي پایگاه داده اوراکل را یادگرفته اصول اولیه معماري پارتیشن همچنینو آشنا خواهند شدیک انبار داده موفق نگهداري

و کاهش دهند را تا زمان پاسخگویی براي عملیات فشرده کردهمزایاي عملیات موازي را بررسی . ارتیشن بندي را می شناسندپ در اولیه اصولآموزند. می ) راETL(فاز هاي اوراکل داده پایگاه داده انباره یک به داده بارگذاري و انتقال واکشی،همچنین عملیات

همچنین در سطح باال یاد را آموخته و ها داده انبار عملکرد بهبود براي را اوراکل materialized view از استفاده مزایاي موردرا Data Mining و OLAP دانشجویان ، در ادامه می گیرند که چگونه بازنویسی کوئري می تواند عملکرد کوئري را بهبود بخشد

به طور خالصه از برخی از ابزارهاي موجود انباره و داده را شناسایی می کنند برخی از مفاهیم پیاده سازي انباربررسی می کنند و Oracle Application Express و Oracle Warehouse Builder ،Analytical Workspace Managerداده مانند

.استفاده می کنند

دانشجویان بعد از پایان این دوره یاد می گیرید:

ي انبار داده را توضیح دهیداصطالحات و مفاهیم پایه •

موفق شناسایی کنید داده انبار یک سازي پیاده براي اوراکل ابزارهاي از برخی و فناوري •

ها توصیف کنید داده بارگیري و تبدیل استخراج، ابزارهاي و ها روش •

کنیدبرخی از ابزارها براي دسترسی و تجزیه و تحلیل داده هاي انباره داده شناسایی •

و بازنویسی کوئري در یک انبار داده را توصیف کنید materialized viewsمزایاي پارتیشن بندي، عملیات موازي، •

پیاده سازي و مسائل سازمانی در مورد پروژه انبار داده را توضیح دهید •

97تاریخ به روزرسانی : شهریور

مخاطبین

افزار نرم دهندگان توسعه •

پشتیبانی مهندس •

داده انبار دهنده توسعه •

عملیاتی اجراي •

داده انبار مدیر •

انبار داده تحلیلگر •

توسعه دهنده •

پروژه مدیر •

اهداف دوره

داده انبار پایه مفاهیم توضیح و اصطالحات تعریف • ها داده لود و تبدیل استخراج، ابزارهاي و ها روش توصیف •

انبارداده داده تحلیل و تجزیه و دسترسی براي ابزارها از برخی شناسایی •

برخی از ابزارهاي اوراکل براي پیاده سازي یک انبار داده موفقشناسایی فناوري و •

تعریف هدف پشتیبانی تصمیم گیري و هدف نهایی یک انبار داده •

و بازنویسی کوئري در یک انبار داده materialized viewمزایاي پارتیشن بندي، عملیات موازي، توصیف •

توضیح پیاده سازي و مسائل سازمانی در مورد پروژه انبار داده •

و بازنویسی کوئري براي بهبود عملکرد انبارداده materialized viewاستفاده از •

داده انبار یک پیاده سازي براي نیاز مورد فناوري از برخی با آشنایی توسعه •

:سرفصل دوره

• Introduction

o Objectives o Questions about You o Lesson Agenda o Course Objectives

97تاریخ به روزرسانی : شهریور

o Prerequisites and Suggested Prerequisites o Suggested Course Schedule o Lesson Agenda o Some of the Sample Schemas Used in the Course o Sales History (sh) Schema o Class Account Information o Appendixes in the Course o SQL Environments Available in the Course o Entering SQL Statements Using Oracle SQL*Plus o What Is Oracle SQL Developer? o Creating Schema Objects o Data Warehousing Tools Used in this Course o Lesson Agenda o Oracle 11g Useful Documentation o Continuing Your Education o Oracle Technology Network (OTN) o Oracle by Example (OBE) o Oracle Warehouse Builder OBEs o Analytic Workspace Manager (AWM) OBEs o Oracle Application Express (APEX) OBEs Technical Support Summary o Summary

• Data Warehousing, Business Intelligence, OLAP, and Data Mining

o Objectives o Lesson Agenda o Evolution of BI o Early Management Information Systems o Analyzing Data from Operational Systems o Why OLTP Is Not Suitable for Analytical Reporting o Data Extract Processing o Issues with Data Extract Programs o Productivity Issues with Extract Processing o Data Quality Issues with Extract Processing o Data Warehousing and Business Intelligence o Technological Solutions for Data Warehousing o Advantages of Warehouse Processing Environments o Business Intelligence (BI): Definition and Purpose o What Is Business Intelligence? o The User Dilemma o Problem: Multivendor, Uninterested Environment o The Optimal Information Platform for Business Intelligence

97تاریخ به روزرسانی : شهریور

o The Optimal Information Platform o Success Factors for a Dynamic Business Environment o Business Drivers for Data Warehouses o Business Intelligence: Requirements o Lesson Agenda o OLAP: Overview o Typical Example of an OLAP Query o The Dimensional Model o Measures o Measure Types o Dimensions o Example of Dimensions in a Report o Sharing Dimensions o Hierarchy o Hierarchy: Example o Level o Hierarchy Types o Attributes o Attributes and Levels: Examples o Dimensional Model Summarized o Physical Layers of a Data Warehouse o Managing the Data Warehouse o Oracle OLAP: Part of an Integrated DW Platform o What Is Oracle OLAP? o Oracle OLAP Option: 11g Highlights o ROLAP Versus MOLAP o Oracle Data Mining: An Overview o Oracle Data Mining: Interfaces o Summary

• Defining Data Warehouse Concepts and Terminology

o Objectives o Lesson Agenda o Data Warehouse: Definition o Data Warehouse Properties o Subject Oriented o Integrated o Time Variant o Nonvolatile o Changing Warehouse Data o Data Warehouse Versus OLTP

97تاریخ به روزرسانی : شهریور

o Enterprise-Wide Data Warehouse o Data Warehouses Versus Data Marts o Dependent Data Mart o Independent Data Mart o Typical Data Warehouse Components o Lesson Agenda o Warehouse Development Approaches o “Big Bang” Approach o Top-Down Approach o Bottom-Up Approach o Incremental Approach to Warehouse Development o Data Warehousing Process Components o Methodology o Architecture o Extraction, Transformation, and Loading (ETL) o Implementation o Operation and Support o Phases of the Incremental Approach o Strategy Phase Deliverables o Introducing the Case Study: Roy Independent School District (RISD) o Summary

• Business, Logical, Dimensional, and Physical Modeling

o Objectives o Lesson Agenda o Data Warehouse Modeling Issues o Data Warehouse: Design Phases o Phase 1: Defining the Business Model o Defining the Business Model: Performing Strategic Analysis o Defining the Business Model: Creating the Business Model o Business Requirements Drive the Design Process o Using a Business Process Matrix o Identifying Business Measures and Dimensions o Determining Granularity o Identifying Business Definitions and Rules: Example o Documenting Metadata o Business Metadata Elements o Metadata Documentation Approaches o Phase 2: Designing the Logical Model o Lesson Agenda o Phase 3: Defining the Dimensional Model

97تاریخ به روزرسانی : شهریور

o Data Warehouse Schemas o Star Schema Model o Star Dimensional Modeling o Advantages of Using a Star Dimensional Model o Snowflake Schema Model o Third Normal Form (3NF) o Fact Table: Characteristics o More on Fact less Fact Tables o Identifying Base and Derived Measures o Fact Table Measures o Dimension Table: Characteristics o Translating Business Dimensions into Dimension Tables o Slowly Changing Dimensions o Slowly Changing Dimension (SCD): An Example o Types of Database Keys o Using Time in the Data Warehouse o Time Dimension o Identifying Hierarchies for Dimensions o Using Hierarchies to Drill on Data and Aggregate Data o Using Data-Modeling Tools o Phase 4: Defining the Physical Model o Translating a Dimensional Model to a Physical Model o Architectural Requirements o Making the Right Choice o Storage and Performance Considerations o Summary

• Database Sizing, Storage, Performance, and Security Considerations o Objectives o Lesson Agenda o Sizing the Database and Other Storage Requirements o Estimating the Database Size o Validating Database Size Assumptions o Testing Load Sampling o Oracle Database Architectural Advantages o Lesson Agenda o Why Data Partitioning Is Needed o Data Partitioning o Benefits of Partitioning o Oracle’s Partitioning Strategies

97تاریخ به روزرسانی : شهریور

o Partition Performance Benefits: Partition Pruning o Indexing o B-Tree Index o Bitmap Indexes o Bitmap Index: Example o Comparing B-Tree and Bitmap Indexes o Other Index Properties o Optimizing Star Queries: Tuning Star Queries o Optimizing Star Queries: Star Transformation o Star Query: Example o Lesson Agenda o Parallelism o Degree of Parallelism (DOP) o Operations That Can Be Parallelized o Parallel Execution Server Pool o PARALLEL Clause: Examples o Using Summary Data o HP Oracle Exadata Storage Server Hardware o Exadata Storage Deployment o Exadata Key Benefits for Data Warehousing o Security in Data Warehouses o Oracle’s Strategy for Data Warehouse Security o Oracle-Supplied Technology and Tools for Implementing VPD o Summary

• The ETL Process: Extracting Data

o Objectives o Lesson Agenda o Extraction, Transformation, and Loading (ETL) Process o ETL: Tasks, Importance, and Cost o Extracting Data o Examining Data Sources o Production Data o Archive Data o Internal Data o External Data o Mapping Data o Lesson Agenda o Extraction Methods o Change Data Capture Mechanism in Oracle Database o Extraction Techniques

97تاریخ به روزرسانی : شهریور

o Designing Extraction Processes o Maintaining Extraction Metadata o Possible ETL Failures o Maintaining ETL Quality o Oracle’s ETL Tool: Oracle Warehouse Builder o Oracle-Supported Features for ETL o Oracle’s Solution for ETL: Oracle Streams, Replication, and Message Queuing o Summary

• The ETL Process: Transforming Data

o Objectives o Lesson Agenda o Transformation o Remote Staging Model o On-Site Staging Model o Data Anomalies o Transformation Routines o Transforming Data: Problems and Solutions o Multipart Keys Problem o Multiple Local Standards Problem o Multiple Files Problem o Missing Values Problem o Duplicate Values Problem o Element Names Problem o Element Meanings Problem o Input Formats Problem o Referential Integrity Constraints Problem o Name and Address Problem o Name-and-Address Processing in Oracle Warehouse Builder o Quality Data: Importance and Benefits o Quality: Standards and Improvements o Data Quality Guidelines o Data Quality: Solutions and Management o Lesson Agenda o Transformation Techniques: Merging Data o Transformation Techniques: Adding a Date Stamp o Transformation Techniques: Adding Keys to Data o Summarizing Data o Maintaining Transformation Metadata o Data Ownership and Responsibilities o Transformation Timing and Location

97تاریخ به روزرسانی : شهریور

o Choosing a Transformation Point o Monitoring and Tracking o Designing Transformation Processes o Transformation Tools o Data Transformation o Multistage Data Transformation o Pipelined Data Transformation o Oracle’s Enhanced Features for Transformation o Application of the MERGE Statement in Data Warehousing: Example o Multitable INSERT Statements o Advantages of Multitable INSERTs o Oracle’s Enhanced Features for Transformation o Summary

• The ETL Process: Loading Data

o Objectives o Lesson Agenda o Loading Data into the Warehouse o Transportation in a Data Warehouse o Transportable Tablespaces o Initial Load and Refresh o Data Refresh Models: Extract Processing Environment o Data Refresh Models: Warehouse Processing Environment o Building the Loading Process o Data Granularity o Loading Techniques o Loading Technique Considerations o Loading Techniques Provided by Oracle: SQL*Loader o Loading Techniques Provided by Oracle o Using External Tables o Benefits of Using External Tables o Creating External Tables o Example of Defining External Tables o Defining External Tables Using SQL*Loader o Creating and Loading an External Table Using ORACLE_DATAPUMP: Example o Lesson Agenda o Postprocessing of Loaded Data o Indexing and Sorting Data o Unique Indexes o Creating Derived Keys o Summary Management

97تاریخ به روزرسانی : شهریور

o Filtering Data o Verifying Data Integrity o Steps for Verifying Data Integrity o Standard Quality Assurance Checks o Summary

• Refreshing the Warehouse Data o Objectives o Lesson Agenda o Developing a Refresh Strategy for Capturing Changed Data o User Requirements and Assistance o Load Window Requirements o Planning the Load Window o Scheduling the Load Window o Capturing Changed Data for Refresh o Choosing a Method for Change Data Capture o Wholesale Data Replacement o Comparison of Database Instances o Time- and Date-Stamping o Database Triggers o Using a Database Log o Refresh Mechanisms in the Oracle Database o Lesson Agenda o Applying the Changes to Data o Overwriting a Record o Adding a New Record o Adding a Current Field o Limitations of Methods for Applying Changes o Maintaining History: Techniques o History Tables and One-to-Many Relationships Versioning o Preserving Complete History o Purging and Archiving Data o Oracle-Supported Techniques for Purging Data o Oracle-Supported Techniques for Archiving Data o Final Tasks o Publishing Data o Summary

• Materialized Views

o Objectives

97تاریخ به روزرسانی : شهریور

o Lesson Agenda o The Need for Summary Management o Using Summaries to Improve Performance o Summary Management o Summary Navigation o Managing Historical Summary Data in the Warehouse o Summary Management Using the Oracle Database o Using Materialized Views for Summary Management o Using Summaries Without Materialized Views: Example o Using Materialized Views for Summary Management: Example o Determining Which Materialized View to Create o Creating a Materialized View Using the CREATE SQL Statement: Example o Available Refresh Modes When Creating a Materialized View o Manual Refresh Using the DBMS_MVIEW Package Procedures o Using the DBMS_MVIEW Package: The Available ON DEMAND Refresh Methods o Refreshing at Scheduled Time: Using the START WITH and NEXT Clauses o Query Rewrite Overview o Cost-Based Query Rewrite Process o Conditions Required for Oracle to Rewrite a Query o Query Rewrite o Lesson Agenda o What Are Dimensions? o A dimension is a structure that categorizes data to enable users to answer business

questions. o What Are Dimension Objects? o Why Are Dimensions Important? o Dimensions and Hierarchies o Dimension Example o Defining Dimensions and Hierarchies o Dimensions with Multiple Hierarchies o Summary

• Leaving a Metadata Trail

o Objectives o Defining Warehouse Metadata o Metadata Users o Types of Metadata o Examining Metadata: ETL Metadata o Extraction Metadata o Transformation Metadata o Loading Metadata

97تاریخ به روزرسانی : شهریور

o Examining Metadata: End-User Metadata o End-User Metadata: Context o Historic Context of Data o Types of Context o Developing a Metadata Strategy o Defining Metadata Goals and Intended Usage o Identifying Target Metadata Users o Choosing Metadata Tools and Techniques o Choosing the Metadata Location o Managing the Metadata o Integrating Multiple Sets of Metadata o Managing Changes to Metadata o Additional Metadata Content and Considerations o Common Warehouse Metamodel o Oracle Warehouse Builder: Compliance with OMG-CWM o Summary

• Data Warehouse Implementation Considerations

o Objectives o Project Management o Requirements Specification or Definition o Logical, Dimensional, and Physical Data Models o Data Warehouse Architecture o ETL Considerations o Reporting Considerations o Security Considerations o Metadata Management o Testing the Implementation o Post-Implementation Change Management o Some Useful Resources and White Papers

************************************************

Oracle Data Integrator Student Guide 1,2 نام دوره:

ساعت 44 مدت دوره:

:آنچه شما یاد خواهید گرفت

97تاریخ به روزرسانی : شهریور

Oracle Data Integrator حجم وام نیازهاي یکپارچه سازي داده را با است که تمپلت فرم جامع یکپارچه سازي داده یک براي تیدیل و بارگذاري داده ها از Oracle Data Integratorدهد کارایی باال با استفاده از فرایندهاي یکپارچه سازي انجام می

به منظور طراحی و پیاده سازي انباره داده ETLتواند به عنوان ابزار پیاده سازي و می کند می استفاده متفاوتی RDBMS موتورهاي .مورد استفاده قرار گیرد

دانشجویان بعد از پایان این دوره یاد می گیرید:

براي انجام تیدیل داده ها در میان پلت فرم هاي مختلف استفاده کنید Oracle Data Integratorاز •

طراحی کنیدELT ، روش ها و بسته ها براي انجام انجام تبدیالت داده ODI نقشه هاياز •

انجام دهیدرا ODIدر و تنظیم امنیت ODI مدیریت منابع •

یکپارچه سازي داده ها و تبدیل در میان پلت فرم هاي مختلف را انجام دهید •

.کنید استفاده ELT ، بسته ها و کارهاي براي تعریف رویه هاODI از رابط گرافیکی •

نگهداري کنید و تنظیم را ODI کاربره چند و امن محیط یک •

را انجام دهید CDCپیاده سازي ODIبا استفاده از •

:مخاطبین

کار و کسب تحلیلگران •

داده مدلسازان •

داده انبار مدیر •

داده پایگاه مدیران •

فنی مشاور •

:اهداف دوره

ODI توصیف مفاهیم مدل •

Oracle Data Integrator 12c توصیف معماري •

براي ادغام داده ها ODI کاربرد مفاهیم توپولوژي •

ELT ، بسته ها و برنامه هاي بار براي تبدیل داده ، روش هاODI طراحی نقشه هاي •

ODI جستجو، رسیدگی داده و اعمال کیفیت داده با •

ODI و تنظیم امنیت با ODI مدیریت منابع • ODI با CDC پیاده سازي •

97تاریخ به روزرسانی : شهریور

:سرفصل دوره

Introduction to Integration and Administration

o Course Objectives o Lesson Objectives o Agenda o Why Oracle Data Integrator? o Conventional Integration Process: ETL o Extract Load Transform (E-LT) o ODI Architecture and Components o ODI Architecture o ODI Components: Overview o Using ODI Studio o Designer Navigator (Work Repository) o Operator Navigator (Work Repository) o Topology Navigator (Master Repository) o Security Navigator (Master Repository) o What Is an Agent? o ODI Agents o Three Types of Agents: Java EE, Standalone, Collocated Standalone o Using the Three Types of Agents o Standalone Agent: Example o ODI Console o Enterprise Manager FMW Console o Management Pack for ODI for Enterprise Manager Cloud Control o Management Pack for ODI for EM CC ODI Home Page o Agenda o ODI Repositories o Master and Work Repositories o Repository Setup: Example o Repository Setup: Multiple Master Repositories o Components: Global View o Possible ODI Methodology

97تاریخ به روزرسانی : شهریور

o Checklist of Practice Activities o Starting Oracle Data Integrator o Using Online Help o Summary

• Administering ODI Repositories

o Objectives o Agenda o Initial Repository Administration Tasks o Steps to Set Up ODI Repositories o 1.Run Repository Creation Utility o 1a. Create Schemas o 1b. Create Passwords and Tablespaces o 2. Connect to the Master/Work Repository o 3. Create a Wallet o Connecting to the Master/Work Repository o Exporting the Master Repository o Importing the Master Repository o Creating a Work Repository o Changing the Work Repository Password o Quiz o Summary o Checklist of Practice Activities o Practice 2-1: Creating and Connecting to ODI Master and Work Repositories

• ODI Topology Concepts

o Objectives o Agenda o What Is Topology? o What Is in the Topology? o Agenda o What Is a Data Server? o Data Servers: Examples o Important Guideline 1 o What Is a Physical Schema? o Physical Schemas: Properties o Technology Terminology Among Vendors o Important Guideline 2

97تاریخ به روزرسانی : شهریور

o Agenda o Infrastructure for Two Production Sites: Example o ODI Design: Physical Architecture of the Two Production Sites o Logical Schemas and Contexts o What Is a Logical Schema? o Important Guideline 3 o Logical Versus Physical Architecture o Design Time Versus Run Time o What Is a Context? o A Context Maps a Logical to a Physical Schema o Defining Contexts o Mapping Logical and Physical Resources o Agenda o ODI Physical Agents o Creating a Physical Agent o ODI Agent Parameters o Launching a Stand-Alone Agent: Examples o Stopping the ODI Agent o Deploying and Configuring a Java EE Agent o Load Balancing: Example o Important Guideline 5 o Infrastructure with Agents: Example o Defining Agents: Example o Special Case: Fragmentation Problem o Special Case: Important Guideline 6 o Special Case: Defining the Physical Architecture o Special Case: The Infrastructure o Special Case: Physical Architecture in ODI o Agenda o Planning the Topology o Matrix of Logical and Physical Mappings o Summary

• Describing the Physical and Logical Architecture

o Objectives o Agenda o What Topology Navigator Contains o Topology Navigator: Overview

97تاریخ به روزرسانی : شهریور

o Review: Context Connects Logical to Physical o Objects You Create in the Practice o Defining a Context o Agenda o Physical Architecture View o Prerequisites for Connecting to a Server o Important Note o Creating a Data Server o Creating a Data Server: JDBC o JDBC Driver o JDBC URL o Creating a Data Server: JNDI o Testing a Data Server Connection o Creating a Physical Schema o Agenda o Logical Architecture and Context Views o Creating a Logical Schema o Creating a Logical Agent o Editing a Context to Link Logical and Physical Agents o Summary

• Setting Up a New ODI Project

o Objectives o Agenda o What Is a Project? o Oracle Data Integrator Projects: Overview o How to Use ODI Projects in Your Work o Creating a New Project o Agenda o What Is a Folder? o Creating a New Folder o Organizing Projects and Folders o Agenda o What Is a Knowledge Module? o Types of Knowledge Modules o Which Knowledge Modules Are Needed? o Knowledge Modules: Examples o Importing Knowledge Modules

97تاریخ به روزرسانی : شهریور

o Replacing Existing KMs o Knowledge Module Editor o Editing a Knowledge Module o Agenda o Exporting and Importing o Exporting an Object o Importing an Object o ID Numbers: Overview o Import Types o Choosing the Import Mode o Import Report o Agenda o What Is a Marker? o Tagging Objects with Markers o Removing Markers o Marker Groups o Project and Global Markers o Creating a Marker Group o Summary

• Oracle Data Integrator Model Concepts

o Objectives o What Is a Model? o Agenda o Relational Model o Relational Model: Tables and Columns o Relational Model: Keys o Relational Model: Foreign Keys o Relational Model: Constraints o Relational Model: Indexes o Relational Model Support in ODI o Additional Metadata in ODI o Flex Fields o Agenda o What Is Reverse-Engineering? o Methods for DBMS Reverse-Engineering o Other Methods for Reverse-Engineering o Standard Versus Customized Reverse-Engineering

97تاریخ به روزرسانی : شهریور

o Reverse-Engineering Life Cycle o Agenda o Creating a Model by Reverse-Engineering o Step 1: Creating and Naming a New Model o Note: Creating and Naming a New Model o Step 2: Defining a Reverse-Engineering Strategy o Step 3: Starting the Reverse-Engineering Process o Using RKM for Customized Reverse-Engineering o Selective Reverse-Engineering o Step 4: Fleshing Out Models o Shortcuts o Smart Export and Import o Summary

• Organizing ODI Models and Creating ODI Datastores

o Objectives o Agenda o What Is a Model Folder? o Creating a Model Folder o What Is a Submodel? o Creating a Submodel o Organizing Datastores into Submodels o Setting Up Automatic Distribution o Agenda o Creating Datastores o Creating a Datastore in a Model o Adding Columns to a Datastore o Agenda o What Is a Constraint in ODI? o Constraints in ODI o Creating a Mandatory Column o Agenda o Creating a Key o Checking a Key o Creating a Reference o Creating a Simple Reference o Creating a Complex Reference o Checking a Reference

97تاریخ به روزرسانی : شهریور

o Agenda o Creating a Condition o Checking a Condition o Agenda o Audit/Explore: When and Why o Audit/Explore Process: Overview o Agenda o Displaying the Contents of a Datastore o Viewing the Distribution of Values o Analyzing the Contents of a Datastore o Agenda o Defining Business Rules in ODI o From Business Rules to Constraints o Deducing Constraints from Data Analysis o Testing a Constraint o Auditing a Model or Datastore o Reviewing Erroneous Records o Summary

• ODI Mapping Concepts

o Objectives o Agenda o What Is a Mapping? o Business Rules for Mappings o Where Are the Rules Defined? o Agenda o What Is an Expression? o What Is a Join? o What Is a Filter? o What Is a Lookup? o What Is a Set? o What Are Some of the Others? o New with Patch: Pivot and Unpivot o Agenda o How Does ODI Implement Business Rules? o Business Problem o Implementing the Rules o Integration Process

97تاریخ به روزرسانی : شهریور

o Process Details o Process Implementation: Example o Process Implementation: Example o Process Implementation: Example o Agenda o What Is the Staging Area? o Execution Location o Agenda o From Business Rules to Processes o Knowledge Modules o What Is a Knowledge Module? o Code Generation o KM Types Used in Mappings o Agenda o Purpose of a Mapping o What Is an Expression? o Creating a One-to-One Mapping o Creating and Naming a Mapping o Defining the Target Datastore o Multiple Targets o Defining the Source Datastore o Connecting the Ports to Make the Map o Defining the Expressions o Valid Expression Types o Saving the Mapping o Running the Mapping o Summary

• Designing Mappings

o Objectives o Agenda o Multiple-Source Datastores o Creating a Join Manually o Advanced Joins o Types of Joins o Setting Up a Join o Creating Lookups o Using Lookups

97تاریخ به روزرسانی : شهریور

o Agenda o Filters in ODI o Defining a Filter Manually o Setting Up a Filter o Agenda o Physical Mapping Diagram o Flow in the Physical Diagram o What Defines the Flow? o Scenario o Basic Process o Agenda o Purpose of a Staging Area o Placing the Staging Area o Important Note o Specifying the Staging Area o Agenda o Options for Expressions o Setting Options for Expressions o Disabling an Expression o Enabling a Mapping for Inserts or Updates o Agenda o Execution Location and Syntax o Why Change the Execution Location? o Changing the Execution Location o ODI Mapping Execution Simulation o Agenda o Which KMs for Which Flow? o Knowledge Modules: Additional Information o Identifying IKMs and LKMs o IKMs and LKMs: Strategies and Methods o Specifying an LKM o Specifying an IKM o Common KM Options o Flow: Example 1 o Flow: Example 2 o Flow: Example 3 o Summary

97تاریخ به روزرسانی : شهریور

• Mappings: Monitoring and Troubleshooting o Objectives o Agenda o Operator Navigator: Viewing the Log o Using Operator Navigator o Hierarchy: Sessions, Steps, Tasks o Viewing Details of Sessions, Steps, and Tasks o Monitoring Execution of an Mapping o Troubleshooting a Session o Identifying the Error o Reviewing the Code o Fixing the Code and Restarting the Session o Fixing the Mapping o Keys to Reviewing the Generated Code o Agenda o Common Errors and Symptoms o Important Note o Tips for Preventing Errors o Using Attribute Panel for Quick Edits o Summary

Designing Mappings: Advanced Topics 1 o Objectives o Agenda o Business Rules in Mappings o Business Rule Elements o More Elements o Expression Editor o Agenda o Using a Variable in Code o Binding Versus Substitution o Case Sensitivity o Agenda o Defining a Dataset o Using Set-Based Operators o Example of SET: UNION o Agenda o Types of Sequences

97تاریخ به روزرسانی : شهریور

o Support for Native Sequences o Creating a Native Sequence o Referring to Sequences o Note: Sequences Updated by Agent o Using Standard Sequences in Mappings Correctly o Using ODI Standard Sequences in Mappings o Populating Native Identity Attributes o Sequences: Best Practices o Automatic Temporary Index Management o Tracking Variables and Sequences o How Variable and Sequence Tracking Works o Variable Actions o Definition Tab of Session Step or Session Task o Summary

• Designing Mappings: Advanced Topics 2

o Objectives o Agenda o Partitioning o Definition in Datastore After Reverse-Engineering o Using Partitioning in a Mapping o Agenda o Reusable Mappings o Using Reusable Mappings: Example o Derived Select (Subselect) for Reusable Mappings o Agenda o What Is a User Function? o Why Use User Functions? o Properties of User Functions o Using User Functions o Creating a User Function o Defining an Implementation o Syntax and Implementations o User Functions at Design Time o User Functions at Run Time o Note: Functions in Execution Log o Agenda o Using Substitution Methods

97تاریخ به روزرسانی : شهریور

o Substitution Methods: Examples o Agenda o Description of KM Steps o Details of the Steps o Setting KM Options o Developing Your Own KM: Guidelines o Complex File Technology o Summary

• Using ODI Procedures

o Objectives o Agenda o What Is a Procedure? o Procedure: Examples o Creating Procedures: Overview o Agenda o Creating a New Procedure o Agenda o Creating a Command o Arranging Tasks in Order o Which Parameters Should Be Set? o Valid Types of Commands o More Elements o Why Use a Source Command? o Agenda o Types of Options o Creating a New Option o Making a Command Optional o Using an Option Value in a Command o Agenda o Procedure Execution o Using the Operator Navigator to View Results o Summary

• Using ODI Packages

o Objectives o Agenda o What Is a Package?

97تاریخ به روزرسانی : شهریور

o Creating a Package o Agenda o Creating and Naming a Package o Package Diagram o Package Diagram Toolbar o Agenda o Package Steps o Creating a Package Step o What Is an ODI Tool? o Creating an ODI Tool Step o Tool Steps: Best Practices o Agenda o Sequencing Steps o A Simple Package o Sequencing Package Steps o Agenda o Executing a Package o Agenda o Basic Step Types o Advanced Step Types o Agenda o Creating Model, Submodel, and Datastore Steps o Models, Submodels, and Datastore Steps o Agenda o Creating a Variable Step o Variable Steps o Agenda o Controlling Execution o Error Handling o Creating a Loop o The Advanced Tab o Summary

• Step-by-Step Debugger

o Objectives o Agenda o Overview o Agenda

97تاریخ به روزرسانی : شهریور

o Process Overview o Starting a Session in Debug mode o Specifying Debug Properties o Control Execution Flow o Screen Step Numbering o Agenda o New Functionalities o Benefits for End Users o Agenda o Debug Toolbar o Toolbar: Current Cursor o Toolbar: Get Data o Toolbar: Step Into o Toolbar: Run to Task End o Toolbar: Run to Next Task o Toolbar: Run to Step End o Toolbar: Run to Next Step o Toolbar: Pause o Toolbar: Resume o Summary

• Managing ODI Scenarios

o Objectives o Agenda o What Is a Scenario? o Properties of Scenarios o Agenda o Scenario-Related Tasks o Generating a Scenario o Regenerating a Scenario o Generation Versus Regeneration o Executing a Scenario from the GUI o Executing a Scenario from a Command Line o Executing a Scenario from a Package o Exporting a Scenario o Agenda o Preparing Scenarios for Deployment o Automating Scenario Management

97تاریخ به روزرسانی : شهریور

o Scheduling the ODI Scenario o Scheduling ODI Scenario with External Scheduler o Managing Schedules o Summary

• Using Load Plans o Objectives o Should You Organize Executions with Load Plans? o What Are Load Plans? o Load Plan Editor 5 Load Plan Steps o Defining the Restart Behavior o Are Load Plans Substitutes for Packages or Scenarios? o Benefits of Using Load Plans o Handling Failed Load Plans o Summary

• Enforcing Data Quality with ODI

o Objectives o Agenda o Why Data Quality? o When to Enforce Data Quality o Data Quality in Source Applications o Data Quality Control in the Integration Process o Data Quality in the Target Applications o Agenda o Data Quality Business Rules o From Business Rules to Constraints o Agenda o Data Quality System: Overview o Static and Flow Controls: Differences o Data Quality Control: Properties o Synchronous Control o What Is a Constraint? o What Can Be Checked? o Enforcing Data Quality in a Mapping o Agenda o Setting Up Static or Flow Control

97تاریخ به روزرسانی : شهریور

o Enabling Static or Flow Control o Agenda o Setting the Physical Options o Setting the Logical Options o Agenda o Selecting Which Constraints to Enforce o Selecting Which Constraints to Check o Differences Between Control Types o Agenda o Reviewing Erroneous Records o EnterpriseDataQuality Tool o Using the EDQ Tool o Summary

• Working with Changed Data Capture

o Objectives o Why Changed Data Capture? o CDC Techniques o Changed Data Capture in ODI o Journalizing Components o CDC Infrastructure in ODI o Simple Versus Consistent Set Journalizing o Limitations of Simple CDC Journalizing: Example o Consistent CDC Journalizing o Consistent CDC: Infrastructure o Setting Up Journalizing o Setting CDC Parameters: Example o Adding a Subscriber: Example o Starting Journal: Example o Journalizing Status o Viewing Data/Changed Data: Example o Using Changed Data o Oracle GoldenGate Integration o Oracle GoldenGate Integration in ODI 12c o Summary

• Advanced ODI Administration

o Objectives

97تاریخ به روزرسانی : شهریور

o Agenda o Introduction to ODI Security Navigator o Security Concepts: Overview o Defining Security Policies o Creating Profiles o Using Generic and Nongeneric Profiles o Built-in Profiles o Creating Users o Assigning a Profile to a User o Assigning an Authorization by Profile or User o Defining Password Policies o Setting User Preferences o ODI Security Integration: Overview o Implementing External Authentication (OPSS) o Implementing External Authentication (OPSS): Switching the Authentication Mode o Implementing External Password Storage o Agenda o Types of ODI Reports o Generating Topology Reports o Generated Topology Report: Example o Version Comparison Report: Example o Generating Object Reports o Agenda o Integration of ODI with Enterprise Manager o Java EE Agent and Enterprise Manager Configuration with WebLogic Domain:

Overview o Using ODI Console: Example

97تاریخ به روزرسانی : شهریور