presentation ogg workshop

8/13/2019 Presentation OGG Workshop

1/82

Oracle PTS GoldenGate Workshop for partners


2/82

Agenda

Introduction

Use Cases

Break / VirtualBox Installation & Import

Architecture Configuration Overview

ands!on "a#s


3/82

Oracle $olden$ate %volution

Company Strengthand Serice

!apid Gro"th inStrategic Partners

#$$% customers&&& '$$$% solutions implemented( in )# countries*sta+lished, -oyal

Customer .ase

GoldenGate Soft"areesta+lished in /00#

1c2uired +yOracle in 3$$0 Glo+al sales andsupport


4/82

$olden$ate is trategic to Oracle

'

' .est4in4class leader in real4time data solutions

' Complements e5isting Oracle products

' Continuous 1aila+ility for heterogeneous

systems

' !eal4time data access for !eporting

' !eal4time data for .I, *P6, *5adata

' 7ero4do"ntime migrations 8 upgrades to

Oracle 9ata+ase and 1pplications

' Over 400 customers with 4,000+ implementations

across Fortune 500 companies: Financial Services,

Communications, Healthcare, Public Sector, Retail

!tilities in"ustries

' Top ) of # largest commercial +anks' Top ) of ) +usiest 1T6 net"orks

' Top : of /$ financial data serices companies

' Top ' of # telecommunications proiders

' Top ) of # largest food ; drug stores


5/82

Industr( )roof )oints

#Oracle will become more competitive in "ata inte$ration tools an"ma% enhance its hi$h&availabilit%pro"ucts b% bu%in$ 'ol"en'ate()

*e" Frie"man, 'artner

*his is a critical reuirement to enable hi$h volume "ata etractionto support real&time "ata warehousin$ an" -., as well as master"ata mana$ement an" other operational use cases()

Rob /arel, Forrester

#.t1s uite a catch 2or Oracle in that it1s a si$ni2icant a""ition to its"ata warehousin$ an" -. port2olio()

3ames /obielus, Forrester


6/82

Customers *emand Continuous +eal ,ime *atahile-o"ering IT Costs and Gaining Operational *fficiencies

!eal4Time Information 1ccess for

Intelligence ; 9ecisioning

'Instantl( availa#le *ata for +eporting'Access to -e( Information for Anal(sis

'Across eterogeneous (stems

!eal4Time

.usiness

Operations

Continuous 1aila+ility of

Critical 1pplications and 9ata

'Continuous Uptime in event of disaster'.o downtime during planned outage'"oad #alancing & *ata distri#ution

-o"er IT Spend ; Improe *fficiencies

'Choose #est s(stem for need'oderni0e "egac( (stems

'Offload for reporting


7/82:

Oracle $olden$ateThe Solution for *nterprise4"ide !eal Time 9ata =eeds

!eal4timeinformation

Oracle 'ol"en'ate "elivers real&time access o2 real&time in2ormation, enablin$companies to "ramaticall% improve the availabilit%, reliabilit%, an" per2ormance

o2 critical "ata across enterprise s%stems(

atabase an"applications, 6ie"sources, "istribute"s%stems, le$ac%,

O7*P, O78P

6ission Critical8pplications ata, -usiness

.ntelli$ence,Reportin$ 2orCustomers,Partners 9mplo%ees

!eal4time 1ccess


8/82

Oracle )roducts for *ata ovementComparing Ho" They Work

1ctie 9ataGuard

9irect

6emory 1ccess

!ead

On49isk -ogs?ast S@-

9irect

Write to -ogs

!edo in

6emory

.uffer

GoldenGate

9ata

Integrator

9isaster !ecoery ; 9ata Protection

!eal Time 9ata Integration ; High 1aila+ility

S@- @uery Set4+ased,

Comple5 S@-

9ata Integration for 9ata Warehouse ; SO1H*T*!OG*=*OAS


9/82

Complementar( and Used ,ogether1ctie 9ata Guard and GoldenGate

0

' *nterprise4"ide heterogeneous

replication' 7ero do"ntime operations' =on4inasie +y reading data+ase

logs' Supports actie4actie scenarios' *nsures transactional consistency' High olumeB lo" latency' Guaranteed deliery across "ide area

net"orks

9ata 9istri+ution 8

Synchroniation

Oracle GoldenGate

Oracle 1ctie9ata Guard

Oracle 9. Primary Oracle 9. Stand+y

Heterogeneous

9istri+uted

Su+set

!eplicas

OracleGoldenGate

' ?ast failoer to physical stand+y

data+ase' ?astest solution for Oracle' Oracle 9ata+ase only' 1llo"s stand+y to +e open for reads

to leerage customer inestment' Transparent data protection to repair

corrupted +locks on primary or

stand+y

9isaster !ecoery ;

9ata Protection

Oracle 1ctie 9ata Guard


10/82

Complementar( and Used ,ogether1ctie 9ata Guard and GoldenGate

/$

Central Hub 8ctive ata 'uar"Ph%sical Stan"b%

'ol"en'ateSource

*ar$et

'ol"en'ate *ar$ets

'ol"en'ate*ar$et

'ol"en'ateSource

*ar$et

*5ample of ho" aglo+al hu+ ; spokemanufacturing

operation may +edeployed using +oth1ctie 9ata Guardand GoldenGate


11/82

Complementar( and Used ,ogether9ata Integrator *nterprise *dition and GoldenGate

//

' 1astest real!time solution' u#!second latenc( for real!time feeds' $uarantee deliver( eliminates data loss' %liminates down!time for migration and

upgrades' "east intrusive to source s(stems' "everage %",/%," for complex

transformation

!eal4Time 9ata Integrationand !eplication

Oracle GoldenGate

' $UI design environment for %,"

developers' 1astest %!", olution' Optimi0ed %,!#ased transformation for

high volume transformations' *ata lineage for improved managea#ilit(' Integrates to *ata 2ualit(

.ulk 9ata 6oementand Transformation

Oracle 9ata Integrator*nterprise *dition

Oracle GoldenGate

Oracle 9ata Integrator

*nterprise *dition

!eal4time 9ata

*4-T

Transformation

Heterogeneous Sources Heterogeneous Targets


12/82

/3

Oracle +eal ,ime *ata IntegrationOracleDs Ani2ue Offering for !eal Time .usiness Intelligence

Oracle GoldenGate'+eal time extracts from transactional s(stems

' .on!invasive on sources

'Continuous streaming load into O* chema of target

' "atenc( in seconds

Oracle 9ata Integrator **'igh )erformance 3%!",4 on target data warehouse

' )eriodic mini!#atches 567 min8' ,ransform in the *ata#ase' .ever go #ack to sources

*6P

OracleGoldenGate

Oracle 9ataIntegrator

*6P 9*PT

9I6

?1CT

9I6

9I69I6

O9S Schema 9W Schema

On49isk -ogs

Source /

On49isk -ogs

Source 3

OracleGoldenGate

*6P 9*PT

9*PT


13/82

+eal!time Business *elivers Value & +OI

0$E reduced recoery time formission4critical transactional

applicationBank of America

WorldDs .usiest 1T6 =et"ork!emains Continuously

1aila+leVocaLINK

F productiity gains in

manufacturing plant "ith real4

time dataAMD

/$$E aaila+ility duringphased upgrade for 3'5:critical C!6 application

HSN

/$$E paperless enironmentdries efficiency and improes

patient care across hospitalMontefiore

Processing > / .illionTransactions each year, and

ero outagesSwedbank


14/82

6oement 6anagement Integration

Speed Su+second -atency

olume Thousands of TPS

-og4+ased Capture

=atie, -ocal 1pply

*fficient IO and.and"idth Asage

.idirectional

Group Transactions

.ulk Operations

Compression

One4to46any,

6any4to4One Cascade

Transaction Integrity

Transparent Capture

Guaranteed 9eliery

Conflict 9etection,!esolution

9ynamic !oll+ack

Incremental T96

Initial 9ata -oad

GAI4+ased 6onitoringand Configuration

Proactie 1lerts

*ncryption

!eal4Time 9eferred or

.atch *ent 6arkers

Heterogeneous 9ataSources

6apping

Transformation

*nrichment

9ecoupled 1rchitecture

Ta+le, !o", Column?iltering

6-, 1SCII, S@-?ormats

@ueue Interface

Stored Procedures

Aser *5its

*T- Integration Jaa8J6S Integration

Oracle $olden$ate Advantages


15/82

Oracle $olden$ate9 *ata#ases and )latforms

9ata+ases O8S and Platforms

Capture9OracleIB *B:icrosoft 2" erver(#ase A%Ingres,eradata

%nscri#e2"/)2"/;

*eliver(9All listed a#ove(2"< ) .eoview< .ete00a

An( O*BC compati#le data#ases%," products= message >ueues or topics

?indows :@@@< :@@< ;)

"inux

un olaris

) .ontop

)!U;

) ,+U ) OpenV

IB AI;

IB 0/O

IB O/D@

IB O/@@


16/82

Oracle $olden$ate ,echnolog( *ifferentiators

16/F

Oracle GoldenGate provides low-impactcapture, routing, transformation, and

delivery of database transactions across heterogeneous environments in real-time

Performance

*5tensi+le ;

?le5i+le

!elia+le

Key 9ifferentiatorsL

=on4intrusie, -o" Impact, Su+4second

latency

Open, modular architecture 4 Heterogeneous

sources ; Targets

6aintains Transactional Integrity 4 !esilient

against interruptions and failures


17/82

Agenda

Introduction

Use Cases



ands!on "a#s


18/82

Oracle $olden$ate Use Cases%nterprise!wide olution for +eal ,ime *ata .eeds

7o$ -ase", Real&

*ime Chan$e ataCapture

Heterogeneous

Source Systems

*9WO9S

*9W

9isaster !ecoery,

9ata Protection

7ero 9o"ntime

6igration and

Apgrades

Operational!eporting

!eal4time .I

Stand+y

MOpen ; 1ctieN

!eporting

9ata+aseOGG

*T-

*T-

@uery Offloading

9ata 9istri+ution

' tandardi0e on ingle,echnolog(for ultiple .eeds

' *eplo( for Continuous

Availa#ilit( and+eal!time

*ata Access for +eporting / BI

' ighl( 1lexi#le

' 1ast *eplo(ments' "ower ,CO & Improved +OI


19/82

/0

-e( )la(s for Oracle $olden$ate


20/82

2uer( Offloading Use Case9ata+ase TieringL Sae 6illions and 9rie !eenue

Business Challenges9 %nsure continuous availa#ilit( of Air ,ravel

hopping %ngine 5A,%8 throughout

upgrades and migrations Optimi0e s(stem performance to handle

growth and scale< while reducing ,CO via

platform changes "ow latenc( data movement #etween O",)

5E#ookersF8 and search data#ase 5ElookersF8$olden$ate olutions9 Gero *ata#ase *owntime during hardware

and data#ase migration for A,% *ata#ase ,iering insures high availa#ilit(< top

performance and lower costs +eal!,ime *ata Integration for ElookersF

>uer( activit( on lower cost platform

+esults9 H@ ,CO reduction J millions of dollars in

savings igher customer satisfaction ! improved

response times and availa#ilit(

GoldenGateprovided the glue to move the data across

systems, evolving our overall approach in parallel with the

future of online travel commerce.

- James arding, !" of #ystems "lanning $ "erformance,

#abre

/#F 6yS@- 9ata+ases on -inu5

9ata+ase Tiering *na+les Top

Performance, Anlimited Scala+ility

Sche"ule

8vailabilit% !p"atesFare Rule !p"ates

Oracle 9ata+ases

-ookups

GoldenGate Transaction Apdates

Ap to $$,$$$ p8hour, /&F T.8day

8ir *ravelShoppin$

Sche"ule 8vailabilit% Chan$es

8ccounts -illin$

3$


21/82

Continuous Availa#ilit( Use Case9ata 9istri+ution ; *nterprise4Wide 9ata 6oement

CO6P1= O*!I*W Head2uartered in 7urich and .asel,

S"iterland, A.S is one of the "orldQsleading financial firms& It seres adiscerning, international client +ase for"ealth management, inestment +ankingand asset management& In S"iterland,A.S is the market leader in retail andcommercial +anking&

CH1--*=G*S 8 OPPO!TA=ITI*S

-arge, Comple5 ; Heterogeneousenironment for /$$ +ack officeapplications

=umerous installations that re2uire afle5i+le solution& MOracle, Sy+ase ; 6SS@- SererN for +oth production anddeelopment&

Oracle P!OI9*SL' 9ata distri+ution among internal applications

' 9ata distri+ution for read4only archiing andreporting

' 9ata+ase High 1aila+ility and 9isasterTolerance

' 9ata+ase rolling upgrade8actie migration

' Topology includes one4"ay and multi4masteron Oracle instances

!*SA-TS

!eplaced Sy+ase !eplication Sererproduct and standardied on GoldenGatefor all data moement

!educed costs +y eliminating mid4tierserers

!eplicating all heterogeneous data+asesacross the enterprise protects againstdo"ntime&

3/


22/82


23/82

*ata is not a #usiness pro#lemK It is the foundation of

our a#ilit( to #e profita#le in a rapidl( changing

marketplaceL

- ric "ost, +irector of +ata %arehousing,

iberty (utual

+eal ,ime Business Intelligence Use CaseActive *ata ?arehouse Improves Customer ervice

Active %nterprise Intelligence

9.3 -AW

9.3

6ainframe

Operational Systems

Teradata Warehouse

Customer ClaimsProcessing

MS1S .INual 8ctive

.usiness ChallengesL )rovide up!to!second data in centrali0ed

enterprise data warehouse for #usiness users5customer claims processing for maMor incidents8

Integrate data from multiple operational s(stems5*B: on 0/O and "U?8

"everage existing %," investment to achievenear real!time data feedsL

GoldenGate SolutionL

+eal!,ime *ata ?arehousing captures N@million transactions per da( from heterogeneousoperational sourcesL

+eal!,ime C*C co!exists with Informatica %,"for data re>uiring heav( transformationsL

!esultsL

+educed claims litigation costs #( :@ !ena#led #( faster and more responsiveemplo(ee intelligence on claims dataL

Improved resource utili0ation efficienc( #( 7

anagement team can now d(namicall( monitorreserve threshold to increase profita#ilit(L

3)


24/82

Agenda

Introduction

Use Cases



ands!on "a#s


25/82

VirtualBox Installation & Import

Cop( #oth ?orkshop *V*s to a single director( on (our local harddrive

*ownload and install lateset VirtualBox version from http9//virtual#oxLorg .ote9 Virtual#ox vL:LH for ?indows ;) is included on *V*

After Installation9 Start irtual.+o5

?ile 4> Import 1ppliance

Choose &of file


26/82

Agenda

Introduction

Use Cases



ands!on "a#s


27/82

Oracle $olden$ate *ata Capture and *eliver(

Oracle $olden$ate,ransactional *ata anagement9

)rimaril( used for change data capture and deliver( from data#ase

transaction logs

Can optionall( #e used for initial load directl(from data#ase ta#les %speciall( useful for s(nchroni0ing heterogeneous data#ases

*ata#ase!specific methods ma( #e prefera#le for homogeneous

configurations


28/82

3

ow It ?orks9 odular Architecture

Source

Database(s)

Target

Database(s)

LAN / WAN /Internet(TCP/IP)

Route: Data is compress ed, encrpted !or routin" totar"ets#

Capture: Committed c$an"es are captured (and can%e !i&tered) as t$e occur % readin" t$e transaction

&o"s#

Capture

Trai& !i&es: 'ta"es and ueues data !orroutin"#

'ource Trai&

De&ier: App&ies data *it$ transactioninte"rit, trans!ormin" t$e data as

reuired#

Tar"et Trai&

De&ier

Bi-directional

'ource Trai&Tar"et Trai&

De&ier Capture


29/82

Change*ata Capture & *eliver(

TransactionLo"

+tract 'ererCo&&ector

Rep&icatTrai&

-ana"er -ana"er

'ourceData%ase

Tar"etData%ase

Net*or.(TCP/IP)


30/82

Change*ata Capture & *eliver( using a *ata )ump

Transaction Lo"

+tract 'ererCo&&ector

Rep&icatRemoteTrai&

-ana"er -ana"er

'ourceData%ase

Tar"etData%ase

DataPump

Loca&

Trai&

Net*or.(TCP/IP)


31/82

)repare %nvironment9 anager ! Overview

)erforms s(stem management and monitoring tasks tarting $olden$ate erver Collector processes

tarting *(namic erverCollector< +eplicat or $$CI

processes

%rror and lag reporting

$olden$ate trail management / purging

)arameter 1ile

mgrLprm file in $$ L/dirprm director(

%vent information written to ggserrLlog file

tart with9GGSCI> START MANAGER

-ana"er


32/82

Change Capture9 %xtract ! Overview

%xtract can #e configured to9 Capture changed data from data#ase logs

*istri#ute data from local trails to remote s(stems 5data

pump8

Capture data directl( from source ta#les for initial dataload

+tract


33/82

Configuration ,asks J Change Captureource (stem

Add a primar( %xtract 5reading from sourcetransaction logs8 with an associated parameter file

Optionall(< add a local trail and a data pump

%xtract 5reading from the local trail8 with an

associated parameter file Add a remote trail tart the %xtract5s8


34/82

*ata )umps ! Overview

*ata is stored in a local trail file on the source s(stem A second %xtract process< the *ata )ump9

+eads this trail and sends to one or more targets

anipulates the data or passes it through without change

+easons for using9A safeguard against network or target failures

,o #reak complex filtering and transformation into phases

,o consolidate data from man( sources

,o s(nchroni0e one source with multiple targets

DataPump


35/82

*ata )umps J One to an( ,rails

Primar+tract

Trai&DataPump

Trai&

Trai&

Trai&


36/82

*ata )umps J One to an( ,arget (stems

Primar+tract

Trai&Data

Pump Trai&

Trai&

Trai&

DataPump 1

DataPump 0


37/82

Change *eliver(9 erver Collector

On the ,arget (stem9A erver Collector process reassem#les and writes the data

to a $olden$ate remote trail

A +eplicat process reads this trail and applies it to the target

data#ase

'ererCo&&ector


38/82

Change *eliver(9 +eplicat

+eplicat can9 +ead data out of $olden$ate trail files

)erform *ata 1iltering

,a#le< row< operation

)erform data transformation

)erform data#ase operations Must as (our application

performed them

Rep&icat

Ch * li C fi ti , k


39/82

)0

Change *eliver( Configuration ,asks

,arget (stem

Create a checkpoint ta#le in the target data#ase *B"O$I.

A** C%C-)OI.,,AB"%

Create a parameter file for +eplicat

%*I, )A+A

Add (our initial +eplicat checkpoint into $olden$ate trails A** +%)"ICA,

tart the +eplicat process ,A+, +%)"ICA,

.est

Practice


40/82

'$

%xtract ,rails and 1iles ! Overview

%xtract writes data to an( of9 +emote trail 5+,,+AI"8

+emote file 5+,1I"%8

"ocal trail 5%;,,+AI"8

"ocal file 5%;,1I"%8

%xtract trails and files are unstructured< with varia#le lengthrecords I/O performed using large #lock writes

%xtract writes checkpoints for trails during change capture9 $uarantees no data lost during restart

ultiple +eplicat processes ma( process the same trail %xtract does not write checkpoints for files


41/82

'/

%xtract ,rails and 1iles ! *istri#ution

%xtract can write ,o local trails< then distri#ute over I) with a *ata )ump to

remote trails

,o multiple trails

1or distri#ution to multiple s(stems/disk storage devices

1or parallel processing #( downstream processes

,rails and files can #e transported online using ,C)/I)or sent in #atch using an( file transfer method


42/82

'3

%xtract ,rails and 1iles ! Contents

%ach record in the trail contains an operation that has#een committed in the source data#ase

,ransactions are output in commit order

Operations in the transaction are grouped together< inthe order the( were applied B( default< onl( the primar( ke( and changed columns are

recorded

1lags indicate the first and last records in eachtransaction


43/82

%xtract ,rails and 1iles ! Cleanup

,rail files can #e purged once consumed

,emporar( storage re>uirement is small if processes keep

pace

Configure anager to purge used trail data .estPractice


44/82

''

,rails ! $olden$ate *ata 1ormat

B( default< trails are formatted in the $olden$ate *ata1ormat

%ach ,rail file has a trail file header and trail records

eader Info9 Compati#ilit( "evel Identifies the trail file format #( $olden$ate version num#ers

Allows customers to use different versions of $olden$ate %xtractuence .um#er 5C.8 Identifies the se>uence in which transactions were committed

*ata#ase platform independent

ore efficient than using heterogeneous data#ase!suppliedtransaction num#ers


45/82

Viewing ,rail 1ile Contents J "ogdump utilit(

,he "ogdump utilit( allows (ou to *ispla( or search for information that is stored in $olden$ate

trail files

ave a portion of a $olden$ate trail to a separate trail file

tart "ogdump from $olden$ate installation director(using logdump command

"ogdump is documented in the Oracle $olden$ate

,rou#leshooting and ,uning $uide

%xample9 Logdump> open dirdat/rt00000

I iti l " d


46/82

Initial"oad

+tract Rep&icat

-ana"er -ana"er

'ourceData%ase

Ta%&esTar"et

Data%ase

Net*or.(TCP/IP)

'ererCo&&ector

i&es

2r D3 3u&.Load 4ti&it

$olden$ate initial load methods9 *irect "oad ! %xtract sends data directl( to +eplicat to appl( concurrentl( using 2" *irect Bulk "oad 5Oracle8 ! +eplicat uses Oracle 2""oader A)I to improve performance 1ile to +eplicat 5%xtract writes to a file that +eplicat applies using 2"8 1ile to data#ase utilit( 5%xtract writes to a file formatted for a *B #ulk load utilit(8

I iti l " d *i t " d


47/82

Initial "oad9 *irect "oad

6anager

*5tract !eplicat

6anager

199 *T!1CT , SOA!C*IST1.-*

*5tract parametersL

!6TT1SK !*P-IC1T, G!OAP

199 !*P-IC1T , SP*CI1-!A=

Source

9ata+aseTarget

9ata+ase

I iti l " d *i t B lk " d 5t O l 8


48/82

Initial "oad9 *irect Bulk "oad 5to Oracle8

6anager

S@--oader

1PI

6anager

199 *T!1CT , SOA!C*IST1.-*

*5tract parametersL

!6TT1SK !*P-IC1T, G!OAP

199 !*P-IC1T , SP*CI1-!A=

!eplicat parametersL

.A-K-O19

*5tract !eplicatSource

9ata+ase

Source

9ata+aseOracle

Target

I iti l " d 1il t + li t


49/82

Initial "oad9 1ile to +eplicat

199 *T!1CT *5tract parametersL

SOA!C*IST1.-*

!6TT!1I-

?iles

6anager

*5tract !eplicat

Source

9ata+aseTarget

9ata+ase

I iti l " d 1il t * t # Utilit


50/82

Initial "oad9 1ile to *ata#ase Utilit(

199 *T!1CT *5tract parametersL

SOA!C*IST1.-*

!6T?I-*

?O!61T1SCII .CP or S@--O19*!

S@--oader

.CP

SSIS

?ile

?ile

?ile

6anager

*5tract

Source

9ata+aseTarget

9ata+ase

Online versus Batch "oad


51/82

Online versus Batch "oad

Change data capture & deliver( can #e run either continuousl( 5online8

or as a special run 5#atch run8 to capture changes for a specific periodof timeL

Initial load is alwa(s a special run 5#atch run8L

Ch k i ti


52/82

.egin, T /

Insert, T /

.egin, T 3

Apdate, T /

Insert, T 3

Commit, T 3

.egin, T )

Insert, T )

.egin, T '

Commit, T)

9elete, T '

Capture< )ump< and *eliver( save positions to a checkpoint file so the(

can recover in case of failure

Capture Commit Ordered

Source TrailSource

9ata+ase

.egin, T 3

Insert, T 3

Commit, T3

.egin, T )

Insert, T )

Commit, T)

Start of Oldest Open MAncommittedNTransaction

Current !eadPosition

Capture

Checkpoint

CurrentWritePosition

Checkpointing

Ch k i ti


53/82

Capture< )ump< and *eliver( save positions to a checkpoint file so the(

can recover in case of failure

Capture PumpCommit Ordered

Source Trail

Commit Ordered

Target TrailSource

9ata+ase

.egin, T /

Insert, T /

.egin, T 3

Apdate, T /

Insert, T 3

Commit, T 3

.egin, T )

Insert, T )

.egin, T '

Commit, T)

9elete, T '

.egin, T 3

Insert, T 3

Commit, T3

.egin, T )

Insert, T )

Commit, T)

.egin, T 3

Insert, T 3

Commit, T3



Capture

Checkpoint


Current

!eadPosition

PumpCheckpoint

Current

WritePosition

Checkpointing

Ch k i ti


54/82

Checkpointing

Capture< )ump< and *eliver( save positions to a checkpoint file so the( can

recover in case of failure

Capture9elieryPumpCommit Ordered

Source Trail

Commit Ordered

TargetTrailSource

9ata+aseTarget

9ata+ase

.egin, T /

Insert, T /

.egin, T 3

Apdate, T /

Insert, T 3

Commit, T 3

.egin, T )

Insert, T )

.egin, T '

Commit, T)

9elete, T '

.egin, T 3

Insert, T 3

Commit, T3

.egin, T )Insert, T )

Commit, T)

.egin, T 3

Insert, T 3

Commit, T3



Capture

Checkpoint


Current

!eadPosition

PumpCheckpoint

Current

WritePosition

Current

!eadPosition

9elieryCheckpoint

A d


55/82

Agenda

Introduction

Use Cases


Architecture

Configuration Overview

ands!on "a#s

Configuring Oracle $olden$ate


56/82

Configuring Oracle $olden$ate

0# Per!orm Initia& Load (arious met$ods)

1# Prepare t$e +nironment(Insta&& 2rac&e 5o&den5ate, +na%&e Transaction Lo""in")

Tar"et

Data%ase

TransactionLo"

'ourceData%ase

3& Configure ; Start Change Capture

*5tract!emote

Trail

-ocal

Trail

9ata

Pump

# Con!i"ure 7 'tartC$an"e De&ier

Rep&icat

)repare the %nvironment


57/82

)repare the %nvironment

et up each s(stem9

Install Oracle $olden$ate software on source and target

Configure and start $olden$ate anager on source and target

If heterogeneous source/target< generate source definitions and

cop( to target

)repare the data#ase

%nsure data#ase access #( $olden$ate

%na#le transaction logging

$olden$ate Installation


58/82

Access the product media pack 5software and documentation8 athttp9//edeliver(LoracleLcom

elect )roduct )ack9 Oracle 1usion iddleware

Identif( the proper release of $olden$ate for (our source and targetenvironments9 Operating s(stem and version

*ata#ase and version

$olden$ate InstallationAccess the edia )ack

$olden$ate Installation


59/82

$olden$ate Installation$olden$ate *irectories

*irector( Contentsdirchk $olden$ate checkpoint files

dirdat $olden$ate trail and extract files

dirdef *ata definitions produced #( *%1$%. and used to

translate heterogeneous datadirpcs )rocess status files

dirprm )arameter files

dirrpt )rocess report files

dirs>l 2" scripts

dirtmp ,emporar( storage for transactions that exceedallocated memor(

$olden$ate Configuration


60/82

$olden$ate Configuration)arameters< )rocess $roups and Commands

$olden$ate processes are configured #( ACII parameter filesL A process group consists of9

An %xtract or +eplicat process

Associated parameter file

Associated checkpoint file

An( other files associated with that process

%ach process group on a s(stem must have a uni>ue group nameL

)rocesses are added and started using the $olden$ate oftware

Command Interface 5$$CI8 with the group nameL

$$CI commands also add trails< check process status< etcL



61/82

tart a anager process

GGSCI> START MGR

Add an %xtract group

GGSCI> ADD EXTRACT myext TRANL!G "EGIN N!#

Add a local trailGGSCI> ADD EXTTRAIL /gg$/dirdat/rt EXTRACT myext

tart an %xtract group

GGSCI> START EXTRACT myext

Use OB%P command to run text command files9

GGSCI> !"E% $tartmgr&o'y

$olden$ate Configuration$$CI %xamples



62/82

$olden$ate Configuration$"OBA" versus )rocess )arameters

$"OBA" parameters appl( to all processes

et when anager starts

+eside in Q$olden$ate install director(R/$"OBA"

)rocess parameters appl( to a specific process

5anager< %xtract< erver Collector< +eplicat< Utilities8

et when the process starts

Override $"OBA" settings

+eside #( default in the dirprm director( in files named

QprocessnameRLprm ost appl( to all ta#les processed #ut some can #e specified at the

ta#le level



63/82

$olden$ate Configuration%diting )arameter 1iles

%dit parameter files to configure $olden$ate processes

,he $"OBA" parameter file is identified #( its file path

GGSCI> EDIT (ARAMS &/GL!"ALS

anager and utilit( parameter files are identified #( ke(words

GGSCI> EDIT (ARAMS MGRGGSCI> EDIT (ARAMS DE)GEN

%xtract and +eplicat parameter files are identified #( the

process group name

GGSCI> EDIT (ARAMS *group name>



64/82

$olden$ate Configuration1unctions ! *ata ,ransformation

$olden$ate provides the capa#ilit( to transformcolumns #( using a set of #uilt!in functions

,ransformation functions can #e applied for either

%xtract or +eplicat

If (ou re>uire more complex functions< (ou alsohave the a#ilit( to call (our own logic through user

exits



65/82

$olden$ate Configuration1unctions ! *ata ,ransformation

Using column conversion functions (ou can9

)erform string and num#er conversions

%xtract portions of strings or concatenate columns

Compare strings or num#ers

)erform a variet( of date mappings

Use single or nested I1 statements to evaluate num#ers

presentation ogg workshop

Documents