p.2 pts odi11g odi overview
TRANSCRIPT
-
7/26/2019 p.2 Pts Odi11g Odi Overview
1/31
Copyrigh
t2010,Oracle.Allrightsreserve
d.
-
7/26/2019 p.2 Pts Odi11g Odi Overview
2/31
PTSWo
rkshop:ODI11g
OracleDataIntegrator
Overview
-
7/26/2019 p.2 Pts Odi11g Odi Overview
3/31
Agenda
DataIntegrationOve
rview
ODI:K
eyBenefits
ODIatOracle
Q&A
Copyrigh
t2010,Oracle.Allrightsreserve
d.
-
7/26/2019 p.2 Pts Odi11g Odi Overview
4/31
Oracle
DataIntegration
Copyrigh
t2010,Oracle.Allrightsreserve
d.
-
7/26/2019 p.2 Pts Odi11g Odi Overview
5/31
1.
DoMo
rewithLess
2.
CompeteGlobally24X7
Designmetadata-driveninte
gration
Leverag
eskills&dictatepatterns
Ensure
continuousuptime
Access
datainrealtime
Busin
essDriversforData
Integratio
n
AddValu
etotheCoreBusinessLines
Copyrigh
t2010,Oracle.Allrightsreserve
d.
3.
UseDataforCompetitive
Advan
tage
4.
Autom
ateandAdapt
BusinessProcesses
Ensure
thequalityofyourd
ata
Actively
governmostvaluab
leasset
Expose
dataservicesforreuse
OrchestrateprocessesusingSOA
-
7/26/2019 p.2 Pts Odi11g Odi Overview
6/31
ProjectDriversforDataIn
tegration
Essentia
lIngredientforInformationAgility St
rategicValueofDataIntegration
ConsistencyformajorenterpriseinitiativeslikeBI,DW,&MDM
Commontechnicalfoundationplatformacrossdatas
ilos
Centralpointfordatagovernance,availabilityandco
ntrols
Copyrigh
t2010,Oracle.Allrightsreserve
d.
KeyDataIntegrationUseCases
BI,DW,andOLTPDataIntegration&Replicatio
n
SOA,Enterpris
eIntegration&Modernization
Migrationsand
MasterDataManagement
-
7/26/2019 p.2 Pts Odi11g Odi Overview
7/31
OracleDataIntegrationSolution
Best-in-c
lassHeterogeneo
usPlatformforDa
taIntegration
M
DM
Applications
SOA
Platforms
Oracle
Application
s
Business
Intelligence
Activity
Monitoring
Custom
Applications
OracleGoldenGate
SOAAbs
tractionLayer
ServiceB
us
ProcessManager
DataServices
OracleDataInterator
OracleData
ualit
DataFederation
ComprehensiveDataIntegrationSolution
Copyrigh
t2010,Oracle.Allrightsreserve
d.
Log-basedCDC
Bi-directionalReplication
Real-timeData
ELT/ETL
DataTransformation
BulkDataMovement
OLTP
System
FlatFile
s
DataWarehouse/
DataMart
OLAPCube
Web2.0
WebandEven
t
Services,SOA
Storage
DataVerification
DataProfiling
DataParsing
DataCleansing
DataLineage
MatchandMerge
-
7/26/2019 p.2 Pts Odi11g Odi Overview
8/31
Oracle
DataIntegratorEnterp
riseEdition
Optimized
E-LTforimproved
Performance,Prod
uctivityandLowerTCO
E
-LTTransformation
vs.E-T-L
AnyData
Warehouse
Legacy
Sources
Copyrigh
t2010,Oracle.Allrightsreserve
d.
BestinclassforPerformance,
Sc
alability,Availability
LightweightDeployment
for
LoweringTCO
Faste
rtime-to-valuethrou
gh
DeclarativeDesign
Any
Planning
System
OLTPDB
Sources
Application
Sources
Heterogeneous,Openand
Standards-based
-
7/26/2019 p.2 Pts Odi11g Odi Overview
9/31
Oracle
GoldenGateOverview
Enterprise-wideSolutionfo
rRealTimeData
Needs
LogBa
sed,
Real-
TimeChangeData
Ca
ture
DisasterReco
very,
DataProtection
ZeroDowntime
Migrationand
Upgrade
s
Operational
Standby
(Open&Active)
StandardizeonSingle
TechnologyforMultipleNeeds
DeployforContinuou
s
Av
ailabilityandReal-t
imeData
Ac
cessforReporting/BI
Copyrigh
t2010,Oracle.Allrightsreserve
d.
Heterogeneous
SourceSystems
EDW
ODS
EDW
eporng
Real-timeBI
Database
O
GG
ETL
ETL
QueryOffloading
DataDis
tribution
HighlyFlexible
Fa
stDeployments
Lo
werTCO&ImprovedROI
-
7/26/2019 p.2 Pts Odi11g Odi Overview
10/31
GovernDataBe
tterwithD
ataQuality
DataMovement
E-LT&ETL
DataTrans
formation
ChangeDa
taCapture
DataAcces
s
DataServices
DataProfiling
StatisticalAnalysis
Rule-based
Validation
Monitoring&
Timeslice
Fine-grained
Auditing
DataMovem
ent
Copyrigh
t2010,Oracle.Allrightsreserve
d.
DataCleansing
DataValidationduringETL
DataStandardiz
ation
AddressMatchin
g&Dedup
ErrorHospital/Workflow
Data
Cleansing
D
ataProfiling
Da
taIntegration
-
7/26/2019 p.2 Pts Odi11g Odi Overview
11/31
ImprovePerformance
andScalability
1.IntegratedwithApplicationGrid
2.D
atasourceconn
ectionpooling
3.U
nifiedJDevenvironment
WhatsNewinOracleDataIntegrator11g
DesignThemes
Copyrigh
t2010,Oracle.Allrightsreserve
d.
ow
er
ShortenT
imetoValue
5.N
ewconnectivity
toOLAP,SAP
6.E
mbeddedAPIfo
rapplications
4.E
nterpriseManag
er
-
7/26/2019 p.2 Pts Odi11g Odi Overview
12/31
CY2009
CY2011
Unified
Team
High-L
evelDataIn
tegrationR
oadmap
NaturalUpgradePath
forExistingSo
lutions
OWB
10gR1
O
WB
1
0gR2
OWB
11gR1
O
WB
11
R2
Copyrigh
t2010,Oracle.Allrightsreserve
d.
ODI
10gR3
ODI
11gR1
ODI
11gR2
CY2009
C
Y
2010
Unified
Platf
orm
OWB/ODIInvestmentsare
FullyProte
cted
NoForcedMigrations
NaturalUpgra
dePath
UnifiedPlatform
aimstobe
aSupersetof
Existing
Productsnoregression
-
7/26/2019 p.2 Pts Odi11g Odi Overview
13/31
Directionsfor11g
MajorFeatures
ExecutionManagement:L
oadPlans
Paralle
lism,Restartability,ConcurrentTaskM
anagement,Task
Killing
JPSIntegration
Extern
alizedAuthenticatio
n+SSOsupport
Copyrigh
t2010,Oracle.Allrightsreserve
d.
Helptroubleshooting/fixing
ErrorTab
leManagement
Manag
etheerroneousrows
EMInteg
ration
Monito
ranEnterpriseArchitecture
KMEnha
ncements
-
7/26/2019 p.2 Pts Odi11g Odi Overview
14/31
WhyisODIUnique
?
Copyrigh
t2010,Oracle.Allrightsreserve
d.
-
7/26/2019 p.2 Pts Odi11g Odi Overview
15/31
Differen
tia
tor:E
-LTArchitecture
HighP
erformance
ConventionalETLArchitecture
Extract
Load
Transform
Conventional:SeparateETLServer
ProprietaryETLEngine
PoorPerformance
HighCostsforSeparateStandalo
neServer
IBM&Inform
aticasapproach
Oracle:NoNewServers
LowerCost:LeverageComputeR
esources&
PartitionWo
rkloadefficientl
Copyrigh
t2010,Oracle.Allrightsreserve
d.
N
extGenerationArch
itecture
E-LT
E-LT Load
Extract
Tr
ansform
Transform
Efficient:Ex
ploitsDatabaseOptim
izer
Fast:ExploitsNativeBulkLoad&
Other
DatabaseIn
terfaces
Scalable:ScalesasyouaddProc
essorsto
SourceorTarget
Benefits
OptimalPer
formance&Scalability
BetterHardwareLeverage
EasiertoManage&LowerCost
-
7/26/2019 p.2 Pts Odi11g Odi Overview
16/31
Differen
tia
tor:D
eclarative
Design
DeveloperProductivity
ConventionalETLD
esign
Conventional:SpecifyETLDa
taFlow
DevelopermustdefineeverystepofComplex
ETLFlowLogic
TraditionalapproachrequiresspecializedETL
skills
Andsignificantdevelopmentandmaintenance
efforts
Copyrigh
t2010,Oracle.Allrightsreserve
d.
race:
ecarave
e-ase
esgn
Simplifiesthenumberofsteps
AutomaticallygeneratestheDataFlowwhatever
thesourcesand
targetDB
Benefits
Significantlyre
ducethelearningcurve
Shorterimplem
entationtimes
Streamlineaccesstonon-ITpros
ODIDeclarativeDe
sign
DefineHow:Built-inTem
plates
Define
What
YouWant
Automatic
ally
Generate
Dataflow
11
22
-
7/26/2019 p.2 Pts Odi11g Odi Overview
17/31
Journalize
ReadfromCDC
Source
Load
FromSourcesto
S
taging
Check
Constraintsbefo
re
Load
Integrate
TransformandMove
toTargets
Service
ExposeDataand
Transformation
Services
Reverse
EngineerMetadata
Reverse
Journalize
Load
Check
Integrate
Services
PluggableKnowledgeModulesArchitecture
CDC
Sources
StagingTables
ErrorTables
TargetTables
WS
WS
WS
Differen
tia
tor:K
nowledge
Modules
Hot-Pluggable,Modul
ar,Extensible
Copyrigh
t2010,Oracle.Allrightsreserve
d.
Le
verageDatabaseOp
timizations:
NativeSQL;NativeFunctions;NativeLoad
s;NativeJournaling
/CDC
Ta
ilortoanorganizationsexistingbestpr
actices
Ea
seadministrationw
ork
Reducecostofownership
SAP/R3
SiebelL
ogMiner
DB2Journals
SQLServer
Triggers
Oracle
DBLink
DB2Exp/Imp
JMSQueues
CheckM
S
Excel
Check
Sybase
Oracle
SQL*Loader
TPump/
Multiload
TypeIISCD
OracleMerge
SiebelEIM
Schema
OracleWeb
Services
D
B2Web
Services
Sampleout-of-the-boxKnowledgeModules
Benefits
-
7/26/2019 p.2 Pts Odi11g Odi Overview
18/31
Change
Da
taCap
ture
(CDC)
allows
forrea
ltim
eda
tatobeavaila
ble
forany
typeo
fda
taintegr
ationso
lution.
Ch
ange
Da
taCap
tur
eis
accomp
lis
he
dbycap
turin
gjus
tthec
hange
drecordsan
dnot
the
fulldata
se
t,drama
tica
lly
reduc
ing
timeand
resourcesoverth
elife
oftheda
taintegra
tionso
lution.
KeyUseC
ase:RealtimeDa
taWarehouse
(con
tinuous
lyre
fres
he
dthroug
hou
tthe
day
)
Differen
tia
tor:C
hangedDataCaptur
e
Event-DrivenFramework
forRealtimeDa
taIntegration
Copyrigh
t2010,Oracle.Allrightsreserve
d.
-
7/26/2019 p.2 Pts Odi11g Odi Overview
19/31
SupplyRealTim
eBusinessIntellige
nce
Non-inva
siveCapture+E
-LTProcessing
Application
RealTimeBI
(usingReplica)
AnalyticBI
(Facts&Dims)
Con
sistency
W
indow
Copyrigh
t2010,Oracle.Allrightsreserve
d.E
-LT
(Mini-Batch+Transforms)
-
7/26/2019 p.2 Pts Odi11g Odi Overview
20/31
Unified
Management+Monitoring
CommonRuntime100%Java
CommonMonitoring
Examp
leUseCases
BulkDataTransformation(any2any)
XML/EDILargeFileH
andling
-
Unify
E-LTAgen
twithSOARuntime
BestofB
reedDataIntegrationasaShare
dSOAService
Copyrigh
t2010,Oracle.Allrightsreserve
d.
HighPerformance
ETL&Replication
AnyDataSource
DataWarehouse
&OLAP
LoadDWfromSOA
UnifiedDataStewardWorkflow
(ETLErrorHospitalw/BPELPM)
ERPMigration,Replication/
Loading
QueryOffloading&Ze
roDowntime
E-LTFrameworksareoptimalarchitecturesfor:
BusinessIntelligence
PerformanceManagement
Database&OLAP
EmbeddedApplications
ApplicationIntegr
ation
MiddlewareServers
-
7/26/2019 p.2 Pts Odi11g Odi Overview
21/31
DataIntegrityFirewa
ll
Auditing,cleansinga
ndrecycling
1.
Declareconstraintsattablelevel
2.
Designmappingsan
dcheckflow
integrity
3.
Audit,cleanseorrec
yclerejected
records
Message
Id
Name
City
Duplicated
Record
001
JohnDoe
New
York
Duplicated
Record
022
JohnDoe
Boston
InvalidCity
Reference
230
AlbertFresh
Maris
Differen
tia
tor:D
ataQuality
InlineE-LTDataIntegrity
Framework
Copyrigh
t2010,Oracle.Allrightsreserve
d.
-
7/26/2019 p.2 Pts Odi11g Odi Overview
22/31
OracleD
ataIntegrator
OracleD
ataIntegrator
Optional:Advan
cedGovernance
OracleDataQualityforDataIntegrator
BestofbreedQuality
JointdevelopmentwithTrillium
Proven,scalableDQengines
Richg
lobalcontentforcleansing,
standardization,validation
Extensiblebycustomers
with
domain-specificDataQuality
functions
Out-of-bo
xintegration
Target
Sources
IntegrationProcess
IntegrationProcess
Copyrigh
t2010,Oracle.Allrightsreserve
d.
viapre-builtKnowledgeM
odules
ODIM
odelmetadatapassedto
ODQatdesigntime
ODQsourceandtargetM
etadata
passe
dtoODIatDesign
Time
Out-of-boxODIToolforruntime
invoca
tionofODQprocesses
Packaged
QualityRules
Delive
redOut-of-the-Box
byOracle
For35
Countries&Doma
ins
OracleDataQualityforData
Integrator
OracleDataQualityforData
Integrator(*)(*)
GlobalData
Router
Transformer
Parser
Postal
Matcher
Relationship
Linker
(*)JointDevelopmentwithTrillium
Parsing
,Cleansing,Standardization,
Parsing
,Cleansing,Standardization,
Matchin
g
Matchin
g
-
7/26/2019 p.2 Pts Odi11g Odi Overview
23/31
Differen
tia
tor:F
lexibleErrorWorkflow
ErrorRecycling,NativeIntegrationwith
BPEL&HumanWorkflow
Target
Static
Check
Inte
gration
Process
Errors
Sales
FlowCheck
DuringIntegration
Sources
Conventional:
Rigid/Non-Exist
entWorkflow
Proprietary
workflowbaked-in
Noworkflow
/3rdpartysolution
Weakintegration,non-standard
Oracle:Open,
FlexibleWorkflo
w
FlexibleDataCorrectionWorkflow
Copyrigh
t2010,Oracle.Allrightsreserve
d.
BPELProcessManagerH
uman
Workflow
Flow-basedConstraintCheckinga
ndValidation
ErrorRec
ycling
Standards-B
asedProcessFlow
BPELPro
cessManager/BPEL4P
eople
ReuseStandardizedErrorHandlin
gProcedures
Integratedw
ithHumanWorkflow
ManageL
ongRunningTransactions
ManageC
omplexApprovalandOverridingPatterns
Er
rorRecycling
-
7/26/2019 p.2 Pts Odi11g Odi Overview
24/31
Differen
tia
tor:D
ataLineag
e
Large
numberofdataflowsinacomplex
enviro
nment
Howt
ogetanoverview?
Web-b
asedend-to-enddatalineage
1.U
nderstandyourdataflow
s
2.Followthepathofdata
3.D
rill-downtotransformatio
ns
?
Copyrigh
t2010,Oracle.Allrightsreserve
d.
-
7/26/2019 p.2 Pts Odi11g Odi Overview
25/31
ODIatOracle
Copyrigh
t2010,Oracle.Allrightsreserve
d.
-
7/26/2019 p.2 Pts Odi11g Odi Overview
26/31
-
7/26/2019 p.2 Pts Odi11g Odi Overview
27/31
ExtremePerformanceforDataWarehousing
ExadataV
2isthePlatformforRealTimeDataW
arehousing
OracleD
ata
Integrat
or
LoadExada
tawithGoldenG
ate;GenerateTransformsfromODI-EE
NewExadataplatformoptimizedforO
LTPandDataWarehousingsuitsRealTimeD
W
ExtremeExad
ataperformancecanhandlehugedatavolume
sthatcomewithRealT
imeDW
Copyrigh
t2010,Oracle.Allrightsreserve
d.
EMP
DEPT
DIM
FACT
DIM
DIM
DIM
ODSSchema
DWSchema
Oracle
GoldenGate
OracleData
base
-
7/26/2019 p.2 Pts Odi11g Odi Overview
28/31
SpeedProjectD
elivery/TimetoMark
et
E-LTuse
sDeclarativeSQ
L-styleDesign+SimpleRuntim
e
Develo
pmentProductivity
40%EfficiencyGain
s
EnvironmentSetup(ex:
BIApps)
33-50%LessComplex
NumberofSetupSteps
7
NumberofServers
1
Numberofconnectio
ns
3
Copyrigh
t2010,Oracle.Allrightsreserve
d.
NumberofSetupSteps
10
NumberofServers
3
Numberofconnectio
ns
7
-
7/26/2019 p.2 Pts Odi11g Odi Overview
29/31
Traditio
nalETL+CDC
TransformationsinETLengine
on
expensivem
iddletierservers
Bulkloadto
thedatawarehousewith
largenightly
/dailybatch
Nomid-tier;transformations
use
database
(mostefficient)
Mini-batc
hesthroughoutthe
dayor-
bulkproc
essingnightly
ModernDataIntegrationA
pproach
Heterogeneous,Real-time,Non-Invasive,HighPerformanceE-L
T
ModernE-LT+Real-time
Copyrigh
t2010,Oracle.Allrightsreserve
d.
usingcomplexAdapters
Streamingrequiresseveralhop
s
-
Continuouslowlatencyfeed
sfrom
operation
alsystems
Stag
ing
Tric
kle
Lookup
Data
Loa
d
Ex
trac
t
Lookup
Data
Xform
Xform
Bu
lk
Agent
Agent
He
terogeneous
-
7/26/2019 p.2 Pts Odi11g Odi Overview
30/31
Copyrigh
t2010,Oracle.Allrightsreserve
d.
-
7/26/2019 p.2 Pts Odi11g Odi Overview
31/31
Copyrigh
t2010,Oracle.Allrightsreserve
d.