datamigrator update release 7.7.04

Clif KranishDirector, Data Management Division

DataMigrator UpdateRelease 7.7.04

1

Data Management Console

2

Autosave

3

Edit Undo / RedoSpecify limit for Flows and Synonyms

4

Edit - Undo / RedoSynonym and Flow editors

5

Tabbed Windows

6

Tab GroupsWindow > New Horizontal Tab Group

7

Tab GroupsView two Data Profiling reports at once

8

Data ProfilingCount

9

Browser See all files in application directories

10

Edit flat files

11

Edit XML and XSD

12

Print Preview

13

Data Flows and Process Flows

PartitioningSUB QUERIES

Database Default Values

14

Quick CopyGenerates Data Flow for entire table(s)

15

For source with a numeric key columnAutomatic partitioning

16

Automatic PartitioningGenerated Process Flow

17

Automatic PartitioningParameter Passing

18

Automatic PartitioningLog

19

WHERE FilterNew SQL Operators

20

Function AssistEXISTS

21

Function AssistSUBQUERY

22

Sub Query In Select List

23

Database Default ValuesCOUNTRY default is ‘USA’

24

Database DefaultsTransformations – No value assigned to COUNTRY

25

Database Defaults

Data type Nullable Default Old NewCharacter Yes No NULL NULLNumeric Yes No NULL NULLCharacter Yes Yes NULL DefaultNumeric Yes Yes NULL DefaultCharacter No No Blank ErrorNumeric No No 0 ErrorCharacter No Yes Blank DefaultNumeric No Yes 0 Default

Database defaults are now respected.

But for NOT NULL columns without a default…You must assign a value!

26

Set VariablesHelp for Statistical Variables

27

IndexesTimestamps

Slowly Changing Dimensions

28

Slowly Changing DimensionsType I changes – Overwrite History

Skey Empid Br Name Start End

7 JG088 BOS Gamola, Jan 01-Jan-12 .

Empid Br NameJG088 BOS Gamola, Jan

Dimension

Source

Newcomb, Jan

Newcomb, Jan

29

Slowly Changing DimensionsType II changes – Record History

Skey Empid Br Name Start End

8 RI083 STL Iddles, Roger 01-Jan-12 .

Empid Br NameRI083 STL Iddles, Roger

Dimension

Source

LA

06-Jun-1214 RI083 LA Iddles, Roger 07-Jun-12 .

30

Faster Load with Indexes in RDBMS Tables

31

Index Fields EditorAccept Index on REPNO (key column)

32

IndexesAdded Index on REPNO and EMPID

33

IndexesRecreate Database Table

34

IndexesAs seen in RDBMS

35

Slowly Changing Dimension tablesDatetime / Timestamp for begin / end dates

36

Scheduler

• Start/Stop Scanning• Manage Scheduled Flows• Run When Server Starts

37

SchedulerStart / Stop Scanning and Scheduler Agents

38

Scheduler AgentsSelect and Activate / Deactivate

39

Real Time CDC Log or File Listener Source

40

Scheduled FlowsRun when server starts

41

New and Improved Adapters

• Load• Salesforce• AddressDoctor• JSON• Hadoop and Hive

42

Improved Adapters

Concurrent fastload inserts

Teradata Parallel Transport API

Change Data Capture

43

Salesforce.comQuery Adapter based on SOQL

44

Salesforce.comCreate Cluster Join – using relationships in data model

45

AddressDoctorSynonym for procedure created at configuration

46

AddressDoctorPass parameters in JOIN

47

AddressDoctorCleansed Addresses

48

JSONJavaScript Object Notation

49

JSONSynonym created using document itself

50

JSONSample Data

51

Hadoop and Hive

52

Ribbon

53

Ribbon

54

RibbonHome

55

RibbonFlow, Metadata and Report

56