qualiware qualiware repositoryrepository import / export data · 2017-02-15 · quick introduction...

49
QualiWare QualiWare QualiWare QualiWare Repository Repository Repository Repository Import / Export Data Import / Export Data Import / Export Data Import / Export Data Bob Boisvert February7th, 2017 CloseReach 1

Upload: others

Post on 20-Mar-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

QualiWare QualiWare QualiWare QualiWare RepositoryRepositoryRepositoryRepositoryImport / Export DataImport / Export DataImport / Export DataImport / Export Data

Bob Boisvert

February 7th, 2017

CloseReach

1

Page 2: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Quick Introduction

• Bob Boisvert, in IT world since 1972

• Instructor throughout most of career

• QualiWare experience since 2011

• This is a technical presentation about Export and Import of architecture components in QualiWare

• Considerations for 5.3 and 6.X QLM environments

2

Page 3: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

RepositoryRepositoryRepository

QLM Environment

3

PWS1 PWS2

Page 4: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

QLM Environment

4

RepositoryRepositoryRepository

PWS

1

PWS

2

RepositoryRepositoryRepository

PWS

1

PWS

2

Development Production

Page 5: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

QLM Environment

5

Page 6: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

We have a need here:

Must be able to move architectural objects between

all of these “places”

6

Page 7: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Compare utility

Diagrams to compare can be any two diagrams:

- different revisions of same diagram

- in different PWS

- in different configurations

- in different repositories

- that are totally different objects (copy)

7

Page 8: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Compare utility

Properties of two non-diagram objects:

- different revisions

- in different PWS

- in different configurations

- in different repositories

- that are totally different objects (copy)

8

Page 9: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

NOTE: Compare different objects

In RepositoryExplorer:

- you can Copy an object (or diagram)

- paste the object (or diagram)

This creates an object (diagram) with a different ObjID, but same contents. Useful for variants, As-Is/To-Be.

9

Page 10: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

How to initiate Compare

From any

diagram:

10

Page 11: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

How to initiate Compare

From a diagram in a PWS:

File � Private WorkSpace � Promote

11

Page 12: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Compare Dialog:

WHAT to

compare, can

choose anything

NOTE: Is a

hidden

template!

12

Page 13: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Compare Dialog:

WHAT to

compare with,

can choose

anything

13

Page 14: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Comparing:

Same configuration Basically revisions

Either same config or PWS

Other Configuration Select one

Other Repository Must be connected

14

Page 15: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Results:

15

Page 16: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Direction matters: (e.g. 1 vs 0)

Subset to

compare:

(rev 1)

Compare

with:

(rev 0)

Unchanged Moved Added Deleted

16

Page 17: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Other way (0 vs 1)

Subset to

compare:

(rev 0)

Compare

with:

(rev 1)

Unchanged Moved Deleted Added

17

Page 18: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Sharing/moving data strategies –File based repository

Computer…

Repository

*.qrp File backup

Repository level

Subset Export

Repository level

Full Export

Repository level DumpOther (XML, Custom)

18

Page 19: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Sharing, moving data strategies –Database repository

Server

Database

Repository

Repository level

Subset Export

Repository level

Full ExportRepository level

Dump

Other (XML, Custom)

19

Repository Clone

Page 20: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Export/Import

• Organizations often have Development, Testing and Production environments; need to move data around

• Need to share with other organizations

• Need to take work home on laptop, return it

• Share work across servers

• Checking work out/back in

20

Page 21: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Export

• From File menu:

Note choices:

Export All…

Everything in the Repository

(caveat)

Export Subset…

You choose what is needed

21

Page 22: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Export Subset

22

Page 23: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

QLM Export file formats

• QLM before 6.5 had *.exp (partial) and *.dmp(full export formats

• QLM 6.5 primarily uses *.qrx export format

23

Page 24: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

When choosing export file…

5.X

6.X

24

Page 25: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Export types

Export Subset

• Everything that is selected (Diagram, selected, Templates, other) :

• Exports objects, diagrams, symbols …

• Current Revision only of every object

• Base language only, if run from default language

• Base + other language, if run from "other" language

• … in this configuration

• … in this PWS

• … does not export deleted objects (big red X)

25

Page 26: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Export types

Full Export

• Everything in repository:

• Exports all objects, diagrams, symbols …

• Current Revision only of every object

• Base language only, if run from default language

• Base + other language, if run from "other" language

• … in this configuration

• … in this PWS

• … does not export deleted objects (big red X)

26

Page 27: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Export types

Dump

• Everything:

• All objects, diagrams, symbols, …• All Revisions• All Language Variants• All Configurations• … including all Private WorkSpaces• All hidden templates• All deleted objects still sitting in background

Same as: Copy of the *.qrp repository (if file-based),

or cloning

27

Page 28: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Feature summary

Export (All or Subset)

From default language

Export (All or Subset)

From other language Dump

Objects selection selection All

Revisions Default only Default only All

Language Variants Default language Default+Other All

Configurations Current Current All

Private Workspaces Current Current All

Deleted Objects No No Yes

Export file size smallest small largest

Time to export Least More time Most time

28

Page 29: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Stubs when exporting

29

Page 30: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

What are stubs ?

30

Page 31: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Stubs

QualiWare Objects are like puzzle pieces:

Object 2 Object 4

Object 3

Object 1

31

Page 32: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Example

Repository 1:

32

Page 33: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Example

• create a new repository

• Import (without stubs)

33

Page 34: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

But, if we export/import with stubs:

34

Page 35: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Stubs designed for…

A B C D E

Import

Links

will mesh

with stubs!

B1B C D E (stub)

35

Export

Page 36: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Stubs designed for…

A EB1B C D

After import:

Results in proper integration of

imported objects, IF stubs are

included !

36

Page 37: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Export file types

37

Page 38: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

In QLM 5.3

These file types:

*.exp

*.qrb

*.qrp

*.dmp

Have the exact same file format!

38

Page 39: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

In QLM 6.5+ – Export format

• Will now be in XML format instead of previous file format

• Import/Export performance has been significantly improved

• File is a *.qrx extension; can be un-zipped

• Contains many folders and files

• Dump is also a *.qrx file

• For backward compatibility, still have an option to export/import in *.exp format

39

Page 40: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Export in 6.X

40

Page 41: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

*.qrx is a zipped file

41

Page 42: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Timing test –full dump 20,437 objects

QLM 6.5 – QRP formatCreated file name:C:\Users\Bob Boisvert\Desktop\test full dump qrp.qrpWriting configuration BaseConfiguration[20437 revisions] is finished..Writing configurations finished. Time used 7sStart writing repository objects to dump file...

All repository objects are written to dump file in Time used: 5 minutes

QLM 6.5 – QRX formatExport to file: C:\Users\Bob Boisvert\Desktop\test export.qrxCreated file name:C:\Users\Bob Boisvert\Desktop\full dump test.qrxDuring QIS dump file creation please refer to QEF log for warnings and errors.

Time used:1 minute

42

Page 43: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Notes about Dump

Different from Export, Dump exports everything

• All objects

• All Revisions

• All Language Variants

• All Configurations

Entire repository!

43

Page 44: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Dump – careful when loading!

NOTE:

It is NOT a good idea to load from a Dump file into an existing repository.

It will clobber all data changes after dump was created!

44

Page 45: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Uses for a Dump file

• Most complete way to backup one repository

• Transfer a complete Repository to another server

• Same as Clone operation (RA does this)

45

Page 46: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Import/Export note for QLM 6.X

• In 6.x, should no longer use Import/Export from QLM for large imports/exports/dumps• Instead, use standalone executable:

QLMDumpLoad.exe

• A streamlined version of QLM• You can try to import from QLM, but can

hangup!• Must run in exclusive mode

46

Page 47: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Suggestions before import tests

• Backup your data 1st

• Test Export/Import procedure in PWS or sandbox repository

• Can easily move PWS data to base configuration with Export (simpler)

47

Page 48: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

DEMO

48

Page 49: QualiWare QualiWare RepositoryRepository Import / Export Data · 2017-02-15 · Quick Introduction •Bob Boisvert, in IT world since 1972 •Instructor throughout most of career

Thank you!Bob Boisvert

[email protected]

© 2017 CloseReach Ltd. All Rights Reserved.

3147 Klondike Road West K0A 2T0

North Gower, ON, Canada

telephone: 1 613 505 0262

toll-free: 1 877 238 2134

toll-free fax: 1 877 295 3616

[email protected]

49