it all comes back to fast and sustainable …...initial mappings as well as the oracle spatial...

25
IT ALL COMES BACK TO FAST AND SUSTAINABLE SYNCHRONIZATION SMALLWORLD ENTERPRISE GATEWAY 2018 EMEA User Conference, Wembley, UK

Upload: others

Post on 22-Sep-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

IT ALL COMES BACK TO FAST AND

SUSTAINABLE SYNCHRONIZATION

SMALLWORLD ENTERPRISE GATEWAY 2018 EMEA User Conference, Wembley, UK

Page 2: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

INTRODUCTION

1993Graduated Technical University of Twente

1994 at RealworldSystems

Lead two

large projects

Gert Wijsman

RealworldSoftware Products

BV

Company originated in

The Netherlands

Divisions all over the worldUK, AUS, ROM,

GER, IND, SA

SWEG is maintained in the Products

division

Product Manager for:

- Diagnostics

- Enterprise Gateway

Page 3: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

WHAT IS SWEG

WHAT IS SWEG FOR

WHY SWEG

InSync to SWEG

CONTENT

› Introduction

› Open Smallworld data to other means than Smallworld (next to data warehouse)

› High performance;

› Improved speed for full sync;

› Configuration instead of customization;

› Low total cost of ownership

Page 4: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

“The noblest pleasure is the joy of understanding”

Leonardo da Vinci (1454 – 1519)

Page 5: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

What is SWEG

• SWEG is an on-demand synchronization enginethat hooks into the two databases:

✓ ORACLE

✓ Smallworld Database

Page 6: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

History

Performance

1990s 2018

InSync

2006 : Realworld started

synchronisation product

2010 : Release 2

2012 : SWEG 4.3

2018 : SWEG 5.1.7

2016 : SWEG 5

Page 7: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

01

02

03

04

ORACLE

INTEGRATION

HIGH AVAILABILITY

ACCESSIBILTY

PURPOSE

Page 8: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

Design objectives

1. Performance

2. Reliable

3. Only configuration (no customisation)

Page 9: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

High speed

Imports Oracle data

changes into Smallworld

Deep Smallworld

support

Fully integrated User Interface

WHY SWEG

Page 10: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

SWEG FEATURES

PERFORMANCE

METADATA

DATAMODEL•Changes

•Joins

•Geometry Mapping

OTHER. Two way

synchronisation

Parallel synchronisation

•Heterogeneous Joins

• Internal Worlds

•Enumerators

•Topology export

Page 11: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

Fix for common tolerance issues in geometries 5

Full reports of sync runs by email6

Configuration backup7

Automated script running (SQL and magik)8

Advanced Mapping 1

XML export of configurations 2

Coordinate system transformations 3

Multiple Smallworld sources into a single Oracle target 4

Other features

Page 12: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

OPTIMAL LEVERAGE OF ORACLE AND SMALLWORLD TECHNOLOGY

PARALLEL PROCESSING

DATASET MULTIPLEXING03

02

01

HIGH PERFORMANCE

Page 13: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

User Interface

• Administration Settings

• Collection Mappings

• Datamodel

• Manage Oracle spatial

• Manage enumerators

• Manage Network connectivity (called manifolds in Smallworld)

• Process monitoring

• Logging

Page 14: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

Unified log in Oracle Start directly from the GUI Multiple GUI instances

Monitor all running SWEG processes

LOGGING CONTROL FEEDBACK

Delete and import configurations

Clean up the target Oracle schema

Upgrade the Oracle schema

Individual SW session logs in files

Page 15: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

“Simplicity is the ultimate sophistication”

Leonardo da Vinci (1454 – 1519)

Page 16: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

BENEFITSConfiguration SWEG and upgrade do not interfereUpgrade to CST 5 will be simplified

SWEG 5 is compatible with CST 4.3 Make new configuration.

Advised migration path:First step: Upgrade InSync to SWEG 5 Second step: Upgrade to CST 5

Migration path InSync to CST 5

Page 17: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and
Page 18: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

InSync

SETUP AND MAINTENANCE

Requires the creation and maintenance ofinitial mappings as well as the Oracle Spatial

metadata to match the configured Oracledatabases

Automatically creates mappings andmaintains the connection to Oracle usingconfigurations and Oracle data dictionary

Information. It has centralized log, full access to configuration metadata in Oracle and integrated

Smallworld session management.

SWEG

Page 19: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

PERFORMANCE

InSync SWEG

Very slow if Smallworld data update volume is

high

High speed ACPT interface to Oracle provides

10x or better performancegains over the native Smallworld interface.

It is scalable using multiple processes on multiple

machines for even more throughput.

Page 20: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

SWEGGeneral Capabilities InSync

Intuitive user interface with good functions to automatically setup and

map a database✓

Intuitive user interface with good functions to automatically setup and

map a database✓~~User Interface

Several panels with multiple windows and steps to complete basic mapping

and replication

Error handling Errors produce tracebacks, handled at the sync run levels

Tracks error for individual records while completing the rest of the

synchronization run✓

Tracks error for individual records while completing the rest of the

synchronization run✓

Joins included

.

1:n support via manual foreign key creation

Full support for heterogeneous joins (with specific metadata)

Includes Network connectivity YES

Includes Internal Worlds

Enumerator values included

Support for datamodel evolution

Post-Sync reporting and email

Spatial metadata management

Geometry correction

Page 21: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

vs

vs

vs

vs

vs

vs

runwithin minutes

Derived fields aresupported

complete replication of data within a single day

selected collections orfields can be re-replicated

single configuration for bothreplication andsynchronization

“One Click” migration ofconfiguration to other

environments

can sometimes take more than a day

derived fields are not supported

complete replication of data took almost 5 days

not able to re-replicate selected fields

separate configurationsneeded for replication and

synchronization

migration of configurationto other environments

is difficult

SWEG InSyncDaily

synchronization

Limitations

Replication

Configuration

Customer experience example

Page 22: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

References

Page 23: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

CONCLUSION

It all comes back to Fast and Sustainable Synchronization!

CONFIGURATIONSaves you on maintenance!

HIGH PERFORMANCENo more issues with small maintenance windows!

Be CST 5 ready by replacing InSynctoday with SWEG!.

1

3

2

4

Page 24: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

“It's easier to resist at the beginning than at the end”

Leonardo da Vinci (1454 – 1519)

Page 25: IT ALL COMES BACK TO FAST AND SUSTAINABLE …...initial mappings as well as the Oracle Spatial metadata to match the configured Oracle databases Automatically creates mappings and

More information

•GE Grid Solutions representative

[email protected]