cloudifying inspire:a future proofscalablesdi · azure blobstorage, services fabric & message...

19
Cloudifying INSPIRE: A future proof scalable SDI Bart Cosyn

Upload: others

Post on 16-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

�������������� ���� �� �������

Cloudifying INSPIRE: A future proof scalable SDI

Bart Cosyn

Page 2: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

Informatie Vlaanderen

308 municipalities

2068 private partners

6.4 M citizens

978 public 

partners

Federal & 3 

regions

EU

Context from

Page 3: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI�

Portal Metadata & CSW

Flemish SDI Components

Page 4: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI�

Services (WMS/WMTS/WFS)

Page 5: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

Geo‐based services

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI�

Page 6: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� Metadata & Catalog https://metadata.geopunt.be https://www.geopunt.be/catalogus

� Informatievlaanderen website https://overheid.vlaanderen.be/informatie‐vlaanderen/producten‐

diensten/webdiensten

Flemish SDI online

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI�

Page 7: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� Capacity (No limits)� Availability (24/7)� No authentication� Unexpected temporal over‐usage� Compliancy – vendor independent interface (INSPIRE/OGC/standard endpoints)� Manageable architecture & avoid infrastructure management� Cost effective

Non functional requirements

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI�

Page 8: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� Make all components scalable at any moment� Locate all components in one environment� Use the best available up to date technology� Focus to the implementation

Best practices

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI�

Page 9: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� The public cloud scales� Shop technology & infrastructure� Tend to PAAS/SAAS� We have chosen Microsoft Azure.

Solving the problem

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI�

Page 10: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� Portal runs as tomcat appservice using Conterra MapApp & Azure SQL DB� Monitored by Application Insights� Logging by GA

Portal

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI��

Page 11: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

Download & View services

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI��

Page 12: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� Geoserver & Arcgis Enterprise� Tomcat appservices & Arcgis VM� Azure Application Gateway as NLB� Scalable� Application insights monitoring� Spatineo monitor log analysis and

monitoring

Download & View services

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI��

Page 13: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� Azure SQL� Azure Webjobs� Azure Blob storage & File 

storage

Download & View services

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI��

Page 14: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� In house C# Azure cloud proof solution� Azure Blobstorage, Services Fabric & Message queuing� Instant updating of tiles based on messaging of changed BBOXes

WMTS

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI��

Performance & instant up‐to‐date tiles in one INSPIRE View Service (Tools and technologies ‐ Visualisationand mapping ‐ 19/09/2018 ‐ 16:00 ‐ Room: Gorilla 3)

Page 15: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� Migrating GEONETWORK to Azure as tomcat app service (PAAS)� Using Azure SQL DB� Fully scalable

Metadata & CSW (under construction)

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI��

Page 16: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� Services available as Azure App services or Azure Cloud services� Full scalable� Logged & monitored with Application insights� Reported with MS PowerBI

Misc services

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI��

Page 17: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� How to move the source data to Azure? (Azurewebjobs, powershell & AZCopy)

� How to control costs? (Power BI)� Monitor and log efficient (application Insights, 

azure streaming analytics) – tune the tresholds� Implement autoscale

Challenges

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI��

Page 18: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

� Moving from on premise to the cloud is an architectural challenge that takes time

� Moving from IAAS (on premise & cloud) to PAAS/SAAS is a mindset� Keeping data synced between the cloud and internal processes is a challenge� Moving to the cloud offers enhanced availability.� Enhancing performance is continuous a work item� Moving to the cloud resulted in higher agility – faster architectural changes� More monitoring. Good monitoring is a continuous effort.� Governance of the system is not by default – continuous work area� The Flemish SDI is now more reliable. Availability = + 99% 

Lessons learned

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI��

Page 19: Cloudifying INSPIRE:A future proofscalableSDI · Azure Blobstorage, Services Fabric & Message queuing Instant updating of tiles based on messaging of changed BBOXes WMTS INSPIRE Conference

Performance & instant up‐to‐date tiles in one INSPIRE View Service (Tools and technologies ‐ Visualisation and mapping ‐ 19/09/2018 ‐ 16:00 ‐ Room: Gorilla 3)

Check the “Informatie Vlaanderen” booth

More on this

INSPIRE Conference 2018 ‐ Cloudifying INSPIRE: A future proof scalable SDI��