a new software architecture for a distributed, modular and ...create microservices for different...

40
KIT – The Research University in the Helmholtz Association KIT - Institute for Applied Computer Science (Prof. Dr. Veit Hagenmeyer) www.kit.edu A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers Eric Braun

Upload: others

Post on 22-May-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

KIT – The Research University in the Helmholtz Association

KIT - Institute for Applied Computer Science (Prof. Dr. Veit Hagenmeyer)

www.kit.edu

A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centersEric Braun

Page 2: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science2

Outline

MotivationRequirementsConcept

BackendFrontend

PrototypeConclusion

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 3: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science3

Motivation

Energy Lab 2.0 as power system control centerincoming data will be stored, analyzed, and visualizedcontrol electrical equipmentbig variety of applications

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

http://tdworld.com/site-files/tdworld.com/files/imagecache/large_img/uploads/2014/08/nyisonewcontrolroom022614-2approved.jpg

Page 4: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science4

Motivation: Role in Energy Lab 2.0

SenSSiC (Smart Energy System Simulation and Control Center)

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 5: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science5

Motivation: Role in Energy Lab 2.0

Control, Monitoring and Visualization Center

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 6: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science6

Requirements

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 7: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science7

Requirements

Data Managementstructured datatime seriesdocuments or fileslinks between data

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 8: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science8

Requirements

Data Managementstructured datatime seriesdocuments or fileslinks between data

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

{„name“: „IAI Building“,„number“: 449,„address“: ……

}

Page 9: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science9

Requirements

Data Managementstructured datatime seriesdocuments or fileslinks between data

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

{„name“: „Janitza UMG 512“,„description“: “Power quality analyser“,

…}

Page 10: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science10

Requirements

Data Managementstructured datatime seriesdocuments or fileslinks between data

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

{„name“: „Mesurement“,„identifier“: „MMXU“,„TotW“: …,„Hz“: …,…

}

Page 11: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science11

Requirements

Data Managementstructured datatime seriesdocuments or fileslinks between data

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 12: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science12

Requirements

Data Managementstructured datatime seriesdocuments or fileslinks between data

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 13: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science13

Requirements

Data Managementstructured datatime seriesdocuments or fileslinks between data

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 14: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science14

Requirements

Visualization / Monitoringline / bar chart

maps

3D visualizations

Analysise.g. forecasting (electricity consumption)

Controle.g. electrical equipment

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 15: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science15

Requirements

non-functional

high performance

secure system

easy to use applications

(e.g. no programming knowledge needed)

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 16: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science16

Concept

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 17: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science17

Basic State-of-the-art Concept

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Frontend Applications

Backend Services

Databases

Page 18: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science18

How do we design such an infrastructure?

avoid common mistakes:

monolith

custom solution for every usecase

desktop application as frontend

State-of-the-art technologies

build it for people with little IT knowledge

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 19: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science19

Monolith

one hardware serverone technology stackone codebase

easy scaling (replicate whole software)easy development

codebase too bigscalability is not efficientupdates are problematicdeployment to server takes hours or days

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

http://odino.org/images/monolith.png

Page 20: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science20

Microservices

small projectslow couplingbetter scalabilitydefined by (HTTP) interface, not by implementationsmall development teams

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 21: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science21

Custom Solution for Every Usecase

don‘t …use databases with fix schemas (relational database)

changes to the structure of the data a lot of workcreate microservices for different applications

do …use NoSQL databases

e.g. MongoDB, Elasticsearchcreate microservices based on different features

no timeseries for electr. service BUT a generic timeseries service

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 22: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science22

Desktop Application as Frontend

often only run on a specific platform (e.g. windows, linux, android)need installation

web frontend that can run in any modern browser

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 23: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science23

Concept: Backend

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 24: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science24

Generic Microservice Backend

separate services for different types of data

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Time Series Service

Master Data Service

Digital Asset Service

Page 25: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science25

Generic Microservice Backend

additional services for more demanding applications

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Schema Service

Link Service

Geo Service

Application Configuration Service

Search Service

Auth Service (e.g. OAuth 2)

Page 26: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science26

Architecture

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Gateway

Applications- Energy Management- Demand Site Management- Planning Tools- Asset Management

Page 27: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science27

Concept: Frontend

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 28: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science28

Concept: Frontend

configuration over programmingprogramming is done by the developerthe user only configures the rest

all applications in the same design (e.g. Material Design)suitable for desktop, tablet, smartphone, etc.

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 29: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science29

Prototypes

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 30: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science30

Prototype: Visualization

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 31: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science31

Prototype: Analysis

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 32: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science32

Prototype: Dashboard

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 33: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science33

Summary and Outlook

summary:requirments for the IT infrastructurehow to design the infrastructureconcept of the frontend and backend different prototypes

future tasks:implementation of the whole conceptintegration of various applications for Energy Lab 2.0

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 34: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science34

Thank you for your attention!

Mail: [email protected]

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 35: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science35

Sources

Icons made by SimpleIcon, Madebyoliver, Freepik from www.flaticon.comhttp://www.janitza.com/files/topics/products/Energie-und-Spannungsqualitaets-Messtechnik/UMG-512/Janitza-Klasse-A-Spannungsqualitaetsanalysator-UMG512.pnghttp://www.novatechweb.com/wp-content/uploads/2013/04/iec.png

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 36: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science36

Scalability of Microservices

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

Page 37: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science37

Scalability of Microservices

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

B

1 req. / min1 req. / min

A

Page 38: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science38

Scalability of Microservices

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

B

1 req. / min1.000.000req. / sec

A

Page 39: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science39

Scalability of Microservices

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

B

1 req. / min1.000.000req. / sec

Page 40: A new software architecture for a distributed, modular and ...create microservices for different applications do … use NoSQL databases e.g. MongoDB, Elasticsearch create microservices

Institute for Applied Computer Science40

Scalability of Microservices

Eric Braun - A new software architecture for a distributed, modular and scalable IT infrastructure of future power system control centers

20.02.2017

A AA

A A A

B

1 req. / min1.000.000req. / sec

A AA