grnet noc network monitoring & visualization tools
TRANSCRIPT
![Page 1: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/1.jpg)
http://www.grnet.gr
GRNET NOC network monitoring &
visualization tools
TF-NOCZurich
Alex Kosiaris ([email protected])Leonidas Poulopoulos ([email protected])
![Page 2: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/2.jpg)
Network monitoring• Constant monitoring of network for components
• Failing• Malfunctioning
• Notification of users via mail, sms, web interface• Monitoring aids in
• Preventing or limiting downtime• Effectively tracing errors and coping with them• Translating from machine errors to user friendly ones• Keeping performance, errors and faults archive
TF-NOC, Zurich 2GRNET NOC network monitoring & visualization tools
![Page 3: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/3.jpg)
TF-NOC, Zurich 3GRNET NOC network monitoring & visualization tools
Visualization• Network Topology
• Clearer view of network topology• Easier reading of links and relations
• Services• Better anticipation of service deployment• Effective and appealing “marketing”
• Any network related set of data• Traffic, Errors, Service requests
• Charts, Maps, Graphs, Tables
![Page 4: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/4.jpg)
Tools• What we do
70% of the tools is developed in-house
Python/Django: 70%, PHP: 30%
Use SNMP (99%) to harvest network data
Release updates every 2-3 months
Use a MySQL database to bind data
Avoid live SNMP queries to devices
• Tool Requirements Developed (if possible) in-house
… using the same (if-possible)development framework
…with a widely deployed and accepted network mgmt middleware
Maintained in-house
Bound together – using a common data source
With the least possible overhead to the network devices, services
TF-NOC, Zurich 4GRNET NOC network monitoring & visualization tools
![Page 5: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/5.jpg)
• In-house grnetdb (~150 tables) MySQL
Topology, devices features discovery: SNMP, PHP, custom RDBMS layer (4 times/day)
Visualization: Google Maps API, Djangoframework, DOJO JS framework, JSON data serialization
Graphs: Django framework, jquery, rrd
Monitoring: Nagios with data feed from grnetdb
• NMS & Monitoring Alcatel & Adva NMS
HP OV
Nagios, Munin, mrtg/rrd
Tools (2)
TF-NOC, Zurich 5GRNET NOC network monitoring & visualization tools
![Page 6: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/6.jpg)
Architecture
GRNET
grnetdbMySQL
PHP SNMP getters
Network discovery core functionality
GRNET RDBMS
DJA
NG
O f
ram
ewo
rk
Device Graphs
Network Topology
Hostmaster
H/W Inventory
L1 topology builder
Widgets
Nagios
Rancid
Ticketing (Jira)
CLI check scripts
TF-NOC, Zurich 6GRNET NOC network monitoring & visualization tools
![Page 7: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/7.jpg)
Device Graphs•http://mon.grnet.gr/rg
•Django (Python) templates - backend
•jQuery & jQuery UI
•Mobile flavour (jQuery mobile)
•Network device configuration retrieved from grnetdb
•Poll devices using a smart algorithm (minimize overhead)
•RRD graphs (rrdtool Python)
•Minor administrative interference
•Devices and ifces discovered by PHP SNMP script automatically
•Device graph types determined automatically
•Personalization
•Custom search engine
•Version releases every 2-3 months
•Not open sourced yet
• Abstraction layer has to be implemented
• Rewrite parts of code – get rid of GRNET-specific parts
TF-NOC, Zurich 7GRNET NOC network monitoring & visualization tools
![Page 8: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/8.jpg)
Device Graphs (2)
Mobile flavor will be soon released
TF-NOC, Zurich 8GRNET NOC network monitoring & visualization tools
![Page 9: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/9.jpg)
9GRNET NOC network monitoring & visualization tools
TF-NOC, Zurich
• http://mon.grnet.gr/network/maps/
Google Maps API v2 (soon to be ported to v3)
Django Framework
DOJO Javascript Framework
Data serialized to JSON and fed to API
Topology (L1, L2, L3)
Network weathermap (live data from rrd files)
Points of presence – GRNET clients
Lightweight edition eases integration with other apps
Network Topology
![Page 10: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/10.jpg)
10GRNET NOC network monitoring &
visualization toolsTF-NOC, Zurich
Network Topology (2)
![Page 11: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/11.jpg)
TF-NOC, Zurich 11GRNET NOC network monitoring & visualization tools
Alarming
• Nagios based
Common Infrastructure
• Network – Django Python tool to query grnetdb and generate
configuration
• Servers/Services– Populated through automation tool Puppet
An effort to maximize SNR
• Notifications go to interested parties only
• Web interface supports authorization so only relevant information is available
Plans for Load Balancing/HA setup
![Page 12: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/12.jpg)
TF-NOC, Zurich 12GRNET NOC network monitoring & visualization tools
Alarming (2)
• Visualization
Standard interface not topology aware
• Hates circular (aka rendundant) links
• Nagios map cgi ugly
• Information decimation difficult
Nagvis to the rescue
• Supports multiple maps
• Maps web editable
• Visual and audible alarming
• Still a work in progress
![Page 13: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/13.jpg)
TF-NOC, Zurich 13GRNET NOC network monitoring & visualization tools
Alarming (3)
![Page 14: GRNET NOC network monitoring & visualization tools](https://reader031.vdocuments.net/reader031/viewer/2022020203/58a2d7961a28ab41128b71a0/html5/thumbnails/14.jpg)
Thank you
TF-NOC, Zurich GRNET NOC network monitoring & visualization tools
14
Questions ?