monitoring backbone networks · 2014-09-10 · monitoring backbone networks manuel Șubredu,...
TRANSCRIPT
R O E NM A N I A N D U C A T I O N E T W O R K
NetEduRo
Monitoring backbone networks
Manuel Șubredu, Valeriu Vraciu – RoEduNet
Chișinău, September 9, 2014
Agenda
Why ?
What ?
How ?
Tools ?
Facts !
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Why ?
A picture is worth a thousand words ! – Frederick R. Barnard, 20th century
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
What to monitor ?
Backbone and critical equipment – routers, switches, firewalls, load-balancers, etc
Servers and services
Values of traffic
Error rates
Transport network equipment, if available
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
How
Always use Industry standards for collecting data like:
SNMP
NetFlow v5/v9 and IPFIX
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Tools
OSS Software largely available
SNMP based:
NMIS
Cacti
Weathermap
NetFlow based:
NFSEN/NFDUMP
Custom software
Maps using free API from Google Maps (CEENGINE VTR)
Maps using different technologies: JS, ActionScript, PHP, SVG, etc (RoEduNet WeatherMap)
Proprietary software
For optical network
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Facts for Romanian Education Network !
NMIS:
home: https://opmantek.com/network-management-system-nmis/
90 routers and 20 switches monitored
Uses SNMP for collection of data
Xen based VPS - 1 x Xeon 2.4Ghz, 1G of memory, 64G of disk
OpenSuSE (64 bits)
Average load of the server – 2-3
3G of disk space for data since 2009 (5 years)
Requires some knowledge of Linux system and services for setup
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
NMIS (main page)
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Facts for Romanian Education Network !
Cacti
home: http://www.cacti.net/
Uses SNMP for collecting data
Can easily monitor any OID that returns an integer (think about temperature, number of routes, etc)
Easy deployment and small requirements (web server with PHP)
Easy administration using a web interface
Authenticated access, configurable per user views
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Cacti (custom temperature graph)
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Facts for Romanian Education Network !
Weathermap
home: http://www.network-weathermap.com/
Uses RRDs from NMIS
Can be build using only OSS technologies like SVG and JavaScript
Is very flexible and can accommodate all kind of data visualisation
Major downside – requires some programming skills
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
RoEduNet Weathermap
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Facts for Romanian Education Network !
Nfsen/nfdump
home: http://nfsen.sourceforge.net/
Uses NetFlow (v5 or v9)
Can have profiles of subset of data (think about graphs by service type or by IP addresses)
Supports plugins (Perl knowledge is required)
Supports alerts based on threshold or deviation from the mean
Major downside – lots of hardware needed on big networks: 1 server for data processing (8 x Xeon E7000 2.8Ghz with 64G of memory) and 22T of storage for 6 month of NetFlow’s exported by 13 core routers (8-12Gbps average traffic).
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Nfsen (main page)
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Facts for Romanian Education Network !
CEENGINE Visual Traceroute
home: https://noc.ceengine.eu/vtr/
Based on Google Maps
Heavy use of JS and custom web services
Backend and data collector written in Perl
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
VTR
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Facts for Romanian Education Network !
Custom maps
home: N.A.
Frontend based on JS and HTML5
Backend uses multiple OSS services and technologies:
Lots of data input points: email, http, logs, other databases.
PostgreSQL as database server
Perl for data processing
REST API
Low hardware requirements: 1 Xen based VPS with 1 Processor and 4G or memory.
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Project Asgard
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
(Extra slide – RoEduNet Optical network management)
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014
Q ?
E-infrastructure Autumn Workshop, Chisinau, September 8-11, 2014