advanced architecture for inter-domain quality of service monitoring, modelling and visualisation
DESCRIPTION
IST-2001-34123 http://www.ist-intermon.org. Advanced architecture for INTER-domain quality of service MONitoring, modelling and visualisation. Project Review No.1 Brussels, Belgium March 12, 2003. Project Overview. WP1, WP 2. Ulrich Hofmann (Salzburg Research). Architecture. WP3. - PowerPoint PPT PresentationTRANSCRIPT
Slide 104/21/23
Advanced architecture for INTER-domain quality of service MONitoring,
modelling and visualisation
Project Review No.1
Brussels, Belgium March 12, 2003
IST-2001-34123 http://www.ist-intermon.org
Slide 204/21/23
Outline
INTERMON Demo
Visual data mining
Modelling & Simulation
Monitoring & Measurements
Architecture
Project Overview
INTERMON partners
Stefan Michaelis (Uni Dortmund)WP6
Matthias Scheidegger (Uni Bern)WP5
Sandra Tartarelli (NEC)WP4
Mauro Gargiulo (CINI/ITEM)WP3
Ulrich Hofmann (Salzburg Research)WP1, WP2
Slide 304/21/23
Outline
INTERMON Demo
Visual data mining
Modelling & Simulation
Monitoring & Measurements
Architecture
Project Overview
INTERMON partners
Stefan Michaelis (Uni Dortmund)WP6
Matthias Scheidegger (Uni Bern)WP5
Sandra Tartarelli (NEC)WP4
Mauro Gargiulo (CINI/ITEM)WP3
Ulrich Hofmann (Salzburg Research)WP1, WP2
Slide 404/21/23
Consortium
Universities
and
Research Institutes
SalzburgResearch, Austria
Frauenhofer- FOKUS, Germany
Uni Bern, Switzerland
Uni Budapest, Hungary
Waterford Institute, Ireland
CINI/ITEM, Italy
Uni Dortmund
SAR
FOKUS
Uni Be
DTT-BUTE
WIT
CINI/ITEM
Uni Do
ISP and
Network Operators
T-Syst. Deutsche Telekom, Germ.
Telefonica, Spain
Telecom Italia Lab., Italy
T-NOVA
TID
TILAB
I&C
manufacturer
Siemens PSE, Austria
NEC Europe, Germany
SAG
NEC-E
Slide 504/21/23
Role of partners
Architecture,delay meas.,topology tool,integr.
Hybrid modelling, simulation, integration
Time series modelling, ARIMA forecasting
Visual data mining, architecture, integration
Architecture, services, integration
Visual data mining, filters, VoIP model., integr.
FOKUS
Uni Be
BUTE
WIT
CINI/ITEM
Uni Do
Traffic analyser, user interface, integr,exploit.
Topology discovery, Modelling,Integr.,exploit.
Traffic Measurement, Modelling, Integration
T-NOVA
TID
TILAB
Requirements, VoIP scenarios, modelling IPFIX, standard., modelling, integr., exploit.
SAG
NEC-E
WP2 Leader
WP4 Leader
WP7 Leader
SAR WP1 LeaderCoord., fluid simul., mod.,DB,QoS tools,integr.
WP3 Leader
WP5 Leader
WP6 Leader
Slide 604/21/23
Project Meetings and Co-Operation
Project Meetings Kick Off Meeting , Salzburg 4/2002 Project Meeting, Berlin 6/2002 Project Meeting, Waterford 9/2002 Project Meeting, Turin 11/2002 Project Meeting, Salzburg 2/2003
Concertation Meetings 6/2002 Brussels 3/2003 Brussels
Next Generation Networks (NGN) Activities IP QoS & MoMe Roadmap , Benchmarking 7-9/2002 NGNi MoMe Workshop 6/2002 Berlin
Slide 704/21/23
Project Meetings and Co-Operation
Cluster Activities MoMe ( Monitoring & Measurement) Integration of AQUILA results into INTERMON IPS workshop presentations from AQUILA, CADENUS
Initiation by INTERMON of the first International Workshop on Inter-domain Performance and Simulation (IPS 2003) , Salzburg
20/21.2003
International cooperation with ITA Brazil, NCIT Canada tools used for education in ITA INTERMON exploitation for Tele-Haptics with NCIT
Slide 804/21/23
Deliverables (all in time)
WP3Feb 03Architecture components and interactions (additional deliverable)
D4
WP6Dec 02Specification of visual data mining and user interface
D7
WP5Dec 02Specification of inter-domain QoS modelling and Simulation toolkit
D6
WP4Sept 02Specification of inter-domain QoS data base with policy controlled data collection
D5
WP4Sept 02Specification of Inter-Domain QoS Monitoring and structure discovery components
D3
WP3Aug 02System Architecture und SpecificationD2
WP2Jun 02Analysis and Requirements ReportD1
WPDateTitle
Slide 904/21/23
Objectives
Enhance the inter-working of tools in large scale,
multi-domain Internet networks to support: QoS and traffic analysis and forecasting Network planning and traffic engineering
Collect, process and present (in an automatic fashion) information about: Network topology, Traffic flows, QoS, and SLA fulfillment
Integrating various components and methods: Topology detection and traffic measurement tools Distributed information base Measurements based analytical models and simulations ! Visual data mining techniques
Slide 1004/21/23
Tools, data base, interactions, architecture
Policy Controlled DataBaseAccess
Flexible Configurationof DataBase Sources
Visual Data miningTraffic MatrixQoS analysis
Monitoring Tools- active QoS- passive traffic, IPFIX
InterDomain topology discovery
Path structureBGP
Simulation Toolsusing measurement based
load models
Objectives (2)
Slide 1104/21/23
Project Highlights (1) INTERMON Toolkit
first experience feedback from the users ( ISP, I&C )
important step before integration (6/03)
Scalable and efficient Inter-Domain simulation technologies fluid using differential equations
hybrid integrating analytical models
time series data
Measurement based modelling and simulation trace based models (CBTM)
forecasting models (ARIMA considering outliers)
Design of an advanced inter-domain QoS analysis architecture with topology discovery, QoS and traffic monitoring, modelling, simulation and visual data mining using data base with policy control
Slide 1204/21/23
Project Highlights (2)
IPS Workshop 26 presentations distributed over 9 sessions
Contributions from European countries, but also US, Canada, Brazil
2 Tutorials
50 participants + students
Standardisation IPFIX PSAMP Contributed to the establishment of a new IETF WG (PSAMP) Co-chairing IETF PSAMP Submitted 1 Internet Drafts (2 versions) to IETF PSAMP
International research contributions
32 publications - www.ist-intermon.org
Slide 1304/21/23
Innovations (1)
Policy based Monitoring and Measurement Different kinds of QoS analysis need
different policies for tool interworking and data base access
Dependency of end-to-end QoS on inter-domain routing
Dependency of end-to-end QoS on inter-domain topology path
Inter-domain QoS inferencing
(tomography) from end-to-end
measurements and inter-domain
topology discovery
•IPFIX
• combination of tools for multivariate QoS & traffic analysis
• event detection /“outliers“
• INTERMON CM Toolset extension for QoS inferencing (tomography)
Slide 1404/21/23
Innovations (2)
Modelling, Simulation
Load modelsmeasurements <--> load models load models <--> simulation models
Structured load modelsclass based : monitor only heavy loadanalyse outliers
Measurement based QoS modelling and forecasting toolkit
modelling considering abnormal events?Novel forecasting models?VoIP Modelling
Measurement based modelling and simulation environmentby policy driven measurement
Measurement based modelling and forecasting toolkit
QoS prediction based on ARIMA and further models considering „outliers“
application model generators (VoIP,..) integration in CM Toolset
Slide 1504/21/23
Innovations (3)
Inter-Domainabstraction
Algorithm
no loss =>no feedbackin traffic (control)
sequentialtime seriessimulation
Time Series BasedSimulation Architecture/IPS 31-36/
ID-delay= corepropagation + ID-link delay
Hybridsimulation
ns2 with AnalyticalNetwork Cloud Models/IPS 21-30/
aggregated trafficload ->N-distribution
continousload ; usenumericalpower
Multi-Class signal flowmodel/IPS 37-50/
Simulation Models
Slide 1604/21/23
Innovations (4)
Visual data mining
Scalable and flexible data
preparation/visualisation
Customisable visual data mining for
application QoS in interdomain
environment
Spatial composition
Inter-domain traffic analysis
Generalised Pipline Concept - configurable filters, mappings and applications
Spatio-temporal QoS analysis (QoS patterns, „outliers“) for enhanced QoS provision
Flexible traffic matrix concept for inter-domain capacity planning
Slide 1704/21/23
New toolkits for the network operator and end user
Architecture which integrates components and their interfaces database
Interface to the user Command GUI
Visualisation
Management
Innovations must be validated
INTERMON toolkit
INTERMON database
XML interfaces and adapters
Flexible data source integration
Local-global controller
Configurable application integration
into INTERMON Toolkit-GUI
Statistical-, 2-,3-D Visualisation
Test bed
field trial
feedback loop to inter-domain modelling
Innovations (5)
Slide 1804/21/23
Achievements (1)
WP2 Requirements : D1 6/02 (Siemens) Intermon architecture and toolkit requirements - general concepts for tool
integration, policy based tool interaction and data base control
Architecture and INTERMON-integrated Toolkit requirements
Policy based monitoring, Modelling, Simulation, Visual data mining and data base
requirements
Application requirements
QoS / SLA monitoring, modelling, simulation and validation of applications
(VoIP, ..) in inter-domain environment
Border router traffic flow monitoring, modelling and simulation for traffic
engineering and capacity planning
Requirements for services and business scenarios
Cooperations (GEANT, ..)
Results presented at EURESCOM Conference
Slide 1904/21/23
Achievements (2)
WP3 Architecture D2 8/02 ( SR, FHG), D4 2/03 (CINI) D2 8/02 based on the Requirements deliverable
defines tools and their conceptual interfaces
specifies menus and configurable user interface
D4 2/03 Extended Architecture Deliverable March 2003 with implementation oriented view of the architecture and service concepts
global / local controller
abstractions from specific tools (e.g. different meters)
Information model for configuring an IETF IPFIX meter (which can serve to produce further contributions to the IETF)
dedicated presentation planned at today Review
Slide 2004/21/23
Achievements (3)
WP4 Policy controlled data collection&monitoring, database
D3 9/02 (NEC), D5 9/02 (SR) Specification of Inter-Domain QoS Monitoring and structure discovery
components IPFIX traffic measurementCM Toolset topology discovery
Specification of inter-domain QoS data base with policy controlled data collection
INTERMON data base
policy controlled usage of tools for QoS analysis
flexible configuration of data sources
Slide 2104/21/23
Achievements (4)
WP 5 : Modelling, Simulation D6 12/02 (UBE) Several novel simulation concepts and prototypes
=> see innovations
Inter-Domain modelsRouter and domain models based on neural networksModels of traffic aggregate behavior of several application typesPure analytical approach for QoS
Measurement based traffic modellingTrace based traffic model - CBTM method IPSApplication based models (VoIP for IP-Backbones) IPS
Slide 2204/21/23
Achievements (5)
Modelling and prediction of measured time series data of QoS parameters considering “outliers”
Usage of Box&Jenkins (or ARIMA) methodology (differencing the process to remove non-stationarity) and preliminary outliers eliminationIPS
Measurement based QoS forecastingARIMA considering outliers IPS
Slide 2304/21/23
Achievements (6)
WP 6 Visual Data Mining for inter-domain D7 12/02 (UDO)
Generalised filter pipeline concept for scalable and flexible data
preparation/visualisation
Visual data mining for inter-domain topology, traffic and QoSTopology
flexible configurable and parameterizable traffic matrix conversion to meet data
mining demands for traffic flow analysis IPS
spatio-temporal analysis based on statistical models and pattern analysis IPS
Modular user interface for tool integration
Slide 2404/21/23
Achievements (7)
WP 7 Rapid Prototyping Integration ( T-SYS)
First INTERMON integrated Toolkit version is working in a lot of facilities
Intention - development to get experience and to facilitate real usage and
experiments
INTERMON toolkit (current state, business scenarios, functions, future
work)
dedicated presentation planned at today Review
Slide 2504/21/23
Tools (Topology Discovery, Modelling, Simulation, Monitoring)
Controls -Topological and geographical mapping of tools and data bases
Data Base (INTERMON, other data sources)
Objects (Visual data
mining „dictionary“)
INTERMON results
stored in documents
INTERMON Toolkit
INTERMON integrated Toolkit
Slide 2604/21/23
Inter-domain Performance and Simulation Workshop (IPS)20/21.02.2003 Salzburg
www.ist-intermon.org/workshop
initiated by INTERMON project
next IPS 2004 Workshop in Budapest
further steps : IPS conference and IPS Forum for industry and research
Slide 2704/21/23
•lack of european research and projects in inter-domain issues to improve competiveness with rest of the world
•network tomography•interdomain routing•toplogy discovery•events, anomalies•QoS models
•IPS establishment•joint effort of research and industrial partners
•IPS experts from•different disciplines : internet engineers, mathematicians
IPS workshop motivation
Slide 2804/21/23
Standardisation
IETF Drafts
IETF IP Flow Information eXport (IPFIX) working group J. Quittek, T. Zseby, B. Claise, S. Zander:
Requirements for IP Flow Information Export
draft-ietf-ipfix-regs-09.txt, February 2003
IETF Packet Sampling (PSAMP)working group T. Zseby, M. Molina, F. Raspall:
Sampling and Filtering Techniques for IP Packet Selection
draft-ietf-psamp-sample-tech-01.txt, March 2003
J. Quittek
On the Relationship between PSAMP and IPFIX
draft-quittek-psamp-ipfix-01.txt, February 2003
Slide 2904/21/23
Next Steps and future Plans
Implementation - WP4, WP5, WP6 Integration WP7 - first steps 6/2003 Berlin Validation of Models Policy based QoS Analysis Specification Test Bed, Exploitation, Services and Business Scenarios European and international scenarios for INTERMON toolkit usage
Madrid, Salzburg, Berlin and other sites Brazil , Canada
Real Date : GEANT Policy based QoS Analysis Concepts Testscenario and Validation concepts
IPS workshop 2004 MoMe Cluster CeBit 2003 Hannover
Slide 3004/21/23
Outline
Project Overview (WP1)
Architecture (WP3)
Monitoring & Meas. (WP4)
Modelling & Simulation (WP5)
Visual Datamining (WP6)
INTERMON Demo
•Ulrich Hofmann (SalzburgResearch)
•Mauro Gargiulo (CINI/ITEM)
•Sandra Tartarelli ( NEC)
•Matthias Scheidegger ( Uni Bern)
•Stefan Michaelis ( Uni Dortmund)
•.......
Slide 3104/21/23
WP slides will be stored on this computer ( sunday) .... ....
Slide 3204/21/23
Outline
Project Overview (WP1)
Architecture (WP3)
Monitoring & Meas. (WP4)
Modelling & Simulation (WP5)
Visual Datamining (WP6)
INTERMON Demo
•Ulrich Hofmann (SalzburgResearch)
•Mauro Gargiulo (CINI/ITEM)
•Sandra Tartarelli ( NEC)
•Matthias Scheidegger ( Uni Bern)
•Stefan Michaelis ( Uni Dortmund)
•.......
Slide 3304/21/23
WP slides will be stored on this computer ( sunday) .... ....
Slide 3404/21/23
Outline
Project Overview (WP1)
Architecture (WP3)
Monitoring & Meas. (WP4)
Modelling & Simulation (WP5)
Visual Datamining (WP6)
INTERMON Demo
•Ulrich Hofmann (SalzburgResearch)
•Mauro Gargiulo (CINI/ITEM)
•Sandra Tartarelli ( NEC)
•Matthias Scheidegger ( Uni Bern)
•Stefan Michaelis ( Uni Dortmund)
•.......
Slide 3504/21/23
WP slides will be stored on this computer ( sunday) .... ....
Slide 3604/21/23
Outline
Project Overview (WP1)
Architecture (WP3)
Monitoring & Meas. (WP4)
Modelling & Simulation (WP5)
Visual Datamining (WP6)
INTERMON Demo
•Ulrich Hofmann (SalzburgResearch)
•Mauro Gargiulo (CINI/ITEM)
•Sandra Tartarelli ( NEC)
•Matthias Scheidegger ( Uni Bern)
•Stefan Michaelis ( Uni Dortmund)
•.......
Slide 3704/21/23
WP slides will be stored on this computer ( sunday) .... ....
Slide 3804/21/23
Outline
Project Overview (WP1)
Architecture (WP3)
Monitoring & Meas. (WP4)
Modelling & Simulation (WP5)
Visual Datamining (WP6)
INTERMON Demo
•Ulrich Hofmann (SalzburgResearch)
•Mauro Gargiulo (CINI/ITEM)
•Sandra Tartarelli ( NEC)
•Matthias Scheidegger ( Uni Bern)
•Stefan Michaelis ( Uni Dortmund)
Slide 3904/21/23
demo slides will be stored on this computer ( sunday) .... ....