the management infrastructure of a network measurement system for qos parameters alexandru bikfalvi,...
TRANSCRIPT
The Management The Management Infrastructure of a Infrastructure of a
Network Measurement Network Measurement System for QoS System for QoS
ParametersParametersAlexandru Bikfalvi, Paul PAlexandru Bikfalvi, Paul Pătraş, ătraş,
Mihai Cristian Vancea, Virgil DobrotMihai Cristian Vancea, Virgil DobrotăăTechnical University of Cluj-NapocaTechnical University of Cluj-Napoca
Communications DepartmentCommunications Department26-28 Baritiu Street, 400027 Cluj-Napoca, Romania, Tel/Fax: +40-26-28 Baritiu Street, 400027 Cluj-Napoca, Romania, Tel/Fax: +40-
264-597083264-597083
AgendaAgenda
• Scenario based on existing toolsScenario based on existing tools• Overview of a network management Overview of a network management
systemsystem• Design of the management Design of the management
infrastructureinfrastructure• Experimental resultsExperimental results• Conclusions and future workConclusions and future work
• Vendor specific Vendor specific applications for specific applications for specific platformsplatforms
• Not all applications are Not all applications are QoS capableQoS capable
• Some require complex Some require complex commands, scripts, commands, scripts, procedural stepsprocedural steps
• Manual measurement Manual measurement control (especially on control (especially on different tools)different tools)
• Additional software and Additional software and computations to obtain computations to obtain targeted resultstargeted results
Existing Tools ScenariosExisting Tools Scenarios
MeasuremeMeasurement nt
ApplicationApplicationss
Tested NetworkTested Network
Our Software SolutionOur Software Solution
Tested NetworkTested Network
Network Network Measurement Measurement SystemSystem
ManagemenManagement Consolet Console
MeasuremenMeasurement Agentst Agents
Management Management StationStation
ConsoleConsole• Straightforward user Straightforward user
interfaceinterface• User focuses on scenarios, User focuses on scenarios,
topology, test objectivestopology, test objectives• Runtime operations Runtime operations
performed by the computerperformed by the computer• Measured QoS parameters Measured QoS parameters
available automaticallyavailable automatically
InfrastructureInfrastructure• Software module used by Software module used by
both applicationsboth applications• Measurement information Measurement information
communicationcommunication• Accomplish the task using a Accomplish the task using a
management protocolmanagement protocol
Network Management Network Management OverviewOverviewArchitecture – collection Architecture – collection
of…of…• Managing devices – Managing devices –
management stationsmanagement stations• Managed devices – Managed devices –
network elementsnetwork elements• Management messages Management messages
– management protocol– management protocol
ManagersManagers
AgentsAgents
A comprehensive management architecture is A comprehensive management architecture is usually specific to a management technologyusually specific to a management technology
Managers and AgentsManagers and Agents
Managers handle management Managers handle management taskstasks
• Network Management Systems Network Management Systems (NMS) or Operation Support (NMS) or Operation Support Systems (OSS)Systems (OSS)
• Communicate with the agents Communicate with the agents within the managed deviceswithin the managed devices
• Provide a console or an interface for Provide a console or an interface for user administrationuser administration
• Perform predefined or user-defined Perform predefined or user-defined automated actionsautomated actions
Management ConsoleManagement Console
QoS QoS Measurement Measurement
AgentAgentAgents run on managed Agents run on managed
devicesdevices• Service managers’ requestsService managers’ requests• Notify of unexpected eventsNotify of unexpected events
Message CommunicationMessage Communication
It is done using a management protocol such as SNMP, CMIPIt is done using a management protocol such as SNMP, CMIP
Polling…Request Request message message sent to the sent to the agentagent
Process Process request request and reply and reply backback
Event-driven…
!!An An event event occursoccurs
A notification A notification is sent to is sent to inform the inform the managermanager
The event The event is is processedprocessed
Management Information
• Meaning of data transported by the management Meaning of data transported by the management protocol between the managers and the agentsprotocol between the managers and the agents
There are manyThere are many• ManufacturersManufacturers• EquipmentsEquipments• ApplicationsApplications• ParametersParameters
Repository Repository of of manageable manageable informationinformation
What is requiredWhat is required
• Should contain the managed objects and their Should contain the managed objects and their relationshipsrelationships
• Must provide a base of identifying those Must provide a base of identifying those objectsobjects
• Must be build on widely accepted rulesMust be build on widely accepted rules
Infrastructure DesignInfrastructure Design
NMS NMS ManagemeManageme
ntnt
Structural LogicStructural Logic
The user interacts with The user interacts with these items to perform a these items to perform a measurementmeasurement
Organizes Organizes measurement measurement operations as a set of operations as a set of abstract itemsabstract items
SessionsSessionsGroupsGroupsTasksTasks
Management MessagesManagement MessagesIdentification messages relay information Identification messages relay information about agents’ capabilitiesabout agents’ capabilitiesTask control messages request agents to Task control messages request agents to start a measurement taskstart a measurement taskData messages are used to collect QoS Data messages are used to collect QoS results from a set of agentsresults from a set of agents
Infrastructure DesignInfrastructure Design
The fundamental QoS measurement The fundamental QoS measurement scenarioscenarioA data structure comprising the A data structure comprising the agents and parameters used in the agents and parameters used in the QoS testQoS testReusability: can be saved and later Reusability: can be saved and later loadedloadedSeveral sessions mapped with one Several sessions mapped with one referencereferenceContain unrelated sessions Contain unrelated sessions distributed in timedistributed in timeBased on a single session with a Based on a single session with a variable parametervariable parameter
A session or a group to be executedA session or a group to be executedThe start time can be user-definedThe start time can be user-definedThe execution process done entirely The execution process done entirely by the management softwareby the management software
Infrastructure DesignInfrastructure DesignDefining SessionsDefining Sessions • Agent (s) Agent (s)
involvedinvolved• Generation / Generation / AnalysisAnalysis• Traffic typeTraffic type
• Packet Packet distributiondistribution• Protocol specificProtocol specific
• Desired resultsDesired results
Session 1Session 1Agent 1 Agent 1 ►► Agent Agent
33Session 2Session 2Agent 2 Agent 2 ►► Agent Agent
44
Agent Agent 11
Agent 2Agent 2Agent 3Agent 3
Agent 4Agent 4
Task 1Task 1Session 2Session 2 @ 1 o’clock @ 1 o’clock
Task 2Task 2Session 1Session 1 @ 3 o’clock @ 3 o’clock
(pending(pending))
(pending(pending))
(running(running))
(finishe(finished)d)
(runnin(running)g)
QoS P
ara
mete
r
TimeTime
Management StationManagement Station
Scheduling and Running TasksScheduling and Running Tasks
CollectingResultsCollectingResults
Management MessagesManagement Messages
Access ProceduresAccess Procedures
Set RequestSet Request
Request ResponseRequest Response
Get RequestGet Request
Request ResponseRequest Response
Get RequestGet Request
ResponseResponse
Structure of Structure of Management Management InformationInformation
isoisoisoiso
orgorgorgorg
doddoddoddod
interneinternett
interneinternett
experimentexperimentalal
experimentexperimentalal
11
33
66
11
33
connectionconnectionconnectionconnection
systemsystemsystemsystem
traffictraffictraffictraffic
advancedadvancedadvancedadvanced
11
22
33
44
Object Object ClassesClasses
The management infrastructure uses The management infrastructure uses the Simple Network Management the Simple Network Management
ProtocolProtocol
ManagemenManagement Stationt Station AgentAgent
Software ArchitectureSoftware Architecture
Measurement Measurement ServicesServices
Communication Communication ServicesServices
ManagemeManagement Consolent Console
ManagemeManagement Consolent Console
MeasuremeMeasurement Agentnt Agent
User User InterfaceInterface
User User InterfaceInterface
Session Session ManagerManager
Queuing Queuing ServiceService
SNMP SNMP ServiceServiceSNMP SNMP
ServiceService
ManagemeManagement Servicent Service
• Management console’s QoS Management console’s QoS measurement intelligencemeasurement intelligence
• Enables user control through Enables user control through various windows and dialogsvarious windows and dialogs
• Allows creation of measurement Allows creation of measurement sessions, groups and taskssessions, groups and tasks
• Runs the measurement task; Runs the measurement task; collects and stores resultscollects and stores results
• Synchronous service for Synchronous service for asynchronous messagesasynchronous messages
• Message retransmissions, Message retransmissions, duplicates deletion, timeoutduplicates deletion, timeout
• Encapsulation of messages to Encapsulation of messages to SNMP PDUsSNMP PDUs
• SNMP data verification, buffer SNMP data verification, buffer overflow checking overflow checking
• A thread for each assigned local A thread for each assigned local network interfacenetwork interface
• Socket I/O operations with SNMP Socket I/O operations with SNMP datadata
Management ConsoleManagement Console
Session ManagerSession ManagerSession ManagerSession Manager
The primary application that enables the The primary application that enables the users to perform QoS measurementsusers to perform QoS measurements
GUIGUIGUIGUI Task Task SchedulingScheduling
Task Task SchedulingScheduling
Queuing ServiceQueuing ServiceQueuing ServiceQueuing Service
SNMP ServiceSNMP ServiceSNMP ServiceSNMP Service Management Management ServiceService
Management Management ServiceService
Service Control ManagerService Control ManagerService Control ManagerService Control Manager
Configuration ServiceConfiguration ServiceConfiguration ServiceConfiguration Service
Hard
ware
Man
ager
Hard
ware
Man
ager
Hard
ware
Man
ager
Hard
ware
Man
ager
Message Message WrapperWrapperMessage Message WrapperWrapper
Running Core ServicesRunning Core Services
I want to schedule I want to schedule my first my first measurement task measurement task using using Agent 1Agent 1
I want to schedule I want to schedule my first my first measurement task measurement task using using Agent 1Agent 1
GUIGUI SessionSession ManagerManager
TaskTask
PendingPendingRunningRunning
OutboundOutbound
InboundInbound
Level 1Level 2
Level 3Level 4
Level 1Level 2
Level 3Level 4
MessagMessagee
MessagMessagee
MessagMessagee
MessagMessagee
MessagMessagee
ACKACK
MessagMessagee
MessagMessagee
Queuing ServiceQueuing Service
Management Management ServiceService
MessagMessagee
SNMP ServiceSNMP Service
222200001111
SNMPSNMP
Experimental ScenarioExperimental Scenario
Management Management StationStation
Cisco Catalyst Cisco Catalyst 29502950
AgentAgent
1Gpbs 1Gpbs SysKonnect SysKonnect
Measurement Measurement Endace DAGEndace DAG
AgentAgent
ObjectivesObjectives• SysKonnect system SysKonnect system
performanceperformance• ThroughputThroughput
• Packet delay variationPacket delay variation
• Packet lossPacket loss
1000 Base SX1000 Base SX
ParametersParameters• Frame rate: 200 to 100,000 Frame rate: 200 to 100,000
ppspps• Frame size: 1500 bytesFrame size: 1500 bytes
• Test duration: 100 secondsTest duration: 100 seconds
• Packet distribution: Packet distribution: periodicperiodic
Experimental ResultsExperimental Results
• Series of tests vs. packet rate at 1500 byte Series of tests vs. packet rate at 1500 byte framesframes
0
1
2
3
4
5
6
7
0 20 40 60 80 100Packet Rate [103 pps]
Num
ber of
Pac
kets
[10
6 pac
kets
]
Tx Packets
Rx Packets
0
1
2
3
4
5
6
7
0 20 40 60 80 100Packet Rate [103 pps]
Num
ber of
Pac
kets
[10
6 pac
kets
]
Tx Packets
Rx Packets
• Packet countPacket count• ThroughputThroughput• Delay Delay
variationvariation• Packet loss Packet loss ratioratio
6 million 6 million packets per packets per 100 100 seconds seconds testtest
0
100
200
300
400
500
600
700
800
0 20 40 60 80 100Packet Rate [103 pps]
Thro
ughp
ut [M
bps]
Throughput (Mbps)
0
100
200
300
400
500
600
700
800
0 20 40 60 80 100Packet Rate [103 pps]
Thro
ughp
ut [M
bps]
Throughput (Mbps)
Almost 700 Almost 700 MbpsMbps
-5
-4
-3
-2
-1
0
1
2
3
4
5
0 20 40 60 80 100
Packet Rate [103 pps]
Del
ay [m
s]
Avg Delay Variation (ms)Min Delay Variation (ms)
Max Delay Variation (ms)-5
-4
-3
-2
-1
0
1
2
3
4
5
0 20 40 60 80 100
Packet Rate [103 pps]
Del
ay [m
s]
Avg Delay Variation (ms)Min Delay Variation (ms)
Max Delay Variation (ms)
Up to 4 Up to 4 millisecondsmilliseconds
-1
0
1
2
3
4
5
6
7
0 20 40 60 80 100
Packet rate [103 pps]
Pack
et L
oss Ra
tio
[%]
Packet Loss Ratio (%)
-1
0
1
2
3
4
5
6
7
0 20 40 60 80 100
Packet rate [103 pps]
Pack
et L
oss Ra
tio
[%]
Packet Loss Ratio (%)
Up to 6.5 Up to 6.5 percentpercent
• Real-time Real-time failurefailure
-1
0
1
2
3
4
5
6
0 20 40 60 80 100
Packet Rate [106 pps]
Real
-tim
e Fa
ilure
s [1
06 tim
es]
Real-time Failure (times)
-1
0
1
2
3
4
5
6
0 20 40 60 80 100
Packet Rate [106 pps]
Real
-tim
e Fa
ilure
s [1
06 tim
es]
Real-time Failure (times)
Conclusions and Future Conclusions and Future WorkWork
• Faster experiment setup and results Faster experiment setup and results processingprocessing
AdvantagesAdvantages
• No human attendance during testing requiredNo human attendance during testing required• Extra features to make network testing easier to Extra features to make network testing easier to
performperform• User focuses on experiment target rather on User focuses on experiment target rather on implementationimplementation• Greater availability of data after a test is Greater availability of data after a test is completedcompleted
• Not portable on all existing platformsNot portable on all existing platforms• Not optimized for local resources usage and all Not optimized for local resources usage and all
measurement proceduresmeasurement procedures• Does not implement a fine-grained analysis to Does not implement a fine-grained analysis to
conserve management bandwidthconserve management bandwidth
DrawbacksDrawbacks
Future WorkFuture Work
• Extend support for other management Extend support for other management protocolsprotocols• Improve communication control procedures Improve communication control procedures between management console and agentsbetween management console and agents
• Include support for other networking Include support for other networking technologiestechnologies
Thank YouThank You