evaluation of euqos system by simulation: tools and resultsaai.tele.pw.edu.pl/artikuly/evaluation of...
TRANSCRIPT
![Page 1: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/1.jpg)
Slide 1/27© EuQoS consortium University of Pisa/CPR
Evaluation of EuQoS System by Simulation: Tools and Results
Giovanni Stea, University of Pisa/CPRAndrzej Beben, Warsaw University of Technology
![Page 2: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/2.jpg)
Slide 2/27© EuQoS consortium University of Pisa/CPR
D2.1.2: Validation of the EuQoSsystem by simulation
• Editor: Wojciech Burakowski.• Contributors:
– Gerardo García de Blas, Maria L. García Osma, S. Pérez, R. Trueba (TID)– Jorge Sá Silva, Maxweel Carmo, Rómulo Ribeiro (UoC);– Giovanni Stea, Enzo Mingozzi, Claudio Cicconetti (UoPisa/CPR);– Gianfranco Santoro, Andrea Angelini, Marco Cavicchioni, Vito D’Eri,
Domenico Fiorentini, Riccardo Proietti (UoR/CRMPA);– Xavi Masip, Sergi Sánchez, Jordi Domingo (UPC);– Robert Janowski, Halina Tarasiuk, Jaroslaw Sliwinski, Wojciech
Burakowski, Damian Duda, Jordi Mongay Batalla, Andrzej Beben (WUT).
![Page 3: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/3.jpg)
Slide 3/27© EuQoS consortium University of Pisa/CPR
Simulation modelfor the EuQoS system
• Motivation:– validate & verify the EuQoS architecture;– provide guidelines based on simulation results.
• Simulation tools:– SiM-EuQoS-PTL: Packet transmission level;– SiM-EuQoS-CIL: Call invocation level;– SiM-EuQoS-PL: Provisioning level.
![Page 4: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/4.jpg)
Slide 4/27© EuQoS consortium University of Pisa/CPR
Overview of SiM-EuQoS-PTLPacket Transmission Level Simulator
• Access networks connected to the core through a single link
• No. of flows is fixed• Routing does not change
• Traffic distinguished into – Foreground, i.e. applications
which are actually measured– Background, i.e. aggregated
interference traffic
Hypotheses
![Page 5: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/5.jpg)
Slide 5/27© EuQoS consortium University of Pisa/CPR
Access networks
• Four different access networks are considered:
UMTS
xDSL
WiFi
Ethernet
![Page 6: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/6.jpg)
Slide 6/27© EuQoS consortium University of Pisa/CPR
Access Networks: UMTS
• Urban and rural scenarios considered– Different propagation and
mobility models
• Single Node B– Intercell interference accounted
for by using interference models
• DSCH and DCH implemented
![Page 7: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/7.jpg)
Slide 7/27© EuQoS consortium University of Pisa/CPR
Access Networks: WiFi
• Nodes using DCF in an 802.11 infrastructure mode network (802.11e left for the 2nd phase)
• RTS/CTS handshake• Fragmentation
• No mobility simulated• Channel error models to be
added• No power saving nor rate
switching
![Page 8: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/8.jpg)
Slide 8/27© EuQoS consortium University of Pisa/CPR
Access Networks: Ethernet
• Switched Ethernet:– Small Office Home Office
(SOHO)– Campus/LAN scenario– MAN organization scenario– MAN residential scenario
(EPON)
• 802.1p and 802.1q standards implemented
![Page 9: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/9.jpg)
Slide 9/27© EuQoS consortium University of Pisa/CPR
Access Networks: xDSL
![Page 10: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/10.jpg)
Slide 10/27© EuQoS consortium University of Pisa/CPR
Core Network
• DiffServ-capable routers with (at least) 2 PHBs
• QoS-oriented classification, policing and scheduling mechanisms enforced
• Interfering traffic represents aggregated traffic from access networks and core domains
• Bottlenecks are at the inter-domain links
![Page 11: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/11.jpg)
Slide 11/27© EuQoS consortium University of Pisa/CPR
Traffic models
Foreground traffic• VoIP
– G.711, G.729 codecs with VAD• Video Conference
– MPEG4 and H263 VC traces• Video streaming
– MPEG 4 encoded movies• Input expected from
application developers in EuQoS
Background traffic• Depends on the network
(access tech. and core)• Depends on what applications
are actually used• Many models available in the
literature• Input expected from
measurement activities in EuQoS
![Page 12: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/12.jpg)
Slide 12/27© EuQoS consortium University of Pisa/CPR
Implementation of the packet level simulator
• Ns-2 has been used• Devised a framework that allows the seamless addition
of new modules• Simulation scenarios can be built incrementally
![Page 13: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/13.jpg)
Slide 13/27© EuQoS consortium University of Pisa/CPR
First simulation results
• Objectives:– Validate the PTL simulator– Assess the level of QoS provided by the existing
“bare” access and core technology• What do we get without EuQoS• What do we need from EuQoS
– Test QoS in heterogeneous access networks• Do different QoS mechanisms interoperate correctly?
– “lay the ground” for simulating the effectiveness of EuQoS mechanisms at all relevant layers
![Page 14: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/14.jpg)
Slide 14/27© EuQoS consortium University of Pisa/CPR
Example: impact of non QoStraffic on QoS traffic
ATU-R
ATU-R DSLAM
DSLAM
Switch
Switch
BRAS
Background traffic node 1
Background traffic node 2
Background traffic node 3
Background traffic node 4
Background traffic node 5
User S
User T
User T
Server S
Server T
User SATU-R
ATU-R DSLAM
DSLAM
Switch
Switch
BRAS
Background traffic node 1
Background traffic node 2
Background traffic node 3
Background traffic node 4
Background traffic node 5
User S
User T
User T
Server S
Server T
User S
Negligible where native QoSdifferentiation exists
Arbitrarily large where no QoS differentiation exists
![Page 15: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/15.jpg)
Slide 15/27© EuQoS consortium University of Pisa/CPR
SiM-EuQoS-PTL: xDSLResults
• The performance of CBR and VBR-nrt traffic depends on the amount of CBR traffic.
• Thus, AC algorithms for guaranteeing QoS are needed.
0,00%
0,20%
0,40%
0,60%
0,80%
1,00%
1,20%
0% 5% 10% 15% 20% 25% 30% 35% 40%
Demand / Capacity (%)
Pac
ket L
oss
Rat
io (%
)
0
50
100
150
200
250
300
0 20 40 60 80 100 120 140 160 180
File size (KB)
Thro
ughp
ut (K
B /
s)
20%30%40%Exponencial (20%)Exponencial (30%)Exponencial (40%)
Exponential (20%)Exponential (30%)Exponential (40%)
![Page 16: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/16.jpg)
Slide 16/27© EuQoS consortium University of Pisa/CPR
SiM-EuQoS-PTL: LAN
• SOHO scenario with full-duplex 10 Mbps links.• QoS is supported by means of strict priority queueing.• It is possible to provide EuQoS applications with full
isolation from background traffic.
![Page 17: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/17.jpg)
Slide 17/27© EuQoS consortium University of Pisa/CPR
SiM-EuQoS-PTL: WiFiDescription
• Two 802.11g @ 24 Mbps hot spots.• No specific QoS mechanism has been simulated.
![Page 18: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/18.jpg)
Slide 18/27© EuQoS consortium University of Pisa/CPR
SiM-EuQoS-PTL: WiFiResults
• Mixing QoS and non-QoS traffic leads to inacceptableperformance degradation, even with low traffic.
• Special AC algorithms are needed.
0.001
0.01
0.1
1
10
100
0 10 20 30 40 50 60
dela
y (s
), 95
per
cent
ile#flows
conf c dl perdlconf c ul perdlconf v dl perdlconf v ul perdl
0.001
0.01
0.1
1
0 10 20 30 40 50 60
dela
y (s
), 95
per
cent
ile
#flows
video dl perdl
![Page 19: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/19.jpg)
Slide 19/27© EuQoS consortium University of Pisa/CPR
Test specific QoS mechanisms: admission control in UMTS
• Suburban environment mobility model for UEs.• Node-Bs placed at 800m from each other.• The bottleneck for providing QoS in UMTS is the
UTRAN, for which special AC algorithms are needed.
Throughput
0
500
1000
1500
2000
2500
3000
3500
4000
0,20
1,80
3,40
5,20
6,80
8,40
10,2
0
11,8
0
13,4
0
15,2
0
16,8
0
18,4
0
20,2
0
21,8
0
23,4
0
25,2
0
26,8
0
28,4
0
30,2
0
31,8
0
33,4
0
35,2
0
36,8
0
38,4
0
time (sec)
Arrows CAC Interference CAC Joint Scheduler CAC
![Page 20: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/20.jpg)
Slide 20/27© EuQoS consortium University of Pisa/CPR
SiM-EuQoS-PTL: IP Core
• Admission control performed online per flow.
• Router configuration on provisioning (long) time scale.
• No per-flow policing.• AC algorithms based on
enhanced rules for calculatingadmissible traffic load are needed.
• It is recommended for end-to-end simulations to test telephony CoS and video conference CoS as separated.
Inter-domain service AS1-AS2
AS1
output port
Egress BR
AS2
Intra-domain service in AS2
input ports Router input port
Ingress BR
Ingress BR
Ingress BR
Intra-domain service in AS1
output port
AC AC
AC
AC
Inter-domain service AS1-AS2
AS1
output port
Egress BR
AS2
Intra-domain service in AS2
input ports Router input port
Ingress BR
Ingress BR
Ingress BR
Intra-domain service in AS1
output port
AC AC
AC
AC
![Page 21: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/21.jpg)
Slide 21/27© EuQoS consortium University of Pisa/CPR
SiM-EuQoS-CIL
• Implementation in the Network Simulator 2, based on the RSVP module.
• Current version:– UDP only;– simplified NSLP.
![Page 22: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/22.jpg)
Slide 22/27© EuQoS consortium University of Pisa/CPR
SiM-EuQoS-CIL: Example of Results
Exponential ON/OFFTraffic
VoIP Traffic
Without NSIS With NSIS
•SOHO scenario, with VoIP traffic.•NSIS agents configure 802.11p priorities along the path.•Advisable to carry NSIS messages asQoS traffic.
![Page 23: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/23.jpg)
Slide 23/27© EuQoS consortium University of Pisa/CPR
SiM-EuQoS-PL (1): Objectives
• To evaluate the performance of EQ-BGP (convergence time, scalability), under:
• announcement of previously unavailable network (route)
• withdrawing existing network (route)• link or node failure (reliability)• occurrence of route flapping • degradation or improvement of QoS level offered by a
given domain • iBGP processing
![Page 24: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/24.jpg)
Slide 24/27© EuQoS consortium University of Pisa/CPR
SiM-EuQoS-PL (2): Assumptions
• fixed values of QoS offered by ASs• different „QoS assembling” functions (delay losses, jitter)• different decision algorithms• different network topologies and size (4, 11, 20, 29, ASs)
Internet driven topology
ring
full mesh
4 5 6 7
B-clique
![Page 25: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/25.jpg)
Slide 25/27© EuQoS consortium University of Pisa/CPR
SiM-EuQoS-PL (3): Simulation tool
• NS2 with enhanced ns-BGP module:– QoS-NLRI attribute– new decision algorithm replacing AS path length by
„cumulative” value of QoS– an algorithm for assembling QoS (calculating
„cumulative” value of QoSadvertise start node 1 route 10.0.1.0/24 1.78075 send 1 -> 2 wds: - ads: 10.0.1.0/24 (1) 3 1.78075 send 1 -> 0 wds: - ads: 10.0.1.0/24 (1) 3 1.78252 rcv 2 <- 1 wds: - ads: 10.0.1.0/24 (1) 3 1.78252 send 2 -> 3 wds: - ads: 10.0.1.0/24 (2 1) 13 1.78252 rcv 0 <- 1 wds: - ads: 10.0.1.0/24 (1) 3 1.78252 send 0 -> 3 wds: - ads: 10.0.1.0/24 (0 1) 12 1.78431 rcv 3 <- 2 wds: - ads: 10.0.1.0/24 (2 1) 13 1.78431 send 3 -> 0 wds: - ads: 10.0.1.0/24 (3 2 1) 20 1.78431 rcv 3 <- 0 wds: - ads: 10.0.1.0/24 (0 1) 12 1.78431 send 3 -> 0 wds: 10.0.1.0/24 ads: -
![Page 26: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/26.jpg)
Slide 26/27© EuQoS consortium University of Pisa/CPR
SiM-EuQoS-PL (4): Summary and conclusions
• EQ-BGP gives a stable routing establishing the e2e QoS paths
• The convergence time is at the similar level as in case of BGP-4, however:– It is longer after route advertisement– It is shorter after route withdrawal
• EQ-BGP protocol needs to exchange a large number of messages
• Further studies are required!
![Page 27: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/27.jpg)
Slide 27/27© EuQoS consortium University of Pisa/CPR
Conclusions and future work
• For the time being:– The software tools (with full documentation) for
evaluating different aspects related to EuQoSarchitecture and QoS framework were developed.
– Preliminary simulation results were collected and guidelines for other WPs have been devised.
• Experimental limits to CAC algorithms evaluated
• Most exhaustive simulation studies will be performed, to be included in the next version of D2.1.2.– Take into account newly defined EuQoS CoS and
apply QoS mechanisms
![Page 28: Evaluation of EuQoS System by Simulation: Tools and Resultsaai.tele.pw.edu.pl/Artikuly/Evaluation of EuQoS...© EuQoS consortium Slide 1/27 University of Pisa/CPR Evaluation of EuQoS](https://reader035.vdocuments.net/reader035/viewer/2022070616/5cd8224d88c993273a8d8e91/html5/thumbnails/28.jpg)
Slide 28/27© EuQoS consortium University of Pisa/CPR
Thanks for your attention.
Comments or questions?