on the suitability of two large-scale internet measurement ... ·...
TRANSCRIPT
![Page 1: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/1.jpg)
On the suitability of two large-scale Internetmeasurement platforms
Thomas Holterbach, Cristel Pelsser and Randy Bush
November 4, 2014
1/28
![Page 2: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/2.jpg)
Problematic
RIPE Atlas probes are small devices with low capacity and anyone inthe world is able to start measurements from and toward this probe.
QuestionAre the probes powerful enough to perform these measurements ?
2/28
![Page 3: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/3.jpg)
How to measure the suitability of the RIPE Atlas probes ?
IdeaWe combine two measurement platforms : RIPE Atlas and NLNOG Ring
∼300 Ubuntu VMs in different ASsProvides powerful measurement tools such as Scamper
3/28
![Page 4: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/4.jpg)
How to measure the suitability of the RIPE Atlas probes ?
12 Atlas probes and NL Ring nodes are on the same local network
Each of these 12 NL Ring nodes performs pings towardthe 11 other NL Ring nodes and their associated Atlas probesand two BSD servers
We perform ping for 16 different flow-IDs
4/28
![Page 5: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/5.jpg)
How to measure the suitability of the RIPE Atlas probes ?
12 Atlas probes and NL Ring nodes are on the same local network
Each of these 12 NL Ring nodes performs pings towardthe 11 other NL Ring nodes and their associated Atlas probesand two BSD servers
We perform ping for 16 different flow-IDs
ConsequenceWe are now able to compare RIPE Atlas probes with
NL Ring nodesand the two BSD servers
5/28
![Page 6: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/6.jpg)
How to measure the suitability of the RIPE Atlas probes ?
6/28
![Page 7: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/7.jpg)
How to measure the suitability of the RIPE Atlas probes ?
6/28
![Page 8: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/8.jpg)
How to measure the suitability of the RIPE Atlas probes ?
6/28
![Page 9: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/9.jpg)
How to measure the suitability of the RIPE Atlas probes ?
Actually, we have 12 Ring nodes, 12 Atlas probes and 2 servers⇒ 288 couples source-destination in total
6/28
![Page 10: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/10.jpg)
Measurement orchestration
7/28
![Page 11: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/11.jpg)
Measurement calibration
Ping frequencyThanks to the NL Ring nodes, we are able to perform ping with a highfrequency ⇒ 1 ping every two seconds for each flow-ID
Theoretical ActualEvery two seconds One week One week
Platform Number Ping sent Ping received Sent Received Sent ReceivedRing node 12 384 176 116M 53M 107M 49MAtlas probe 0 176 0 53M 0 49M
Server 2 0 192 0 58M 0 53M
8/28
![Page 12: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/12.jpg)
Is an event coming from the Internet or the end-points ?
Events occur both on the NL Ring node and the RIPE Atlas probe⇒ These events are coming from the Internet
9/28
![Page 13: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/13.jpg)
Is an event coming from the Internet or the end-points ?
An event between 14:00 and 20:00 only occurs with the Atlas probeThis event might be due to this RIPE Atlas probe
10/28
![Page 14: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/14.jpg)
Is an event coming from the Internet or the end-points ?
An event between 14:00 and 18:00 only occurs with the Ring nodeThis event might be due the NL Ring node
11/28
![Page 15: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/15.jpg)
Is an event coming from the Internet or the end-points ?
Same destination, same time, another sourceThe previous event on the NL Ring node does not occur this time⇒ the previous event is not coming from the NL Ring node
12/28
![Page 16: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/16.jpg)
Some statistics over one week
13/28
![Page 17: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/17.jpg)
Mean RTT
0 50 100 150 200 250RTT (ms)
R1A1
R2A2
R3A3
R4A4
R5A5
R6A6
R7A7
R8A8
R9A9
R10A10
R11A11
R12A12
De
stin
ati
on
ID
18321889
1016997
919943
1931721
10361033
18811043
9461901
19302139
10311854
10561046
155871009
18041754
Destination couple 1
14/28
![Page 18: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/18.jpg)
Mean RTT
0 50 100 150 200 250RTT (ms)
R1A1
R2A2
R3A3
R4A4
R5A5
R6A6
R7A7
R8A8
R9A9
R10A10
R11A11
R12A12
De
stin
ati
on
ID
18321889
1016997
919943
1931721
10361033
18811043
9461901
19302139
10311854
10561046
155871009
18041754
Atlas probe
Ring node
14/28
![Page 19: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/19.jpg)
Mean RTT
0 50 100 150 200 250RTT (ms)
R1A1
R2A2
R3A3
R4A4
R5A5
R6A6
R7A7
R8A8
R9A9
R10A10
R11A11
R12A12
De
stin
ati
on
ID
18321889
1016997
919943
1931721
10361033
18811043
9461901
19302139
10311854
10561046
155871009
18041754
Src
14/28
![Page 20: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/20.jpg)
Mean RTT
0 50 100 150 200 250RTT (ms)
R1A1
R2A2
R3A3
R4A4
R5A5
R6A6
R7A7
R8A8
R9A9
R10A10
R11A11
R12A12
De
stin
ati
on
ID
18321889
1016997
919943
1931721
10361033
18811043
9461901
19302139
10311854
10561046
155871009
18041754
Global RTT average
14/28
![Page 21: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/21.jpg)
Mean RTT
Between these two platformsthe global average RTT difference is 0.5msthere is at most 1.5ms difference in global RTT average
0 50 100 150 200 250RTT (ms)
R1A1
R2A2
R3A3
R4A4
R5A5
R6A6
R7A7
R8A8
R9A9
R10A10
R11A11
R12A12
Dest
inati
on ID
18321889
1016997
919943
1931721
10361033
18811043
9461901
19302139
10311854
10561046
155871009
18041754
14/28
![Page 22: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/22.jpg)
Mean RTT
Between these two platformsthe global average RTT difference is 0.5msthere is at most 1.5ms difference in global RTT average
0 50 100 150 200 250RTT (ms)
R1A1
R2A2
R3A3
R4A4
R5A5
R6A6
R7A7
R8A8
R9A9
R10A10
R11A11
R12A12
Dest
inati
on ID
18321889
1016997
919943
1931721
10361033
18811043
9461901
19302139
10311854
10561046
155871009
18041754
15/28
![Page 23: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/23.jpg)
Standard deviation
To take into account the flow-IDs effect, we define a newRTT variability metric
RTT variability metric
∆ds is the average RTT standard deviation over the 16 flow-IDs
between the source s and the destination d
∆ds =
∑15f=0 SD
ds (f )
16
SDds (f ) is the RTT standard deviation between the source s and the
destination d for flow-ID f
16/28
![Page 24: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/24.jpg)
Mean of the Standard Deviation Across Flow-IDsVersus Global Standard deviation
Pair∑15
f=0 SDds (f )
16 (ms) Global standard deviation (ms)R2 - R4 2.7 4.4R2 - A4 1.4 7.3
17/28
![Page 25: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/25.jpg)
Average standard deviation δ
Because there is several sources S (11 Ring nodes) for one destination :δ(d) is the ∆d
s mean over all the sources for the destination d
δ(d) =
∑∀s∈S ∆ds
|S |=
∑∀s∈S ∑15f=0 SD
ds (f )
16 ∗ |S |
18/28
![Page 26: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/26.jpg)
Average Standard deviation δ
Half of the destinations perform better than the two servers regarding theRTT variability.
R1A1
R2A2
R3A3
R4A4
R5A5
R6A6
R7A7
R8A8
R9A9
R10A10
R11A11
R12A12
Destination ID
0
10
20
30
40
50
Avera
ge S
tandard
devia
tion δ
(m
s)
R4R4
R1 R1 R1 R1 R1R1
R1 R1
R10R10
R1 R1
R6 R6
R1 R1
R6 R6
R1
R1 R1 R1
NLNOG Ring
RIPE Atlas
Server 1
Server 2
19/28
![Page 27: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/27.jpg)
Packet loss percentage
RIPE Atlas probes don’t lose more packets thanthe NL Ring nodes and the two servers
R1A1
R2A2
R3A3
R4A4
R5A5
R6A6
R7A7
R8A8
R9A9
R10A10
R11A11
R12A12
Destination ID
0.000
0.002
0.004
0.006
0.008
0.010
0.012
Pack
et
loss
perc
enta
ge
NLNOG Ring
RIPE Atlas
Server 1
Server 2
20/28
![Page 28: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/28.jpg)
What if we increase the set of Atlas probes and Ring nodes up to 250 ?
21/28
![Page 29: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/29.jpg)
New experiment with more Atlas probes and Ring nodes
Ring node X performs pings towardthe 12 selected Ring nodes∼250 random Ring nodes
22/28
![Page 30: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/30.jpg)
New experiment with more Atlas probes and Ring nodes
Ring node X performs pings towardthe 12 selected Ring nodes∼250 random Ring nodes
Ring node Y performs pings towardthe 12 selected Atlas probes∼250 random Atlas probes
22/28
![Page 31: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/31.jpg)
New experiment with more Atlas probes and Ring nodes
Ring node X performs pings towardthe 12 selected Ring nodes∼250 random Ring nodes
Ring node Y performs pings towardthe 12 selected Atlas probes∼250 random Atlas probes
Experiment Duration 1 weekNumber of flow-ID 16Theoretical frequency 1 ping every 20 seconds for each flow-IDActual frequency 1 ping every 21.5 seconds for each flow-ID
22/28
![Page 32: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/32.jpg)
Average Standard deviation δ
In both cases, the 12 selected have similar behavior than the 2505 Atlas probes have 100% losses compared to only 2 Ring nodes
NL Ring nodes0
100
101
102
103
Twelve selected
250 Random
100% losses
RIPE Atlas probes0
100
101
102
103
104
Avera
ge S
tandard
devia
tion δ
(m
s)
23/28
![Page 33: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/33.jpg)
Packet loss percentage
In both cases, the 12 selected have similar behavior than the 25012 Ring nodes have no losses compared to only 1 Atlas probe4 Ring nodes have 50% or more losses compared to 25 Atlas probes
NL Ring nodes0
100
101
102
103
104
105
106
Twelve selected
250 Random
No loss
Ping sent
RIPE Atlas probes0
100
101
102
103
104
105
106
Pack
et
loss
24/28
![Page 34: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/34.jpg)
Further observations
25/28
![Page 35: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/35.jpg)
Our method is able to efficiently catch internet events
Some events only affect a subset of the paths used
26/28
![Page 36: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/36.jpg)
Good news
RIPE Atlas probes are recently able to perform ping measurementswith different flow-ID
27/28
![Page 37: On the suitability of two large-scale Internet measurement ... · HowtomeasurethesuitabilityoftheRIPEAtlasprobes? Actually,wehave12 Ring nodes,12 Atlas probes and2 servers)288couplessource-destinationintotal](https://reader036.vdocuments.net/reader036/viewer/2022081405/5f0a95487e708231d42c5876/html5/thumbnails/37.jpg)
Conclusion
As destination, the RIPE Atlas probes we used are able to providecomparable results than the NL Ring nodes and the two BSD servers
Further work :
Study the RIPE Atlas probes suitability when they are the sourcesFind the maximum ping frequency Atlas probes are able to cope asdestination
28/28