network tests at chep
DESCRIPTION
Network Tests at CHEP. K. Kwon, D. Han, K. Cho, J.S. Suh, D. Son Center for High Energy Physics, KNU, Korea H. Park Supercomputing Center, KISTI, Korea Representing the HEP Working Group for ANF/the HEP Data Grid WG The 3 rd International Workshop on HEP Data Grid - PowerPoint PPT PresentationTRANSCRIPT
-
Network Tests at CHEPK. Kwon, D. Han, K. Cho, J.S. Suh, D. SonCenter for High Energy Physics, KNU, Korea
H. ParkSupercomputing Center, KISTI, Korea
Representing the HEP Working Group for ANF/the HEP Data Grid WG
The 3rd International Workshop on HEP Data Grid August 26, 2004, Daegu, Korea
-
IntroductionNetwork Tests using IperfDomestic testsInternational tests (USA, Europe)
Real File Transfer Tests using bbFTPDomestic testsInternational tests (Europe)
Summary & Future Works
-
HEP Data GridImplementation of the Tier-1 Regional Data Center of LHC
NetworkingTier0 (CERN)Tier1 (CHEP) : ~2.5Gbps via TEINTier1(CHEP)Tier1(US and Japan): ~Gbps via APIITier1(CHEP), Tier2 or 3(inside Korea): 0.155~1 Gbps via KOREN/KREONET
Computing(1000 CPU Linux clusters)
Data Storage CapabilityStorage: 1.1 PB Raid Type Disk (Tier1+Tier2) Tape Drive: ~ 3.2 PBHPSS Servers
-
Network at CHEP & Available Research NetworksServers/PCsServersJapanAPII/H-G1 G 2.5GCisco76061 GCHEPClustered PCsAPII/KREONET22 * 622 MUSATEIN34 MCERN/Geneva100 M1 GHSMTransPAC 2.5GKNU CC1 GCisco6509DataTaG 2.5GNetwork Test PC
-
Test Tools IperfA tool for measuring TCP and bandwidth performance. Data sent by default from the clients memory to the server memory
bbFTPFile transfer software that is optimized for large files. Supports multi-stream transfer and big windows
TCP Reno: Linux 2.4.26 TCP protocol
-
Factors affecting TCP performanceWindow Size
Number of Streams
MTU We have not tried yet.
Txqueuelen No gain in performance
SACK No gain in performance
-
CHEP KOREN-NOC Iperf TestRTT: ~2msBDP=0.002*1000Mbps=0.25MBMax throughput: 920MbpsThroughput of five streams: 916Mbps KORENKNUKOREN-NOC1 GCHEP1 GGigabitEthernet3/1 -- KOREN
Chart1
256 KB345
512 KB682
1 MB918
2 MB921
3 MB922
4 MB921
TCP Window Size
Achievable bandwidth in Mbps
KNU-> KOREN-NOC (Single Stream)
KNU->SNU
KNU (sul.knu.ac.kr)->SNU(147.46.222.194)
sul.knu.ac.kr
OS: Linux 7.3
eth0: Intel(R) PRO/1000 Network Connection
e1000: eth0 NIC Link is Up 1000 Mbps Full Duplex
CPU: Dual AMD Athlon(tm) MP 2000+, 1.7GHz
147.46.222.194
OS: Linux 8.0
eth0: Intel(R) PRO/1000 Network Connection
e1000: eth0 NIC Link is Up 1000 Mbps Full Duplex
CPU: Dual Pentium III(Coppermine), 551MHz each
Date:
Mon Feb 9, 15~18, 2004
Traceroute:
[root@sul pathrate_2.3.0]# /usr/sbin/traceroute 147.46.222.194
traceroute to 147.46.222.194 (147.46.222.194), 30 hops max, 38 byte packets
1 ns_rtr1.kyungpook.ac.kr (155.230.20.5) 0.301 ms 0.186 ms 0.166 ms
2 155.230.253.9 (155.230.253.9) 0.225 ms 0.181 ms 0.162 ms
3 203.255.252.234 (203.255.252.234) 0.353 ms 0.270 ms 0.238 ms
4 192.168.55.2 (192.168.55.2) 1.917 ms 1.961 ms 1.887 ms
5 sgp-tgp.kr.apan.net (203.255.248.161) 4.447 ms 4.461 ms 4.370 ms
6 snu-sgp.kr.apan.net (203.255.248.229) 5.358 ms 5.357 ms 5.328 ms
7 147.46.222.194 (147.46.222.194) 4.937 ms 4.904 ms 4.953 ms
Path Capacity Measurement Using Pathrate:
[knu@hep7 pathrate_2.3.0]$ ./pathrate_rcv -s sul.knu.ac.kr
pathrate run from sul.knu.ac.kr to hep7 on Mon Feb 9 16:41:12 2004
--> Average round-trip time: 4.9ms
--> Capacity Resolution: 20 Mbps
-- Phase I: Detect possible capacity modes --
-> Train length: 2 - Packet size: 600B -> 0% completed
-> Train length: 3 - Packet size: 898B -> 2% completed
-> Train length: 4 - Packet size: 1196B -> 5% completed
-> Train length: 5 - Packet size: 1488B -> 7% completed
-> Train length: 6 - Packet size: 1488B -> 10% completed
-> Train length: 7 - Packet size: 1488B -> 12% completed
-> Train length: 8 - Packet size: 1488B -> 15% completed
-> Train length: 9 - Packet size: 1488B -> 17% completed
-> Train length: 10 - Packet size: 1488B -> 20% completed
-> Train length: 11 - Packet size: 1488B -> 22% completed
-> Train length: 12 - Packet size: 1488B -> 25% completed
Aborting Phase I measurements..
Too many ignored measurements
Phase II will report lower bound on path capacity.
-- Phase II: Estimate Asymptotic Dispersion Rate (ADR) --
-- Number of trains: 500 - Train length: 48 - Packet size: 1488B
-- Local modes : In Phase II --
* Mode: 641 Mbps to 661 Mbps - 61 measurements
Modal bell: 94 measurements - low : 612 Mbps - high : 661 Mbps
-------------------------------------------------
Final capacity estimate : 634 Mbps to 654 Mbps
-------------------------------------------------
Bandwidth Delay Product computation for suggested TCP window size:
BDP = 4.9ms * 1000Mbps =0.6125MB=627KB
I could use 634~654Mbps found from pathrate instead of 1000Mbps but it won't make much difference.
With about 600KB TCP window size, however, I could not get good result.
Right below, about 2Mbyte Window size returns good result. So I chose 2Mbyte TCP window size for test.
Single TCP stream tests with variation of Window Size:
Window SizeBandwidth(Mbps)
600KB254
1M489
2M644
3M495
4M588
5M559
Test Results (2Mbyte of TCP window size, Duration of each test: ~20 Sec)
TCP StreamsBandwidth(Mbps)
1631
2539
3602
4628
5650
6666
7672
8684
9689
10693
20707
30655
40697
50696
60683
70689
80677
90680
100667
UDP Stream TESTs
Specified bandwidth(Mbps)Jitter(ms)Loss Rate(%)
4000.0370.14
4500.0210.14
5000.0190.23
5500.0760.34
6000.0191.7
6500.0413.3
7000.025
7500.0213
80015.419
8500.01726
9000.01726
9500.02227
10000.02627
NOTE: Iperf can generate constant UDP bit rate corresponding to the bandwidth specified.
UDP Stream Test Instances are shown below.
400
Note: -b option specifies the bandwidth to send streams at.
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 400m -p 30000
[ 5] local 155.230.20.20 port 32918 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 483 MBytes 406 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 483 MBytes 405 Mbits/sec 0.037 ms 474/344825 (0.14%)
[ 5] Sent 344825 datagrams
450
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 450m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32919 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 539 MBytes 452 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 538 MBytes 452 Mbits/sec 0.021 ms 531/384575 (0.14%)
[ 5] Sent 384575 datagrams
500
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 500m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32919 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 609 MBytes 511 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 608 MBytes 510 Mbits/sec 0.019 ms 1013/434763 (0.23%)
[ 5] Sent 434763 datagrams
550
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 550m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32920 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 668 MBytes 560 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 665 MBytes 558 Mbits/sec 0.076 ms 1638/476155 (0.34%)
[ 5] Sent 476155 datagrams
600
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 600m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32920 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 738 MBytes 619 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 725 MBytes 608 Mbits/sec 0.019 ms 9085/526191 (1.7%)
[ 5] Sent 526191 datagrams
650
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 650m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32921 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 779 MBytes 653 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 753 MBytes 632 Mbits/sec 0.041 ms 18141/555453 (3.3%)
[ 5] Sent 555453 datagrams
700
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 700m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32921 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 875 MBytes 734 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 832 MBytes 698 Mbits/sec 0.020 ms 31146/624502 (5%)
[ 5] Sent 624502 datagrams
750
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 750m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32921 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 934 MBytes 783 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 816 MBytes 684 Mbits/sec 0.020 ms 84287/666205 (13%)
[ 5] Sent 666205 datagrams
800
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 800m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32921 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1000 MBytes 839 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.2 sec 806 MBytes 660 Mbits/sec 15.493 ms 138417/713243 (19%)
[ 5] Sent 713243 datagrams
850
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 850m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32922 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.05 GBytes 903 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 798 MBytes 669 Mbits/sec 0.017 ms 198107/767508 (26%)
[ 5] Sent 767508 datagrams
900
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 900m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32923 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.05 GBytes 903 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 801 MBytes 672 Mbits/sec 0.017 ms 196024/767644 (26%)
[ 5] Sent 767644 datagrams
950
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 950m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32924 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.06 GBytes 912 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 796 MBytes 668 Mbits/sec 0.022 ms 207276/775404 (27%)
[ 5] Sent 775404 datagrams
1000
[root@sul Iperf]# ./iperf -c 147.46.222.194 -u -b 1000m -p 30000
------------------------------------------------------------
Client connecting to 147.46.222.194, UDP port 30000
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32925 connected with 147.46.222.194 port 30000
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.07 GBytes 918 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 798 MBytes 669 Mbits/sec 0.026 ms 211502/780871 (27%)
[ 5] Sent 780871 datagrams
SNU->KNU
SNU(147.46.222.194) -> KNU(sul.knu.ac.kr)
Date
Tue Feb 10, 9~11, 2004
Traceroute:
[knu@hep7 Iperf]$ /usr/sbin/traceroute sul.knu.ac.kr
traceroute to sul.knu.ac.kr (155.230.20.20), 30 hops max, 38 byte packets
1 147.46.222.193 (147.46.222.193) 1.003 ms 0.869 ms 0.838 ms
2 sgp-snu.kr.apan.net (203.255.248.230) 0.716 ms 0.627 ms 0.610 ms
3 tgp-sgp.kr.apan.net (203.255.248.162) 3.255 ms 3.225 ms 3.113 ms
4 192.168.55.1 (192.168.55.1) 4.913 ms 4.779 ms 4.843 ms
5 203.255.252.233 (203.255.252.233) 4.990 ms 5.028 ms 4.982 ms
6 155.230.253.10 (155.230.253.10) 4.974 ms 4.992 ms 4.961 ms
7 sul.kyungpook.ac.kr (155.230.20.20) 4.964 ms 4.909 ms 4.961 ms
Path Capacity Measurement Using Pathrate:
[root@sul pathrate_2.3.0]# ./pathrate_rcv -s 147.46.222.194
pathrate run from 147.46.222.194 to sul.knu.ac.kr on Tue Feb 10 08:58:5
3 2004
--> Average round-trip time: 4.9ms
--> Capacity Resolution: 20 Mbps
-- Phase I: Detect possible capacity modes --
-> Train length: 2 - Packet size: 600B -> 0% completed
-> Train length: 3 - Packet size: 898B -> 2% completed
-> Train length: 4 - Packet size: 1196B -> 5% completed
-> Train length: 4 - Packet size: 1219B -> 7% completed
-> Train length: 4 - Packet size: 1242B -> 10% completed
-> Train length: 4 - Packet size: 1265B -> 12% completed
-> Train length: 5 - Packet size: 1488B -> 15% completed
-> Train length: 5 - Packet size: 1488B -> 17% completed
-> Train length: 5 - Packet size: 1488B -> 20% completed
-> Train length: 5 - Packet size: 1488B -> 22% completed
-> Train length: 5 - Packet size: 1488B -> 25% completed
-> Train length: 5 - Packet size: 1488B -> 27% completed
-> Train length: 5 - Packet size: 1488B -> 30% completed
-> Train length: 5 - Packet size: 1488B -> 32% completed
-> Train length: 5 - Packet size: 1488B -> 35% completed
-> Train length: 5 - Packet size: 1488B -> 37% completed
-> Train length: 5 - Packet size: 1488B -> 40% completed
-> Train length: 5 - Packet size: 1488B -> 42% completed
-> Train length: 5 - Packet size: 1488B -> 45% completed
-> Train length: 5 - Packet size: 1488B -> 47% completed
-> Train length: 5 - Packet size: 1488B -> 50% completed
-> Train length: 5 - Packet size: 1488B -> 52% completed
-> Train length: 5 - Packet size: 1488B -> 55% completed
-> Train length: 5 - Packet size: 1488B -> 57% completed
-> Train length: 5 - Packet size: 1488B -> 60% completed
-> Train length: 5 - Packet size: 1488B -> 62% completed
-> Train length: 5 - Packet size: 1488B -> 65% completed
-> Train length: 5 - Packet size: 1488B -> 67% completed
-> Train length: 5 - Packet size: 1488B -> 70% completed
-> Train length: 5 - Packet size: 1488B -> 72% completed
-> Train length: 5 - Packet size: 1488B -> 75% completed
-> Train length: 5 - Packet size: 1488B -> 77% completed
-> Train length: 5 - Packet size: 1488B -> 80% completed
-> Train length: 5 - Packet size: 1488B -> 82% completed
-> Train length: 5 - Packet size: 1488B -> 85% completed
-> Train length: 5 - Packet size: 1488B -> 87% completed
-> Train length: 5 - Packet size: 1488B -> 90% completed
-> Train length: 5 - Packet size: 1488B -> 92% completed
-> Train length: 5 - Packet size: 1488B -> 95% completed
-> Train length: 5 - Packet size: 1488B -> 97% completed
-- Local modes : In Phase I --
* Mode: 731 Mbps to 745 Mbps - 56 measurements
Modal bell: 168 measurements - low : 697 Mbps - high : 781 Mbps
* Mode: 952 Mbps to 972 Mbps - 49 measurements
Modal bell: 188 measurements - low : 882 Mbps - high : 1045 Mbps
* Mode: 794 Mbps to 807 Mbps - 38 measurements
Modal bell: 80 measurements - low : 794 Mbps - high : 852 Mbps
* Mode: 671 Mbps to 690 Mbps - 35 measurements
Modal bell: 102 measurements - low : 635 Mbps - high : 718 Mbps
* Mode: 1287 Mbps to 1305 Mbps - 33 measurements
Modal bell: 206 measurements - low : 1190 Mbps - high : 1446 Mbps
* Mode: 1134 Mbps to 1134 Mbps - 23 measurements
Modal bell: 24 measurements - low : 1134 Mbps - high : 1146 Mbps
* Mode: 866 Mbps to 870 Mbps - 21 measurements
Modal bell: 21 measurements - low : 866 Mbps - high : 870 Mbps
-- Phase II: Estimate Asymptotic Dispersion Rate (ADR) --
-- Number of trains: 500 - Train length: 48 - Packet size: 1488B
-- Local modes : In Phase II --
* Mode: 825 Mbps to 845 Mbps - 187 measurements
Modal bell: 483 measurements - low : 787 Mbps - high : 904 Mbps
-------------------------------------------------
Final capacity estimate : 825 Mbps to 845 Mbps
-------------------------------------------------
Test Results (2Mbyte of TCP window size, Duration of each test: ~20 Sec)
TCP StreamsBandwidth(Mbps)
1587
2640
3638
4637
5637
6605
7619
8589
9586
10586
20619
30625
40618
50579
60619
70553
80599
90410
100545
UDP Stream TESTS
Specified bandwidth(Mbps)Jitter(ms)Loss Rate(%)
4000.0180.039
4500.0160
5000.0330.0051
5500.0250.0067
6000.0170.0083
6500.0170
7000.0220.0071
7500.0170.009
8000.0240.0054
8500.020.006
9000.00320
9500.0320
10000.0140.011
Note: Here, after 600, results are Meaningless, because it seems that SNU machine
cannot generate more than 600Mbps UDP streams. See below.
Note: -b option specifies bandwidth to send streams at.
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 400m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 483 MBytes 405 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 483 MBytes 405 Mbits/sec 0.018 ms 136/344667 (0.039%)
[ 5] 0.0-10.0 sec 444 datagrams received out-of-order
[ 5] Sent 344667 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 450m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 537 MBytes 450 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 537 MBytes 450 Mbits/sec 0.016 ms 0/382920 (0%)
[ 5] 0.0-10.0 sec 508 datagrams received out-of-order
[ 5] Sent 382920 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 500m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 607 MBytes 509 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 607 MBytes 509 Mbits/sec 0.033 ms 22/432919 (0.0051%)
[ 5] 0.0-10.0 sec 685 datagrams received out-of-order
[ 5] Sent 432919 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 550m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 650 MBytes 545 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 650 MBytes 546 Mbits/sec 0.025 ms 31/463862 (0.0067%)
[ 5] 0.0-10.0 sec 846 datagrams received out-of-order
[ 5] Sent 463862 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 600m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 661 MBytes 554 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 661 MBytes 555 Mbits/sec 0.017 ms 39/471464 (0.0083%)
[ 5] 0.0-10.0 sec 788 datagrams received out-of-order
[ 5] Sent 471464 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 650m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 667 MBytes 560 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 667 MBytes 560 Mbits/sec 0.017 ms 0/476138 (0%)
[ 5] 0.0-10.0 sec 823 datagrams received out-of-order
[ 5] Sent 476138 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 700m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 691 MBytes 580 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 691 MBytes 580 Mbits/sec 0.022 ms 35/492819 (0.0071%)
[ 5] 0.0-10.0 sec 973 datagrams received out-of-order
[ 5] Sent 492819 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 750m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 697 MBytes 585 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 697 MBytes 585 Mbits/sec 0.017 ms 45/497534 (0.009%)
[ 5] 0.0-10.0 sec 908 datagrams received out-of-order
[ 5] Sent 497534 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 800m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 699 MBytes 586 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 699 MBytes 586 Mbits/sec 0.024 ms 27/498533 (0.0054%)
[ 5] 0.0-10.0 sec 908 datagrams received out-of-order
[ 5] Sent 498533 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 850m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 699 MBytes 586 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 699 MBytes 586 Mbits/sec 0.020 ms 33/498545 (0.0066%)
[ 5] 0.0-10.0 sec 869 datagrams received out-of-order
[ 5] Sent 498545 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 900m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 699 MBytes 586 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 699 MBytes 587 Mbits/sec 0.032 ms 0/498651 (0%)
[ 5] 0.0-10.0 sec 923 datagrams received out-of-order
[ 5] Sent 498651 datagrams
[knu@hep7 Iperf]$ ./iperf -c sul.knu.ac.kr -u -b 1000m
------------------------------------------------------------
Client connecting to sul.knu.ac.kr, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1030 connected with 155.230.20.20 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 699 MBytes 587 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 699 MBytes 587 Mbits/sec 0.014 ms 57/498781 (0.011%)
[ 5] 0.0-10.0 sec 944 datagrams received out-of-order
[ 5] Sent 498781 datagrams
SNU->KOREN_NOC
SNU(147.46.222.194)->KTcluster2
Single Stream TCP tests with 2MB, 4MB TCP window sizes.
[knu@hep7 Iperf]$ ./iperf -c 203.255.252.12 -w 1m -t 20
------------------------------------------------------------
Client connecting to 203.255.252.12, TCP port 5001
TCP window size: 2.00 MByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1910 connected with 203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-20.0 sec 1.51 GBytes 648 Mbits/sec
[knu@hep7 Iperf]$ ./iperf -c 203.255.252.12 -w 2m -t 20
------------------------------------------------------------
Client connecting to 203.255.252.12, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 147.46.222.194 port 1911 connected with 203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-20.0 sec 1.51 GBytes 648 Mbits/sec
KNU(sul.knu.ac.kr)->KTcluster2
Single Stream TCP tests with 2MB, 4MB TCP window sizes.
[root@sul Iperf]# ./iperf -c 203.255.252.12 -w 1m -t 20
------------------------------------------------------------
Client connecting to 203.255.252.12, TCP port 5001
TCP window size: 2.00 MByte (WARNING: requested 1.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 60834 connected with 203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-20.0 sec 2.13 GBytes 916 Mbits/sec
[root@sul Iperf]# ./iperf -c 203.255.252.12 -w 2m -t 20
------------------------------------------------------------
Client connecting to 203.255.252.12, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 60815 connected with 203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-20.0 sec 2.15 GBytes 922 Mbits/sec
UDP Stream TEST from KNU to KT
Specified Bandwidth(Mbps)Jitter(ms)Loss Rate(%)
9000.0160.014
10000.0290.022
[root@sul Iperf]# ./iperf -c 203.255.252.12 -u -b 900m
------------------------------------------------------------
Client connecting to 203.255.252.12, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32927 connected with 203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.05 GBytes 902 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 1.05 GBytes 902 Mbits/sec 0.016 ms 107/767275 (0.014%)
[ 5] Sent 767275 datagrams
[root@sul Iperf]# ./iperf -c 203.255.252.12 -u -b 1000m
------------------------------------------------------------
Client connecting to 203.255.252.12, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 64.0 KByte (default)
------------------------------------------------------------
[ 5] local 155.230.20.20 port 32928 connected with 203.255.252.12 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.0 sec 1.07 GBytes 920 Mbits/sec
[ 5] Server Report:
[ 5] 0.0-10.0 sec 1.07 GBytes 920 Mbits/sec 0.029 ms 171/782253 (0.022%)
[ 5] Sent 782253 datagrams
KNU->KOREN_NOC
KNU(sul.knu.ac.kr)->KT window size test with single TCP stream.
Window SizeBandwidth achieved(Mbps)
256 KB345
512 KB682
1 MB918
2 MB921
3 MB922
4 MB921
KNU->KOREN_NOC
TCP
(Achievable bandwidth in Mbps)
-> NOC (Single Stream)
Chart1
A182
B162
C180
D218
E174
TCP Stream
Achievable Bandwidth in Mbps
KNU->KOREN-NOC (5 Parallel TCP Streams)
Dec19
1219 Achievable Bandwidth TEST from CHEP16 to NKCHEP3
Physical Capacity (pathrate, netest)
pathrate-> 292ms(RTT), Capacity: 98Mbps
netest-> 291.4ms(RTT), Capacity: 155.520Mbs
No. of TCP streamsAchievable bandwidth with TCP window of 4MB
13.09(Mbps)
23.45
34.89
47.86
57.32
611.7
79.75
812.2
911.9
1015.5
1111.6
1218
1319.8
1417.5
1520.8
1621.7
1717.6
1828.1
1924.6
2024.3
2119.3
2224.2
2328.1
2428.1
2529.7
2627.7
2733.6
2833.1
2932
3032.9
3135.4
3233.8
3334.8
3432.9
3536.7
3628.7
3721.5
3840.7
3942
4042.9
4142.5
4247.3
4342.9
4447.3
4548.3
4638.5
4736.8
4844.7
4954.8
5049.7
5145
5250
5346.6
5448.3
5544.9
5649.5
5751
5849.2
5950.6
6049.3
6146.5
6249.9
6347.8
6444.9
6553.5
6651.3
6754.4
6849.3
6955.1
7053.2
7153.9
7251.7
7348.8
7452.1
7550.6
7658.1
7753.6
7855.6
7947
8054.4
8155.9
8256.1
8354.1
8459.6
8553.1
8660.5
8763.4
8862.2
8953.6
9057.2
9160.5
9264.4
9359.3
9460.5
9564.3
9662.8
9761.3
9858
9959.2
10058.7
Dec19
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
No. of TCP Streams
Bandwidth(Mbps)
1219 CHEP16->NKCHEP3
Dec20
1220 Achievable Bandwidth TEST from CHEP16 to NKCHEP3
Physical Capacity (pathrate, netest)
pathrate-> 281.2ms(RTT), Capacity: 96Mbps to 99 Mbps
netest->281.6ms(RTT), Capacity: 100Mbps,
No. of TCPAchievable bandwidth (window:4MB)Achievable bandwidth(window:128KB)
131.61
233.52.25
3233.41
424.14.54
537.99.1
630.611
733.612.7
835.914.4
929.816.3
1032.26.84
1134.17.79
1236.99.75
137.4211.3
1414.211.6
1532.214.5
1636.515.6
1738.616.5
1832.317.3
1929.318.4
2012.318.1
2123TCP window size of 128KB performs poorly with small number of TCP Streams.
2231.4
2336.6
2429.7
2538.8
2632
2732.4
2831.4
2930.1
3031.724.5
3135.7
3227.2
338.4
3423.4
3538
3637.6
3736
3834.4
3933.1
4039.131.8
4138.2
4236.3
4328.1
4432.5
4541.1
4644.1
4743.9
4837.6
4935.1
5039.942.8
5140.1
5244
5342.6
5443.7
5543.9
5641.5
5745.5
584246.6
5939.9
6035.6
6146.3
6243.3
6340.2
6445.6
6539.6
6641.2
6740.6
6841.8
6943
7044.821.9
7141.5
7238.2
7342.7
7442.9
7546.9
7643.4
7742.9
7840.8
7940.5
8040.246.7
8140.1
8243.6
8343.3
8447.1
8544.9
8650.3
8752.2
8849.4
8949.7
9047.450.7
9150.1
9248.4
9347.5
9447.5
9547.6
9650.7
9750.8
9848.8
9947.7
10054.446.9
Dec20
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
00
4MB
128KB
No. of TCP Streams
Bandwidth(Mbps)
1220 CHEP16->NKCHEP3
Dec21
1221 Achivable Bandwidth TEST from CHEP16 to NKCHEP3
Physical Capacity (pathrate, netest)
pathrate-> 281.3ms(RTT), Capacity: 97Mbps to 99 Mbps
netest->281.9ms(RTT), Capacity: 100Mbps
No. of TCPAchievable bandwidth with 4MB of TCP window
132.6
231.9
346
442.6
543.5
649.5
742.1
831.6
932.3
1029.8
1133.9
1236.9
1339.9
1442.3
1540.6
1632.4
1739.5
1842.1
1944.1
2046.3
2147.6
2229.6
2328.4
2441.3
2534.8
2646.3
2735.6
2838.4
2935.7
3039.9
3146.8
3237.1
3339.7
3438.6
3535.8
3633.3
3739.1
3841.2
3936.1
4041.3
4142.9
4240.8
4344
4442.7
4544.2
4645.1
4745.9
4846.1
4937.5
5043
5150.9
5252.4
5337.3
5447.6
5547.7
5645.5
5746.1
5847.2
5941.1
6039
6150.5
6249.4
6344.1
6448
6548.1
6653.3
6746.7
6849.3
6951
7049.8
7143.6
7250.5
7344.2
7449.2
7549.3
7648.6
7750.3
7851.7
7952.6
8050.8
8154.6
8253.7
8351.9
8450.1
8550.6
8653.5
8750
8855.6
8947.9
9050.1
9153.6
9249.2
9354.7
9454
9551.5
9651.3
9753.9
9852.1
9956
10049.5
Dec21
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
No. of TCP Streams
Bandwidth(Mbps)
1221 CHEP16->NKCHEP3
Dec22
12 22
TCP (CHEP16->NKCHEP3)
With TCP Window Size of 4MByte
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55837 connected with 131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 140 MBytes 38.6 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55838 connected with 131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.4 sec 147 MBytes 40.5 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55839 connected with 131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 120 MBytes 32.9 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55840 connected with 131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.4 sec 138 MBytes 38.1 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55841 connected with 131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 138 MBytes 38.1 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55842 connected with 131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 136 MBytes 37.4 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55843 connected with 131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 139 MBytes 38.1 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 2m -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55844 connected with 131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.4 sec 138 MBytes 38.2 Mbits/sec
With TCP Window size of 128 KB
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 65535 -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 128 KByte (WARNING: requested 64.0 KByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55850 connected with 131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 7.33 MBytes 2.01 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 65535 -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 128 KByte (WARNING: requested 64.0 KByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55851 connected with 131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.5 sec 7.30 MBytes 2.01 Mbits/sec
[root@chep16 Iperf]# ./iperf -c nkchep3.fnal.gov -w 65535 -t 30
------------------------------------------------------------
Client connecting to nkchep3.fnal.gov, TCP port 5001
TCP window size: 128 KByte (WARNING: requested 64.0 KByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55852 connected with 131.225.235.248 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.3 sec 7.29 MBytes 2.02 Mbits/sec
chep16->KT
CHEP16->KTCLUSTER1
This test shows that single TCP stream bandwidth roughly equals the sum of the bandwidths of multiple TCP streams
when TCP window size is optimal and there is no network deficiencies.
Single Stream TCP
[root@chep16 Iperf]# ./iperf -c ktcluster1.koren21.net -w 2m -t 30
------------------------------------------------------------
Client connecting to ktcluster1.koren21.net, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 5] local 155.230.20.242 port 55910 connected with 203.255.252.11 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-30.0 sec 3.23 GBytes 925 Mbits/sec
5 TCP Streams
[root@chep16 Iperf]# ./iperf -c ktcluster1.koren21.net -w 2m -P 5
------------------------------------------------------------
Client connecting to ktcluster1.koren21.net, TCP port 5001
TCP window size: 4.00 MByte (WARNING: requested 2.00 MByte)
------------------------------------------------------------
[ 9] local 155.230.20.242 port 55915 connected with 203.255.252.11 port 5001
[ 7] local 155.230.20.242 port 55913 connected with 203.255.252.11 port 5001
[ 8] local 155.230.20.242 port 55914 connected with 203.255.252.11 port 5001
[ 5] local 155.230.20.242 port 55911 connected with 203.255.252.11 port 5001
[ 6] local 155.230.20.242 port 55912 connected with 203.255.252.11 port 5001
[ ID] Interval Transfer Bandwidth
[ 5] 0.0-10.1 sec 220 MBytes 182 Mbits/sec
[ 7] 0.0-10.1 sec 195 MBytes 162 Mbits/sec
[ 6] 0.0-10.1 sec 218 MBytes 180 Mbits/sec
[ 9] 0.0-10.1 sec 261 MBytes 218 Mbits/sec
[ 8] 0.0-10.1 sec 208 MBytes 174 Mbits/sec
[SUM] 0.0-10.2 sec 1.08 GBytes 906 Mbits/sec
A182
B162
C180
D218
E174
chep16->KT
A182
B162
C180
D218
E174
(Achievable Bandwidth in Mbps)
-> NOC (5 )
BDP
Bandwidth Delay Product:
BDP roughly determines the optimal TCP window size which should be adjusted both at local and at remote machines.
Default TCP window size of Linux is 65535 bytes which is too small for High Bandwidth WAN.
BDP can be computed as follows:
The bottleneck link between chep16 and nkchep3 is 100Mbps.
RTT is 291ms currently.
Therefore BDP is 100Mbps* 291ms = 3.6375Mbytes.
So TCP window size should be at least 4Mbytes.
Conclusion
CONCLUSION AND SOME OBSERVATIONS:
1. Dec19 test is a little bit strange compared to Dec20, Dec21 and Dec22 because the single stream bandwidth was
less than 5MB. I think this is due to previous practice multi-stream tests before the actual measurements.
Single stream test which follows multi-stream tests right away usually gives low achivable bandwidth.
It seems that we need to wait for TCP to refresh. Or network might have been less stable at that time.
2. Physical Capacity from chep16 to nkchep3 is 95~100Mbps.
3. Achievable bandwidth from chep16 to nkchep3 with single TCP stream is 30~40Mbps on the condition that
optimal TCP window size is used, which can be roughly computed by Bandwidth Delay Product.
4. With multiple parallel TCP streams, usually 50~70 Mbps can be achieved from chep16 to nkchep3.
5. On a good network, single TCP stream bandwidth = sum of bandwidths achieved by multiple TCP streams
6. Single TCP stream is more vulnerable than multiple parallel TCP streams to network unstability due to algorithms
such as congestion avoidance and slow-start implemented in TCP.
With multiple parallel streams, this effect is minimized and the rate of recovery from packet loss is increased.
See Reference [7].
7. Parallel applications such as bbftp will be helpful in securing more bandwidth, hence speeding up data transfer over WAN.
8. With default TCP window size of 65535 bytes in Linux, a single TCP stream can achieve less than 5Mbps.
Note: Linux kernel usually doubles the requested window size. If you request 65535 bytes, it will give 128KB for window size.
9. TCP Extensions specified in RFC 1323 must be turned on to utilize high band networks ( >100Mbps ).
/proc/sys/net/ipv4/tcp_window_scaling - to allow window larger than 65K bytes
/proc/sys/net/ipv4/tcp_sack - selective acknowledgement
/proc/sys/net/ipv4/tcp_timestamps - single TCP Timestamps Options
/proc/sys/net/ipv4/ip_no_pmtu_disc - path MTU discovery
/proc/sys/net/core/rmem_default - default receive window
/proc/sys/net/core/rmem_max - maximum receive window
/proc/sys/net/core/wmem_default - default send window
/proc/sys/net/core/wmem_max - maximum send window
/proc/sys/net/ipv4/tcp_rmem - memory reserved for TCP rcv buffers
/proc/sys/net/ipv4/tcp_wmem - memory reserved for TCP snd buffers
Below are some examples of chep16 TCP parameters.
[root@chep16 Iperf]# more /proc/sys/net/core/rmem_default
65535
[root@chep16 Iperf]# more /proc/sys/net/core/wmem_max
8388608
[root@chep16 Iperf]# more /proc/sys/net/ipv4/tcp_wmem
4096 87380 4194304
References
1. http://dast.nlanr.net/Projects/Iperf/
2. http://www-didc.lbl.gov/NMWG/NM-WG-tools.html
3. http://www-didc.lbl.gov/NCS/netest/
4. http://www.psc.edu/networking/perf_tune.html
5. Netest: A Tool to Measure the Maximum Burst Size, Available Bandwidth and Achievable Bandwidth Throughput
Guojun Jin, Brian Tierney, Lawrence Berkeley National Laboratory
6. http://www.internet2.edu/~shalunov/writing/tcp-perf.html
7. The End-to-End Performance Effects of Parallel TCP Sockets on a Lossy Wide-Area Network
Thomas J. Hacker, Brian D. Athey, University of Michigan
-
Single Stream Tests between CHEP Caltech
Duration: 10min each, 10min interval, over KOREN-TransPAC path (1Gbps), 20MB window, TCP(Linux 2.4.26) RTT: ~130msBDP: 0.13*1000Mbps=16MBMax throughput: 146Mbps
Chart1
110
146
76.8
81.7
102
TCP Reno(2.4.26)
No. of Trial
Bandwidth(Mbps)
KNU-> Caltech(June 23)
Sheet1
[root@cluster90 ipv4]# traceroute 192.91.239.1
traceroute to 192.91.239.1 (192.91.239.1), 30 hops max, 38 byte packets
1 ns_rtr1 (155.230.20.5) 0.527 ms 0.177 ms 0.151 ms
2 155.230.253.9 (155.230.253.9) 0.235 ms 0.187 ms 0.232 ms
3 203.255.252.234 (203.255.252.234) 0.549 ms 0.312 ms 0.273 ms
4 192.168.88.2 (192.168.88.2) 1.823 ms 1.758 ms 1.772 ms
5 apii-juniper-ge0-1-0-1.jp.apan.net (203.181.249.162) 6.955 ms 6.973 ms 7.
117 ms
6 tpr4-10gi0-0-0-1036.jp.apan.net (203.181.248.225) 45.545 ms 44.409 ms 65.
299 ms
7 tpr2-ae0-7.jp.apan.net (203.181.249.17) 25.780 ms 25.851 ms 25.649 ms
8 transpac-la-tpr2.jp.apan.net (203.181.248.129) 129.313 ms 129.377 ms 129.
272 ms
9 snvang-losang.abilene.ucaid.edu (198.32.8.95) 139.394 ms 139.411 ms 139.4
20 ms
10 dnvrng-snvang.abilene.ucaid.edu (198.32.8.2) 164.068 ms 164.110 ms 164.00
7 ms
11 kscyng-dnvrng.abilene.ucaid.edu (198.32.8.14) 174.620 ms 174.723 ms 182.1
80 ms
12 iplsng-kscyng.abilene.ucaid.edu (198.32.8.80) 183.899 ms 183.827 ms 197.4
68 ms
13 chinng-iplsng.abilene.ucaid.edu (198.32.8.76) 187.729 ms 187.849 ms 187.6
47 ms
14 r04chi-v-187.caltech.datatag.org (192.91.236.198) 187.769 ms 187.898 ms 1
87.773 ms
15 w01gva-ge-0.cern.datatag.org (192.91.239.1) 438.666 ms 313.109 ms 312.979
ms
[kihwan@w01gva Iperf]$ /usr/sbin/traceroute cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max, 38 byte packets
1 r04chi-v-570.caltech.datatag.org (192.91.239.56) 125.546 ms 125.523 ms 12
5.508 ms
2 abilene-tge.cern.ch (192.91.236.197) 125.668 ms 125.662 ms 125.676 ms
3 iplsng-chinng.abilene.ucaid.edu (198.32.8.77) 129.587 ms 129.637 ms 138.1
27 ms
4 kscyng-iplsng.abilene.ucaid.edu (198.32.8.81) 187.181 ms 138.687 ms 138.8
34 ms
5 dnvrng-kscyng.abilene.ucaid.edu (198.32.8.13) 149.312 ms 149.329 ms 149.3
30 ms
6 snvang-dnvrng.abilene.ucaid.edu (198.32.8.1) 174.043 ms 174.031 ms 198.55
3 ms
7 losang-snvang.abilene.ucaid.edu (198.32.8.94) 184.041 ms 184.037 ms 184.0
42 ms
8 tpr2-transpac-la.jp.apan.net (203.181.248.130) 287.810 ms 287.759 ms 287.
759 ms
9 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 306.576 ms 307.133 ms 307.056
ms
10 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226) 306.479 ms 306.437
ms 306.431 ms
11 203.181.249.161 (203.181.249.161) 311.452 ms 311.436 ms 311.497 ms
12 192.168.88.1 (192.168.88.1) 312.899 ms 312.910 ms 312.904 ms
13 203.255.252.233 (203.255.252.233) 313.323 ms 313.268 ms 313.223 ms
14 155.230.253.10 (155.230.253.10) 313.183 ms 313.140 ms 313.243 ms
15 cluster90.knu.ac.kr (155.230.20.120) 313.136 ms 313.205 ms 313.165 ms
BDP=313*1Gbps=39MB
Using FAST over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 60MbyteBandwidth
125.7
232
330.9
428.5
528.4
Multi StreamWindow(stream*window < 100MB)Bandwidth
106MB173
203MB
302MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Using Reno over TransPAC with 1Gbps capacity
Single Streamwindow with 60MbyteBandwidth
1
2
3
4
5
Multi StreamWindow(stream*window < 100MB)Bandwidth
106MB
203MB
302MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Caltech
[kihwan@cluster90 Iperf]$ /usr/sbin/traceroute socrates.cacr.caltech.edu
traceroute to socrates.cacr.caltech.edu (131.215.144.227), 30 hops max, 38 byte packets
1 ns_rtr1 (155.230.20.5) 0.208 ms 0.153 ms 0.164 ms
2 155.230.253.9 (155.230.253.9) 0.238 ms 0.202 ms 0.183 ms
3 203.255.252.234 (203.255.252.234) 0.405 ms 0.336 ms 0.284 ms
4 192.168.88.2 (192.168.88.2) 1.827 ms 1.799 ms 1.765 ms
5 apii-juniper-ge0-1-0-1.jp.apan.net (203.181.249.162) 6.984 ms 6.983 ms 6.937 ms
6 tpr4-10gi0-0-0-1036.jp.apan.net (203.181.248.225) 44.594 ms 45.327 ms 44.263 ms
7 tpr2-ae0-7.jp.apan.net (203.181.249.17) 25.671 ms 25.703 ms 25.631 ms
8 transpac-la-tpr2.jp.apan.net (203.181.248.129) 129.312 ms 129.317 ms 129.437 ms
9 hpr-lax-gsr1--abilene-LA-10ge.cenic.net (137.164.25.2) 129.450 ms 129.677 ms 129.404 ms
10 lax-hpr.losnettos-hpr.cenic.net (137.164.27.246) 129.911 ms 129.824 ms 129.996 ms
11 Booth-RSM.ilan.caltech.edu (131.215.254.253) 130.053 ms 129.926 ms 129.722 ms
12 CACR-ITS-BMR.caltech.edu (131.215.5.147) 129.833 ms 129.949 ms 129.936 ms
13 socrates.cacr.caltech.edu (131.215.144.227) 129.776 ms 129.604 ms 129.610 ms
[kihwan@socrates kihwan]$ /usr/sbin/traceroute cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max, 38 byte packets
1 defaultroute (131.215.144.254) 0.184 ms 0.131 ms 0.125 ms
2 ITS-CACR-BMR.caltech.edu (131.215.5.145) 0.180 ms 0.156 ms 0.160 ms
3 SFL-border.ilan.caltech.edu (131.215.254.252) 0.186 ms 0.181 ms 0.165 ms
4 lax-hpr.losnettos-hpr.cenic.net (137.164.27.241) 0.907 ms 0.746 ms 0.618 ms
5 abilene-LA--hpr-lax-gsr1-10ge.cenic.net (137.164.25.3) 0.755 ms 0.606 ms 0.633 ms
6 tpr2-transpac-la.jp.apan.net (203.181.248.130) 104.360 ms 104.522 ms 104.355 ms
7 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 123.369 ms 123.375 ms 124.634 ms
8 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226) 123.054 ms 123.187 ms 123.047 ms
9 203.181.249.161 (203.181.249.161) 128.043 ms 128.120 ms 128.011 ms
10 * * *
11 203.255.252.233 (203.255.252.233) 129.787 ms 129.830 ms 130.009 ms
12 155.230.253.10 (155.230.253.10) 129.717 ms 129.681 ms 129.744 ms
13 cluster90.knu.ac.kr (155.230.20.120) 129.892 ms 129.656 ms 129.797 ms
Using FAST over TransPAC with 1Gbps capacity
day 1Reno(for graphing)
Single Streamwindow with 20MbyteBandwidth
166.9110
2109146
370.776.8
46981.7
571.1102
Multi StreamWindow(stream*window < 100MB)BandwidthReno(for graphing)
102MB267414
201MB364532
301MB431630
401MB525668
501MB557690
601MB639750
701MB678768
801MB680755
901MB697783
1001MB701742
Using Reno over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 20MbyteBandwidth
1110
2146
376.8
481.7
5102
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB414
201MB532
301MB630
401MB668
501MB690
601MB750
701MB768
801MB755
901MB783
1001MB742
Caltech
00
00
00
00
00
FAST(2.4.22)
TCP Reno(2.4.26)
No. of Trial
Bandwidth(Mbps)
KNU-> Caltech(Single Stream)
Geneva
00
00
00
00
00
00
00
00
00
00
FAST
TCP Reno
No. of Streams
Bandwidth(Mbps)
KNU->Caltech (Parallel Streams)
To w01gva from cluster90
[kihwan@w01gva kihwan]$ /usr/sbin/traceroute cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max, 38 byte packets
1 r04chi-v-570.caltech.datatag.org (192.91.239.56) 251.110 ms 125.512 ms 12
5.511 ms
2 abilene-tge.cern.ch (192.91.236.197) 125.657 ms 125.658 ms 125.654 ms
3 iplsng-chinng.abilene.ucaid.edu (198.32.8.77) 129.471 ms 129.531 ms 172.7
75 ms
4 kscyng-iplsng.abilene.ucaid.edu (198.32.8.81) 138.677 ms 138.667 ms 139.1
03 ms
5 dnvrng-kscyng.abilene.ucaid.edu (198.32.8.13) 149.309 ms 149.290 ms 149.2
89 ms
6 snvang-dnvrng.abilene.ucaid.edu (198.32.8.1) 174.042 ms 174.034 ms 174.03
2 ms
7 losang-snvang.abilene.ucaid.edu (198.32.8.94) 184.903 ms 184.037 ms 184.0
07 ms
8 tpr2-transpac-la.jp.apan.net (203.181.248.130) 287.780 ms 287.780 ms 287.
793 ms
9 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 306.379 ms 306.703 ms 306.605
ms
10 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226) 306.439 ms 306.441
ms 306.449 ms
11 203.181.249.161 (203.181.249.161) 311.466 ms 311.488 ms 311.401 ms
12 192.168.88.1 (192.168.88.1) 312.921 ms 312.915 ms 312.906 ms
13 203.255.252.233 (203.255.252.233) 350.098 ms 343.048 ms 342.980 ms
14 155.230.253.10 (155.230.253.10) 343.086 ms 342.983 ms 342.947 ms
15 cluster90.knu.ac.kr (155.230.20.120) 343.202 ms 342.919 ms 343.020 ms
[root@cluster90 Iperf]# /usr/sbin/traceroute 192.91.239.1
traceroute to 192.91.239.1 (192.91.239.1), 30 hops max, 38 byte packets
1 ns_rtr1 (155.230.20.5) 0.255 ms 0.177 ms 0.147 ms
2 155.230.253.9 (155.230.253.9) 0.217 ms 0.194 ms 0.193 ms
3 203.250.174.45 (203.250.174.45) 0.215 ms 0.204 ms 0.176 ms
4 rubyl3-daegul3.kreonet.net (134.75.5.9) 2.579 ms 2.523 ms 2.520 ms
5 baramgsr.kreonet.net (134.75.20.1) 2.695 ms 2.633 ms 2.624 ms
6 startapgsr.kreonet.net (134.75.20.70) 2.548 ms 2.469 ms 2.471 ms
7 134.75.108.46 (134.75.108.46) 254.147 ms 217.544 ms 217.514 ms
8 r04chi-v-187.caltech.datatag.org (192.91.236.198) 217.663 ms 217.738 ms 217.547 ms
9 w01gva-ge-0.cern.datatag.org (192.91.239.1) 342.812 ms 342.850 ms 342.860 ms
340ms* 622Mbps = 26MB
Using FAST over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 20MbyteBandwidth
1
2
3
4
5
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB
201MB
301MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Using Reno over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 60MbyteBandwidth
142.5
243.6
343.5
443.4
543.1
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB122
201MB126
301MB130
401MB129
501MB132
601MB132
701MB132
801MB
901MB
1001MB
-
Multi-Stream Tests between CHEP Caltech Duration: 10min each over KOREN-TransPAC path (1Gbps), (Stream* Window ) Caltech (June 23)
Sheet1
[root@cluster90 ipv4]# traceroute 192.91.239.1
traceroute to 192.91.239.1 (192.91.239.1), 30 hops max, 38 byte packets
1 ns_rtr1 (155.230.20.5) 0.527 ms 0.177 ms 0.151 ms
2 155.230.253.9 (155.230.253.9) 0.235 ms 0.187 ms 0.232 ms
3 203.255.252.234 (203.255.252.234) 0.549 ms 0.312 ms 0.273 ms
4 192.168.88.2 (192.168.88.2) 1.823 ms 1.758 ms 1.772 ms
5 apii-juniper-ge0-1-0-1.jp.apan.net (203.181.249.162) 6.955 ms 6.973 ms 7.
117 ms
6 tpr4-10gi0-0-0-1036.jp.apan.net (203.181.248.225) 45.545 ms 44.409 ms 65.
299 ms
7 tpr2-ae0-7.jp.apan.net (203.181.249.17) 25.780 ms 25.851 ms 25.649 ms
8 transpac-la-tpr2.jp.apan.net (203.181.248.129) 129.313 ms 129.377 ms 129.
272 ms
9 snvang-losang.abilene.ucaid.edu (198.32.8.95) 139.394 ms 139.411 ms 139.4
20 ms
10 dnvrng-snvang.abilene.ucaid.edu (198.32.8.2) 164.068 ms 164.110 ms 164.00
7 ms
11 kscyng-dnvrng.abilene.ucaid.edu (198.32.8.14) 174.620 ms 174.723 ms 182.1
80 ms
12 iplsng-kscyng.abilene.ucaid.edu (198.32.8.80) 183.899 ms 183.827 ms 197.4
68 ms
13 chinng-iplsng.abilene.ucaid.edu (198.32.8.76) 187.729 ms 187.849 ms 187.6
47 ms
14 r04chi-v-187.caltech.datatag.org (192.91.236.198) 187.769 ms 187.898 ms 1
87.773 ms
15 w01gva-ge-0.cern.datatag.org (192.91.239.1) 438.666 ms 313.109 ms 312.979
ms
[kihwan@w01gva Iperf]$ /usr/sbin/traceroute cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max, 38 byte packets
1 r04chi-v-570.caltech.datatag.org (192.91.239.56) 125.546 ms 125.523 ms 12
5.508 ms
2 abilene-tge.cern.ch (192.91.236.197) 125.668 ms 125.662 ms 125.676 ms
3 iplsng-chinng.abilene.ucaid.edu (198.32.8.77) 129.587 ms 129.637 ms 138.1
27 ms
4 kscyng-iplsng.abilene.ucaid.edu (198.32.8.81) 187.181 ms 138.687 ms 138.8
34 ms
5 dnvrng-kscyng.abilene.ucaid.edu (198.32.8.13) 149.312 ms 149.329 ms 149.3
30 ms
6 snvang-dnvrng.abilene.ucaid.edu (198.32.8.1) 174.043 ms 174.031 ms 198.55
3 ms
7 losang-snvang.abilene.ucaid.edu (198.32.8.94) 184.041 ms 184.037 ms 184.0
42 ms
8 tpr2-transpac-la.jp.apan.net (203.181.248.130) 287.810 ms 287.759 ms 287.
759 ms
9 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 306.576 ms 307.133 ms 307.056
ms
10 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226) 306.479 ms 306.437
ms 306.431 ms
11 203.181.249.161 (203.181.249.161) 311.452 ms 311.436 ms 311.497 ms
12 192.168.88.1 (192.168.88.1) 312.899 ms 312.910 ms 312.904 ms
13 203.255.252.233 (203.255.252.233) 313.323 ms 313.268 ms 313.223 ms
14 155.230.253.10 (155.230.253.10) 313.183 ms 313.140 ms 313.243 ms
15 cluster90.knu.ac.kr (155.230.20.120) 313.136 ms 313.205 ms 313.165 ms
BDP=313*1Gbps=39MB
Using FAST over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 60MbyteBandwidth
125.7
232
330.9
428.5
528.4
Multi StreamWindow(stream*window < 100MB)Bandwidth
106MB173
203MB
302MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Using Reno over TransPAC with 1Gbps capacity
Single Streamwindow with 60MbyteBandwidth
1
2
3
4
5
Multi StreamWindow(stream*window < 100MB)Bandwidth
106MB
203MB
302MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Caltech
[kihwan@cluster90 Iperf]$ /usr/sbin/traceroute socrates.cacr.caltech.edu
traceroute to socrates.cacr.caltech.edu (131.215.144.227), 30 hops max, 38 byte packets
1 ns_rtr1 (155.230.20.5) 0.208 ms 0.153 ms 0.164 ms
2 155.230.253.9 (155.230.253.9) 0.238 ms 0.202 ms 0.183 ms
3 203.255.252.234 (203.255.252.234) 0.405 ms 0.336 ms 0.284 ms
4 192.168.88.2 (192.168.88.2) 1.827 ms 1.799 ms 1.765 ms
5 apii-juniper-ge0-1-0-1.jp.apan.net (203.181.249.162) 6.984 ms 6.983 ms 6.937 ms
6 tpr4-10gi0-0-0-1036.jp.apan.net (203.181.248.225) 44.594 ms 45.327 ms 44.263 ms
7 tpr2-ae0-7.jp.apan.net (203.181.249.17) 25.671 ms 25.703 ms 25.631 ms
8 transpac-la-tpr2.jp.apan.net (203.181.248.129) 129.312 ms 129.317 ms 129.437 ms
9 hpr-lax-gsr1--abilene-LA-10ge.cenic.net (137.164.25.2) 129.450 ms 129.677 ms 129.404 ms
10 lax-hpr.losnettos-hpr.cenic.net (137.164.27.246) 129.911 ms 129.824 ms 129.996 ms
11 Booth-RSM.ilan.caltech.edu (131.215.254.253) 130.053 ms 129.926 ms 129.722 ms
12 CACR-ITS-BMR.caltech.edu (131.215.5.147) 129.833 ms 129.949 ms 129.936 ms
13 socrates.cacr.caltech.edu (131.215.144.227) 129.776 ms 129.604 ms 129.610 ms
[kihwan@socrates kihwan]$ /usr/sbin/traceroute cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max, 38 byte packets
1 defaultroute (131.215.144.254) 0.184 ms 0.131 ms 0.125 ms
2 ITS-CACR-BMR.caltech.edu (131.215.5.145) 0.180 ms 0.156 ms 0.160 ms
3 SFL-border.ilan.caltech.edu (131.215.254.252) 0.186 ms 0.181 ms 0.165 ms
4 lax-hpr.losnettos-hpr.cenic.net (137.164.27.241) 0.907 ms 0.746 ms 0.618 ms
5 abilene-LA--hpr-lax-gsr1-10ge.cenic.net (137.164.25.3) 0.755 ms 0.606 ms 0.633 ms
6 tpr2-transpac-la.jp.apan.net (203.181.248.130) 104.360 ms 104.522 ms 104.355 ms
7 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 123.369 ms 123.375 ms 124.634 ms
8 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226) 123.054 ms 123.187 ms 123.047 ms
9 203.181.249.161 (203.181.249.161) 128.043 ms 128.120 ms 128.011 ms
10 * * *
11 203.255.252.233 (203.255.252.233) 129.787 ms 129.830 ms 130.009 ms
12 155.230.253.10 (155.230.253.10) 129.717 ms 129.681 ms 129.744 ms
13 cluster90.knu.ac.kr (155.230.20.120) 129.892 ms 129.656 ms 129.797 ms
Using FAST over TransPAC with 1Gbps capacity
day 1Reno(for graphing)
Single Streamwindow with 20MbyteBandwidth
166.9110
2109146
370.776.8
46981.7
571.1102
Multi StreamWindow(stream*window < 100MB)BandwidthReno(for graphing)
102MB267414
201MB364532
301MB431630
401MB525668
501MB557690
601MB639750
701MB678768
801MB680755
901MB697783
1001MB701742
Using Reno over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 20MbyteBandwidth
1110
2146
376.8
481.7
5102
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB414
201MB532
301MB630
401MB668
501MB690
601MB750
701MB768
801MB755
901MB783
1001MB742
Caltech
00
00
00
00
00
00
00
00
00
00
FAST
TCP Reno
No. of Streams
Bandwidth(Mbps)
KNU->Caltech (Parallel Streams)
Geneva
To w01gva from cluster90
[kihwan@w01gva kihwan]$ /usr/sbin/traceroute cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max, 38 byte packets
1 r04chi-v-570.caltech.datatag.org (192.91.239.56) 251.110 ms 125.512 ms 12
5.511 ms
2 abilene-tge.cern.ch (192.91.236.197) 125.657 ms 125.658 ms 125.654 ms
3 iplsng-chinng.abilene.ucaid.edu (198.32.8.77) 129.471 ms 129.531 ms 172.7
75 ms
4 kscyng-iplsng.abilene.ucaid.edu (198.32.8.81) 138.677 ms 138.667 ms 139.1
03 ms
5 dnvrng-kscyng.abilene.ucaid.edu (198.32.8.13) 149.309 ms 149.290 ms 149.2
89 ms
6 snvang-dnvrng.abilene.ucaid.edu (198.32.8.1) 174.042 ms 174.034 ms 174.03
2 ms
7 losang-snvang.abilene.ucaid.edu (198.32.8.94) 184.903 ms 184.037 ms 184.0
07 ms
8 tpr2-transpac-la.jp.apan.net (203.181.248.130) 287.780 ms 287.780 ms 287.
793 ms
9 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 306.379 ms 306.703 ms 306.605
ms
10 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226) 306.439 ms 306.441
ms 306.449 ms
11 203.181.249.161 (203.181.249.161) 311.466 ms 311.488 ms 311.401 ms
12 192.168.88.1 (192.168.88.1) 312.921 ms 312.915 ms 312.906 ms
13 203.255.252.233 (203.255.252.233) 350.098 ms 343.048 ms 342.980 ms
14 155.230.253.10 (155.230.253.10) 343.086 ms 342.983 ms 342.947 ms
15 cluster90.knu.ac.kr (155.230.20.120) 343.202 ms 342.919 ms 343.020 ms
[root@cluster90 Iperf]# /usr/sbin/traceroute 192.91.239.1
traceroute to 192.91.239.1 (192.91.239.1), 30 hops max, 38 byte packets
1 ns_rtr1 (155.230.20.5) 0.255 ms 0.177 ms 0.147 ms
2 155.230.253.9 (155.230.253.9) 0.217 ms 0.194 ms 0.193 ms
3 203.250.174.45 (203.250.174.45) 0.215 ms 0.204 ms 0.176 ms
4 rubyl3-daegul3.kreonet.net (134.75.5.9) 2.579 ms 2.523 ms 2.520 ms
5 baramgsr.kreonet.net (134.75.20.1) 2.695 ms 2.633 ms 2.624 ms
6 startapgsr.kreonet.net (134.75.20.70) 2.548 ms 2.469 ms 2.471 ms
7 134.75.108.46 (134.75.108.46) 254.147 ms 217.544 ms 217.514 ms
8 r04chi-v-187.caltech.datatag.org (192.91.236.198) 217.663 ms 217.738 ms 217.547 ms
9 w01gva-ge-0.cern.datatag.org (192.91.239.1) 342.812 ms 342.850 ms 342.860 ms
340ms* 622Mbps = 26MB
Using FAST over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 20MbyteBandwidth
1
2
3
4
5
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB
201MB
301MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Using Reno over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 60MbyteBandwidth
142.5
243.6
343.5
443.4
543.1
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB122
201MB126
301MB130
401MB129
501MB132
601MB132
701MB132
801MB
901MB
1001MB
MBD051D9514.xls
Chart1
66.9110
109146
70.776.8
6981.7
71.1102
FAST(2.4.22)
TCP Reno(2.4.26)
No. of Trial
Bandwidth(Mbps)
KNU-> Caltech(Single Stream)
Sheet1
[root@cluster90 ipv4]# traceroute 192.91.239.1
traceroute to 192.91.239.1 (192.91.239.1), 30 hops max, 38 byte packets
1 ns_rtr1 (155.230.20.5) 0.527 ms 0.177 ms 0.151 ms
2 155.230.253.9 (155.230.253.9) 0.235 ms 0.187 ms 0.232 ms
3 203.255.252.234 (203.255.252.234) 0.549 ms 0.312 ms 0.273 ms
4 192.168.88.2 (192.168.88.2) 1.823 ms 1.758 ms 1.772 ms
5 apii-juniper-ge0-1-0-1.jp.apan.net (203.181.249.162) 6.955 ms 6.973 ms 7.
117 ms
6 tpr4-10gi0-0-0-1036.jp.apan.net (203.181.248.225) 45.545 ms 44.409 ms 65.
299 ms
7 tpr2-ae0-7.jp.apan.net (203.181.249.17) 25.780 ms 25.851 ms 25.649 ms
8 transpac-la-tpr2.jp.apan.net (203.181.248.129) 129.313 ms 129.377 ms 129.
272 ms
9 snvang-losang.abilene.ucaid.edu (198.32.8.95) 139.394 ms 139.411 ms 139.4
20 ms
10 dnvrng-snvang.abilene.ucaid.edu (198.32.8.2) 164.068 ms 164.110 ms 164.00
7 ms
11 kscyng-dnvrng.abilene.ucaid.edu (198.32.8.14) 174.620 ms 174.723 ms 182.1
80 ms
12 iplsng-kscyng.abilene.ucaid.edu (198.32.8.80) 183.899 ms 183.827 ms 197.4
68 ms
13 chinng-iplsng.abilene.ucaid.edu (198.32.8.76) 187.729 ms 187.849 ms 187.6
47 ms
14 r04chi-v-187.caltech.datatag.org (192.91.236.198) 187.769 ms 187.898 ms 1
87.773 ms
15 w01gva-ge-0.cern.datatag.org (192.91.239.1) 438.666 ms 313.109 ms 312.979
ms
[kihwan@w01gva Iperf]$ /usr/sbin/traceroute cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max, 38 byte packets
1 r04chi-v-570.caltech.datatag.org (192.91.239.56) 125.546 ms 125.523 ms 12
5.508 ms
2 abilene-tge.cern.ch (192.91.236.197) 125.668 ms 125.662 ms 125.676 ms
3 iplsng-chinng.abilene.ucaid.edu (198.32.8.77) 129.587 ms 129.637 ms 138.1
27 ms
4 kscyng-iplsng.abilene.ucaid.edu (198.32.8.81) 187.181 ms 138.687 ms 138.8
34 ms
5 dnvrng-kscyng.abilene.ucaid.edu (198.32.8.13) 149.312 ms 149.329 ms 149.3
30 ms
6 snvang-dnvrng.abilene.ucaid.edu (198.32.8.1) 174.043 ms 174.031 ms 198.55
3 ms
7 losang-snvang.abilene.ucaid.edu (198.32.8.94) 184.041 ms 184.037 ms 184.0
42 ms
8 tpr2-transpac-la.jp.apan.net (203.181.248.130) 287.810 ms 287.759 ms 287.
759 ms
9 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 306.576 ms 307.133 ms 307.056
ms
10 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226) 306.479 ms 306.437
ms 306.431 ms
11 203.181.249.161 (203.181.249.161) 311.452 ms 311.436 ms 311.497 ms
12 192.168.88.1 (192.168.88.1) 312.899 ms 312.910 ms 312.904 ms
13 203.255.252.233 (203.255.252.233) 313.323 ms 313.268 ms 313.223 ms
14 155.230.253.10 (155.230.253.10) 313.183 ms 313.140 ms 313.243 ms
15 cluster90.knu.ac.kr (155.230.20.120) 313.136 ms 313.205 ms 313.165 ms
BDP=313*1Gbps=39MB
Using FAST over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 60MbyteBandwidth
125.7
232
330.9
428.5
528.4
Multi StreamWindow(stream*window < 100MB)Bandwidth
106MB173
203MB
302MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Using Reno over TransPAC with 1Gbps capacity
Single Streamwindow with 60MbyteBandwidth
1
2
3
4
5
Multi StreamWindow(stream*window < 100MB)Bandwidth
106MB
203MB
302MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Caltech
[kihwan@cluster90 Iperf]$ /usr/sbin/traceroute socrates.cacr.caltech.edu
traceroute to socrates.cacr.caltech.edu (131.215.144.227), 30 hops max, 38 byte packets
1 ns_rtr1 (155.230.20.5) 0.208 ms 0.153 ms 0.164 ms
2 155.230.253.9 (155.230.253.9) 0.238 ms 0.202 ms 0.183 ms
3 203.255.252.234 (203.255.252.234) 0.405 ms 0.336 ms 0.284 ms
4 192.168.88.2 (192.168.88.2) 1.827 ms 1.799 ms 1.765 ms
5 apii-juniper-ge0-1-0-1.jp.apan.net (203.181.249.162) 6.984 ms 6.983 ms 6.937 ms
6 tpr4-10gi0-0-0-1036.jp.apan.net (203.181.248.225) 44.594 ms 45.327 ms 44.263 ms
7 tpr2-ae0-7.jp.apan.net (203.181.249.17) 25.671 ms 25.703 ms 25.631 ms
8 transpac-la-tpr2.jp.apan.net (203.181.248.129) 129.312 ms 129.317 ms 129.437 ms
9 hpr-lax-gsr1--abilene-LA-10ge.cenic.net (137.164.25.2) 129.450 ms 129.677 ms 129.404 ms
10 lax-hpr.losnettos-hpr.cenic.net (137.164.27.246) 129.911 ms 129.824 ms 129.996 ms
11 Booth-RSM.ilan.caltech.edu (131.215.254.253) 130.053 ms 129.926 ms 129.722 ms
12 CACR-ITS-BMR.caltech.edu (131.215.5.147) 129.833 ms 129.949 ms 129.936 ms
13 socrates.cacr.caltech.edu (131.215.144.227) 129.776 ms 129.604 ms 129.610 ms
[kihwan@socrates kihwan]$ /usr/sbin/traceroute cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max, 38 byte packets
1 defaultroute (131.215.144.254) 0.184 ms 0.131 ms 0.125 ms
2 ITS-CACR-BMR.caltech.edu (131.215.5.145) 0.180 ms 0.156 ms 0.160 ms
3 SFL-border.ilan.caltech.edu (131.215.254.252) 0.186 ms 0.181 ms 0.165 ms
4 lax-hpr.losnettos-hpr.cenic.net (137.164.27.241) 0.907 ms 0.746 ms 0.618 ms
5 abilene-LA--hpr-lax-gsr1-10ge.cenic.net (137.164.25.3) 0.755 ms 0.606 ms 0.633 ms
6 tpr2-transpac-la.jp.apan.net (203.181.248.130) 104.360 ms 104.522 ms 104.355 ms
7 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 123.369 ms 123.375 ms 124.634 ms
8 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226) 123.054 ms 123.187 ms 123.047 ms
9 203.181.249.161 (203.181.249.161) 128.043 ms 128.120 ms 128.011 ms
10 * * *
11 203.255.252.233 (203.255.252.233) 129.787 ms 129.830 ms 130.009 ms
12 155.230.253.10 (155.230.253.10) 129.717 ms 129.681 ms 129.744 ms
13 cluster90.knu.ac.kr (155.230.20.120) 129.892 ms 129.656 ms 129.797 ms
Using FAST over TransPAC with 1Gbps capacity
day 1Reno(for graphing)
Single Streamwindow with 20MbyteBandwidth
166.9110
2109146
370.776.8
46981.7
571.1102
Multi StreamWindow(stream*window < 100MB)BandwidthReno(for graphing)
102MB267414
201MB364532
301MB431630
401MB525668
501MB557690
601MB639750
701MB678768
801MB680755
901MB697783
1001MB701742
Using Reno over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 20MbyteBandwidth
1110
2146
376.8
481.7
5102
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB414
201MB532
301MB630
401MB668
501MB690
601MB750
701MB768
801MB755
901MB783
1001MB742
Caltech
00
00
00
00
00
FAST(2.4.22)
TCP Reno(2.4.26)
No. of Trial
Bandwidth(Mbps)
KNU-> Caltech(Single Stream)
Geneva
00
00
00
00
00
00
00
00
00
00
FAST
TCP Reno
No. of Streams
Bandwidth(Mbps)
KNU->Caltech (Parallel Streams)
To w01gva from cluster90
[kihwan@w01gva kihwan]$ /usr/sbin/traceroute cluster90.knu.ac.kr
traceroute to cluster90.knu.ac.kr (155.230.20.120), 30 hops max, 38 byte packets
1 r04chi-v-570.caltech.datatag.org (192.91.239.56) 251.110 ms 125.512 ms 12
5.511 ms
2 abilene-tge.cern.ch (192.91.236.197) 125.657 ms 125.658 ms 125.654 ms
3 iplsng-chinng.abilene.ucaid.edu (198.32.8.77) 129.471 ms 129.531 ms 172.7
75 ms
4 kscyng-iplsng.abilene.ucaid.edu (198.32.8.81) 138.677 ms 138.667 ms 139.1
03 ms
5 dnvrng-kscyng.abilene.ucaid.edu (198.32.8.13) 149.309 ms 149.290 ms 149.2
89 ms
6 snvang-dnvrng.abilene.ucaid.edu (198.32.8.1) 174.042 ms 174.034 ms 174.03
2 ms
7 losang-snvang.abilene.ucaid.edu (198.32.8.94) 184.903 ms 184.037 ms 184.0
07 ms
8 tpr2-transpac-la.jp.apan.net (203.181.248.130) 287.780 ms 287.780 ms 287.
793 ms
9 tpr4-gi0-2-0-7.jp.apan.net (203.181.249.19) 306.379 ms 306.703 ms 306.605
ms
10 apii-juniper-ge1-0-0-1036.jp.apan.net (203.181.248.226) 306.439 ms 306.441
ms 306.449 ms
11 203.181.249.161 (203.181.249.161) 311.466 ms 311.488 ms 311.401 ms
12 192.168.88.1 (192.168.88.1) 312.921 ms 312.915 ms 312.906 ms
13 203.255.252.233 (203.255.252.233) 350.098 ms 343.048 ms 342.980 ms
14 155.230.253.10 (155.230.253.10) 343.086 ms 342.983 ms 342.947 ms
15 cluster90.knu.ac.kr (155.230.20.120) 343.202 ms 342.919 ms 343.020 ms
[root@cluster90 Iperf]# /usr/sbin/traceroute 192.91.239.1
traceroute to 192.91.239.1 (192.91.239.1), 30 hops max, 38 byte packets
1 ns_rtr1 (155.230.20.5) 0.255 ms 0.177 ms 0.147 ms
2 155.230.253.9 (155.230.253.9) 0.217 ms 0.194 ms 0.193 ms
3 203.250.174.45 (203.250.174.45) 0.215 ms 0.204 ms 0.176 ms
4 rubyl3-daegul3.kreonet.net (134.75.5.9) 2.579 ms 2.523 ms 2.520 ms
5 baramgsr.kreonet.net (134.75.20.1) 2.695 ms 2.633 ms 2.624 ms
6 startapgsr.kreonet.net (134.75.20.70) 2.548 ms 2.469 ms 2.471 ms
7 134.75.108.46 (134.75.108.46) 254.147 ms 217.544 ms 217.514 ms
8 r04chi-v-187.caltech.datatag.org (192.91.236.198) 217.663 ms 217.738 ms 217.547 ms
9 w01gva-ge-0.cern.datatag.org (192.91.239.1) 342.812 ms 342.850 ms 342.860 ms
340ms* 622Mbps = 26MB
Using FAST over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 20MbyteBandwidth
1
2
3
4
5
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB
201MB
301MB
401MB
501MB
601MB
701MB
801MB
901MB
1001MB
Using Reno over TransPAC with 1Gbps capacity
day 1day2avg
Single Streamwindow with 60MbyteBandwidth
142.5
243.6
343.5
443.4
543.1
Multi StreamWindow(stream*window < 100MB)Bandwidth
102MB122
201MB126
301MB130
401MB129
501MB132
601MB132
701MB132
801MB
901MB
1001MB
-
Single Stream Tests between CHEP CERNDuration: 10min each, 10min interval, over KOREN-TransPAC path 40MB window, TCP(Linux 2.4.26) RTT: ~370msBDP: 0.37*1000Mbps=46MBMax throughput: 99Mbs
Chart1
99.6
93.6
87.8
92.9
47.8
No. of Trials
Throughput(Mbps)
KNU->CERN(Single Stream)
Sheet1
[kihwan@w01gva Iperf]$ date
Mon Jun 28 06:43:30 CEST 2004
[root@cluster118 iperf-1.7.0]# traceroute 192.91.239.1
traceroute to 192.91.239.1 (192.91.239.1), 30 hops max, 38 byte packets
1 134.75.85.161 (134.75.85.161) 2.743 ms 2.630 ms 2.623 ms
2 startapgsr.kreonet.net (134.75.20.70) 2.606 ms 2.564 ms 2.574 ms
3 134.75.108.46 (134.75.108.46) 247.947 ms 247.938 ms 247.950 ms
4 r04chi-v-187.caltech.datatag.org (192.91.236.198) 248.066 ms 248.168 ms 248.074 ms
5 w01gva-ge-0.cern.datatag.org (192.91.239.1) 498.931 ms 373.295 ms 373.264 ms
[kihwan@w01gva Iperf]$ /usr/sbin/traceroute 134.75.85.162
traceroute to 134.75.85.162 (134.75.85.162), 30 hops max, 38 byte packets
1 r04chi-v-570.caltech.datatag.org (192.91.239.56) 125.594 ms 125.520 ms 125.501 ms
2 abilene-tge.cern.ch (192.91.236.197) 125.706 ms 125.699 ms 125.696 ms
3 134.75.108.45 (134.75.108.45) 370.934 ms 370.889 ms 370.888 ms
4 baramgsr.kreonet.net (134.75.20.1) 371.597 ms 371.124 ms 371.141 ms
5 supersirenl3.kreonet.net (134.75.20.20) 371.088 ms 371.107 ms 371.204 ms
6 134.75.85.162 (134.75.85.162) 373.447 ms 373.401 ms 373.449 ms
[root@cluster118 iperf-1.7.0]# date
Mon Jun 28 13:37:42 KST 2004
[root@cluster118 iperf-1.7.0]# ifconfig
eth0 Link encap:Ethernet HWaddr 00:03:47:AD:3A:F1
inet addr:134.75.85.162 Bcast:134.75.85.167 Mask:255.255.255.248
inet6 addr: fe80::203:47ff:fead:3af1/64 Scope:Link
inet6 addr: 2001:320:201::118/48 Scope:Global
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:117524 errors:0 dropped:0 overruns:0 frame:0
TX packets:195466 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:8386125 (7.9 Mb) TX bytes:281014096 (267.9 Mb)
Memory:e8020000-e8040000
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:21094 errors:0 dropped:0 overruns:0 frame:0
TX packets:21094 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:2858292 (2.7 Mb) TX bytes:2858292 (2.7 Mb)
BDP=370*622=28.7
txqueuelen
over TransPAC
cluster116-> Caltech(window size=20mbyte, interval 10min, duration: 10min)
txqueuelen10010001000050000100000150000
114614764113158105
288.923684.9115167145
3177184151321147226
410813617999.596.3120
514614511411012270.4
617540.610617379.9194
7176226174187185191
817510385.4117224175
917676.112960.4117104
1010910211612262127
txqueuelen
000000
000000
000000
000000
000000
000000
000000
000000
000000
000000
100
1000
10000
50000
100000
150000
No. Of Trials
Bandwidth (Mbps)
txqueuelen
Window Size
Over KREONET
From cluster118 to w01gva.datatag.org on June28 (118 June28resultGvaReno)
10min duration, with txqueuelen 100
Window(MB)bandwidthDataPktsOutPktsRetransPkt Loss(%)
539.420419035160.03
1030.7159655412290.07
1530.2157300111720.07
2028.614928299110.06
2529.315246448690.06
3030.5158936511010.07
3529.