internet traffic after ip-convergence -...

Internet traffic after IP-convergence: What drives low-latencies in Internet traffic?

Doug Madory, Senior Analyst Submarine Networks World, Singapore 12 September 2013

© 2013 Renesys Corporation What drives low-latencies in Internet traffic? 2

What drives low-latencies in Internet traffic?

•  Recent Cable Events in Measurement Data •  Activation events can have profound impact on nations

•  Why Submarine Cables are only part of the story •  Subsea cables provide the options •  However actual paths matter!

Global Measurement Infrastructure – More than 100 locations, billions of measurements per day



Recent Cable Events in Measurement Data •  Cuba •  Tonga •  Sierra Leone •  EPEG


Cuba updates


1.  ALBA-1 to Venezuela activated on 14 Jan

2.  ALBA-1 to Jamaica activated on 13 May •  Disappeared 2 Aug

1

2

1

2

Cuba updates (2)

© 2013 Renesys Corporation 6

•  25 Jun: Tata service to Cuba changed from satellite to submarine cable (ALBA-1)

http://www.renesys.com/2013/08/cuban-internet/

Asymmetric satellite

Submarine cable Submarine cable

Telefonica Disruption


Submarine cable Submarine cable


Tonga cable activation •  $34 million project supported by

•  World Bank Group •  Tonga Communications Corporation


•  Asia Development Bank


Satellite

Submarine Cable

§ Cable first use at 5:56 UTC on 5 Aug 2013

Perth Sydney

Sierra Leone ACE cable activation

•  World Bank Project US$31M, China US$15M •  Activation ceremony on 20 Feb 2013



Satellite Satellite

Submarine cable

SierraTel on cable Afcom on cable 13:00 UTC 21 Feb 2013 19:06 UTC 20 Feb 2013


Submarine Cable Alternative Terrestrial Path from Europe to Asia: EPEG


•  Began carrying Internet traffic on 30 March 2013 •  http://www.renesys.com/2013/04/gulf-states-turn-to-iran-russia-for-internet/

•  Avoids submarine cable chokepoint in Egypt •  Began servicing customers in:

•  Oman •  Iran •  Pakistan •  Kenya •  Bahrain

•  Later added •  Kuwait •  Yemen




•  Primary customers are Transworld (Pakistan) and DCI (Iran)


•  Some service disruptions visible



•  Primary customers are Transworld (Pakistan) and DCI (Iran) •  Some service disruptions visible



Why submarine cables are only part of the story •  Myanmar disruptions •  Hair-pinning examples


Myanmar Disruptions

•  Initially reported as a subsea cable fault

•  Multiple disruptions leading up to 25th anniversary of “8888 Protest”

•  Afterwards, Telekom Malaysia becomes top international provider to Myanmar


http://www.renesys.com/2013/08/myanmar-internet/ What drives low-latencies in Internet traffic?

Two views from Singapore to Myanmar


•  Period of Internet disruptions begins 22 Jul (red arrow) •  From one Singapore-based ISP, latencies spike (typical view) •  From another Singapore-based ISP, latencies drop during

disruption via fast path over NTT

Lower latencies

Higher latencies Higher

latencies

Lower latencies


Hairpinning Example #1 Geographic locality ≠ Internet locality


•  Internet traffic can take some surprising paths •  Hanoi -> Singapore via Hong Kong, Tokyo, Seattle, Tokyo (again)




•  Internet traffic can take some surprising paths •  Kuala Lumpur-> Singapore

1 113.23.142.65 Extreme.Broadband Kuala.Lumpur 0.558 ms2 203.188.233.205 1<0<1.a901.as38182.net Extreme.Broadband Kajang 0.863 ms3 216.6.121.121 if<1<2.bb1.KT1<KualaLumpur.as6453.net Tata.Comm. Kuala.Lumpur 1.648 ms4 216.6.121.138 if<4<2<3<4.tcore1.SVW<Singapore.as6453.net Tata.Comm. Singapore 216.008 ms5 180.87.12.2 if<2<2.tcore2.SVW<Singapore.as6453.net Tata.Comm. Singapore 223.297 ms6 180.87.15.26 if<7<2.tcore2.LVW<LosAngeles.as6453.net Tata.Comm. Los.Angeles 227.179 ms7 66.110.59.1 if<2<2.tcore1.LVW<LosAngeles.as6453.net Tata.Comm. Los.Angeles 224.507 ms8 66.110.57.81 if<8<2.tcore2.DT8<Dallas.as6453.net Tata.Comm. Dallas 236.171 ms9 66.110.57.54 if<3<0<0<35.core1.DTX<Dallas.as6453.net Tata.Comm. Dallas 224.721 ms10 216.6.53.18 ix<3<1<0.core1.DTX<Dallas.as6453.net Tata.Comm. Dallas 224.908 ms11 204.70.196.29 cr2<tengige0<7<5<0.dallas.savvis.net Savvis Dallas 225.082 ms12 206.28.96.86 cr1<te<0<6<0<1.sfo.savvis.net Savvis San.Francisco 235.89 ms13 204.70.200.229 er1<te<1<0<1.SanJose3Equinix.savvis.net Savvis San.Jose 248.953 ms14 204.70.204.105 hr1.gig<3<0<18.singapore.sg8.savvis.net Savvis Singapore 263.893 ms

via Dallas, Texas




•  Internet traffic can take some surprising paths •  Singapore -> Singapore via San Jose, California

1 72.26.220.9 20.te1*1.tsr1.sin1.sg.voxel.net Voxel5Dot5Net,5Inc. Singapore 0.2 ms2 202.58.10.37 mpr2.g1*5.inapvoxcust*7.sin001.pnap.netInternap5Network5 Singapore 0.3 ms3 213.254.227.241 ae0*106.sin11.ip4.tinet.net Tinet5International Singapore 0.4 ms4 141.136.109.21 xe*1*3*2.sjc10.ip4.tinet.net Tinet5International San5Jose 169.4 ms5 206.223.116.12 xe*0.equinix.snjsca04.us.bb.gin.ntt.netEquinix,5Inc. San5Jose 170.0 ms6 129.250.5.52 ae*7.r20.snjsca04.us.bb.gin.ntt.net NTT5America,5Inc. San5Jose 169.8 ms7 129.250.3.89 as*6.r20.sngpsi02.sg.bb.gin.ntt.net NTT5Singapore5Ltd Singapore 353.1 ms8 129.250.6.101 ae*0.r21.sngpsi02.sg.bb.gin.ntt.net NTT5Singapore5Ltd Singapore 354.2 ms




•  Subsea cables provide options, however actual paths matter!

•  Paths determined by multiple factors •  Business relationships / Politics •  Transit pricing •  Routing (Mis)configurations

•  Cables provide physical diversity •  Not necessarily low-latency paths


internet traffic after ip-convergence -...

Documents