Tier 2 - Abilene Connectivity USATLAS T1 & T2 Network Planning Meeting Brookhaven National Laboratory

Tier 2 - Abilene Connectivity USATLAS T1 & T2 Network Planning Meeting Brookhaven National Laboratory

Chris Heermann, Internet2

chris.heermann@internet2.edu

Chris Heermann, Internet2

chris.heermann@internet2.edu

2

OutlineOutline

• Abilene Overview

• Tier 2 - Abilene Connectivity

• Abilene Routing Metrics

• Tier 2 Bandwidth Requirements

• Traceroute results to Tier 2 participants

3

Abilene OverviewAbilene Overview

• 10-Gbps ‘best effort’, over-provisioned IP network• Current normal load ~2 Gbps; ~10 Gbps peak

• Carrier provisioned backbone λ’s (Q-Wave)• ~4.7 9’s availability over past 12 months

• IPv4/IPv6, native multicast, MPLS LSPs• Network research facilitation (data + co-lo)• Abilene Observatory project

• Extensive domestic and int’l R&E peering

4

Abilene CommunityAbilene Community

• 39 direct connections (OC-3c 10 Gbps)• 3 10 Gbps (10 GE) connections

• OC-192c SONET also supported• 7 OC-48c connections & 3 GE connectors• 25 connected at OC-12c (622 Mbps) or higher

• 234 Primary Participants – research universities and labs• Library of Congress and U.S. Holocaust Museum most

recent additions• Expanded Access

• 126 Sponsored Participants - Individual institutions, K-12 schools, museums, libraries, research institutes

• 34 Sponsored Educational Group Participants - state-based education networks

See: http://abilene.internet2.edu/

5

The Abilene NetworkThe Abilene Network

6

USATLAS Tier 2 Abilene ConnectivityUSATLAS Tier 2 Abilene Connectivity

NORTH TEXASUT-Arlington

OneNetOklahoma

Indiana GigaPoPIndiana

MRENChicago

Network Virginia

MAX

Hampton

ESNet

ESNet

ESNet

ESNet

NOX

Boston University

MeritMichigan

7

Abilene Routing MetricsAbilene Routing Metrics

NORTH TEXASUT-Arlington

OneNetOklahoma

Indiana GigaPoPIndiana

MRENChicago

Network Virginia

MAX

Hampton

ESNet

ESNet

ESNet

ESNet

NOX

Boston University

MeritMichigan

2095856

366

1893

1295639

902

548260

700233

846587

1176

8

Tier 2 Bandwidth RequirementsTier 2 Bandwidth Requirements

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.

Courtesy ofScott Bradley

9

USATLAS Tier 2 Traceroute for UT-ArlingtonUSATLAS Tier 2 Traceroute for UT-Arlington

• Source: hstnng.abilene.ucaid.edu (Houston)• Destination: www.bnl.gov

HSTNng-re1# run traceroute www.bnl.gov traceroute to cache3.bnl.gov (130.199.3.21), 30 hops max, 40 byte packets 1 atlang-hstnng.abilene.ucaid.edu (198.32.8.34) 21.324 ms 20.218 ms 20.141 ms 2 atlcr1-abilene.es.net (198.124.216.141) 21.709 ms 20.276 ms 20.368 ms 3 dccr1-oc48-atlcr1.es.net (134.55.209.65) 173.805 ms 40.506 ms 47.570 ms 4 aoacr1-oc48-dccr1.es.net (134.55.209.61) 41.348 ms 40.141 ms 40.125 ms 5 bnl-oc48-aoacr1.es.net (134.55.209.130) 42.925 ms 41.909 ms 43.340 ms 6 bnl-esbnl.es.net (198.124.216.114) 53.762 ms 41.991 ms 43.038 ms 7 *^C[edit]

10

USATLAS Tier 2 Traceroute for University of OklahomaUSATLAS Tier 2 Traceroute for University of Oklahoma

• Source: kscyng.abilene.ucaid.edu (Kansas City)• Destination: www.bnl.gov

KSCYng-re1# run traceroute www.bnl.gov traceroute to cache3.bnl.gov (130.199.3.21), 30 hops max, 40 byte packets 1 iplsng-kscyng.abilene.ucaid.edu (198.32.8.80) 253.488 ms 272.925 ms 249.779 ms 2 chinng-iplsng.abilene.ucaid.edu (198.32.8.76) 19.724 ms 18.397 ms 19.432 ms 3 chi-oc48pos-abilene.es.net (198.125.140.53) 29.034 ms 13.995 ms 13.699 ms 4 aoacr1-oc192-chicr1.es.net (134.55.209.58) 51.207 ms 43.769 ms 34.090 ms 5 bnl-oc48-aoacr1.es.net (134.55.209.130) 46.071 ms 56.436 ms 42.884 ms 6 bnl-esbnl.es.net (198.124.216.114) 45.412 ms 35.729 ms 35.419 ms 7 *^C[edit]

11

USATLAS Tier 2 Traceroute for Indiana UniversityUSATLAS Tier 2 Traceroute for Indiana University

• Source: iplsng.abilene.ucaid.edu (Indianapolis)• Destination: www.bnl.gov

IPLSng-re0> traceroute www.bnl.gov traceroute to cache3.bnl.gov (130.199.3.21), 30 hops max, 40 byte packets 1 chinng-iplsng.abilene.ucaid.edu (198.32.8.76) 36.897 ms 16.034 ms 26.814 ms 2 chi-oc48pos-abilene.es.net (198.125.140.53) 27.392 ms 30.902 ms 14.578 ms 3 aoacr1-oc192-chicr1.es.net (134.55.209.58) 61.925 ms 46.650 ms 43.597 ms 4 bnl-oc48-aoacr1.es.net (134.55.209.130) 44.846 ms 69.233 ms 49.984 ms 5 bnl-esbnl.es.net (198.124.216.114) 30.579 ms 46.918 ms 46.616 ms 6 *^C

12

USATLAS Tier 2 Traceroute for University of ChicagoUSATLAS Tier 2 Traceroute for University of Chicago

• Source: chinng.abilene.ucaid.edu (Chicago)• Destination: www.bnl.gov

CHINng-re1# run traceroute www.bnl.gov traceroute to cache3.bnl.gov (130.199.3.21), 30 hops max, 40 byte packets 1 chi-oc48pos-abilene.es.net (198.125.140.53) 0.621 ms 0.574 ms 0.541 ms 2 aoacr1-oc192-chicr1.es.net (134.55.209.58) 20.567 ms 20.580 ms 20.584 ms 3 bnl-oc48-aoacr1.es.net (134.55.209.130) 22.508 ms 22.418 ms 22.377 ms 4 bnl-esbnl.es.net (198.124.216.114) 22.426 ms 22.407 ms 22.533 ms 5 *^C[edit]

13

USATLAS Tier 2 Traceroute for Hampton UniversityUSATLAS Tier 2 Traceroute for Hampton University

• Source: washng.abilene.ucaid.edu (Washington DC)• Destination: www.bnl.gov

WASHng-re1# run traceroute www.bnl.gov traceroute to cache3.bnl.gov (130.199.3.21), 30 hops max, 40 byte packets 1 nycmng-washng.abilene.ucaid.edu (198.32.8.84) 4.790 ms 11.448 ms 14.373 ms 2 aoa-manlan-abilene.es.net (198.124.216.157) 5.403 ms 13.453 ms 5.190 ms 3 bnl-oc48-aoacr1.es.net (134.55.209.130) 19.016 ms 6.933 ms 15.806 ms 4 bnl-esbnl.es.net (198.124.216.114) 6.887 ms 6.891 ms 6.832 ms 5 *^C[edit]

14

USATLAS Tier 2 Traceroute for University of MichiganUSATLAS Tier 2 Traceroute for University of Michigan

• Source: chinng.abilene.ucaid.edu (Chicago)• Destination: www.bnl.gov

CHINng-re1# run traceroute www.bnl.gov traceroute to cache3.bnl.gov (130.199.3.21), 30 hops max, 40 byte packets 1 chi-oc48pos-abilene.es.net (198.125.140.53) 0.650 ms 0.581 ms 0.547 ms 2 aoacr1-oc192-chicr1.es.net (134.55.209.58) 21.222 ms 20.572 ms 20.584 ms 3 bnl-oc48-aoacr1.es.net (134.55.209.130) 22.417 ms 22.383 ms 22.352 ms 4 bnl-esbnl.es.net (198.124.216.114) 22.450 ms 22.414 ms 22.480 ms 5 *^C[edit]

15

USATLAS Tier 2 Traceroute for Boston UniversityUSATLAS Tier 2 Traceroute for Boston University

• Source: nycmng.abilene.ucaid.edu (New York)• Destination: www.bnl.gov

NYCMng-re1# run traceroute www.bnl.gov traceroute to cache3.bnl.gov (130.199.3.21), 30 hops max, 40 byte packets 1 aoa-manlan-abilene.es.net (198.124.216.157) 0.648 ms 15.499 ms 2.026 ms 2 bnl-oc48-aoacr1.es.net (134.55.209.130) 2.608 ms 2.757 ms 3.746 ms 3 bnl-esbnl.es.net (198.124.216.114) 3.709 ms 2.478 ms 3.021 ms 4 *^C[edit]

16