more specific announcements in bgp - apnic · whyadvertise a more specific? ii: to redirect...

45
More Specific Announcements in BGP Geoff Huston APNIC

Upload: others

Post on 27-Jun-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

More Specific Announcements in BGP

Geoff HustonAPNIC

Page 2: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

What’s a more specific?

Aprefixadvertisementthatrefinesa“covering”advertisement

10.0.0.0/810.1.0.0/16

Page 3: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Why advertise a more specific?

I: Toredirectpacketstoadifferentnetwork:“holepunchingprefixes”

10.0.0.0/8AS65530

10.1.0.0/16AS138000DifferentOriginAS

Page 4: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Example: Type I

Network Path>* 72.249.184.0/21 4777 2497 3356 36024>* 72.249.184.0/24 4777 2497 2914 40824 394094

Page 5: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Why advertise a more specific?

II: Toredirectincomingtraffictodifferentnetworkpaths:“trafficengineeringprefixes”

10.0.0.0/8AS65530

10.0.0.0/9AS6553010.128.0.0/9AS65530

AS65536 AS65537

SameOriginAS,differentASPath

Page 6: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Example: Type II

Network Path*> 1.37.0.0/16 4608 1221 4637 4775 i*> 1.37.27.0/24 4608 1221 4637 4837 4775 i*> 1.37.237.0/24 4608 1221 4637 4837 4775 i

Page 7: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Why advertise a more specific?

III:Tomitigatemorespecificprefixhijacking:“morespecificoverlays”

10.0.0.0/22AS65530

10.0.0.0/24AS65530

10.0.1.0/24AS65530

10.0.2.0/24AS65530

10.0.3.0/24AS65530

SameOriginAS,sameASPath

Page 8: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Example: Type III

Network Path*> 1.0.4.0/22 4608 4826 38803 56203 i*> 1.0.4.0/24 4608 4826 38803 56203 i*> 1.0.5.0/24 4608 4826 38803 56203 i*> 1.0.6.0/24 4608 4826 38803 56203 i*> 1.0.7.0/24 4608 4826 38803 56203 i

Page 9: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

How many eBGP route advertisements are more specifics?

AS131072– 13October2017RoutesAdvertisedAddressSpan

BGPRoutes: 685,8952.86B/32sMoreSpecifics: 365,022(53%)1.04B/32s(36%)

Page 10: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

How many eBGP route advertisements are more specifics?

AS131072– 13October2017RoutesAdvertisedAddressSpan

BGPRoutes: 685,8952.86B/32sMoreSpecifics: 365,022(53%)1.04B/32s(36%)

Page 11: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Has this changed over time?

IPv4

Page 12: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Has this changed over time?

IPv4 IPv6

Page 13: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Has this changed over time?

IPv4 IPv6

Lets use the ratio of More-Specifics to the total route set

Page 14: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Has this changed over time?

IPv4 IPv6

Oddly stable at 50%Still growing

2007 2007now now

Page 15: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

More Specific Types – Prefix Counts

IPv4 IPv6

Page 16: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

More Specific Types – Relative Counts

IPv4 IPv6

Page 17: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

More Specific Types – Relative Counts

IPv4 IPv6Hole Punching

Overlay

Page 18: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

More Specific Types

InbothIPv4andIPv6:• TypeIprefixes(”holepunching”)aredecliningovertime(relatively)• TypeIIprefixes(“trafficengineering”)havebeenrelativelyconstantatsome30%ofmorespecifics• TypeIIIprefixes(“overlays”)haverisen(relatively)andarenowthemoreprevalentformofadvertisedmorespecifics

Page 19: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

What about Address Spans covered by more specifics?

IPv4 IPv6

Yes, this is a LOG scale

Page 20: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

What about Address Spans covered by more specifics?

IPv4 IPv6

Lets use the ratio of More-Specifics to the total address span

Page 21: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

What about Address Spans covered by more specifics?

IPv4 IPv6

Lets use the ratio of More-Specifics to the total address span

27% 2%

Page 22: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Address Span: Breakdown into Types

IPv4 IPv6

Page 23: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

% of Total Span: Breakdown into Types

IPv4 IPv6

It’s mostly overlays!

Page 24: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Overlays are the majority of More Specifics• TheinitialIPv6networkhadlittleinthewayofoverlaysandhadahighproportionofTypeI(HolePunching)morespecifics.ThishaschangedovertimeandtherecentprofileissimilartoIPv4

• Inbothprotocolsthelargestblockofmorespecificannouncementsintermsofaddressspanare“overlays”wheretheASPathoftheenclosingaggregateandthemorespecificareidentical

Page 25: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Overlays are the majority of More SpecificsAreOverlays“polluting”theBGPSpace?• Overlaysdonotchangerouting,butdothesemorespecificsaddtotheroutingload?

Page 26: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Updates

• Let’slookat“routingload”bylookingatBGPupdates

• Ourquestionsare:• Aremorespecifics“noisier”thanaggregates?and• AreoverlaysmoreactiveintermsofBGPUpdatesthanotherprefixes?

Page 27: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Update count by Prefix Type

IPv4 IPv6

Page 28: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Update count by Prefix Type

IPv4 IPv6

Page 29: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Update Count

• InIPv4theupdatecountformorespecificprefixesisgreaterthanthecomparablecountforrootprefixes,whiletheoppositeisthecaseinIPv6.• ButtherelativecountofmorespecificsislowerinIPv6• Let’s“normalise”thisbydividingtheupdatecountbythenumberofprefixestogettheaverageupdatecountperprefixofeachtype

Page 30: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Relative Update count by Prefix Type

IPv4 IPv6

Page 31: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Relative Updates

• Onaverage,inIPv4MoreSpecificsareslightlynoisierthanIPv4Roots,whileinIPv6rootsandmorespecificsareequallylikelytobethesubjectofBGPupdates

• AredifferenttypesofmorespecificsmoreorlessstableinBGPterms?

Page 32: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Average Number of Updates Per More Specific Prefix Type

IPv4 IPv6

Page 33: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Average Number of Updates Per More Specific Prefix Type• InIPv4TypeIITrafficEngineeringPrefixesshowaslightlyhigherlevelofBGPinstabilityonaverageoverTypeIHolePunchingPrefixes,whileTypeIIIOverlayPrefixesshowthehighestlevelsofstabilityofmorespecifics• InIPv6thishasonlybeenapparentinthepastthreeyearswhichTypeIITrafficEngineeringPrefixesshowingthegreatestlevelsofBGPinstability,andTypeIHolePunchingmorespecificsshowingthehighestlevelsofrelativestability

Page 34: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

BGP Instability is heavily skewed

IPv4 IPv6

Page 35: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

What Type of Prefixes are more Unstable?

IPv4 IPv6

Page 36: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

What Type of Prefixes are more Unstable?• TypeIIMoreSpecificPrefixes(TrafficEngineering)areapproximatelytwiceaslikelytobeunstablethaneitherrootprefixesorothertypesofMoreSpecificsinbothIPv4andIPv6

• Thismatchesaroughintuitionaboutthenatureofmorespecifics,whereoverlaysandholepunchingwouldbeexpectedtobeasstableasrootannouncements

Page 37: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Average Number of Updates per Active Prefix Type

IPv4 IPv6

Page 38: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Average Number of Updates per Active Prefix Type• InIPv4TypeIITrafficEngineeringPrefixeshaveagreateraveragenumberofupdatesthanotherprefixtypes• InIPv6RootPrefixestendtohavealoweraveragenumberofupdatesthanotherprefixtypes• PerhapsthesignificantmessagehereisthatIPv6hasahigherinherentlevelofinstability– unstableprefixesinIPv6have100xmoreinstabilityeventsperunstableprefixonaveragethanunstableprefixesinIPv4

Page 39: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

What if…

• AllOverlaymorespecificprefixeswereremovedfromtheroutingtable?

Page 40: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Table Size Implications

IPv4 IPv6

-150,000-10,000

Page 41: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Update Count Implications

IPv4 IPv6

Page 42: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

What if…

• AllOverlaymorespecificprefixeswereremovedfromtheroutingtable?• BothIPv4andIPv6routingtableswoulddropinsizebyapproximately30%,asOverlaymorespecificsarenowthepredominatetypeofmorespecificsintheroutingtables• TherateofdynamicinstabilityinBGPwouldnotchangebyanysignificantamount,asoverlymorespecificsarerelativelystableprefixes

Page 43: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Summary of Findings

• MorespecificsaddtoboththesizeandtheupdateloadofBGP• HoweverBGPitselfisbothareachabilityandatrafficengineeringtool,andmorespecificsareoftenusedtoqualifyreachabilitybytrafficengineering.Wehavenootherviableinternet-widetrafficengineeringtools,sothisparticularuseofBGPreallyhasnoalternative• Recentyearshaveseenthedeclineofholepunchingasmoreproviderstendtotreattheiraddressblocksasintegralunits.• Overlaysarebecomingmoreprevalent.WhilethishasimplicationsintermsoftotaltablesizeithasnosignificantimpactonBGPupdaterates.

Page 44: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Summary of Findings

• ThereisthequestionoftotalinstabilityinIPv6beingfargreaterthanIPv4,butthisisnotintrinsicallyanissuewithmorespecifics,butamoregeneralissueofBGProutinginstabilityinIPv6• Moreinvestigationcalledfor!

Page 45: More Specific Announcements in BGP - APNIC · Whyadvertise a more specific? II: To redirect incoming traffic to different network paths: “ traffic engineering prefixes” 10.0.0.0/8

Thanks!