![Page 1: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/1.jpg)
1© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Internet Exchange Point Design
ISP/IXP WorkshopsISP/IXP Workshops
![Page 2: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/2.jpg)
222© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
IXP Design
• Layer 2 Exchange Point
• Layer 3 Exchange Point
• Transit Exchange Point
• Design Considerations
![Page 3: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/3.jpg)
333© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Internet Exchange Points
• Layer 2 exchange point
ethernet, ATM or Frame Relay switch
• Layer 3 exchange point
router based
central or distributed
![Page 4: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/4.jpg)
4© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 2 Exchange
The traditional IXP
![Page 5: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/5.jpg)
555© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 2 Exchange
ISP 1 ISP 2ISP 3
IXP ManagementNetwork
ISP 6 ISP 5 ISP 4
Ethernet Switch
IXP Services:
TLD DNS,
Routing Registry
Looking Glass,
news, etc
![Page 6: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/6.jpg)
666© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 2 Exchange
ISP 1 ISP 2ISP 3
IXP ManagementNetwork
ISP 6 ISP 5 ISP 4
Ethernet Switches
IXP Services:
TLD DNS,
Routing Registry
Looking Glass,
news, etc
![Page 7: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/7.jpg)
777© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 2 Exchange
• Two switches for redundancy
• ISPs use dual routers for redundancy or loadsharing
• Offer services for the “common good”Internet portals and search engines
DNS TLD, News, NTP servers
Routing Registry and Looking Glass
![Page 8: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/8.jpg)
888© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 2 Exchange
• Requires neutral IXP managementusually funded equally by IXP participants
24x7 cover, support, value add services
• Secure and neutral location
• Configurationprivate address space if non-transit and no value add services
ISPs require AS, basic IXP does not
![Page 9: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/9.jpg)
999© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 2 Exchange
• Network Security ConsiderationsLAN switch needs to be securely configured
Management routers require TACACS+ authentication, vty security
IXP services must be behind router(s) with strong filters
![Page 10: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/10.jpg)
10© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 3 Exchange
The wholesale transit ISP
![Page 11: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/11.jpg)
111111© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 3 Exchange
ISP 1 ISP 2ISP 3
IXP ManagementNetwork
ISP 6 ISP 5 ISP 4
IXP Router
IXP Services:
TLD DNS,
Routing Registry
Looking Glass,
news, etc
![Page 12: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/12.jpg)
121212© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 3 Exchange
ISP 1 ISP 2ISP 3
IXP ManagementNetwork
ISP 6 ISP 5 ISP 4
IXP Routers
IXP Services:
TLD DNS,
Routing Registry
Looking Glass,
news, etc
![Page 13: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/13.jpg)
131313© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 3 Exchange
• Two routers for redundancy
• ISPs use dual routers for redundancy or loadsharing
• Offer services for the “common good”Internet portals and search engines
DNS TLD, News, NTP servers
Routing Registry and Looking Glass
![Page 14: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/14.jpg)
141414© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 3 Exchange
• Requires neutral IXP managementusually funded equally by IXP participants
24x7 cover, support, value add services
BGP configuration skills essential
• Secure and neutral location
• Configurationprivate address space if non-transit and no value add services
ISPs and IXP require AS
![Page 15: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/15.jpg)
151515© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 3 Exchange
• Network Security ConsiderationsCore IXP router(s) require strong security, preferably with BGP neighbour authentication
Management routers require TACACS+ authentication, vty security
IXP services must be behind router(s) with strong filters
![Page 16: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/16.jpg)
161616© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 2 versus Layer 3
• Layer 3IXP team requires good BGP knowledge
Rely on 3rd party for BGP configuration
Less freedom on who peers with whom
Could potentially compete with IXP membership
Easier to distribute over wide area
![Page 17: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/17.jpg)
171717© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 2 versus Layer 3
• Layer 2IXP team does not need routing knowledge
Easy to get started
More complicated to distribute over wide area
ISPs free to set up peering agreements with each other as they wish
![Page 18: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/18.jpg)
18© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Transit Exchanges
![Page 19: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/19.jpg)
191919© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Transit IXPs
• Provides local Internet exchange facility to members
• Also provides transit to Internet or upstream ISP
• Usually operated as a commercial service
• Usually layer 3 design
![Page 20: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/20.jpg)
202020© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Layer 3 Transit Exchange
ISP 1 ISP 2ISP 3
IXP ManagementNetwork
ISP 5 ISP 4 Transit Routers
IXP Routers
IXP Services:
TLD DNS,
Routing Registry
Looking Glass,
news, etc
Internet
ISP
![Page 21: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/21.jpg)
21© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
IXP Design Considerations
![Page 22: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/22.jpg)
222222© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Routing and Address Space
• ISP border routers should not be configured with default route or carry full Internet routing table
• Use private addresses if possible – public address space means IXP network could be leaked to Internet which may be undesirable
![Page 23: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/23.jpg)
232323© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Hardware
• Don’t mix port speedsif 10Mbps and 100Mbps connections available, terminate on different switches (L2 IXP)
• Don’t mix transportsif terminating ATM PVCs and G/F/Ethernet, terminate on different devices
• Insist that IXP participants bring their own routermoves buffering problem off the IXP
security is responsibility of the ISP, not the IXP
![Page 24: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/24.jpg)
242424© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Services Offered
• Services offered should not compete with member ISPs (basic IXP)
e.g. web hosting at an IXP is a bad idea unless all members agree to it
• IXP operations should make performance and throughput statistics available to members
![Page 25: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/25.jpg)
252525© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Services to Offer
• TLD DNSthe country IXP could host the country’s top level DNS
e.g. “UK.” TLD is hosted at LINX in London
• Usenet NewsUsenet News is high volume
could save bandwidth to all IXP members
![Page 26: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/26.jpg)
262626© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Services to Offer
• Route CollectorAll IXP members peer with the route collector
Route collector shows the reachability information available at the exchange
Requires a simple router with large memory
• Looking Glassone way of making the Route Collector routes available for global view
public or members only access
![Page 27: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/27.jpg)
272727© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Services to OfferRoute Server
• Reduces admin burden on IXP member routersonly BGP session is with Route Server
Route Server supplies all paths it knows to the IXP member routers – no best path selection
• Can use private ASRoute Server software does not prepend its AS to the AS path
• RSd (from Merit Network) commonly used
![Page 28: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/28.jpg)
282828© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Services to Offer
• Network Time Protocol
Locate a stratum 1 time source (GPS receiver, atomic clock, etc) at IXP
• Multicast
Provide MBONE and other multicast services for the common good
![Page 29: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/29.jpg)
292929© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Services to OfferRouting Registry
• Routing Registry is used to register the routing policy of the IXP membership
documenting peering relationships
auto-configuring of peer routers
• Alternative is to use the public Internet Routing Registry (IRR)
![Page 30: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/30.jpg)
30© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
IXP Design
Summary
![Page 31: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/31.jpg)
313131© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Summary
• L2 IXP – most commonly deployed
typically based around ethernet or ATM switches
• L3 IXP – nowadays generally a marketing concept used by wholesale ISPs
doesn’t offer the same flexibility as L2
![Page 32: Internet Exchange Point Design...Route Server • Reduces admin burden on IXP member routers only BGP session is with Route Server Route Server supplies all paths it knows to the IXP](https://reader034.vdocuments.net/reader034/viewer/2022043022/5f3e439cf32b74320c43f6a8/html5/thumbnails/32.jpg)
32© 2003, Cisco Systems, Inc. All rights reserved.Cisco ISP Workshops
Internet Exchange Point Design
ISP/IXP WorkshopsISP/IXP Workshops