![Page 1: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/1.jpg)
Evolution of Global Traffic Management Aaron Heady, Bing.com, Microsoft
SREcon 2016
https://www.usenix.org/conference/srecon16
![Page 2: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/2.jpg)
• Disclaimer 1… Not representing a specific
technology. • Disclaimer 2… Short talk, big topic. I will gloss
over a few things.
![Page 3: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/3.jpg)
User Representative for Bing
Current:
• Responsible for Availability and Server Latency for Bing.com
Before that:
• 5 years designing, implement and running global traffic management for Bing.com
• Several years as an Incident Manager
• Created the Incident Management system for Bing
• Couple years writing software as a defense contractor
• Owned a very nice restaurant for about a year (hurricane destroyed it)
• 12 years in the US Army, mostly as a Special Forces Medic and Comms NCO
Caveat: As with all things, I had a lot of help and worked with great people to achieve what’s listed above. No one succeeds alone.
[email protected] [email protected] www.linkedin.com/in/aaronheady
![Page 4: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/4.jpg)
Survey
´ Quick awkward low arm raise that you’re half committed to acknowledging that you are or have been significantly responsible for the design or operation of traffic routing for your company’s global traffic?
![Page 5: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/5.jpg)
Global Traffic Management
Availability
Correctness of Response
![Page 6: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/6.jpg)
Users… Reality, for many users, is defined by the information they get from the services run by people in this room.
![Page 7: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/7.jpg)
Let’s look at one ‘reality’.
´ A tragic event that happened a few years ago, but that is still in the news today.
![Page 8: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/8.jpg)
![Page 9: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/9.jpg)
But Aaron, what’s that got to do with traffic management?
Let’s talk about our Users and Correctness of Response.
![Page 10: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/10.jpg)
News, with poor availability.
![Page 11: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/11.jpg)
Maturity Level Fundamental Idea Defining Characteristics
5 Isolation & Protection
Multiple service providers. Advanced internet awareness
4 Privacy & Legal Geopolitical routing zones
3 Availability GTM + Load Feedback
2 Load Management
Basic GTM
1 Redundancy Round robin DNS, Multiple Origins
0 Initial Basic DNS, Single A Record, Single Origin
Traffic Routing Maturity Matrix
Best
Basic
![Page 12: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/12.jpg)
Then things actually get complicated…
“My service has users in, like, 42 countries! OMG!” and “My service operates legally in every country.”
“I just use Azure, it’s global and has availability zones and can’t go down, jeesh!” and “We leverage multiple clouds, and some on premises, to ensure we can get the best pricing, meeting local legal requirements, and don’t create a single vendor lock-in that could hamper future growth.”
![Page 13: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/13.jpg)
Global Config: USA Origin #1, Keepalive.aspx, LFB USA Origin #2, keepalive.aspx, LFB German Origin #1, Keepalive.aspx, LFB German Origin #2, keepalive.aspx, LFB Else, fail.
So you want to handle private data of German citizens?
DNS Lookup for www.example.com If (RevIP.Country == ‘Germany’)
{use Germany GTM config} else {use Global GTM config}
German Config: German Origin #1, Keepalive.aspx, LFB German Origin #2, keepalive.aspx, LFB Else, fail.
Level 4: Legal, privacy, financial, etc….
![Page 14: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/14.jpg)
Maturity Level Fundamental Idea Defining Characteristics
5 Isolation & Protection
Multiple service providers. Advanced internet awareness
4 Privacy & Legal Geopolitical routing zones
3 Availability GTM + Load Feedback
2 Load Management
Basic GTM
1 Redundancy Round robin DNS, Multiple Origins
0 Initial Basic DNS, Single A Record, Single Origin
Traffic Routing Maturity Matrix
Best
Basic
![Page 15: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/15.jpg)
Level 5: Isolation, protection, network aware, etc…
![Page 16: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/16.jpg)
Level 5: Isolation, protection, network aware, etc…
![Page 17: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/17.jpg)
Put myself out of a job.J Anycast, when you don’t want to deal with DNS based traffic management any longer.
´ For more information on our Anycast:
´ Nick Holt, Principal Architect of our Anycast Traffic Management System, presented at NANOG 66 https://youtu.be/40MONHHF2BU.
So what’s next?
![Page 18: Evolution of Global Traffic Management - USENIX · Evolution of Global Traffic Management Aaron Heady, ... implement and running global traffic management for Bing.com • Several](https://reader031.vdocuments.net/reader031/viewer/2022022600/5b40368c7f8b9a51528cfa37/html5/thumbnails/18.jpg)
Reminder… I’m reasonably deaf. Please speak up.
Thanks for listening!
Questions?