internet2 e2epi end-2-end performance initiative jeff w. boote internet2 29 may 2006
TRANSCRIPT
Internet2 E2EPIEnd-2-End Performance Initiative
Jeff W. BooteInternet2
29 May 2006
2 Jeff W. Boote
Vision: Performance Information is …
• Available•People can find it (Discovery)• “Community of trust” allows access across
administrative domain boundaries (AA)
• Ubiquitous•Widely deployed (Paths of interest covered)•Reliable (Consistently configured correctly)
• Valuable•Actionable (Analysis suggests course of action)•Automatable (Applications act on data)
3 Jeff W. Boote
Getting There: Build & Empower the Community
Decouple the Problem Space:•Analysis and Visualization•Performance Data Sharing•Performance Data GenerationGrow the Footprint:•Clean APIs and protocols between each layer•Widespread deployment of measurement infrastructure•Widespread deployment of common performance measurement tools
Analysis & Visualization
Measurement Infrastructure
Performance Tools Performance
Tools
Analysis & Visualization
Measurement Infrastructure
API
API
4 Jeff W. Boote
Result: No more mystery …
• Increase network awareness•Set user expectations accurately
• Reduce diagnostic costs•Performance problems noticed early •Performance problems addressed efficiently•Network engineers can see & act outside their turf
• Transform application design• Incorporate network intuition into application
behavior
5 Jeff W. Boote
Immediate Game-plan:
• Internet2 is leveraged to help provide diagnostic information for “backbone” portion of problem•Create *some* diagnostic tools•Make Abilene data as public as is reasonable
• Work on efforts to more widely make performance data available (perfSONAR)•Contribute to ‘base’ development• Integrate ‘our’ diagnostic tools as ‘good’ example
MP/MA services
6 Jeff W. Boote
BWCTL (Bandwidth Controller)
• What is it?A resource allocation and scheduling daemon for
arbitration of iperf tests
• Typical Solution•Run “iperf” or similar tool on two endpoints and hosts
on intermediate paths
• Typical road blocks•Need permissions on all systems involved•Need to coordinate testing with others•Need to run software on both sides with specified test
parameters
7 Jeff W. Boote
BWCTL: 3-Party Flow Diagram
bwctlclient
bwctld(request broker)
requests/
results
requests/results
verify time/
return resultsbwctld
(peer agent)
teststream
iperf(test process)
bwctldresource broker
(master daemon)initialconnection
initial
connection
resoure
requests
bwctld(request broker)
bwctld(peer agent)
iperf(test process)
bwctldresource broker
(master daemon)
reso
urce
requ
ests
8 Jeff W. Boote
OWAMP: One-Way Active Measurement Protocol
• What is it?• Measures one-way latency: 1-way ping• Control connection used to broker test
request based upon policy restrictions and available resources. (Bandwidth/disk limits)
• Specification• http://tools.ietf.org/wg/ippm/draft-ietf-ippm-
owdp/draft-ietf-ippm-owdp-14.txt
9 Jeff W. Boote
OWAMP Flow Diagram
Server
owpingclient
[Control]
Requests/
Results
owampd[Resource Broker]
Initialconnection
owampd[Control]
OWD TestEndpoint
OWD TestEndpoint
Requests/
Results
Client
10 Jeff W. Boote
Thrulay Overview
• Network capacity and delay tester• Same class of tools as iperf, netperf, nettest, nuttcp, ttcp,
etc.• Unique features not found in other tools:
• TCP: measures round-trip delay along with goodput• UDP: measures:
• One-way delay, with quantiles• Packet loss• Packet duplication• Reordering
• UDP: ability to send precisely positioned true Poisson streams (microsecond errors in sending times)
• Human and machine-readable (ready to be fed to gnuplot)
11 Jeff W. Boote
Thrulay Update
• New release v0.8• Tests with multiple TCP streams• Set DSCP (a.k.a. first 6 bits of the TOS byte)• Report MTU and/or MSS (whichever the OS makes available)• More UDP statistics: duplication, reordering, quantiles of delay• SPARC/Solaris support• Mac OS X support• IPv6 support• Non-busy-waiting UDP mode (less precise, but can run more
concurrent tests)• Documentation: manual pages have been added• Basic client authorization based on IP address• Integration of TSC timekeeping projects for faster and more
precise timestamping
12 Jeff W. Boote
NDT: Network Diagnostic Tool
• Web100 enhanced server handles testing and diagnostic services
• Java based and command line clients allows testing from any client (local or remote)
• Performance and configuration faults reported back to client
• Drill-down functions provide more details & error reporting capabilities
• Grant from NIH/NLM to explore duplex mismatch detection
13 Jeff W. Boote
NDT Flow Diagram
Client
Web
Browser
Java
Applet
NDT - Server
Web
Server
Testing
Engine
Child
Test Engine
Spawn child
Well KnownNDT Server
Web RequestRedirect msgWeb Page Request
Web page response
Test Request
Control Channel
Specific test channels
14 Jeff W. Boote
Bulk Transport
• Build a library / tool for bulk transport that does not require kernel level modifications yet achieves the performance of such
• VFER library•Congestion control hooks• Implements loss-based congestion control•Working on delay-based version
• File transfer utility•An initial version demoed
15 Jeff W. Boote
Everything we work on is available
• Tools are open source, supported, well-documented
• BWCTL/Iperf, OWAMP, NDT are deployed across Abilene backbone and at many partners
• You can:•See ongoing measurement results at the
Abilene Observatory•Test to/from the Abilene backbone
16 Jeff W. Boote
Network Performance Measurement Workshops
•Example Course Materials:• http://e2epi.internet2.edu/npw/presentations.html
Goals:•Grow installed base of BWCTL/Iperf, OWAMP, and
NDT at GigaPoP and regional campuses.• http://e2epi.internet2.edu/pipes/pmp/pmp-dir.html
•Begin integration into IT support processes.•Create an installed base for perfSONAR
deployment.•Give each participant tool-specific cookbooks.
17 Jeff W. Boote
Network Performance MeasurementWorkshop Locations and Dates
•Completed• SOX / GaTech (03/05)• CENIC / UCLA (06/05)• JT – Vancouver (07/05)• OARNet / OSU (09/05)• MAGPI / FMM (09/05)• MAX / College Park (12/05)• APAN (01/06)• JT - Albuquerque (02/06)• MERIT (02/06)• Columbia / NYSERNet
(04/06)• University of Virginia
(04/06)
•Planned• Wisconsin (07/06)
•Under Consideration• Alaska, …
18 Jeff W. Boote
Collaboration
• Working Groups• Bulk Transport (transport.internet2.edu)
• GGF Network Measurement (nmwg.internet2.edu)
• perfSONAR (www.perfsonar.net)
• Funded Research• “Bridging the Gap” (NSF)• Network Measurement for International Connections
• Google Summer of Code• 2005 very successful• 2006 just beginning
19 Jeff W. Boote
Current and Future work
• LHC OWAMP measurements• AMI/pSonar MA interface (perl)
• AMP MA interface (Ga Tech)• Light Path Control-plan tie-in (Dragon project)
• Do more paths need to be provisioned?• The control-plane issues are similar - can pS services be
leveraged?
20 Jeff W. Boote