technology for using high performance networks or how to make your network go faster…. robin...
TRANSCRIPT
Technology for Using High Performance Networks
or
How to Make Your Network Go Faster….
Robin Tasker ([email protected])
UK Light Town Meeting9 September 2004
Presenter Name
Facility Name
One Terabyte of data transferred in less than an hour
On February 27-28 2003, the transatlantic DataTAG network was extended, i.e. CERN - Chicago - Sunnyvale (>10000 km).
For the first time, a terabyte of data was transferred across the Atlantic in less than one hour using a single TCP (Reno) stream.
The transfer was accomplished from Sunnyvale to Geneva at a rate of 2.38 Gbits/s
Throughput? What’s the problem?
Presenter Name
Facility Name
Just the Internet2 Land Speed Record…
OK
We can get transatlantic rates of 6.5 Gbits/s, but how was that done?
What’s the magic?
So you thought 2.38 Gbits/s was good?
Presenter Name
Facility Name
InternetInternet
Regional Regional
RegionalRegional
Campus
Campus
Campus
Campus
Client
Server
Just a Well Engineered End-to-End Connection
End-to-End “no loss” environment from CERN to Sunnyvale!
At least a 2.5 Gbits/s capacity pipe on the end-to-end path
Processor speed and system bus characteristics
TCP Configuration – window size and frame size (MTU)
Network Interface Card and associated driver and their configuration
A single TCP connection on the end-to-end path
Memory-to-Memory transfer; no disk system involved
No real user application
That’s to say the devil is in the detail…
Sorry. No magic here…..
Presenter Name
Facility Name
Campus
Campus
Campus
Campus
Client
Server
UK LightUK Light
Just a Well Engineered End-to-End Connection
End-to-End “no loss” environment
At least a 2.5 Gbits/s capacity pipe on the end-to-end path
Processor speed and system bus characteristics
TCP Configuration – window size and frame size (MTU)
Network Interface Card and associated driver and their configuration
A single TCP connection on the end-to-end path
Memory-to-Memory transfer; no disk system involved
No real user application
Even with UK Light, the devil is in the detail …and it’s harder!
And how about the same across UK Light?
Presenter Name
Facility Name
The Easy Bits…. :-)
End-to-End “no loss” environment
At least a 2.5 Gbits/s capacity pipe on the end-to-end path
Processor speed and system bus characteristics
TCP Configuration – window size and frame size (MTU)
Network Interface Card and associated driver and their configuration
Presenter Name
Facility Name
Read the Details Here
http://grid.ucl.ac.uk/nfnn.html
Presenter Name
Facility Name
Now for the hard bits…
Presenter Name
Facility Name
A Single TCP Connection
Presenter Name
Facility Name
Fortunately there’s good news!
Standard TCPRecovery >10 minutes
Scalable TCPVery rapid recovery
High Speed TCPRapid recovery
Comparison of TCP stack performance under loss rate of 1 in 10**6, RTT=108ms
Presenter Name
Facility Name
Memory to memory; no disk system
High Speed TCP transfer using Iperf,i.e. no disk system and no application
Web100 records of High Speed TCPduring a http-Get data transfer, i.e.disk system but no application
Presenter Name
Facility Name
Understanding disk systems
Presenter Name
Facility Name
No real user application
High Speed TCP transfer using Iperf,i.e. no disk system and no application
Web100 records of High Speed TCPduring a http-Get data transfer, i.e.disk system but no application
Web100 records of High Speed TCPduring a GridFTP data transfer, i.e.disk system and real userapplication
Presenter Name
Facility Name
Understand your Application
It’s YOUR application, so remember
Three Golden Rules
Benchmark!
Benchmark!!
Benchmark!!!
Presenter Name
Facility Name
Book Early!!!
- Pro
visi
onal
ly -
Tues
day
1st –
Wed
nes
day
2nd M
arch
2005
NeS
C
http://grid.ucl.ac.uk/nfnn.html