100 likes | 194 Vues
This report from the GridPP Meeting in Oxford on 2 July 2003, presented by R. Hughes-Jones from Manchester, showcases high throughput data over TCP streams and GridFTP. The event highlighted various measurements of throughput, including trials with CERN-SARA, GÉANT backup links, and user feedback. Insights on network setups, TCP configurations, and data transfer speeds were discussed, emphasizing the importance of optimized protocols for efficient data transmission. The event also demonstrated real-world scenarios of data transfers over high-speed networks, providing valuable insights for network administrators and researchers.
E N D
MB - NG High Throughput: Encouragement & Some Results Lots of people helped GridPP Meeting Oxford 2 July 03 R. Hughes-Jones Manchester
Data over TCP Streams Raid0 Disk Raid0 Disk GridFTP GridFTP EU Review Demo Consisted of: Dante Monitoring Site Monitoring Node Monitoring GridPP Meeting Oxford 2 July 03 R. Hughes-Jones Manchester
Throughput on the day ! TCP ACKs Data ~400 Mbit/s GridPP Meeting Oxford 2 July 03 R. Hughes-Jones Manchester
Some Measurements of Throughput CERN -SARA • Using the GÉANT Backup Link • 1 GByte file transfers • Blue Data • Red TCP ACKs • Standard TCP • Average Throughput 167 Mbit/s • Users see 5 - 50 Mbit/s! • High-Speed TCP • Average Throughput 345 Mbit/s • Scalable TCP • Average Throughput 340 Mbit/s GridPP Meeting Oxford 2 July 03 R. Hughes-Jones Manchester
What the Users Really find: • CERN – RAL using production GÉANT • CMS Tests 8 streams • 50 Mbit/s @ 15 MB buffer • Firewall 100 Mbit/s • NNW – SJ4 Access • 1 Gbit link GridPP Meeting Oxford 2 July 03 R. Hughes-Jones Manchester
MAN MCC OSM-1OC48-POS-SS Gigabit Ethernet 2.5 Gbit POS Access 2.5 Gbit POS core MPLS Admin. Domains SJ4 Dev SJ4 Dev SJ4 Dev PC PC SJ4 Dev MB - NG UCL OSM-1OC48-POS-SS 3ware RAID0 3ware RAID0 PC PC PC PC MB – NG SuperJANET4 Development Network (22 Mar 02) GridPP Meeting Oxford 2 July 03 R. Hughes-Jones Manchester
MB - NG 24 Hours HighSpeed TCP mem-mem • TCP mem-mem lon2-man1 • Tx 64 Tx-abs 64 • Rx 64 Rx-abs 128 • 941.5 Mbit/s +- 0.5 Mbit/s GridPP Meeting Oxford 2 July 03 R. Hughes-Jones Manchester
MB - NG Gridftp Throughput HighSpeedTCP • Int Coal 64 128 • Txqueuelen 2000 • TCP buffer 1 M byte(rtt*BW = 750kbytes) • Interface throughput • Acks received • Data moved • 520 Mbit/s • Same for B2B tests • So its not that simple! GridPP Meeting Oxford 2 July 03 R. Hughes-Jones Manchester
MB - NG Gridftp Throughput + Web100 • Throughput Mbit/s: • See alternate 600/800 Mbitand zero • Cwnd smooth • No dup Ack / send stall /timeouts GridPP Meeting Oxford 2 July 03 R. Hughes-Jones Manchester
MB - NG http data transfers HighSpeed TCP • Apachie web server out of the box! • prototype client - curl http library • 1Mbyte TCP buffers • 2Gbyte file • Throughput 72 MBytes/s • Cwnd - some variation • No dup Ack / send stall /timeouts GridPP Meeting Oxford 2 July 03 R. Hughes-Jones Manchester