1 / 14

Current State of 10 Gigabit Ethernet: Insights from Internet2 Performance Workshop

This document outlines the current state of 10 Gigabit Ethernet (10GE) based on findings from the Internet2 Performance Workshop. It discusses best practices, performance metrics, and limitations observed in high-energy physics environments. Key insights include performance benchmarks, hardware configurations involving PCI-X and PCI Express, and experiences from leading vendors like Intel, Neterion, Chelsio, and Myricom. The workshop emphasizes the importance of dual AMD 64-bit processors and shares anecdotal performance figures, such as achieving 7.5 Gbps TCP on Linux.

tryna
Télécharger la présentation

Current State of 10 Gigabit Ethernet: Insights from Internet2 Performance Workshop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 10 Gigabit Ethernet:current state Internet2 Performance Workshop

  2. Introduction • Caveat: we personally have limited experience with 10GE servers • Reporting current “best of breed” • Some general principles • Land speed record candidates • What High-Energy Physics is doing

  3. 10GE: setting expectations • ~833,400 pps at 1500 MTU • ~138,900 pps at 9000 MTU • Bus limitations • PCI-X 1.0 is ~8Gbps • PCI Express helps

  4. Four Card Vendors • Intel • Neterion (nee S2IO) • Chelsio • Myricom

  5. Anecdotes • You want dual AMD 64 bit processorsPCI-X 1.0 at 133 Mhz has achieved 7.5Gbps TCP on Linux (Neterion) • PCI-X 1.0 at 100 Mhz has achieved 5.0 Gbps • UDP: Esnet had some problems; Harvey’s group at CALTECH has achieved 6.5 Gbps

  6. DREN [October 2004] • 1st gen Intel 10GE NICs • Dell 2650 • 2.4 GHz Xeon, 400Mhz FSB • 3.8Gbps TCP

  7. Caltech [October 2004] • Use 64 bit architecture • S2IO XFrame (now Neterion) • 6.5Gbps • 1st Gen Intel: 5.8 Gbps • Opteron slightly more performant than Itanium

  8. Caltech HW configs [10/2004] • Opteron • Tyan Thunder K8S Pro (S2882), 2x Opteron 2.2GHz, 2GB mem • Itainum • HP rx 4640, 4x1.5GHz Itanium-2, zx1 chipset, 8GB memory

  9. ESnet [April 2005] • Tyan S2895A2NRF IDE Version • “thunderk8we” • Dual AMD 252 Opteron CPUs • 2GB DDR 400 ECC/Reg. • Neterion X-Frame PCI-X NIC • Linux (2.6?) • 7.5Gbps TCP

  10. NCAR [September 2005] • “Dual Opteron, PCI-X” • Chelsio N210 cards • 6.5Gbps • MTU 8160, a bunch of other tuning parms • “it just worked”

  11. MAX [September 2005] • Supermicro X6DHE-XG2, Dual Xeon 800MHz FSB motherboard • (2) Intel Xeon64 3.2GHz, 1MB Cache, 800MHz FSB Processors • Chelsio S210 card

  12. Linux tuning • Talk to your NIC vendor • MTU 9000 (8160?) • Iptables off (and unloaded) • Actual tweaks vary by version (and have changed a lot recently)

  13. A running list • http://e2epi.internet2.edu/net-perf-wkshp/binder-docs/10GEexamples.html

  14. www.internet2.edu

More Related