1 / 22

Evaluation of the LDC Computing Platform for Point 2 SuperMicro X7DBE-X

Andrey Shevel CERN PH-AID ALICE DAQ (Internal report) CERN November 2006. Evaluation of the LDC Computing Platform for Point 2 SuperMicro X7DBE-X. Purpose. Background: Test the machine Elonex Supermicro based on motherboard X7DBE-X (2xDual Core Xeon 3.0 GHz) as LDC with 6 D-RORCs

ursa-deleon
Télécharger la présentation

Evaluation of the LDC Computing Platform for Point 2 SuperMicro X7DBE-X

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Andrey Shevel CERN PH-AID ALICE DAQ (Internal report) CERN November 2006 Evaluation of the LDCComputing Platform for Point 2SuperMicro X7DBE-X

  2. Purpose • Background: • Test the machine Elonex Supermicro based on motherboard X7DBE-X (2xDual Core Xeon 3.0 GHz) as LDC with 6 D-RORCs • Evaluation program: • Linux installation. • DATE V5 installation. • D-RORC throughput with DATE. • Perform a range of runs with internal D-RORC generator and receiving through DATE. • Perform a range of long runs (two days each) in configuration with the test machine as LDC and another machine as GDC. • Quick comparison with another machine based on motherboard X6DHE-XB (Dual Xeon 2.8 MHz).

  3. Architecture of motherboard

  4. CPU 2 x Dual Core Intel Xeon, cache L2 – total 4 MB Chipset Intel 5000P (BlackFord) FSB 1333 MHz Memory 2 GB (max 32GB), 533 MHz,DDR2 I/O 3x 64-bit 133MHz PCI-X, 3x PCI-X (64-bit 133 MHz)3x PCI-X (64-bit 100 MHz) Network 2x GbE, Intel 631xESC/632xESB Disk 120 GB, SATA Graphics ATI Technologies Inc ES1000 Periphery 2x USB front, 2x USB back Serial, PS/2 Chassis 4U (tower) Supermicro X7DBE-X pcald44.cern.ch

  5. Software Installation • Linux • SLC4.4 with kernel 2.6.9-42.0.3.EL.cernsmpno specific problems: USB boot successful, BIOS – everything is OK • To use D-RORC modules the BIOS setting is needed to be changed: all PCI slots were set to 100 MHz • DATE 5.25 installation • MySql • mysqltcl • BWidget • SMI • DIM • Drivers: rorc and physmem have been installed as rpm with additional scripts: DATE_basic_Install-SLC4x.bash, DATE_User_Install-SLC4x.bash, DATE_DriversInstall.bash • No specific problems

  6. Common info about measurement • Total main memory volume = 2 GB • 1 GB for Linux (in /etc/grub.conf) • 1 GB for physmem • 6 cards D-RORC rev 4 (internal data generator). • All measurement were done with DATE 5.25. No received event data were recorded to HD. The data from the database were analyzed with scripts. The pictures were built up with gnuplot. • In total there were performed 390 measurement runs. Because the figures (rates, bandwidth) are fluctuating every run was continued at least 5 minutes. • Two points: random event size with max=10**4 and max=10**6 Bytes were measured during two days each (LDC on test machine, GDC on different machine). • All measurements with randomly distributed event size were performed with event checking in DATE. • D-RORC Page Size was 10**5 Bytes.

  7. Event rate of one card

  8. Bandwidth of readout of one card

  9. Example of editDb page

  10. Example of Memory Banks page

  11. Event rate for several cards

  12. Bandwidth for several cards

  13. Event rate:ConsistencyCheckLevel

  14. Bandwidth: ConsistencyCheckLevel

  15. Event rate:NumberOfCards, ConsistencyCheckLevel

  16. Bandwidth: NumberOfCards, ConsistencyCheckLevel

  17. Event rate: D-RORC Page Size

  18. Bandwidth: D-RORC Page Size

  19. X6DHE-XB vs X7DBE-X

  20. X6DHE-XB vs X7DBE-X (continuation)

  21. Recommendation and conclusion • Recommendation: if you need to allocate D-RORC cards in the machine and like to have maximum bandwidth for X7DBE-X: • it is better to avoid to use PCI slot4&PCI slot5 at the same time for high bandwidth information sources. • Conclusion • In the test it was shown bandwidth (1.96 GB/sec) when all 6 D-RORC cards are in operation and event fragment size is more 10**5 bytes when ConsistencyCheckLevel=0. • X7DBE-X shows increased event rate and bandwidth with 6 D-RORCs, also it has more CPU power in comparison to X6DHE-XB. • The configuration LDC on test machine and GDC on another machine shown about the speed 118 MB/sec with no error during two days test. • Randomly distributed event fragment size with maximum 10**6 bytes gives total bandwidth 1.53 GB/sec during two days run. • The machine on the base X7DBE-X is excellent to be used as LDC with 6 D-RORC cards.

  22. Thank you! Klaus Schossmaier, Sylvain Chapeland, Ulrich Fuchs and PH/AID crew

More Related