SlideServe
Télécharger Obtenir Pro
Menu
Accueil Pro
Préférences
ApparenceLight Aide et commentaires
© SlideServe · v2026

DataTAG - WP3

cain-mcconnell avatar
cain-mcconnell
11 diapositives · 263 Views · Nov 20, 2014

The DataTAG WP3 initiative focuses on performance validation, monitoring, and optimization of high-speed intercontinental networks. With tools designed for extreme Lambda environments, this project will assess application performance using innovative monitoring techniques. Key tasks include performance validation, end-user monitoring, and application optimization over a range of protocols. Insights from experiences with SURFnet Lambda are shared, and ongoing developments in diagnostic libraries and performance tools ensure that we meet the challenges of high-speed data transfers effectively.

#datatag - wp3 #datatag - wp3 ppt #powerpoint #presentation
DataTAG - WP3 - slide 1
01 / 11DataTAG - WP3
1 / 17

Télécharger la présentation

DataTAG - WP3
Une image / un lien ci-dessous est fourni (tel quel) pour télécharger la présentation

Politique de téléchargement : le contenu du site vous est fourni TEL QUEL pour votre information et votre usage personnel ; il ne peut être vendu, concédé sous licence ni partagé sur d’autres sites sans l’accord de son auteur.Le contenu vous est fourni TEL QUEL, pour votre information et votre usage personnel uniquement. Téléchargez la présentation en cliquant sur ce lien. Lors du téléchargement, si vous ne parvenez pas à télécharger une présentation, l’éditeur a peut-être supprimé le fichier de son serveur.Pendant le téléchargement, si vous ne parvenez pas à obtenir une présentation, le fichier a peut-être été supprimé par l’éditeur.

F I N

Plus de contenu associé

Transcription de la présentation

  1. DataTAG - WP3 Objectives, activities and progress by UvA: Wim Sjouw, Hans Blom, Jason Lee, Cees de Laat INRIA: Mathieu Goutelle CERN: tbd

  2. Contents • Objectives • Tasks • Activities • Experiences with SURFnet Lambda • Pointers

  3. WP3 objectives • Bulk data transfer and application performance monitoring: • innovative monitoring tools are required to measure and understand the performance of high speed intercontinental networks and their potential on real Grid application.

  4. Tasks in WP3 • Task 3.1. Performance validation (month 1-12) • Create, collect, test network-tools to cope with the extreme Lambda environment (high RTT, BW) • measure basic properties and establish a baseline performance benchmark • Task 3.2 End user performance validation/monitoring/optimization (month 6-24) • Use “out of band” tools to measure and monitor what performance a user in principle should be able to reach • Task 3.3 Application performance validation, monitoring and optimization (month 6-24) • Use diagnostic libraries and tools to monitor and optimize real applications to compare their performance with task 3.2 outcome.

  5. Task 3.1 Performance validation • Performance Test Tools • http://carol.wins.uva.nl/~jblom/datatag/wp3_1/ • Lambda's are a Layer 1-2 environment • use end to end traffic generating tools • not ICMP based tools since those need routers in the path • tools must work in Gigabit environment • Netperf • TCP bulk transfer, UDP unusable (no shaping) • modifications made to enhance IPv6 support • Iperf • TCP and UDP shaped bulk transfer • lightweight multiple streams test support • IPv6 support • modifications made to introduce TCP shaping, debugging

  6. Task 3.1 Performance validation (cont’d) • UDPmon (by Richard Hughes-Jones) • each packet contains seq. # / time stampinfo receiver can deduce: • # packets lost • # packets out-of-order • UDP bandwidth • very precise timing • not intrusive • tool is in continuous development

  7. Task 3.1 Performance validation (cont’d) Tools under investigation which are either not released yet or incomplete: • Pathload : estimate available bandwidth • Magnet : network software performance • Netprobe : one way delay + variance, jitter

  8. Task 3.1 experiencesusingNetherlight SURFnet Lambda AMS-CHIfull duplex GE  2.5 Gbps SDH , 100 ms RTT • single stream TCP: max. throughput 80 - 150 Mbps, dependent on stream duration • similar for BSD and Linux and different adaptors • UDP measurements show effects of hardware buffer-size in ONS equipment when assigning lower SDH bandwidths,see: www.science.uva.nl/~wsjouw/datatag/lambdaperf.html

  9. Task 3.2 End user performance validation/monitoring/optimization • Toolset for monitoring • Re-use as much as possible WP7 stuff • rTPL(end user performance monitoring): • http://195.169.124.55/rtpl/netherlight/table/ • MRTG (to monitor router interfaces): • http://195.169.124.55/mrtg/ • SmokePing (history and statistics of rtt’s): • http://195.169.124.55/smokeping/smokeping.cgi?target=SARA • Not so ideal tools (for the time being): • Cricket (to monitor large number of router interfaces): • http://195.169.124.55/cricket/grapher.cgi?target=%2Fssr-interfaces

  10. Task 3.2 and 3.3 • set up tool RTPL for end user performance check, can be expanded when DataTAG lambda becomes available. See:http://195.169.124.55/rtpl/netherlight/table/ • task 3.3 will most probably use netlogger, did not yet start. • all info can also be found via:www.datatag.org

  11. Summary of status • Tools have been investigated, selected and where necessary adapted to benchmark and characterize Lambda networks • http://carol.wins.uva.nl/~jblom/datatag/wp3_1/ • New tools appear and need to be studied to add to the set • Influence layer 1 and 2 infrastructure properties on TCP throughput is under study on SURFnet Lambda testbed and NetherLight • Monitoring setup is underway, inclusion of WP7 toolset is next step • Application performance monitoring and optimization should start soon • Preparation for iGrid2002 which also gives us: • a 2.5 gig connection Amsterdam-CERN • for duration of iGrid2002 10 Gbit/s connection Starlight-Amsterdam by Level3! • WWW.IGRID2002.ORG in Amsterdam 23-26 september