SlideServe
Télécharger Obtenir Pro
Menu
Accueil Pro
Préférences
ApparenceLight Aide et commentaires
© SlideServe · v2026

Enhancing SDSS Data Transfer through NCHC: A Collaborative Initiative for Astronomical Research

davis-bishop avatar
davis-bishop
15 diapositives · 292 Views · Nov 17, 2014

The National Center for High-Performance Computing (NCHC) is collaborating with Fermi Laboratories to enhance the data transfer process of the Sloan Digital Sky Survey (SDSS). This initiative aims to improve the sharing of astronomical data among researchers in Taiwan's research and education institutes. By leveraging NCHC's advanced computing, storage, and networking resources, alongside the Taiwan Advanced Research and Education Network (TWAREN), the project seeks to accelerate data accessibility and contribute to significant astronomical discoveries.

Enhancing SDSS Data Transfer through NCHC: A Collaborative Initiative for Astronomical Research - slide 1
01 / 15Enhancing SDSS Data Transfer through NCHC: A Collaborative Initiative for Astronomical Research
1 / 17

Télécharger la présentation

Enhancing SDSS Data Transfer through NCHC: A Collaborative Initiative for Astronomical Research
Une image / un lien ci-dessous est fourni (tel quel) pour télécharger la présentation

Politique de téléchargement : le contenu du site vous est fourni TEL QUEL pour votre information et votre usage personnel ; il ne peut être vendu, concédé sous licence ni partagé sur d’autres sites sans l’accord de son auteur.Le contenu vous est fourni TEL QUEL, pour votre information et votre usage personnel uniquement. Téléchargez la présentation en cliquant sur ce lien. Lors du téléchargement, si vous ne parvenez pas à télécharger une présentation, l’éditeur a peut-être supprimé le fichier de son serveur.Pendant le téléchargement, si vous ne parvenez pas à obtenir une présentation, le fichier a peut-être été supprimé par l’éditeur.

F I N

Plus de contenu associé

Transcription de la présentation

  1. SDSS Data Transfer Jing-Jou Yen Division ManagerNational Center for High-Performance Computing (August 26, 2005)

  2. OUTLINE • Project Background • Introduction to NCHC/TWAREN • Sloan Digital Sky Survey (SDSS) Overview • Network Architecture and Configuration • Network Performance Monitoring • Future Plan

  3. It is a joint program NCHC with the Fermi Laboratories to mirror the SDSS data. The goal is to speed up the SDSS information sharing for physicists working in R&E institutes in Taiwan. NCHC computing, storage and networking resources enhance functions in the astronomical research. NCHC uses TaiWan Advanced Research and Education Network (TWAREN) for the SDSS data transfer. NCHC’s Operations teams will ensure the quality for all efforts. Hsinchu Tainan Taipei Taichung Computing Center Knowledge Center Core node equipment Network Operation Center SDSS Data Transfer Project

  4. NCHC is Taiwan’s only National Lab Dedicated to • High-Performance Computing & Applications • Storage, Networking & the Applications Development • NCHC Mission • Provide resources and services • Do research and development • Offer education, training, and outreach Resources and Services High-performance Computing & Networking Research and Development High-performance Computers TANet2/TWAREN PC Clusters Storage/Databases Application SW Industrial, Government, Academic Projects International Collaborations Conferences Education, Training and Outreach Consultation Training Workshops Lectures Exhibits National Center for High-performance Computing NCHC

  5. SINICA NCU NTU NCTU Taipei NTHU Hsinchu NDHU NCHU NCNU Taichung CCU Tainan NCKU NSYSU TaiWan Advanced Research and Education Network TWAREN • TWAREN - Successor of TANet2 • TWAREN -One of the Most Advanced Networks/Operations in the World • TWAREN Goals • To provide a network infrastructure for academic and R&E community. • To stimulate creativity and foster talents • TWAREN Architecture • A hybrid network with 20G POS and DWDM technologies at its core. • Hierarchical topology: 3 layers (core, GigaPoPs, end nodes) • Eleven GigaPoPs - each links to the core • node at 20 Gbps and 1 dark fiber. • Highly scalable and flexible • Providing multiple services • International links to the USA • Integrated NMS Architecture

  6. NTU Sinica NCU Taipei NCTU NTHU Hsinchu NTU NCHU Taichung NCNU Tainan CCU NCKU NSYSU TWAREN Network topology Pacific Wave CANARIE NETHER Land StarLight CANARIE 2G 3*STM-4+3*STM-1 2.5G 2.5G 1.25G 1.8G 3*STM-4+2*STM-1 1.25G 1.25G MAN LAN LALALAN

  7. TWAREN NMS Architecture HP OpenView Service Information Portal (SIP) Service Desk Carrier OSS/ NMS Alarm SLA Reports NOC BMS Remedy Help Desk (Trouble Ticket System) HP OpenView Performance Insight & Report Pack for Cisco MPLS VPN / IP QoS / Cisco Ping / SA/ Netflow / IPT / CAR / RMON & Customize Report Raw Data SMS Cisco Info Center (Micromuse) HP OpenView Operation Manager Apps Apps Cisco IP Solution Center Cisco Secure ACS Apps Apps HP OpenView Extend Topology & Multicast Apps Apps NMS HP OpenView Network Node Manager (NNM) & CiscoWorks2000 for LAN/WAN & CTM Apps Apps Apps EMS WAN/LAN IP Telephony Network Elements IPv6 Multicast MPLS Multimedia

  8. Sloan Digital Sky Survey (SDSS) Overview • It is an very ambitious astronomical survey project. • The goal is to image one-half of the northern celestial hemisphere, and a smaller portion of the southern sky. • It determines the positions and absolute brightnesses of more than 100 million celestial objects. • The SDSS Southern Coadd project combines all images to detect very faint and distant astronomical objects. • Fermi National Accelerator Laboratory (FNAL) uses Grid3 to carry out a full coadd of all available data.

  9. NTU Sinica NCU Taipei NCTU NTHU Hsinchu NTU NCHU Taichung NCNU Tainan CCU NCKU NSYSU TWAREN Connections to Fermi Lab Pacific Wave CANARIE NETHER Land StarLight CANARIE 2G 3*STM-4+3*STM-1 2.5G 2.5G 1.25G 1.8G 3*STM-4+2*STM-1 1.25G 1.25G MAN LAN LALALAN

  10. 15600 HC 15600 TP1 15454 TP2 15454 SF 15454 CH Network Topology 198.49.208.10 131.225.7.156 140.110.240.10/24 [FNAL measurement server for CDF] [SDSS-server] [SDSS client] FNAL-SW NCHC-SW1 211.79.63.59/29 211.79.63.57/29 TWAREN International Optical Network ONS in Sartlight 211.79.63.58/29 NCHC ONS (HC) HC-7609P (NCHC-SW2) 211.79.59.250 211.79.59.252 [NCHC measurement server] [FNAL measurement client for CDF]

  11. Network Connections 198.49.208.10 131.225.7.156 140.110.240.10/24 [FNAL measurement server for CDF] [SDSS-server] [SDSS client] FNAL-SW NCHC-SW1 211.79.63.59/29 211.79.63.57/29 TWAREN International Optical Network HC NCHC ONS ONS in Chicago Sartlight 211.79.63.58/29 HC-7609P (NCHC-SW2) 211.79.59.250 211.79.59.252 [NCHC measurement server] [FNAL measurement client for CDF]

  12. TWAREN International Network ONS ONS Network Set-ups • Use Cisco 7609 & ONS (15454/15600) for connection • Use CTC, CTM or UCLP for lightpath set-up • Layer 1 international link for Hsin-Chu – Chicago • 622 Mbps lightpath (Hsin-Chu – Taipei – S.F. – Chicago) • 7 ONS’s included in the lightpath • Rsync: 2MB/s  8MB/s • Data Fragmentation • Policy Route • 5.0 TB Storage FNAL Hsin-chu NCHC Starlight

  13. Network Performance Monitoring • IPERF.MBPS: Max= 228.78 Mbps • Reverse IPERF.MBPS: Max= 213.27 Mbps • Available BW(Mbps): Max= 600.00 Mbps • RTT: 182 ms • No. of Hops: 3

  14. Network Monitoring Topology at Fermilab

  15. Future Plan • Resources (Computing + Storage+ Network) • Partnership with Universities and Institutes • Production Certificate Authority • Processing Functions • Applications Definition • International Collaborations