150 likes | 266 Vues
SDSS Data Transfer. Jing-Jou Yen Division Manager National Center for High-Performance Computing (August 26, 2005). OUTLINE. Project Background Introduction to NCHC/TWAREN Sloan Digital Sky Survey ( SDSS) Overview Network Architecture and Configuration Network Performance Monitoring
E N D
SDSS Data Transfer Jing-Jou Yen Division ManagerNational Center for High-Performance Computing (August 26, 2005)
OUTLINE • Project Background • Introduction to NCHC/TWAREN • Sloan Digital Sky Survey (SDSS) Overview • Network Architecture and Configuration • Network Performance Monitoring • Future Plan
It is a joint program NCHC with the Fermi Laboratories to mirror the SDSS data. The goal is to speed up the SDSS information sharing for physicists working in R&E institutes in Taiwan. NCHC computing, storage and networking resources enhance functions in the astronomical research. NCHC uses TaiWan Advanced Research and Education Network (TWAREN) for the SDSS data transfer. NCHC’s Operations teams will ensure the quality for all efforts. Hsinchu Tainan Taipei Taichung Computing Center Knowledge Center Core node equipment Network Operation Center SDSS Data Transfer Project
NCHC is Taiwan’s only National Lab Dedicated to • High-Performance Computing & Applications • Storage, Networking & the Applications Development • NCHC Mission • Provide resources and services • Do research and development • Offer education, training, and outreach Resources and Services High-performance Computing & Networking Research and Development High-performance Computers TANet2/TWAREN PC Clusters Storage/Databases Application SW Industrial, Government, Academic Projects International Collaborations Conferences Education, Training and Outreach Consultation Training Workshops Lectures Exhibits National Center for High-performance Computing NCHC
SINICA NCU NTU NCTU Taipei NTHU Hsinchu NDHU NCHU NCNU Taichung CCU Tainan NCKU NSYSU TaiWan Advanced Research and Education Network TWAREN • TWAREN - Successor of TANet2 • TWAREN -One of the Most Advanced Networks/Operations in the World • TWAREN Goals • To provide a network infrastructure for academic and R&E community. • To stimulate creativity and foster talents • TWAREN Architecture • A hybrid network with 20G POS and DWDM technologies at its core. • Hierarchical topology: 3 layers (core, GigaPoPs, end nodes) • Eleven GigaPoPs - each links to the core • node at 20 Gbps and 1 dark fiber. • Highly scalable and flexible • Providing multiple services • International links to the USA • Integrated NMS Architecture
NTU Sinica NCU Taipei NCTU NTHU Hsinchu NTU NCHU Taichung NCNU Tainan CCU NCKU NSYSU TWAREN Network topology Pacific Wave CANARIE NETHER Land StarLight CANARIE 2G 3*STM-4+3*STM-1 2.5G 2.5G 1.25G 1.8G 3*STM-4+2*STM-1 1.25G 1.25G MAN LAN LALALAN
TWAREN NMS Architecture HP OpenView Service Information Portal (SIP) Service Desk Carrier OSS/ NMS Alarm SLA Reports NOC BMS Remedy Help Desk (Trouble Ticket System) HP OpenView Performance Insight & Report Pack for Cisco MPLS VPN / IP QoS / Cisco Ping / SA/ Netflow / IPT / CAR / RMON & Customize Report Raw Data SMS Cisco Info Center (Micromuse) HP OpenView Operation Manager Apps Apps Cisco IP Solution Center Cisco Secure ACS Apps Apps HP OpenView Extend Topology & Multicast Apps Apps NMS HP OpenView Network Node Manager (NNM) & CiscoWorks2000 for LAN/WAN & CTM Apps Apps Apps EMS WAN/LAN IP Telephony Network Elements IPv6 Multicast MPLS Multimedia
Sloan Digital Sky Survey (SDSS) Overview • It is an very ambitious astronomical survey project. • The goal is to image one-half of the northern celestial hemisphere, and a smaller portion of the southern sky. • It determines the positions and absolute brightnesses of more than 100 million celestial objects. • The SDSS Southern Coadd project combines all images to detect very faint and distant astronomical objects. • Fermi National Accelerator Laboratory (FNAL) uses Grid3 to carry out a full coadd of all available data.
NTU Sinica NCU Taipei NCTU NTHU Hsinchu NTU NCHU Taichung NCNU Tainan CCU NCKU NSYSU TWAREN Connections to Fermi Lab Pacific Wave CANARIE NETHER Land StarLight CANARIE 2G 3*STM-4+3*STM-1 2.5G 2.5G 1.25G 1.8G 3*STM-4+2*STM-1 1.25G 1.25G MAN LAN LALALAN
15600 HC 15600 TP1 15454 TP2 15454 SF 15454 CH Network Topology 198.49.208.10 131.225.7.156 140.110.240.10/24 [FNAL measurement server for CDF] [SDSS-server] [SDSS client] FNAL-SW NCHC-SW1 211.79.63.59/29 211.79.63.57/29 TWAREN International Optical Network ONS in Sartlight 211.79.63.58/29 NCHC ONS (HC) HC-7609P (NCHC-SW2) 211.79.59.250 211.79.59.252 [NCHC measurement server] [FNAL measurement client for CDF]
Network Connections 198.49.208.10 131.225.7.156 140.110.240.10/24 [FNAL measurement server for CDF] [SDSS-server] [SDSS client] FNAL-SW NCHC-SW1 211.79.63.59/29 211.79.63.57/29 TWAREN International Optical Network HC NCHC ONS ONS in Chicago Sartlight 211.79.63.58/29 HC-7609P (NCHC-SW2) 211.79.59.250 211.79.59.252 [NCHC measurement server] [FNAL measurement client for CDF]
TWAREN International Network ONS ONS Network Set-ups • Use Cisco 7609 & ONS (15454/15600) for connection • Use CTC, CTM or UCLP for lightpath set-up • Layer 1 international link for Hsin-Chu – Chicago • 622 Mbps lightpath (Hsin-Chu – Taipei – S.F. – Chicago) • 7 ONS’s included in the lightpath • Rsync: 2MB/s 8MB/s • Data Fragmentation • Policy Route • 5.0 TB Storage FNAL Hsin-chu NCHC Starlight
Network Performance Monitoring • IPERF.MBPS: Max= 228.78 Mbps • Reverse IPERF.MBPS: Max= 213.27 Mbps • Available BW(Mbps): Max= 600.00 Mbps • RTT: 182 ms • No. of Hops: 3
Network Monitoring Topology at Fermilab
Future Plan • Resources (Computing + Storage+ Network) • Partnership with Universities and Institutes • Production Certificate Authority • Processing Functions • Applications Definition • International Collaborations