1 / 31

NEXPReS - evolving the use of e-Infrastructures in the Radio Astronomy Community

Francisco Colomer (Instituto Geográfico Nacional - IGN, Spain) ‏ for the NEXPReS team. NEXPReS - evolving the use of e-Infrastructures in the Radio Astronomy Community.

kwines
Télécharger la présentation

NEXPReS - evolving the use of e-Infrastructures in the Radio Astronomy Community

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. INGRID 2011- Santander, Spain Francisco Colomer (Instituto Geográfico Nacional - IGN, Spain)‏ for the NEXPReS team NEXPReS - evolving the use of e-Infrastructures in the Radio Astronomy Community

  2. INGRID 2011- Santander, Spain NEXPReS (“Novel EXplorations Pushing Robust e-VLBI Services”) is a three-year project aimed at further developing e-VLBI services of the European VLBI Network (EVN), with the goal of incorporating e-VLBI into every astronomical observation conducted by the EVN. The project is developing tools to help take advantage of computational and networked infrastructures to the intensive data analysis demands of radio astronomy. The project is also helping construct tools that will allow users to build dynamic networks and buffer peta-byte scale data sets. NEXPReS - evolving the use of e-Infrastructures in the Radio Astronomy Community

  3. INGRID 2011- Santander, Spain Outline Introduction: the highest spatial resolution in Astronomy – in real time! e-VLBI primer and achievements NEXPReS: objectives NEXPReS: activities Cloud Correlation High Bandwidth on Demand Computing in a Shared Infrastructure High- Bandwidth & High-Capacity Networked Storage on Demand Summary

  4. INGRID 2011- Santander, Spain Introduction Very Long Baseline Interferometry (VLBI) provides the highest available spatial resolution in Astronomy: 30 as = detecting details of the size of a tennis ball placed on the moon! Allows to access the engines of active galactic nuclei, star forming regions, evolved envelopes, etc. VLBI networks are being scheduled to study Target Of Oportunity (ToO) sources, such as supernovae, transients, etc. Real-time data transfer and correlation allow also greater quality monitoring and flexible scheduling.

  5. INGRID 2011- Santander, Spain

  6. INGRID 2011- Santander, Spain

  7. INGRID 2011- Santander, Spain e-VLBI Primer

  8. INGRID 2011- Santander, Spain

  9. INGRID 2011- Santander, Spain European VLBI Network (EVN)http://www.evlbi.org/

  10. INGRID 2011- Santander, Spain VLBI radio Observation

  11. INGRID 2011- Santander, Spain Real-time, or e-VLBI: project EXPReS Connection of 16 radio telescopes at 1 Gbps rate Provide tools to support ToOs / rapid response science

  12. INGRID 2011- Santander, Spain e-VLBI: state of the art

  13. INGRID 2011- Santander, Spain e-VLBI: state of the art

  14. INGRID 2011- Santander, Spain e-VLBI Science

  15. INGRID 2011- Santander, Spain e-VLBI Science

  16. INGRID 2011- Santander, Spain NEXPReS Novel EXplorations Pushing Robust e-VLBI Services Radio Astronomy Observations from multiple telescopes at (inter)continental separations Advanced Networks (high data rates, light paths, custom routes, etc.) Central data analysis, custom supercomputer Looking deep into the universe (earliest times) to see how the universe formed SKA Pathfinder SKA is an ESFRI project e-VLBI is a declared pathfinder technology/technique

  17. INGRID 2011- Santander, Spain NEXPReS Objectives Correlate in real time what you canand correlate later what you must Optimize science return telescopes and observing time (network always available) Will influence operational mode of future interferometers (SKA) Introduce a transparent caching mechanism in the data transport All experiments can benefit from e-VLBI feedback, even if they require many correlations Reduce logistics of recording media

  18. INGRID 2011- Santander, Spain NEXPReS Overview (1 of 2)‏ 3 Year Project (2010-2013)‏ 5.6 M€ (3.5 M€ financed by EC)‏ WP1 Management WP2 EVN-NREN (Astronomers & Networkers)‏ WP3 eVSAG WP4 Communication & Outreach WP5 Cloud Correlation WP6 High Bandwidth on Demand WP7 Computing in a Shared Infrastructure WP8 High- Bandwidth & High-Capacity Networked Storage on Demand

  19. INGRID 2011- Santander, Spain NEXPReS Overview (2 of 2)‏ 1 JIVE NL 2 ASTRON NL 3 INAF IT 4 MPG DE 5 UMAN UK 6 OSO SE 7 VENT LV 8 FG-IGN ES 9 NorduNet DK 10 SURFnet NL 11 PSNC PL 12 DANTE UK 13 AALTO FI 14 TUM DE 15 CSIRO AU 15 Partners 11 countries Astronomy Institutes, NRENs, Super Computing centers Most partners were part of the predecessor project, EXPReS

  20. INGRID 2011- Santander, Spain e-VLBI Today: 20 Globally Distributed Telescopes

  21. INGRID 2011- Santander, Spain e-VLBI up to Today Recently Developed Today Results Today Traditional Past

  22. INGRID 2011- Santander, Spain NEXPReS: Evolving and Improving e-VLBI distributed network LTS multiple telescopes dedicated storage science results

  23. INGRID 2011- Santander, Spain NEXPReS activities 2 Service Activities focus on new operational astronomical features Higher bandwidth, dynamically Cached transport, increasing flexibility of observations 2 Joint Research Activities aiming at innovating future operations Distributed correlation in astronomy domain Transparent buffering 2 special Networking Activities Management & Outreach 2 user community networks (from EXPReS) Astronomy use and policy: eVSAG Network providers/telescope operators: NREN Forum

  24. INGRID 2011- Santander, Spain WP5: Cloud correlation / Improving operational tools Transform complete VLBI observational chain: - Scheduling, observing, buffering, real-time - delayed correlation, use of hardware/software correlators - Enable modification of observational parameters on the fly - Implement 4 Gbps recording/transmitting/playback - Implement flexible buffering at stations and correlator - Continuous quality and network monitoring, station remote control - Automated network-dependent correlation

  25. INGRID 2011- Santander, Spain WP6: High bandwidth on demand Domain 1 [NL] Domain 3 [EU] Domain 5 [CN] Domain 2 [EU] Domain 4 [CN] • Permanent, static links are very convenient, but under-used, and limited to 1 Gbps. • Integrate e-VLBI with existing BoD techniques • Investigate on-demand access for large archives • Establish international multi-Gbps on-demand services • Prepare EVN for real-time 4 and 10 Gbps operations • Position EVN to take full advantage of emerging 100 Gbps technology

  26. INGRID 2011- Santander, Spain WP7: Computing in a shared infrastructure • Real-time stream processing; disks are slow, keep data on network/in memory • Make use of EVN infrastructure, develop generic Grid alternatives • Allow additional VLBI observations with (a subset) of the EVN and global VLBI arrays with a minimal impact on scarce resources (disk, manpower)‏

  27. INGRID 2011- Santander, Spain WP8: High- Bandwidth & High-Capacity Networked Storage on Demand • Develop buffering solutions capable of multi-Gbps simultaneous I/O streaming • Investigate use of LTAs, allocation of resources

  28. INGRID 2011- Santander, Spain NEXPReS impact on the EVN • Step towards use of real-time high-bandwidth e-VLBI for EVN • Must increase interoperability with other VLBI networks • Raise level of availability • Continuous data quality monitoring • Continuous network monitoring • More remote control, immediate feedback • Should consider more frequent, more evenly spaced observing sessions • Move to VLBI every Friday... eventually • Introduction of observations with sub-sets of EVN telescopes • semi-automatically generated schedules and control • transient response, multi-epoch campaigns • High degree of automation in operations • Scheduling (network and correlator) • Network monitoring • Automated pipelines • Increased use of software correlator • Parallel operations soft- and hardware correlators • Mixed 1Gbps-4Gbps operations

  29. INGRID 2011- Santander, Spain e-VLBI as an SKA pathfinder Long-range connectivity Real-time radio-astronomy Shared technology interests: Digital processing (correlators) Calibration pipeline http://www.skatelescope.org/

  30. INGRID 2011- Santander, Spain Summary Short term: What we can do now 1 Gbps per station Regularly Intercontinental e-Science Mid term: What we expect to do soon 4 – 10 Gbps per station Operation on demand Need e-infrastructures! Long term: SKA pathfinder Applications/User Communities Storage Networking Computation

  31. INGRID 2011- Santander, Spain Contact Info & Q/A T. Charles Yun Francisco Colomer tcyun @ jive.nl f.colomer@oan.es JIVE http://www.jive.nl/ NEXPReS http://www.nexpres.eu/ NEXPReS is an Integrated Infrastructure Initiative (I3), funded under the European Union Seventh Framework Programme (FP7/2007-2013) under grant agreement RI-261525.

More Related