1 / 26

ASTRONOMICAL COMPUTING

Explore the current computing setup at Leiden Observatory and Leiden University, including desktops, servers, network facilities, and administrative services. Discover plans for IT improvements and advancements in scientific computing to address new challenges in astronomy.

mswank
Télécharger la présentation

ASTRONOMICAL COMPUTING

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ASTRONOMICAL COMPUTING @ THE OBSERVATORY AND THE UNIVERSITY

  2. CONTENT 01 02 Current situation Near future Long term future What does the IT group provide in terms of facilities and policies. An overview of the current compute setup. Plans for IT improvements at Leiden Observatory and at Leiden University level. Are we entering a new paradigm and what can we expect for new challenges in Astronomy. 03

  3. Current Situation What is available now

  4. What I willNOTshow 01 02 Helpdesk System Management tools Software repository The helpdesk utility contains both a ticketing system and a Dokuwiki. Big brother is watching you and your computer. We have loads of software installed. It is located on the /software disk, in your desktop /usr/bin or addon to python site-packages 03

  5. Current Situation What is available now Desktops Servers Desktops For BSc, MSc, PhD, PD, Staff and Support Office automation and Science servers. On the spot science analysis 4.8PB 122 800 80 z Bulk Storage Acquisition machines HPC Facilities Lab computers Large and slow disk farm. Which computer facilities are available and for what purpose. Direct connection with lab equipment Machines that are located in a harsh environment. High Performance Server farms. 240 45 z

  6. Current Situation What is available now Desktop Server HPC Bulk Storage Local analysis Heavy processing High performance Pertinent storage Very fast data access located near huge compute power, include GPU processing. Multi-user. Smaller quantities of data, but local to processing CPU. Usually single user Fast local data access at large quantities. Significant processing power, multiple users. Slow but large amount of storage on secure media. Long term storage

  7. Serverroom Occupation Observatory and Physics server locations in the Gorlaeus and Oort building server rooms. GorlaeusServerroom OortServerroom

  8. Current Situation What is available now z Network Facilities Servers BYOD MeetPCs Desktops Which computer facilities are available and for what purpose. • Specialized interconnectivity. • Segmentation • Security • Local management • Wireless GDPR/AVG ISO 27002 UL-STRW-LION Eduroam

  9. Current Situation What is available now University Firewall Eduroam STRW/LION Firewall Desktop Firewall Server Firewall Meetnet Firewall c cv Host Firewall Host Firewall Host Firewall UL-STRW-LION

  10. Current Situation What is available now z Administrative Services Science Other • Astronomical software ease of use • Sysadmin all equipment • Software centralization, development support • Infrastructure • Unify computer diversity • IT Interoperability support and scientific staff IT support is not only about hardware. • Specialized tools for office automation • Webtools • Accounts • Posters z z

  11. Current Situation What is available now z ~200 Software Services License service Generic license server for many different software packages IT support is not only about hardware. • A variety of tools and programs • LINUX OS • RedHat, Fedora • Windows OS • 7 - 10 • Mac OS • Local management • /software disk • ~/.localadditions ~10 z

  12. Current Situation What is available now z ~1280 Accounts Services Additional service • Helpdesk • Project websites • Software developement • Acquisitions IT support is not only about hardware. • Multiple account domains • STRW/LION • ULCN • Clusters • Projects z

  13. Current Situation What is available now Delft Leiden z ~80 sites WEB awareness Policies Data service • Astronomy is about data • Data Dissemination • Web services • IVOA • Data management • Day-to-day operations • Open access • Long term storage How things are organized. • Multiple information bases • UNIV site www.strw.leidenuniv.nl • LOCAL STRW web directory local.strw.leidenuniv.nl • Project sites z

  14. Near Future Plans @ STRW and @ UNIV

  15. Near Future Plans Plans for IT improvements at Leiden Observatory and at Leiden University level. z ~120 k€ Virtual Environment @ STRW Science Single Compute hardware Bulk storage extension Bare Metal Server farm extensions Planned Enhancements and unplanned extensions. Adding extension boxes to go from 1 PB to > 2PB • New virtual server farm • Office automation • Mail services • Web services ? k€ z ~100 k€ z

  16. Near Future Plans Plans for IT improvements at Leiden Observatory and at Leiden University level. z Scientific Computing One Stop Shop @ UNIV CFER/HPC Data Center Scientific computing embrassed Center For Excellent Research New housing for all computer equipment on premises Helpdesk for all your computing questions z z

  17. Near Future Plans Plans for IT improvements at Leiden Observatory and at Leiden University level. z @ UNIV Data Center Scientific computing on the table • New housing for all computer equipment on premises • Replaces Gorlaeus and Oort Server rooms • May house SRON servers • Will be science user accessible • Ready beginning 2020

  18. Near Future Plans Plans for IT improvements at Leiden Observatory and at Leiden University level. z @ UNIV CFER/HPC Management Package Equipment package Eduction Package Scientific computing on the table Make CFER separate entity at university management level JackoKoster (BB/IM) Acquire, implement and configure CFER equipment and setup initial support Erik Deul (STRW) BSc and MSc curriculum on HPC/parallelization Aske Plaat (WD/LIACS) Center For Excellent Research Project definition

  19. Near Future Plans Plans for IT improvements at Leiden Observatory and at Leiden University level. z @ UNIV CFER/HPC Data Center Evaluate Production First Hardware Define Pilot Start full implementation End of guaranteed budget Scientific computing on the table Center For Excellent Research Initialization phase Implement Pilot Compleet cv 2018 2019 2020 2021 2028

  20. Near Future Plans Plans for IT improvements at Leiden Observatory and at Leiden University level. z 3.5 M€ @ UNIV CFER/HPC Scientific computing on the table • Center For Excellent Research • Budget • First investment • Yearly cycle

  21. Near Future Plans Plans for IT improvements at Leiden Observatory and at Leiden University level. z @ UNIV CFER/HPC Scientific computing on the table • Center For Excellent Research • Support • Hardware and basic software (ISSC related) • HPC Tooling (current IT support personnel) • HPC Software development (current IT support personnel + CFDS)

  22. Near Future Plans Plans for IT improvements at Leiden Observatory and at Leiden University level. z @ UNIV CFER/HPC Scientific computing on the table • Center For Excellent Research • Federated • Step on ladder of facilities • Integration of like facilities (UNIV, LUMC, TUD, SARA…) SARA CFER/HPC Institute cluster Desktop

  23. Long Term Future Challenges in Astronomy

  24. Long Term Future New paradigm in computing and challenges for Astronomy ? z Local versus Cloud New Paradigm Software development CPU to the Data Restructure IT group core business The IT Landscape is rapidly changing. Adding extension boxes to go from 1 PB to > 2PB Institute to small to provide z z

  25. Long Term Future New paradigm in computing and challenges for Astronomy ? z Data analysis Challenges in Astronomy Data integrity Software development • Interpretation of scientific data • Machine Learning • Science Platforms: Tools for Data Discovery and Analysis from Different Angles • Astrophysical Data Visualization from Line Plots to Augmented and Virtual Reality • Astronomers are from the stone age! • Data Science: Workflows, Hardware, Software, Humanware • DevOps practices in Astronomy Software • Data management procedures and software • Databases and Archives: Challenges and Solutions in the Big Data Era • Quality Assurance of Science Data The IT Landscape is rapidly changing. z z

  26. Tank you!! Any questions?

More Related