1 / 30

The challenge of R2O and O2R in Transferring NWP Research Activities into Operations

The challenge of R2O and O2R in Transferring NWP Research Activities into Operations. NOAA/NESDIS/STAR. Sid-Ahmed Boukabara. The Satellite Summer School, July 16 th , 2019, Fort Collins, CO. What Is R2O or R2X in General?. 1. What is an O2R and why is it important?.

zaneallen
Télécharger la présentation

The challenge of R2O and O2R in Transferring NWP Research Activities into Operations

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The challenge of R2O and O2R in Transferring NWP Research Activities into Operations NOAA/NESDIS/STAR Sid-Ahmed Boukabara The Satellite Summer School, July 16th , 2019, Fort Collins, CO

  2. What Is R2O or R2X in General? 1 What is an O2R and why is it important? How do we measure Success in R2O? Conclusions and Lessons Learned 2 4 6 3 5 What is needed for a successful R2O/O2R? Specific Example of S4 Contents

  3. What Is R2O or R2X in General? • R2O is the process by which a scientific project led by a researcher, proven to provide added value, is transitioned to the Operational environment • R2X refers to the transition of a research project outcome to operations, applications, and services (for example to decision makers). R2O is an example of R2X

  4. Why is R2O Important for NOAA?(and other operational partners) • R2O is an efficient way to leverage research done in NOAA and the outside research community, to improve NOAA operational systems • R2O allows NOAA to maximize the return on investment (ROI) of its outsourced research • R2O allows NOAA to remain competitive, and at the edge of science in its products.

  5. R2O ? • R2O means often different things to different people NOAA NESDIS STAR R2O R2O OSPO Researcher in Academia R2O NWS EMC R2O NCO

  6. R2O Concept • Goal: Accelerates the use of satellite data in NWP centers • Ensures resources are in place to achieve successful transition: supercomputer, a software integration team, etc. • Ensures consistency and demonstrates benefits with operational systems like: Hybrid GDAS system (global), HWRF (Hurricane forecast). Scientific efforts in satellite DA in research community Diverse R&D activities Scientific efforts in satellite DA in academia, CIs Scientific efforts in satellite DA in NOAA/OAR Scientific efforts in satellite DA in NOAA/NESDIS (funded by GOES-R PGs, JPSS PGs, etc) NOAA’s own DA Activities Products, techniques, improvements, with direct and immediate relevance to NWP Operational Models (both global and regional) Made consistent with Operational Systems Select projects for R2O Transition NWP Operational Centers Objective: Improvements in Forecast skills Ongoing Baseline Improvement in NWP centers

  7. What Is R2O or R2X in General? 1 What is an O2R and why is it important? How do we measure Success in R2O? Conclusions and Lessons Learned 2 4 6 3 5 What is needed for a successful R2O/O2R? Specific Example of S4 Contents

  8. What is an O2R and why is it important? • O2R infrastructure brings the Operational environment to researchers • It allows scientists to perform their research in a system that is compatible with operational needs • When a successful research project is performed in an O2R environment, it increases its chances to transition to Operations (R2O) • Without an O2R environment, R2O is at best difficult, (often does not happen).

  9. O2R Is the Bridge Between R and O Research Operations O2R Valley of Death

  10. What Is R2O or R2X in General? 1 What is an O2R and why is it important? How do we measure Success in R2O? Conclusions and Lessons Learned 2 4 6 3 5 What is needed for a successful R2O/O2R? Specific Example of S4 Contents

  11. Components of an O2R/R2OInfrastructure(1) • The infrastructure is not just the supercomputer: • What Money can Buy…. • Supercomputer (Hardware, basic software, and IT) (almost the easiest part!) • Scientific Software Integration (this is the hardest part: keep in synch with operational models) • User Support & Documentation • Management of resources to allow R2O and O2R to be sustained • Documented Utilities to help scientists (CRTM, assessment, formatting tools) • Constant engagement between Research and Operations • Rigorous software configuration system to track changes • Rigorous (and independent) testing mechanism to demonstrate added value

  12. Components of an O2R/R2OInfrastructure (2) • What Money can NOT Buy…. • And perhaps more importantly: the right culture. • Transparency of R2O protocols and willingness to accept research performed by researchers & work collaboratively (on the operational partner) • Willingness to work/start with operational system and follow protocols and accept constructive feedback (on the research partner) • Sense of Mutual respect between Researchers and Operational partners: respect for innovation in research and pragmatism in the operational implementation Accept that R2O is not for everyone: careful choice of research and operations partners is important

  13. What Is R2O or R2X in General? 1 What is an O2R and why is it important? How do we measure Success in R2O? Conclusions and Lessons Learned 2 4 6 3 5 What is needed for a successful R2O/O2R? Specific Example of S4 Contents

  14. Metrics for Assessing O2R Success • When R2O transition has occurred: assess specific scientific metric(s) that was(ere) improved upon transition to operational environment. • Example: Anomaly correlation, hurricane track improvement, etc. • When R2O transition has not occurred yet, assess progress in the maturity of the project (metric: TRL: Technology Readiness Level), as a result of the O2R infrastructure

  15. Example of a project that led to an R2O transition (Improved QC) Southern hemisphere 500-hPa height ACC for 10 September – 24 October 2012 for the control (black) and LNVD (red). Bottom: Variation between LNVD (red) and the control (operational QC of MODIS winds: black) based on forecast hour. All ACC differences outside of the bars are significant at the 95% confidence level. The circle represents a statistically significant improvement for the Day-4 and Day-5 forecasts. Significant Plot courtesy of D. Santek, UW (S4 project)

  16. How do we assess R2O-maturity? (an Example) R2O Path

  17. What Is R2O or R2X in General? 1 What is an O2R and why is it important? How do we measure Success in R2O? Conclusions and Lessons Learned 2 4 6 3 5 What is needed for a successful R2O/O2R? Specific Example of S4 Contents

  18. Supercomputer for Satellite Simulations and data assimilation Studies (S4) • Overview: • NESDIS, in collaboration with UW is making S4 available to scientists involved in satellite data assimilation and other activities related to it. • One of the purposes is to consolidate data assimilation activities performed in the research community • and to encourage the usage of NOAA operational models/tools/codes installed on it. • Open policy for users (since hosted in academic institution). • Only open source/non-restricted data allowed on S4. • Upgraded once in 2014 • Status: Being Upgraded in 2019. The S4 system, hosted by University of Wisconsin.

  19. S4 Technical Description • Brief Technical Description • The S4 system is a Linux cluster (Dell/Intel hardware), • 4700 CPU cores (60 Tflops) with 18TB of total RAM • 1700TB in storage nodes • Hosted in the UW/SSEC Data Center (with UPS) • Able to run 4 GSI/GFS experiments simultaneously at T1534 • System Administration and Resource Allocation • SSEC provides system administration services and security protocols for the system, • NESDIS/STAR provides overall guidance on system resource allocation and selection of users as well as scientific support (code management, software integration, etc)

  20. S4 Intented Activities • This system is intended to allow primarily (but not exclusively) the following major activities: • (1) Undertake satellite data assimilation experiments at global and/or regional scales and the assessment of their impacts on forecast models skills, using currently flying satellite sensors and allowing scientists to test new science/methodology and • (2) In support of the activity above, undertake all necessary satellite data simulations, calibration, algorithms development/improvement, radiative transfer modeling and validation, quality control (QC) procedures, etc • (3) Perform Observing System Simulation Experiments (OSSEs) for new sensors (such as GOES-R and JPSS). • This component is expected to address key questions that NESDIS constantly faces: (a) what is the impact and the added value of flying new sensors, (b) what is the optimal orbital configuration, (c) what are the best mitigation strategies possible, from an NWP perspective, given the budget and other constraints, (d) how to best coordinate with other national and international partners to achieve the most optimal Earth satellite observing system

  21. S4 Governance & Management • S4 is governed by a NESDIS/STAR policy memo identifying roles and responsibilities • IT support is handled by the host institution UW. • Software Integration is handled by NESDIS • To request an account, a simple email to STAR POC will suffice. Accounts usually set up the same day. • The S4 committee includes NESDIS/STAR director, deputy, and senior program scientists makes recommendations concerning 90% of the machine's resources. The remaining 10% is managed by UW.

  22. Policies and Code management on S4 • Code management is the hardest part • The software integration team is dedicated to making sure the NOAA codes installed on S4 are in synch with the operational models (including scripts, codes, datasets, libraries, etc) • SVN is extensively used when appropriate. • The following is a list of S4 Policies: • User account request • Managing resources • Account expiration • Tools and softwares guidance • User guide • Compiler & Software Availability • Intel Fortran / C++ • Gfortran /gcc/g++ • Netcdf 3 & 4 • Matlab • IDL • NCO 4 • GRADS • HDF 4 & 5 • NCL

  23. How much did Projects benefit from S4?

  24. Maturity Assessment of S4 projects Added value of S4 O2R Environment measured by the maturity-index (before and after using the S4)

  25. Resources installed for Global and Regional DA and OSSE Activities • The following models & tools are installed on S4 (not exhaustive list): • Global Data Assimilation System (GDAS) (including the new Hybrid Ensemble system) • Grid Statistical Interpolation (GSI) • Weather Research & Forecast (WRF) (WRF-ARW and WRF-NMM) • Hurricane Weather Research & Forecast (HWRF) • Microwave Integrated Retrieval System (MIRS) • Community Radiative Transfer Model (CRTM) • Verification Statistics Data Base (VSDB) • Ocean Model HYCOM • Etc…

  26. What Is R2O or R2X in General? 1 What is an O2R and why is it important? How do we measure Success in R2O? Conclusions and Lessons Learned 2 4 6 3 5 What is needed for a successful R2O/O2R? Specific Example of the JIBB and S4 Contents

  27. Lessons learned for an effective R2O • Importance of the O2R environment • Importance of availability of an accessible HPC • Importance of a transparent R2O protocol • Importance of code portability & synchonization • Importance of enforcing the exclusive usage (by researchers) of the operational systems • Importance of a rigorous traceability of changes • Importance of the S4 approache • Importance of nurturing a culture of mutual respect between research and operations partners

  28. Coordination & Synchronization: Accelerated R2O coordination for SNPP/ATMS • SNPP Was launched Nov 2011 • Dec 2011, a coordinated memo was signed for the Action Plan for ATMS R2O between NESDIS and NWS • The main points were: Who, does what and when and where (between NESDIS and NWS) • Strong backing from STAR and NCEP Directors (present at kick off meeting) • 7 months after launch, ATMS was assimilated operationally in NOAA • Important of ‘coordinate & synch’

  29. Conclusions • NOAA is involved in R2O by making significant resources available to scientists and collaborators (HPC, support, ..) • The two major activities targeted are: (1) AdvancedSatellite data assimilation and (2) OSSE activities. • The O2R infrastructure is more than the supercomputer: components include software management, integration and user support, etc • The S4 offer an O2R that is both operationally relevant as well as open and inclusive • S4 access offers an O2R environment conducive of innovation, but with a clear R2O objective. • In progress A major Initiative called EPIC (Environmental Prediction Innovation Center) will be implemented in FY20, to take the O2R/R2O to a much higher level (resources wise).

  30. Questions?

More Related