1 / 23

Construction of e-science Environment for Meteorological Data in Korea

Construction of e-science Environment for Meteorological Data in Korea. Jai-Ho Oh Dept. Environmental Atmospheric Science Pukyong National University. Contents. Introduction of the meteorological data sharing system. Background Concept

zona
Télécharger la présentation

Construction of e-science Environment for Meteorological Data in Korea

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Construction of e-science Environment for Meteorological Data in Korea Jai-Ho Oh Dept. Environmental Atmospheric Science Pukyong National University

  2. Contents • Introduction of the meteorological data sharing system. • Background • Concept • Architecture of the meteorological data sharing system • Meteorological Information Search/Display system. • Conclusion and Future Works

  3. Introduction of the meteorological data sharing system • Background • Too many types of meteorology data is produced everyday with big size. • Difficulties to find meteorology data that scientists required to model. • Concepts • If we have a metadata of meteorology data in indexed DB from the SAM file stored in SAN, we can easily find meteorology data. • If we control sharing permission of each meteorology data, we can safely handle and share the meteorology data. • If we are able to display the meteorology data before download , we can decide if the searched data is really one we need.

  4. Development of Meteorological Data Sharing System • Construction of Internal Data Grid Basis using Super Computer • Construction of Data Grid middleware • Resource Broker • Data management : Replica Service • Information and Monitoring Service • Large amount storage service • Security • Preparation of User Interface for Conjugation of Data Grid • Design and Preparation of Meta catalog for Numerical Simulations • Design Metadata of KMA NWP data following WMO metadata Standards • Construction of NWP data sharing prototype using Metadata catalog • Meta Catalog • Metadata Presentation • Metadata Update • Data Formats • Support of data transport protocols • Support of data access protocols • Authentication and Authorization • Advanced World Meteorology Information Network V-GISC and Logical Harmony of Metadata

  5. Detail objectives of Meteorological Data Sharing System • Data Management Service : Simple way to search and acquire Selected Meteorological data (sorted by Area and Time) - Development of platform for WMO data sharing - Compatible with Data Grid • Construction of Data Pool - Shared Data server using Data broker - Development of Common Interface for Atmospheric data server as like LAS (Live Access Server) & GDS (GrADS Data Server) • Metadata cataloging Service - Prototype design for Metadata of Meteorological data - DataBase of Metadata • Output Display Service - Various Visualization techniques to interpret Meteorological model results - GridSphere based on GrADS Plug-in

  6. Structure of meteorological Data sharing system

  7. Architecture of the meteorological data sharing system Meteorological Administration center • Architecture of the meteorology data sharing system • Consist of Two systems. • Meteorological Administration Center • Meteorology information search/display system Meteorology information display system

  8. Access control of meteorological data(1) Select meteorology data we want to change Permission and Information. Show all meteorology data

  9. Access control of meteorological data(2) Click Enable to approve sharing and add additional Info Click Disable to prevent sharing

  10. Manage the information of meteorological data Click Meta-Info to see description

  11. Search Agent configuration Setting the search condition Search Configuration DB keep the search condition in DB Search meteorological data using search condition in DB Search Agent • Search Condition • File Type • Production time • Execution time

  12. Work flow of the search agent WGRIB DBMS Search Agent Register Agent Control File grib2ctl 1. Search meteorological data to register 2. Make a Control File for Register Agent 3. Register meta data of meteorological data to DBMS

  13. History view of the search request

  14. Register data grid server

  15. Meteorological information display system • Software used by the meteorology information display system • GridSphere • Globus Toolkit • GrADS • Functions of the meteorology information display system • Seek meteorology data using search condition. • Show the list of results. • Setting the GrADS display options. • Show meteorology data by graphic. • Users can have their own DataBox so that they can keep the searched results for later use.

  16. Structure of the meteorological information display system

  17. Legacy System Integration Efforts • Implemented Data Broker for GDS&LAS • Search Agent invokes Data Broker to add new datasets • into the configuration file • Run ‘Restart’ script to affect recently added datasets GDS&LAS Data Broker

  18. Work Flow between GridSphere and USER Authentication using GT Connect to the web server of Gridsphere Job Creation

  19. Search Option Page Input the Search Condition and Push the Search button Show the search result

  20. Setting the GrADS option Setting the GrADS option And push Show Graph button

  21. Image Output(1)

  22. Image Output(2)

  23. Conclusion & Future Work • Efficient Way for Data Sharing for Administrator • Agent Based Data Searching/Cataloging • Integration with Grid Sphere (portlet) • On-Demand Service Architecture • Dynamic Meta Data Cataloging • WSRF based Data Sharing • Extension to various types of data • Need more collaboration with other nations’ weather centers • Any contributions to the E-Community

More Related