1 / 19

Tania Marinova, Ludmila Fidanova Sofia, Bulgaria

BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology. On Data Processing in the Meteorological Database of the Bulgarian National Institute of Meteorology and Hydrology. Tania Marinova, Ludmila Fidanova Sofia, Bulgaria.

jvanhouten
Télécharger la présentation

Tania Marinova, Ludmila Fidanova Sofia, Bulgaria

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology On Data Processing in the Meteorological Database of the Bulgarian National Institute of Meteorology and Hydrology Tania Marinova, Ludmila Fidanova Sofia, Bulgaria International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  2. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology On Data Processing in the Meteorological Database of the Bulgarian National Institute of Meteorology and Hydrology Introduction Meteorological data processing and control before its import into MDB Database structure Data processing in MeteoDB Main database activities Conclusions International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  3. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology • Introduction • The building of meteorological database (MDB) is one of the priority tasks of the NIMH in connection with storage and use of the meteorological information collected in the national hydrometeorological network on the territory of the country. • 1991 – 1999:RDBMS ORACLE 5.2in the environment ofDOS. • Since 2000:RDBMS MS SQL Server 7.0in the environmentofWindows, in view of its lower price in comparison with the ORACLE products. It turned out that the decision was very successful not only from financial point of view but also with regard to database administration and activities. In order to import all digitized data into the new database MeteoDB, a lot of work was done in MDBMD, as follows: • Building the structure of the new database MeteoDB • Data transfer from the old ORACLE database into MeteoDB • Standardization of the programs for meteorological data digitization in view of its importing into the new database • Development of programs for processing of all digitized data in old formats in order to be imported into the database, etc. International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  4. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Meteorological data processing and control before its import into MDB Current meteorological informationfrom: 38 synopticstations (8 synoptic and 3 climate obs/day) 96 voluntary climatological stations (3 climate obs/day) 296 precipitation stations (1 obs/day) is collected and digitized into computer-compatible form at the hydrometeorological observatories or the Regional Centers of the NIMH in Pleven, Varna, Plovdiv and Kjustendil. Then it is delivered for importing into MDB of the NIMH in Sofia. Historical dataavailable only in paper forms in the Meteorological Archive of the NIMH since the beginning of the respective measurements is digitized in MDBMD by the technical staff. International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  5. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Digitizing of current and archived data into computer-compatible form is completed by means of specialized programs: SYNOPD– hourly synoptic data SVK– hourly climate data and atmospheric phenomena SOT– hourly soil temperatures RJO– daily data from precipitation stations These programs execute data entering, correcting and examining, as well as verification for incorrect symbols, syntax errors, permissible values of elements, belonging to a certain interval of values or code table, etc. Standard applications are also used (Excel, Pe2) to digitize hourly data for sunshine duration and total solar radiation. International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  6. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Structure of MeteoDB – Basic tables Digitized meteorological information is imported into the basic tables. International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  7. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Structure of MeteoDB Code tables The different codes used to enter data into computer-compatible form are imported into the code tables with corresponding descriptions. International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  8. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Structure of MeteoDB – Meta tables The first three tables include information about identical number of the station, its name and specific measurements which are necessary for data processing. The common meta table STATION is partially filled up and it contains detailed information about the stations (geographical location, type, changes of type, measuring instruments, moving, interruption periods, etc.). International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  9. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Data processing in MeteoDB SQL Server Enterprise Manager – Transact-SQL stored procedures menu International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  10. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Scheme of data transfer into MeteoDB and main database activities International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  11. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology • Some priorities of using stored procedures • The modern programming language SQL, which is used for data manipulation in all relational databases (it is Transact-SQL for MS SQL Server), is comparatively easy to be learned and besides, it has new additional possibilities such as cycles, conditions, etc. In many cases this allows to process data by means of user stored procedures instead of applications. • The source of a given Transact-SQL stored procedure is always available in the database and it can be easily changed, if necessary. • Missing data (particular dates, months and years) in the data series, used by store procedures, is taken into consideration – it can not be done using built-in functions of Transact-SQL which ignore them. • Applications can be developed by appropriate programming language to use processed data from the database through execution of corresponding Transact-SQL stored procedures – in case of need it is enough to change only the procedure source, but not the application, that is very convenient. International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  12. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Main database activities Standard meteorological data processing The basic conception, accepted for data processing in MeteoDB, is to work with one station for a fixed period of time – month, year or several years, taking into consideration particular missing values of meteorological elements or dates, as well as particular whole months and years. For the time being if there are missing values in a data set, the corresponding daily, monthly or annual categories are not calculated as the results will not be correct. More than 60 stored procedures for standard meteorological data processing were developed, as follows: • Daily, decade, monthly or annual mean/sum of the different meteorological elements; • Monthly and annual reports for different meteorological elements on the basis of data from all available stations in the database. International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  13. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Monthly and annual reports from MeteoDB International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  14. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology In view of the insufficient hard disks space and operative memory of the server in MDBMD (2700 MHz Intel Pentium III, 2×9.1 GB HDD SCSI, 768 MB SDRAM),processed meteorological information is not imported into MeteoDB because it means to create tables for storing processed data and to make connections between tables with row and processed data. In this way changes in row data will reflect on corresponding processed data – as a result the work of the server will be getting more complicated. For this reason it was decided to obtain processed information by specially developed Transact-SQL stored procedures. International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  15. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Data quality control It is regularly completed, as follows: Verification for missing observations, missing values of a certain meteorological element or parameter, permissible values and intervals of variation, correspondence with the code tables, etc.; Expert control on the basis of annual reports and comparison with near meteorological stations. Specialized customer requests In case of non-standard requests specialized stored procedures are developed, in order to improve meteorological data serving of our clients. • Applications • For the time being two applications are used in MDBMD, as follows: • MDBCor– Data corrections in MeteoDB; • MDBLight– MeteoDB data visualization (presentation of meteorological parameters on the map of Bulgaria,). • These applications use directly the results of the execution of specially developed Transact-SQL stored procedures. The results are stored into temporary tables and thus the application can be used by many users. International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  16. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  17. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  18. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Conclusions • The approach to meteorological database building depends to a great extent on available resources (financial and human). Thus, we have used an approach to collect row data into the basic database tables and to process data by specially developed Transact-SQL stored procedures. In this way processed information is not stored into the database. • Availability of missing data in data sets used by stored procedures (particular elements, dates, months, years) has been taken into consideration in appropriate manner in all user Transact-SQL stored procedures. • For the time being visualization of data from MeteoDB is completed by specially developed application which uses the results of the execution of corresponding stored procedures. • Data homogenization and using GIS and different statistical methods for meteorological data processing, control and restore are the main tasks of MDBMD in the next several years. International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

  19. BULGARIAN ACADEMY OF SCIENCES National Institute of Meteorology and Hydrology Thank youfor your attention! International Conference on "Water Observation and Information System for Decision Support“Ohrid, Republic of Macedonia, 23 – 26 May 2006

More Related