1 / 20

SDMX and Metadata

SDMX and Metadata. SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata. The main types of metadata. Structural metadata are: acting as identifiers and descriptors of the data, such as: dimensions of statistical cubes variables

tarala
Télécharger la présentation

SDMX and Metadata

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SDMX and Metadata SDMX Basics Course 12 April 2013 Daniel Suranyi Eurostat B5 Management of statistical data and metadata

  2. The main types of metadata Structural metadata are: acting as identifiers and descriptors of the data, such as: • dimensions of statistical cubes • variables • titles of tables • navigation tree Structural metadata must always be associated with the data to allow their identification, retrieval and browsing.

  3. Example for structural metadata

  4. The main types of metadata Reference metadata are: acting only as descriptors of the data, they don’t help to actually identify the data. They can be of different kinds: • conceptual metadata • methodological metadata • quality metadata (process and output) Reference metadata can be exchanged in-dependently from the data they are related to, but are however often linked to them.

  5. Example for reference metadata

  6. Metadata and the ESS vision The ESS vision is based on the Commission Communication 404/2009 “on the production methods of EU statistics: a vision for the next decade”. Some main ideas of this vision are: • From statistical ‘stove pipes’ to more integrated statistical production processes; • Better integration of the ESS in terms of IT infrastructure, IT tools, data quality, metadata, methodology etc. (both in terms of horizontal and vertical integration); • Broader use of administrative data sources in the statistical data production processes; • Statistical legislation should also be cross-cutting in covering larger statistical domains (first cross-cutting legislation drafted).

  7. Standardisation of structural metadata • Code lists describe dimensions in data tables, giving a meaning to the data. • Are based on • official statistical classifications such as NACE, NUTS, ISCO… • the SDMX Content Oriented Guidelines • Domain specific codifcations • A standard code list is a code list already harmonised • Standard code lists should be used all along the statistical business process • data design, collection, aggregation, dissemination, archiving…

  8. Example of a harmonised code list (NACE Rev. 1.1)

  9. Impact on the statistical business processes • Better comparability: same codes for the same concepts • Increase efficiency: less transcoding; less code lists; clean lists • Improve accuracy: facilitate data management and exchange and reduce the number of errors • Re-usability and integration of the data: data warehouse are only possible if codes corresponding to the same concept are the same • SDMX implementation: it is essential for the implementation of a SDMX data/metadata exchange process. • The ESS standard code lists will also be made available in the Euro SDMX Registry(currently Ramon)

  10. http://ec.europa.eu/eurostat/ramon

  11. Standard Code Lists in RAMON

  12. Standardisation of Reference Metadata

  13. Standardisation of reference metadata TheEuroSDMXMetadataStructure(ESMS)

  14. Standardisation of reference metadata TheESS Standard for Quality Reports Structure (ESQRS)

  15. Dissemination of reference metadata

  16. Dissemination of national reference metadata

  17. Metadata from the Metadata from the Eurostat as main Eurostat as main Input from Input from administrator administrator Eurostat domain manager Eurostat domain manager national metadata national metadata ESS ESS – – Metadata Handler Metadata Handler NRME EMIS EMIS NRME RAMON RAMON CODED Euro SDMX Euro SDMX Registry Registry CODED Domain specific non harmonized metadata (inserted from the Eurostat production databases) Common user Interface Common user Interface Output produced for Output produced for Other output for Eurostat Other output for Eurostat the Eurostat Web the Eurostat Web or external users or external users The ESS Metadata Handler

  18. The National Reference Metadata Editor (NRME)

  19. Impact on the statistical business processes ESS reference metadata standards are integrated into the National Reference Metadata Editor for production, exchange and dissemination of reference metadata in the ESS, allowing: + More AUTOMATIC PRODUCTION of the reference metadata in the ESS. + Information collected ONLY ONCE and reused (ESQRS -> ESMS; NSI->Eurostat; Eurostat-> IMF/OECD). + More harmonised and better availability of metadata on quality. + Full SDMX compliance (metadata creation, exchange and dissemination). + Cost and resources savings in the ESS.

  20. Questions? • SDMX Support Team • ESTAT-Support-SDMX@ec.europa.eu • SDMX Website • http://www.sdmx.org • Eurostat SDMX Info Space • https://webgate.ec.europa.eu/fpfis/mwikis/sdmx

More Related