210 likes | 347 Vues
This presentation delves into the intricacies of metadata management within the ILOSTAT system, highlighting its alignment with the Generic Statistical Business Process Model (GSBPM). It covers various types of metadata, including technical, structural, and quality metadata, and discusses the processes of data collection, cleaning, dissemination, and workflow control. The session aims to equip participants with a comprehensive understanding of how metadata underpins effective data governance, ensuring high-quality statistics that support informed decision-making. A Q&A session will follow, inviting engagement from attendees.
E N D
DEALING WITH METADATA .IN ILOSTAT ILO Department of Statistics Edgardo Greising greising@ilo.org
DEALING WITH METADATA(s) IN ILOSTAT ILO Department of Statistics Edgardo Greising greising@ilo.org
Agenda • Introduction • ILOSTAT and GSBPM • Types of Metadata • ILOSTAT Metadata • Summary
Introduction • ILOSTAT, new Statistical Information System • New data collection approach • New application • Standards based • Metadata driven
ILOSTAT and GSBPM • ILOSTAT modules • Data collection • Data cleaning process • Data dissemination • Workflow control • Metadata
ILOSTAT and GSBPM • GSBPM phases • 1. Specify needs • 2. Design • 3. Build • 4. Collect • 5. Process • 6. Analyse • 7. Disseminate • 8. Archive • 9. Evaluate • Overarching processes: • Quality management • Metadata management • …
ILOSTAT and GSBPM • ILOSTAT Compliance
Types of Metadata • Metadata classification
ILOSTAT Metadata • Technical metadata • System’s parameters • Govern automatic updates and scheduled batch processes • Data Collection • Structural validation of data collection instruments • User Access Control • Roles, credentials, access rights, etc. • Process • Consistency rules • Formulas for calculated indicators • Dissemination website • Context information: language, country, subject
ILOSTAT Metadata • Process metadata • ILOSTAT’s workflow • Information used by: • Country Specialists: to manage data collection activities • Supervisors: to have real time information about the amount and quality of the data compiled • Applications: to drive the data workflow
ILOSTAT Metadata • Structural metadata Business Structural metadata • The “heart” of the metadata driven system. • code lists for all the concepts in use • definition of all the artefacts used for • data collection: questionnaires, DSD’s, etc. • Dissemination: tables, charts, navigation menus, etc. • Stored in a single metadata repository • Shared by all the modules • Single point of maintenance
ILOSTAT Metadata • Statistical metacontent Business Reference metadata Descriptive metadata Statistical metacontent • Typical “data about data”. • Two classes of metacontent: • Observation value status: sometimes called flag • Notes: controlled vocabulary, coded at collection time • Cleaning module • Checking for mandatory and contradictory notes • Dissemination module • Table metadata, flags and footnotes • Consolidation of footnotes at display time
Labeled stuff Unlabeled stuff The bean example is taken from: A Manager’s Introduction to Adobe eXtensible Metadata Platform, http://www.adobe.com/products/xmp/pdfs/whitepaper.pdf Why is this metadata relevant?
ILOSTAT Metadata • Statistical metacontent Business Reference metadata Descriptive metadata Statistical metacontent • Typical “data about data”. • Two classes of metacontent: • Observation value status: sometimes called flag • Notes: controlled vocabulary, coded at collection time • Cleaning module • Checking for mandatory and contradictory notes • Dissemination module • Table metadata, flags and footnotes • Consolidation of footnotes at display time
ILOSTAT Metadata • Methodological metadata Business Reference metadata Descriptive metadata Methodological metadata • Methodology used for primary data collection and processing • “Source & Methods” • connected to the series by the “survey” key • collects and disseminates the information in DDI 2.x
ILOSTAT Metadata • Quality metadata Business Reference metadata Descriptive metadata Quality metadata • Stored in the Workflow tables • Provides information about the quality of the data • Ex.: After consistency checking data status can be “Error”, “Ready for dissemination” or “Ready by allowance”. • Additional quality related information attached as comments
ILOSTAT Metadata • External resources Business Reference metadata External resources • Artefacts and documents related to the studies • Questionnaires • Methodological guidelines • Maps • Full study metadata in DDI and microdata files will be available from the ILO Central MicrodataRepository
Questions? E-mail:greising@ilo.org Skype:egreising Twitter: egreising LinkedIn: http://www.linkedin.com/in/egreising
Thank you! E-mail:greising@ilo.org Skype:egreising Twitter: egreising LinkedIn: http://www.linkedin.com/in/egreising
Application development • Knowing how it goes. Qtable (country + indic + survey) E-mail (country + user)