1 / 27

GIS Data Quality Evaluator Version 5.0

DataQE. GIS Data Quality Evaluator Version 5.0. DataLOGIC Corporation 72 Dartmouth Avenue Avondale Estates, GA 30002 404-289-4050 www.datalogic-systems.com. DataLOGIC, Inc. Overview. Concepts Types of QA Checks Performed Evaluation Process Future Development. What is DataQE?.

jesimae
Télécharger la présentation

GIS Data Quality Evaluator Version 5.0

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. DataQE GIS Data Quality EvaluatorVersion 5.0 DataLOGIC Corporation 72 Dartmouth Avenue Avondale Estates, GA 30002 404-289-4050 www.datalogic-systems.com DataLOGIC, Inc.

  2. Overview • Concepts • Types of QA Checks Performed • Evaluation Process • Future Development DataQE – Data Quality Evaluator • 1

  3. What is DataQE? • GIS Data Quality Evaluation Tool • Evaluations based on user-specified rules • Focuses on evaluations of attribute fields and values • Includes: • Layer Checks • Data Structure Checks • Field Checks • Query Checks DataQE – Data Quality Evaluator • 2

  4. What Can You Evaluate with DataQE? Compliance • Is data compliant with established standards, such as a Data Dictionary? Completeness • Has required data been appropriately populated? Suitability • Is a data source appropriate for a given purpose? • Does data make sense from a real-world perspective? DataQE – Data Quality Evaluator • 3

  5. Who Can Use DataQE? • Anyone who needs to evaluate the quality or suitability of a GIS data layer or tabular data • Data Entry Staff • Data Migration Specialists • GIS Managers • Quality Assurance Staff • Analysts DataQE – Data Quality Evaluator • 4

  6. Requirements • ESRI ArcMap 9.3 or higher • Windows 7, Vista or XP • Operates in Desktop (Single User) or Enterprise (Multi-User) environments, including Citrix • Supports the following Data Formats: • Geodatabases (SDE, File, Personal) • Shapefiles/Coverages/CAD Files • Tables (SQL, Oracle, Access, Excel, DBF, CSV) DataQE – Data Quality Evaluator • 5

  7. The Data Evaluation Process • Create Rule Sets containing the rules your data should follow • Assign a Rule Set to the data source being evaluated • Launch an Evaluation of the data source using the selected Rule Set • View Evaluation Results and identify data errors • Correct any errors as necessary using ArcMap or other editing tools • Re-evaluate as necessary DataQE – Data Quality Evaluator • 6

  8. Layer Checks Verify commonly used properties within a spatial data source. • Data Source/File Name Check • Verifies that the name of the evaluated data source name matches a list of valid names • Layer Type Check • Verifies that the layer type of the evaluated data source matches specified requirements (GDB vs. Shapefile vs. Coverage, etc.) • Projection Check • Verifies that a layer’s current projection matches established projection requirements DataQE – Data Quality Evaluator • 7

  9. Data Structure Checks Verify that a data source’s field structure matches appropriate requirements. • Field Exists Check • Verifies that required fields exist in the data source being evaluated • Field Type Check • Verifies that each field is the correct type (Text, Date, etc.) • Field Width Check • Verifies that each field is the correct width DataQE – Data Quality Evaluator • 8

  10. Field Checks Verify that attribute values within a field match established standards. • Required Value Check • Verifies that each record in a field contains a value • Unique Value Check • Verifies that each record in a field contains a unique value • List of Values (LOV) Check • Verifies that each record in a field contains a value that matches a specified list of values (domain) • Valid Range Check • Verifies that each record in a numeric field contains a value that falls within a specified range DataQE – Data Quality Evaluator • 9

  11. Query Checks User-defined rules based on customizable queries. • Used to perform in-depth evaluations of a data source • Query Rules can be created using the DataQE Query Builder, or copied from existing ArcMap or database queries • Allows queries to be stored permanently in Rule Sets • Can be used to expand basic compliance evaluations to determine whether data meets established Business Rules • Can be used by analysts to evaluate whether data is appropriate for a particular purpose • Can be used to validate whether data “makes sense”, as opposed to simply meeting data dictionary standards DataQE – Data Quality Evaluator • 10

  12. Data Quality Evaluator Window • View Rule Set Assignments and properties • Review Evaluation Results • Used to perform evaluations of selected data sources DataQE – Data Quality Evaluator • 11

  13. Data Sources Window Rule Set Explorer Results Window Data Quality Evaluator

  14. Rule Set Editor • Create Rule Sets • Add/Edit rules within a Rule Set • Rule Sets can be published and shared between multiple users Used for managing and editing Rule Sets DataQE – Data Quality Evaluator • 13

  15. Rule Set Explorer Properties Window Rule Set Editor – Properties Window

  16. Rule Set Explorer Layer Rules Rule Set Editor – Layer Rule Properties

  17. Rule Set Explorer Field Rule Properties Rule Set Editor – Field Rule Properties

  18. Rule Set Explorer Field Rules Grid Rule Set Editor – Field Rules Grid

  19. Query Rule Properties • Allow users to build custom Query Rules. • Query Rule Properties tab helps users build a query statement that can be used to evaluate a field or combination of fields. DataQE – Data Quality Evaluator • 18

  20. Rule Set Explorer Query Rule Properties Rule Set Editor – Query Rule Properties

  21. List of Values • Create new LOV’s • Add/Edit Values within an LOV • Assign LOV’s to Rule Sets on the Field Rule Properties and the Field Rules Grid tabs. Used for managing and editing Lists of Values (LOV’s) for Domain Checks DataQE – Data Quality Evaluator • 20

  22. Valid Values Rule Set Editor – List of Values Rule Set Explorer

  23. Create LOV’s from Existing Data • Create new LOV’s based on unique field values. • Specify a field for the LOV value and another field for the LOV description. Use data from the current ArcMap session or browse for spatial or tabular data. DataQE – Data Quality Evaluator • 22

  24. Create LOV’s from Existing Data

  25. Evaluation Manager • Allows creation of Evaluations with pre-assigned properties • Easy selection of Data Sources and Rule Sets • Evaluation Definitions can be stored & shared • Allows definitions to be saved and performed at any time, individually or in batches Used to manage and edit predefined Evaluation Definitions to support batch processing DataQE – Data Quality Evaluator • 24

  26. Properties Window Evaluation Definitions Window Evaluation Manager

  27. Future Development Coming in future versions of DataQE: • Associated Tables/Orphan Records Check • Metadata Check • User Definable Field Rules • Business Logic Check • Spatial Overlay Check DataQE – Data Quality Evaluator • 26

More Related