The Data Quality Module in EQuIS Professional
The Data Quality Module (DQM) in EQuIS Professional improves data integrity by providing configurable data quality checks. Building on feedback from previous discussions at EDMC, DQM allows users to create and customize a library of checks tailored to their needs. Each check consists of rules to assess data quality, enabling users to save qualifiers back into the DT_RESULT table. As a new add-on module from EarthSoft, DQM enhances the Qualification report, allowing for selections based on criteria like COC and MAG/QAPP for effective data quality management.
The Data Quality Module in EQuIS Professional
E N D
Presentation Transcript
The Data Quality Module in EQuIS Professional EDMC- May 15, 2012 Emily Mulford
Overview • Last year’s discussion at EDMC and other input over the years inspired development of the Data Quality Module (DQM) for EQuIS Professional • Initially based on the DQM from EQuIS 3, the new DQM has been developed as a framework for data quality checks.
The Goal of DQM… • To have a library of DQM checks that can be configured. • EarthSoft will create a library, but DQM users may also build their own checks (or customize existing checks) to add to the library • Choose which checks to include every time you run the Qualification report • The qualifiers can be saved back to the data in the DT_RESULT table.
The DQM will be a separate add-on module that can be purchased from EarthSoft. • The entire library will be included, and the user may determine which checks they would like to configure and use. • Requires a schema addition and a separate .dll
DQM Terminology • A check has one or more rules • A rule is a reason code, remark and a qualifier that should be applied when the rule is violated. • Each result may have many violations. RT_QUALIFIER.DQM_CHECK_RANK will determine which qualifier is applied to the results.
Library of Checks • Estimated Results • Blank Contaminations • Holding Times **Each check may have one or more rules
The Qualification Report • Qualify By- COC, Field SDG, Lab SDG, or Task • Qualify- Choose one or more criteria that contain results, based upon the “Qualify By” selection • MAG/QAPP- Must choose one or more MAGs or QAPPs to compare to the checks. • Checks- May select multiple checks • Save Qualifiers- Save the qualifiers applied in the report back to DT_RESULT