1 / 7

Exploring Techniques of Data Quality and Profiling

What Is Data Profiling? What Are Some of Data Profiling Techniques? How To Monitor Your Data?. Exploring Techniques of Data Quality and Profiling. iWay DQC and iDP. Kam Wong Solutions Architect. April 20, 2012. What Is Data Profiling?.

filia
Télécharger la présentation

Exploring Techniques of Data Quality and Profiling

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. What Is Data Profiling? What Are Some of Data Profiling Techniques? How To Monitor Your Data? Exploring Techniques of Data Quality and Profiling iWay DQC and iDP Kam Wong Solutions Architect April 20, 2012

  2. What Is Data Profiling? • Data profiling is about knowing your data • It discovers relationship between data elements, whether they are in the same data source or across multiple, heterogeneous data sources. • It performs statistical analysis against individual columns (as in relational database) discovering such things as the number of null values, patterns, whether the data matches the expected data type and so on.

  3. What Are Some Of Data Profiling Techniques? • Profiling – Technical • Basic Analysis • Minimums • Maximums • Averages • Counts • Etc. • Patterns / Masking • Domain • Extremes • Quantities • Frequency Analysis • Foreign Key Analysis • Charting • Grouping / Aggregate • Drilldown / Interactive Displays

  4. How To Monitor Your Data? • View Profiles • Compare data quality over time – trend analysis • Monitor data quality index based on business rules

  5. iWay Data Quality Management Life-Cycle

  6. Demonstration

  7. Thank-You

More Related