Data Quality Gates
Data quality gates provide process-level validation within customer data and identity resolution workflows, ensuring the integrity of data used in your first-party identity graph. Data quality gates can validate the data preparation, resolution, and export processes of your workflows, detect any issues, halt the workflow at any process that needs further review, and provide an error message in the process indicating any data quality problems.
You can review data quality failures in the Data Quality Gate Overview page and have the option to override the data quality gates and resume the workflow.
Default Data Quality Gates
Default data quality gates are available for data preparation, resolution, and export processes. The following table lists the default data quality gates.
Note
Data quality gate thresholds are currently not configurable. Default thresholds are indicated below.
Data Quality Gate | Name in Data Quality Gate Overview Table | Description |
|---|---|---|
Volume Change | volumechange | Checks if the number of values added or removed in the current workflow process run when compared to the previous is under a specified threshold. Default threshold is 0.5% |
Mandatory | mandatory | Checks if required fields are populated. |
Uniqueness | uniqueness | Checks if specific fields are unique in the dataset. |
Uniqueness by Group | uniquenessByGroup | Checks if a specific group of fields is unique in the dataset. |