Collibra DQ Integrations allow DQ admin users to synchronize metadata from Collibra Data Quality & Observability into Collibra Data Intelligence Platform. You can use the Integration Configuration wizard for a guided mapping of objects between Collibra DQ and Collibra Data Intelligence Platform in only a few clicks. When you integrate Collibra DQ metadata into Collibra Data Intelligence Platform, relations between your DQ rules and the tables and columns they govern are automatically established.
By using the Integrations page, you can achieve the following benefits:
- Broader data sharing between platforms to include not only user defined rules but also adaptive rules, shapes, schema, source, record, pattern, outlier, and duplicate findings along with their scores.
- Automated synchronization between integrated platforms based on job execution and job scheduling.
- Simplified configuration and maintenance of the integration.
Prerequisites
- Your Collibra DQ version is 2023.07 or later and Collibra Data Intelligence Platform version is 2023.05 or later.
- You have an Admin role in Collibra Data Quality & Observability to use the configuration wizard.
- You have an Admin or Dataset Manager role in Collibra Data Quality & Observability to enable or disable individual datasets for integration.
- Your Collibra Data Intelligence Platform profile must have Sysadmin and DataSteward global roles to manage all assets and objects of the integration.
- You have an aggregation path set for your Data Quality Rule in Collibra Data Intelligence Platform
Settings Operating model Data quality rules. - React MUI is turned on.
Integrations
From the Integrations page in the Admin Console, you can add and manage integrations between Collibra Data Quality & Observability and Collibra Data Intelligence Platform. You can conveniently switch integrations between Collibra DQ and Collibra Data Intelligence Platform instances on and off, and find an overview of the status of all datasets with an attempted or completed integration.
The following table describes each column of the dataset integration status table on the Integrations page.
| Column | Description |
|---|---|
| Dataset | The name of the Collibra DQ dataset whose metadata integrated into Collibra Data Intelligence Platform. |
| Last Update | The timestamp of the most recent integration of a given dataset in date-time format. For example, 2023-07-24T11:12:35.461612. |
| Last Run Status | The last job run of your dataset. |
| Last Integration Status | The status of the last attempt to send metadata to Collibra Data Intelligence Platform. |
| Integration Status | The current status of the integration of your dataset. |
| Created By | The username of the user who integrated a dataset. |
| Active | Shows whether a dataset can actively integrate into Collibra Data Intelligence Platform. |
Known limitations
- Users who manually add, integrate, or ingest data quality rules from data quality solutions outside of Collibra DQ cannot use the Quality tab in Collibra Data Intelligence Platform. This is because the new DQ services in the latest Collibra Data Intelligence Platform user interface (UI) aggregates the Data Quality asset differently than the stats service did in the classic UI. Aggregation for Table Data Quality initiates the Data Quality Job asset that is created as part of the integration with Collibra DQ. Aggregation for Column Data Quality initiates the Data Quality Rules in the DQ services tables rather than the Data Quality Rules in the Knowledge Graph.
- Because data quality for Table assets in Collibra Data Intelligence Platform is calculated based on the Data Quality Job asset, the data quality dimension cards are not visible on the Quality tab because the relation to DQ dimensions does not exist on DQ Job assets.
- Rows Passed/Rows Failed do not populate on the integration.
- Rules nested under the Data Quality Job are not visible on the Table asset.