Data source-specific permissions

To run data quality on a data source, the Edge connection must have the minimum permissions described below.

Important 

Permissions by data source

The following sections list the minimum required permissions for each supported data source, organized by capability. Permissions are listed separately for Structural Metadata Ingestion, Data Quality Pullup Processing and Data Quality Pushdown Processing, and archive break records.

Note Archive break records permissions currently apply to Data Quality Pushdown Processing connections only.

Amazon Athena

Structural Metadata Ingestion

No additional permissions required.

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

Amazon Redshift

Structural Metadata Ingestion

The service account user must have:

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

Apache Hive

Structural Metadata Ingestion

The service account user must have:

Data Quality Pullup Processing

The service account user must have:

Azure Synapse

Structural Metadata Ingestion

The service account user must have:

Data Quality Pullup Processing

The service account user must have:

Databricks

Structural Metadata Ingestion

The service account user must have:

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

Db2

Structural Metadata Ingestion

The service account user must have:

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Denodo

Structural Metadata Ingestion

No additional permissions required.

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Google BigQuery

Structural Metadata Ingestion

The service account user must have:

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

Microsoft SQL Server

Structural Metadata Ingestion

The service account user must have:

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

MySQL

Structural Metadata Ingestion

The service account user must have:

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Oracle OCI

Structural Metadata Ingestion

No additional permissions required.

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

Oracle (Thin client-side)

Structural Metadata Ingestion

No additional permissions required.

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

PostgreSQL

Structural Metadata Ingestion

No additional permissions required.

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Presto

Structural Metadata Ingestion

No additional permissions required.

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

Salesforce

Structural Metadata Ingestion

The service account user must have:

Data Quality Pullup Processing

The service account user must have:

SAP HANA

Structural Metadata Ingestion

The service account user must have:

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

Snowflake

Structural Metadata Ingestion

The service account user must have:

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

Starburst

Structural Metadata Ingestion

No additional permissions required.

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

Sybase

Structural Metadata Ingestion

No additional permissions required.

Data Quality Pullup Processing

The service account user must have:

Teradata

Structural Metadata Ingestion

No additional permissions required.

Data Quality Pullup Processing

The service account user must have:

Trino

Structural Metadata Ingestion

No additional permissions required.

Data Quality Pullup Processing and Data Quality Pushdown Processing

The service account user must have:

Archive break records

When using archive break records, the service account user must have:

Note Unlike other Pushdown data sources, Trino connections require you to create COLLIBRA_DQ_RULES and COLLIBRA_DQ_BREAK_RECORDS manually in your source system before enabling archive break records. Collibra cannot create these objects automatically because DDL syntax and data types vary across Trino-connected platforms. Additionally, some Trino connectors, such as the BigQuery connector, do not support creating views through Trino. In those cases, create the view directly in the underlying platform.

Show setup instructions and examples
  1. Create the COLLIBRA_DQ_RULES table using the DDL for your platform. Example for BigQuery:

  2. Copy
    CREATE TABLE `<catalog>`.`<schema>`.`COLLIBRA_DQ_RULES` (
                                    seqno      BIGINT,
                                    updts      TIMESTAMP(6),
                                    job_uuid   VARCHAR,
                                    dataset    VARCHAR,
                                    run_id     TIMESTAMP(6),
                                    rule_name  VARCHAR,
                                    link_id    VARCHAR,
                                    results    VARCHAR
                            )
  3. Create the COLLIBRA_DQ_BREAK_RECORDS view. Because the Trino BigQuery connector does not support creating views through Trino, create this view directly in BigQuery (not through Trino). Example:


  4. Copy
    CREATE VIEW `<catalog>`.`<schema>`.`collibra_dq_break_records`
                                    AS SELECT
                                    dataset    AS job_name,
                                    job_uuid   AS run_uuid,
                                    run_id     AS run_date,
                                    updts      AS updt_ts,
                                    'Rules'    AS monitor_type,
                                    rule_name  AS monitor_name,
                                    CONCAT('Rule violation for "', rule_name, '"') AS description,
                                    CONCAT('{"metadata":{"rule_name":"', rule_name, '"},"results":', TO_JSON_STRING(results), '}') AS details
            FROM `<catalog>`.`<schema>`.`COLLIBRA_DQ_BREAK_RULES`;