Edit global data source registration settings

In Collibra Platform, you can create a data profile when you register a data source.You can configure global settings of data source registration.

Depending on your environment, follow this procedure either in Collibra Console or on the Services Configuration tab of the Collibra settings:

Important You can't edit the service configuration from the Settings page in the latest UI. If you use the latest UI, you can edit the service configuration only in Collibra Console. For more information, go to DGC service configuration settings.

Prerequisites

Steps

  1. Open the Services Configuration tab:
    1. On the main toolbar, click Products icon → Cogwheel icon Settings.
      The Settings page opens.
    2. Click Services Configuration.
    3. Click Edit configuration.
    Open the DGC service settings for editing:
    1. Open Collibra Console.
      Collibra Console opens with the Infrastructure page.
    2. In the tab pane, expand an environment to show its services.
    3. In the tab pane, click the Data Governance Center service of that environment.
    4. Click Configuration.
    5. Click Edit configuration.
  2. In the section Register data source, make the necessary changes.
    SettingDescription
    Table types to ignoreA comma separated list of table types that are not ingested. For example, INDEX and SEQUENCE.

    AWS regions restriction

    A list of AWS regions Data Catalog is allowed to connect to. For example, eu-west-3 and us-east-2. For a list of all AWS locations, see the AWS documentation.

    • If you want to allow Collibra to make a connection to any AWS region, leave the field empty.
    • If you remove a region from this list and the region was previously used for an S3 integration, you may want to delete the Glue database from the previously used region manually. By default, Collibra does not remove it. The Glue database has the following naming convention: collibra_catalog_<Asset Id>_<Domain Id>
      For example: collibra_catalog_d3174a88-5ffe-4d50-8fbe-7bf0832ec3af_5d198ce9-4e56-4d0e-a885-58204da50741
    • When using Edge, a warning is added to the logs if an invalid region is detected in the restricted regions list.
    AWS API call rate

    Allowed number of AWS API calls per second.

    Use this option to limit the number of API calls per second to prevent throttling errors from the AWS API.

    Database registration via Edge

    An option to enable database registration via Edge.

    • True: Register a data source via Edge.
    • False: Register a data source via Jobserver only.

    Note Enabling data source registration via Edge does not prevent you from registering a data source via Jobserver as well.

    Data Quality & Observability Classic Synchronization UI via DQ Connector on Edge

    An option to enable the Data Quality extraction interface in Collibra

    • True: The Quality extraction tab is available on the configuration page of a database asset
    • False (default): The Quality extraction tab is not available and as such, it is not possible to extract and synchronize data quality information.

    You can only enable Data Quality & Observability Classic synchronization if you also enabled Database registration via Edge.

    Maximum number of concurrent Edge jobs

    This setting specifies the maximum number of Edge jobs that can run simultaneously to connect to a data source, update a schema list, or synchronize a schema. If the maximum number is reached, subsequent jobs are queued.
    The default value is 10. You can enter a value from 1 to 20.
    This setting applies only to JDBC data sources.

    Maximum number of ingestion rules

    The setting specifies the maximum number of synchronization rules that can be defined per schema.
    The default value is 10. You can enter a value from 10 to 200.
    This setting applies only to JDBC data sources.

  3. Click Save all.