Synchronize outbound metadata via the Google Knowledge Catalog integration

Synchronizing outbound metadata via the Google Knowledge Catalog (formerly Dataplex Universal Catalog) integration is the process of pushing enriched metadata from Collibra to Knowledge Catalog. You can only synchronize manually. Once you have set it up, outbound synchronization runs automatically every 5 minutes if there are outbound events to process.

Any attribute changes in Collibra Platform are reflected for all supported asset types in the Knowledge Catalog integration. This includes Schema, Table, Database View, and Column assets.

    Note 
  • Outbound synchronization is only supported for assets ingested through the Knowledge Catalog integration, and not for assets ingested through a JDBC data source using the scalable ingestion flow.
  • Attributes with a maximum cardinality greater than 1 are not supported for outbound aspect mapping. Each value is stored as a separate attribute instance, so only the most recently changed value is sent.
  • Outbound synchronization is currently not supported for Cloud SQL assets. It may be supported in a future release.

Prerequisites

In your Collibra environment:

  • When you created the GCP connection, you set the necessary permissions in Knowledge Catalog for outbound synchronization.
  • You have integrated metadata from Knowledge Catalog to Collibra Platform.
  • You have manually created custom aspects in Knowledge Catalog. Outbound synchronization attaches them to the relevant entry automatically if they aren't already attached.

Steps

Manually synchronize Knowledge Catalog:

  1. On the main toolbar, click Products icon → Catalog.
    The Catalog homepage opens.
  2. Click Integrations.
    The Integrations page opens.
  3. Click the Integration configuration tab.
  4. In the Integration column, click the link for your Knowledge Catalog integration.
    The integration settings page opens.
  5. Select the Metadata outbound tab and then click Add configuration.
  6. Complete the fields as needed.
    FieldAction
    Collibra attribute to Knowledge Catalog aspect field mappings

    Configure an aspect field mapping to send a Collibra attribute value to a Knowledge Catalog aspect field.

    To add an outbound aspect field mapping:

    1. In the Collibra attribute to Knowledge Catalog aspect field mappings section, click Add aspect field mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Attribute field, select the attribute whose value you want to send to Knowledge Catalog.
    4. In the Aspect field field, select the aspect and field path, in the format projectid.location.aspectName>fieldPath. For example, xxxxxxxx.europe-west4.custom-aspect>custom_field1.
    Collibra property to BigQuery property mappings (In preview)

    Configure a Collibra property to a native property on the matching BigQuery object, for example, an asset's Description to a BigQuery description. This is available only for BigQuery-backed entries. Note that removing a value in Collibra does not remove the native property in BigQuery.

    To add an outbound property mapping:

    1. In the Collibra property to BigQuery property mappings section, click Add Collibra property to BigQuery property mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Collibra property field, select the property whose value you want to send. Currently, only Description is available.
    4. In the BigQuery property field, select the native BigQuery property to receive the value. Currently, only Description is available. Note that rich-text values are written as plain text.
    Collibra asset status to Knowledge Catalog aspect field mappings (In preview)

    Configure a status mapping to send an asset's current status name to a Knowledge Catalog aspect field. On each status change, the new status name is written. When you remove the status, the integration removes the aspect field value.

    1. In the Collibra asset status to Knowledge Catalog aspect field mappings section, click Add status mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Aspect field field, select the aspect and field path, in the format projectid.location.aspectName>fieldPath.
    Collibra asset articulation score to Knowledge Catalog aspect field mappings (In preview)

    Configure an articulation score mapping to send an asset's articulation score, a decimal from 0.0 to 100.0 (for example, 87.5), to a Knowledge Catalog aspect field. The integration removes the aspect field value when the score is removed.

    1. In the Collibra asset articulation score to Knowledge Catalog aspect field mappings section, click Add articulation score mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Aspect field field, select the aspect and field path, in the format projectid.location.aspectName>fieldPath.
    Collibra asset average rating to Knowledge Catalog aspect field mappings (In preview)

    Configure an average rating mapping to send an asset's average rating, a decimal from 0.0 to 1.0 (for example, 0.8), to a Knowledge Catalog aspect field. The integration removes the aspect field value when the rating is removed.

    1. In the Collibra asset average rating to Knowledge Catalog aspect field mappings section, click Add average rating mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Aspect field field, select the aspect and field path, in the format projectid.location.aspectName>fieldPath.
    Collibra tag to Knowledge Catalog aspect field mappings (In preview)

    Configure a tag mapping to send all Collibra tags on an asset to a Knowledge Catalog aspect field as a single value, joined with semicolons (for example, PII;Sensitive). The value is replaced on each update. The integration removes the aspect field value when the asset no longer has any Collibra tags left.

    1. In the Collibra tag to Knowledge Catalog aspect field mappings section, click Add tag mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Aspect field field, select the aspect and field path, in the format projectid.location.aspectName>fieldPath.
    Collibra responsibility to Knowledge Catalog aspect field mappings (In preview)

    Configure a responsibility mapping to send the owner of a responsibility to a Knowledge Catalog aspect field as owner name:role name (for example, Jane Doe:Data Steward). The integration removes the aspect field value when the responsibility is removed. If more than one owner holds the same role on the same asset, the aspect field shows the owner synced most recently.

    1. In the Collibra responsibility to Knowledge Catalog aspect field mappings section, click Add responsibility mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In Role, select the resource role.
    4. In the Aspect field field, select the aspect and field path, in the format projectid.location.aspectName>fieldPath.
    Collibra data classification to Knowledge Catalog aspect field mappings (In preview)

    Configure a data classification mapping to send the label of an accepted data classification match (for example, Confidential) to a Knowledge Catalog aspect field. The integration removes the aspect field value when the classification is removed.

    1. In the Collibra data classification to Knowledge Catalog aspect field mappings section, click Add data classification mapping.
    2. In Asset, Column is selected by default. Data classification mapping applies to Column assets only.
    3. In Data classification, select the data classification.
    4. In the Aspect field field, select the aspect and field path, in the format projectid.location.aspectName>fieldPath.
  7. Click Save.
    Outbound synchronization runs automatically every 5 minutes if there are outbound events to process.

What's next

The synchronization job synchronizes the Knowledge Catalog data.
After the synchronization: