Synchronize outbound metadata to Databricks Unity Catalog

Synchronizing outbound metadata via the Databricks Unity Catalog integration is the process of propagating attribute and property values from Collibra Platform to Databricks Unity Catalog. Once you have set up a mapping, outbound synchronization runs automatically every 5 minutes if there are outbound events to process.

You can configure the following mappings for outbound synchronization:

The outbound flow is supported for Database, Schema, Table, Database View, and Column assets. For tag mappings, if you leave the tag name or value blank, the next synchronization removes the tag from the asset in Databricks Unity Catalog. Average rating mapping is the exception. Removing the rating writes 0 instead of removing the tag because 0 is a valid rating.

Note Outbound synchronization is only supported for assets ingested through the Databricks Unity Catalog integration, and not for assets ingested through a JDBC data source using the scalable ingestion flow.

About Databricks tags

The integration supports mapping the following two types of tags to Databricks Unity Catalog:

Prerequisites

In your Collibra environment:

Steps

To configure an outbound mapping for Databricks Unity Catalog:

  1. On the main toolbar, click Products icon → Catalog.
    The Catalog homepage opens.
  2. Click Integrations.
    The Integrations page opens.
  3. Click the Integration configuration tab.
  4. In the Integration column, click the link for your Databricks Unity Catalog integration.
    The integration settings page opens.
  5. Select the Metadata outbound tab and then click Add configuration.
  6. Complete the fields as needed.
  7. FieldAction
    Collibra attribute to Databricks tag mappings

    Configure a tag mapping to send a Collibra attribute value to a Databricks Unity Catalog tag.

    To add an outbound tag mapping:

    1. In the Collibra attribute to Databricks tag mappings section, click Add tag mapping to add a new tag mapping.
    2.  In the Asset field, select the supported asset type to which you want to apply the tag mapping. If you do not specify an asset type, the tag mapping will apply to all applicable asset types by default.
    3. In the Attribute field, select the attribute whose value you want to send to Databricks Unity Catalog. Attributes with multiple values are also supported. Their selected values are combined into a single Databricks tag value joined with a semicolon (;). For example, Finance;HR;Legal.
    4. In the Tag key field, specify the value to be mapped in Databricks Unity Catalog for the selected attribute.

    For example, you map a Security Classification attribute to a security_classification tag in Databricks Unity Catalog. If you change the value from Sensitive to Confidential in Collibra, the next outbound synchronization updates the value of the tag in Databricks Unity Catalog.

    Note Attributes with a maximum cardinality greater than 1 are not supported for outbound tag mapping. Each value is stored as a separate attribute instance and propagated as a separate update, so only the most recently changed value is sent.

    Collibra property to Databricks property mappings

    Configure a property mapping to send a Collibra property value to a native Databricks object property. Only Description mapping to the Databricks description property is currently supported.

    To add an outbound property mapping:

    1. In the Collibra property to Databricks property mappings section, click Add Collibra property to Databricks property mapping to add a new property mapping.
    2. In the Asset field, select the supported asset type to which you want to apply the mapping. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Collibra property field, select the attribute whose value you want to send to Databricks Unity Catalog. Currently, only Description is available.
    4. In the Databricks property field, select the native Databricks object property to receive the value. Currently, only description is available.

    For example, your team maintains certified descriptions for finance tables in Collibra. You map the Description attribute on Databricks Unity Catalog Table assets to the corresponding Databricks Unity Catalog description property. When you update a Databricks table's description in Collibra, the next outbound synchronization updates the description value on the table in Databricks Unity Catalog.

    Collibra asset status to Databricks tag mappings (In preview)

    Configure a status mapping to send an asset's current status name to a Databricks tag. On each status change, the new status name is written. When you remove the status, the integration removes the tag.

    1. In the Collibra asset status to Databricks tag mappings section, click Add status mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Tag key field, specify the value to be mapped in Databricks Unity Catalog for the selected attribute.
    Collibra asset articulation score to Databricks tag mappings (In preview)

    Configure an articulation score mapping to send an asset's articulation score, a decimal from 0.0 to 100.0 (for example, 87.5), to a Databricks tag. The integration removes the tag when the score is removed.

    1. In the Collibra asset articulation score to Databricks tag mappings section, click Add articulation score mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Tag key field, specify the value to be mapped in Databricks Unity Catalog for the selected attribute.
    Collibra asset average rating to Databricks tag mappings (In preview)

    Configure an average rating mapping to send an asset's average rating to a Databricks tag. The average rating can be one of the following values: 0, 0.2, 0.4, 0.6, 0.8, or 1. If you remove the average rating in Collibra, the integration writes 0 to the tag. It does not remove the tag because 0 is a valid average rating.

    1. In the Collibra asset average rating to Databricks tag mappings section, click Add average rating mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Tag key field, specify the value to be mapped in Databricks Unity Catalog for the selected attribute.
    Collibra tag to Databricks tag mappings (In preview)

    Configure a tag mapping to send all Collibra tags on an asset to a Databricks tag as a single value, joined with semicolons (for example, PII;Sensitive). The value is replaced on each update. The integration removes the Databricks tag when the asset does not have any Collibra tags left.

    1. In the Collibra tag to Databricks tag mappings section, click Add tag mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Tag key field, specify the value to be mapped in Databricks Unity Catalog for the selected attribute.
    Collibra responsibility to Databricks tag mappings (In preview)

    Configure a responsibility mapping to send the owner of a responsibility to a Databricks tag as owner name:role name (for example, Jane Doe:Data Steward). The integration removes the tag when the responsibility is removed. If more than one owner holds the same role on the same asset, the tag shows the owner synced most recently, not a merged list.

    1. In the Collibra responsibility to Databricks tag mappings section, click Add responsibility mapping.
    2. In Asset, select the asset type the mapping applies to. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In Role, select the resource role.
    4. In the Tag key field, specify the value to be mapped in Databricks Unity Catalog for the selected attribute.
    Collibra data classification to Databricks tag mappings (In preview)

    Configure a data classification mapping to send the label of an accepted data classification match (for example, Confidential) to a Databricks tag. The integration removes the tag when the classification is removed.

    1. In the Collibra data classification to Databricks tag mappings section, click Add data classification mapping.
    2. In Asset, Column is selected by default. Data classification mapping applies to Column assets only.
    3. In Data classification, select the data classification.
    4. In the Tag key field, specify the value to be mapped in Databricks Unity Catalog for the selected attribute.
  8. Click Save.
    Outbound synchronization runs automatically every 5 minutes if there are outbound events to process.

What's next

The synchronization job synchronizes the Databricks Unity Catalog data.
After the outbound synchronization: