Synchronize outbound metadata to Databricks Unity Catalog

Synchronizing outbound metadata via the Databricks Unity Catalog integration is the process of propagating attribute and property values from Collibra Platform to Databricks Unity Catalog. Once you have set up a mapping, outbound synchronization runs automatically every 5 minutes if there are outbound events to process.

The outbound flow is supported for Database, Schema, Table, Database View, and Column assets. If any tag name/value is left blank, the outbound synchronization will remove the tag from the asset in Databricks Unity Catalog. The integration supports mapping the following two types of tags to Databricks Unity Catalog:

Prerequisites

In your Collibra environment:

Steps

Manually synchronize Databricks Unity Catalog:

  1. On the main toolbar, click Products icon → Catalog.
    The Catalog homepage opens.
  2. Click Integrations.
    The Integrations page opens.
  3. Click the Integration configuration tab.
  4. In the Integration column, click the link for your Databricks Unity Catalog integration.
    The integration settings page opens.
  5. Select the Metadata outbound tab and then click Add configuration.
  6. Complete the fields as needed.
  7. FieldAction
    Tag mappings

    Configure a tag mapping to send a Collibra attribute value to a Databricks Unity Catalog tag.

    To add an outbound tag mapping:

    1. In the Tag mappings section, click Add tag mapping to add a new tag mapping.
    2.  In the Asset field, select the supported asset type to which you want to apply the tag mapping. If you do not specify an asset type, the tag mapping will apply to all applicable asset types by default.
    3. In the Attribute field, select the attribute whose value you want to send to Databricks Unity Catalog. Attributes with multiple values are also supported. Their selected values are combined into a single Databricks tag value joined with a semicolon (;). For example, Finance;HR;Legal.
    4. In the Tag key field, specify the value to be mapped in Databricks Unity Catalog for the selected attribute.

    For example, you map a Security Classification attribute to a security_classification tag in Databricks Unity Catalog. If you change the value from Sensitive to Confidential in Collibra, the next outbound synchronization updates the value of the tag in Databricks Unity Catalog.

    Note Attributes with a maximum cardinality greater than 1 are not supported for outbound tag mapping. Each value is stored as a separate attribute instance and propagated as a separate update, so only the most recently changed value is sent.

    Collibra property to Databricks property mappings (In preview)

    Configure a property mapping to send a Collibra property value to a native Databricks object property. Only Description mapping to the Databricks description property is currently supported.

    To add an outbound property mapping:

    1. In the Collibra property to Databricks property mappings (In preview) section, click Add Collibra property to Databricks property mapping to add a new property mapping.
    2. In the Asset field, select the supported asset type to which you want to apply the mapping. If you do not specify an asset type, the mapping applies to all applicable asset types by default.
    3. In the Collibra property field, select the attribute whose value you want to send to Databricks Unity Catalog. Currently, only Description is available.
    4. In the Databricks property field, select the native Databricks object property to receive the value. Currently, only description is available.

    For example, your team maintains certified descriptions for finance tables in Collibra. You map the Description attribute on Databricks Unity Catalog Table assets to the corresponding Databricks Unity Catalog COMMENT property. When you update a Databricks table's description in Collibra, the next outbound synchronization updates the description value on the table in Databricks Unity Catalog.

  8. Click Save.
    Outbound synchronization runs automatically every 5 minutes if there are outbound events to process.

What's next

The synchronization job synchronizes the Databricks Unity Catalog data.
After the outbound synchronization: