About the Databricks Unity Catalog integration via Edge

Important 

In Collibra 2024.05, we launched a new user interface (UI) for Collibra Platform! You can learn more about this latest UI in the UI overview.

Use the following options to see the documentation in the latest UI or in the previous, classic UI:

Databricks Unity Catalog is a technical catalog on Databricks side that provides schema information for all the Databricks databases that are available in the connected Databricks instances.

If you integrate Databricks Unity Catalog, you can integrate the metadata of all or multiple databases in the Databricks Unity Catalog metastore into Collibra Platform. The resulting assets represent the Databricks databases, schemas, tables and columns.

Important This is the preferred way of working with Databricks Unity Catalog because it shows the hierarchy of the assets and allows you to setup sampling, profiling, and classification (beta).
If you used a combination of integrating Databricks Unity Catalog and registering an individual Databricks database via the Databricks JDBC driver before, and you want to switch to using the integration only, go to Switching to working exclusively with the Databricks Unity Catalog integration (beta).

Important Because we only integrate the metadata, you cannot get sample data for the columns and tables, nor profile and classify them. If you want to do that, you need to register the Databricks database via the Databricks JDBC driver. For information, go to combining the integration and the JDBC driver.

Note 
  • The Databricks Unity Catalog integration supports the integration of following tables: EXTERNAL, MANAGED, STREAMING_TABLE, and VIEW tables.
  • You can integrate Databricks Unity Catalog only via Edge.
Tip You can also integrate Databricks AI models. To do so, make sure to set up your connection permissions and define the required configuration. For the best AI integration experience and functionality, make sure to enable AI Governance. If you don't enable AI Governance, the AI integration functionality is limited.

Helpful resources

Follow the Databricks Unity Catalog integration course on Collibra University.

For more information about Databricks, go to the Databricks documentation.