Create a Databricks Workspace connection
Tip You can set up this integration in the unified integrations experience (in preview). This feature is in public preview and applies to metadata, AI, SAP, and lineage integrations. In one guided flow, you select an Edge site, create the connection, add the integration, and configure it. To get started, in the banner on the Integration configuration tab, click Try the new Integrations page. For more information, go to About the unified integrations experience (in preview).
If you integrated Databricks Unity Catalog, you had created a Databricks Workspace connection. You can use the Databricks Workspace connection when you add a technical lineage for Databricks Unity Catalog. If you registered your Databricks file system by using the JDBC connection instead, use this information to create a Databricks connection.
Prerequisites
- If you want to add connection values from a vault, you have added the vault to your Edge site. If your data source connection requires a file from your vault, the file must be encoded into Base64 and stored as a regular secret in your vault. For more information, go to the Vault documentation.Note Vaults are not supported on Collibra Cloud sites.
Steps
- Open a site.
-
On the main toolbar, click
→
Settings.
The Settings page opens. -
In the tab pane, click Edge.
The Sites tab opens and shows a table with an overview of your sites. - In the site overview, click the name of a site.
The site page appears.
-
On the main toolbar, click
-
In the Connections section, click Create Connection and select Databricks Workspace in the Create Connection dialog box.
The Create Connection dialog box for Databricks Workspace opens. - Enter the required information.
Field Description Required Name The name of the Edge or Collibra Cloud site connection for Databricks.
YesDescription The description of the connection.
No
Vault The vault where you store your data source values.
No
Workspace URL Enter the URL of any Databricks workspace connected to Unity Catalog that you want to integrate.
To retrieve the URL, log into Databricks and copy the URL. For example:https://123.cloud.databricks.com.You can add this property from your vault. For more information, go to the vault documentation.
Yes
Authentication TypeSelect the type of authentication that you want to apply. You can select any of the following values:
- Personal Access Token
- OAuth
For information on OAuth-based authentication in Databricks Unity Catalog, go to the Databricks documentation. - Microsoft Entra ID
For information, go to Microsoft Entra service principal authentication in the Azure Databricks documentation. The Microsoft Entra ID authentication option supports Azure Public, Azure China, and Azure US Government. Azure Germany is not supported.
Yes
Access Token The security token that was generated in Databricks for the workspace. The access token must be a personal access token (PAT).
It is possible to generate a PAT for service principals. For information on the service principal token, go to the Databricks documentation.Note Ensure that your Databricks access token has been granted the required permissions in your Databricks environment.
You can add this property from your vault. For more information, go to the vault documentation.
Yes, if you select
Personal Access Tokenas the authentication type.Client IDThe client ID for OAuth-based authentication in Databricks, or the client ID of the Microsoft Entra ID service principal.
For information on OAuth-based authentication in Databricks Unity Catalog, go to the Databricks documentation.
For information on the Microsoft Entra ID service principal, go to Microsoft Entra service principal authentication in the Azure Databricks documentation.
Note Ensure that your Databricks OAuth client or Microsoft Entra ID service principal has been granted the required permissions in your Databricks environment.
Yes, if you select
OAuthorMicrosoft Entra IDas the authentication type.Client SecretThe client secret generated for the OAuth-based authentication on Databricks, or the client secret of the Microsoft Entra ID service principal.
Yes, if you selectOAuthorMicrosoft Entra IDas the authentication type.Tenant ID The Directory (tenant) ID for the related application registered in Microsoft Entra ID.
For information, go to Microsoft Entra service principal authentication in the Azure Databricks documentation.
Yes, if you select Microsoft Entra IDas the authentication type. - Click Create.
The connection is added to the Edge or Collibra Cloud site.
Add the Technical Lineage for Databricks Unity Catalog capability to your Edge or Collibra Cloud site.