Create a dbt connection
Tip You can set up this integration in the unified integrations experience (in preview). This feature is in public preview and applies to metadata, AI, SAP, and lineage integrations. In one guided flow, you select an Edge site, create the connection, add the integration, and configure it. To get started, in the banner on the Integration configuration tab, click Try the new Integrations page. For more information, go to About the unified integrations experience (in preview).
For CollibraData Lineage to connect to and retrieve metadata from dbt Cloud, create a dbt connection.
Before you begin
- Create an Edge site on K3S.
- If you want to add connection values from a vault, you have added the vault to your Edge site. If your data source connection requires a file from your vault, the file must be encoded into Base64 and stored as a regular secret in your vault. For more information, go to the Vault documentation.Note Vaults are not supported on Collibra Cloud sites.
Prerequisites
- You have a global role with the Product Rights > System administration global permission.
- You have a global role that has the Manage Edge sites global permission.
Steps
- Open a site.
-
On the main toolbar, click
→
Settings.
The Settings page opens. -
In the tab pane, click Edge.
The Sites tab opens and shows a table with an overview of your sites. - In the site overview, click the name of a site.
The site page appears.
-
On the main toolbar, click
-
In the Connections section, click Create Connection.
The Create Connection dialog box appears. - Select dbt connection.
- Enter the connection information.
Field Description Required Name
The name of the connection.
Yes
Description
The description of the connection. This field is also visible when you register content.
No
Vault The vault where you store your data source values.
No
Admin URL
The endpoint of the dbt Cloud Administrative API that Collibra Data Lineage uses to download job artifacts. This is typically the Access URL associated with your dbt Cloud account.
How to locate the Access URL in dbt Cloud:- Log in to your dbt Cloud account. Ensure you have Owner or Member group permissions.
- Navigate to Account Settings.
- In the Access URLs section, look for the Access URL field.
The default value for this field is
https://cloud.getdbt.com/api/v2. This value applies only to the North America multi-tenant region. For more information, go to dbt Cloud API v2 in the dbt documentation.This field is used only if you do not enter a value for the Environment Ids field in the Technical Lineage for dbt Cloud capability.
If you enter values for both the Admin URL and Environment Ids fields, the Environment Ids field takes precedence.
Tip In some cases, using environment IDs can help generate more complete technical lineage, depending on how your dbt environments are configured.You can add this property from your vault. For more information, go to the vault documentation.
No
Metadata URL
The endpoint of the dbt Cloud Discovery API. This is typically the Semantic Layer GraphQL API URL associated with your dbt Cloud account.
How to locate the Semantic Layer GraphQL API URL in dbt Cloud:- Log in to your dbt Cloud account. Ensure you have Owner or Member group permissions.
- Navigate to Account Settings.
- In the Access URLs section, look for the Semantic Layer GraphQL API URL field.
The default value is
https://metadata.cloud.getdbt.com/graphql. For details, go to Query the Discovery API in dbt documentation.You can add this property from your vault. For more information, go to the vault documentation.
No
Token Name
The name of the service token. It can be any unique meaningful name.
How to get a service token and token value.- Generate a Service token and ensure that you set the Read-Only permissions for CollibraData Lineage to work properly.
- Copy the token value when you save the service token.
For details, go to Generating service account tokens in dbt documentation.
You can add this property from your vault. For more information, go to the vault documentation.
Yes
Token Value
Enter the service token.
Tip You can select To be encrypted by Edge management server or Encrypted with public key to indicate the encryption method.
You can add this property from your vault. For more information, go to the vault documentation.
Yes
- Click Create.
Add the Technical Lineage for dbt Cloud capability to your Edge or Collibra Cloud site.