dbt Core: Create an S3-Compatible connection

Tip You can set up this integration in the unified integrations experience (in preview). This feature is in public preview and applies to metadata, AI, SAP, and lineage integrations. In one guided flow, you select an Edge site, create the connection, add the integration, and configure it. To get started, in the banner on the Integration configuration tab, click Try the new Integrations page. For more information, go to About the unified integrations experience (in preview).

For Collibra Data Lineage to ingest metadata and generate technical lineage from files stored in an S3-compatible storage service, create an S3-Compatible connection on an Edge or Collibra Cloud site.

Before you begin

Required permissions

Steps

  1. Open a site.
    1. On the main toolbar, click Products icon → Cogwheel icon Settings.
      The Settings page opens.
    2. In the tab pane, click Edge.
      The Sites tab opens and shows a table with an overview of your sites.
    3. In the table, click the name of the site whose status is Healthy.
      The site page opens.
  2. In the Connections section, click Create connection.
    The Create connection page appears.
  3. Select the S3-Compatible connection to connect to your S3-compatible storage service.
  4. Enter the required information.
    FieldDescriptionRequired
    Name

    The name of the Edge or Collibra Cloud site S3-Compatible connection.

    Yes
    Description

    The description of the connection.

    No
    Endpoint URL

    The URL of the S3-compatible endpoint, for example, https://my-s3.yourcompany.com or https://172.91.25.36:9000.

    Yes
    Region

    The region identifier for the S3-compatible storage service. Leave empty if the service does not require a region.

    No
    Access Key ID

    The access key ID for authenticating with the S3-compatible storage service.

    Yes
    Secret Access Key

    The secret access key for authenticating with the S3-compatible storage service.

    Yes
  5. Click Create.
    The connection is added to the Edge or Collibra Cloud site.
    The fields become read-only.

What's next

Add the Technical Lineage for dbt (Cloud) capability for Cloud Storage connections.