Custom technical lineage: Create a Google Cloud Platform connection

Tip You can set up this integration in the unified integrations experience (in preview). This feature is in public preview and applies to metadata, AI, SAP, and lineage integrations. In one guided flow, you select an Edge site, create the connection, add the integration, and configure it. To get started, in the banner on the Integration configuration tab, click Try the new Integrations page. For more information, go to About the unified integrations experience (in preview).

After you install an Edge site or are granted a Collibra Cloud site, you can create a connection to the Google Cloud Platform (GCP).

Prerequisites

In your Collibra environment

  • You either created and installed an Edge site or were granted a Collibra Cloud site.
    Note 

    If you have defined an outbound (forward) proxy on your Edge site, the integration considers that configuration when connecting to the data source. The following proxies are supported for GCS:

    • Pass through (No authentication)
    • Pass through (Basic authentication)
    • MITM (No authentication)
    • MITM (Basic authentication)
    • No proxy for noProxy hosts defined by Edge
  • If you want to add connection values from a vault, you have added the vault to your Edge site. If your data source connection requires a file from your vault, the file must be encoded into Base64 and stored as a regular secret in your vault. For more information, go to the Vault documentation.
    Note  Vaults are not supported on Collibra Cloud sites.
  • You have a global role that has the Manage connections and capabilities global permission, for example, Edge integration engineer.

In your GCP environment

For more information on Google Cloud Platform and service accounts, go to the Google documentation. For more information on Knowledge Catalog roles, go to the Google documentation on Knowledge Catalog roles.

  • You need a Google Cloud Platform service account that can read the Google Cloud Storage (GCS) file system that you want to integrate. This means that the service account must have the following permissions:
    • storage.buckets.list to list buckets
    • storage.objects.list to list objects in a bucket
  • If you use Knowledge Catalog, the service account must be able to detect file schemas in GCS resources from Knowledge Catalog. This means that the service account must have the following permissions, for example, via the Dataplex Viewer role:
    • dataplex.*.get
    • dataplex.*.list

Steps

  1. Open a site.
    1. On the main toolbar, click Products icon → Cogwheel icon Settings.
      The Settings page opens.
    2. In the tab pane, click Edge.
      The Sites tab opens and shows a table with an overview of your sites.
    3. In the table, click the name of the site whose status is Healthy.
      The site page opens.
  2. In the Connections section, click Create connection.
    The Create connection page appears.
  3. Select the GCP connection to connect to Google Cloud Platform.
  4. Enter the required information.
    FieldDescriptionRequiredAvailable for vaults?
    Name

    The name of the Edge or Collibra Cloud site connection for Google Cloud Platform.

    Yes No
    Description

    The description of the connection.

    No No
    Vault The vault where you store your data source values. No No
    Connection type
    Important  Currently, only the Service Account authentication method is supported for this integration.

    The authentication method for your GCP connection. Select Service Account to use a Google service account for authentication.

    Yes No
    GCP Service Account / Workload Identity Federation (WIF)
    Important  Currently, only the Service Account authentication method is supported for this integration.

    The account to connect to GCP.
    Add the full content of the service account key JSON file.

    Copy
    Example
    {
      "type": "service_account",
      "project_id": "PROJECT_ID",
      "private_key_id": "KEY_ID",
      "private_key": "-----BEGIN PRIVATE KEY-----\nPRIVATE_KEY\n-----END PRIVATE KEY-----\n",
      "client_email": "SERVICE_ACCOUNT_EMAIL",
      "client_id": "CLIENT_ID",
      "auth_uri": "https://accounts.google.com/o/oauth2/auth",
      "token_uri": "https://accounts.google.com/o/oauth2/token",
      "auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",
      "client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/SERVICE_ACCOUNT_EMAIL"
    }

    Ensure the service account has the required permissions, as defined in the prerequisites. For more information about service account keys, go to the Google documentation.

    Yes Yes
    Property

    If your connection to GCP requires any additional parameters, click Add Property.

    No No
  5. Click Create.
    The connection is added to the Edge or Collibra Cloud site.

What's next

Define the lineage and store the file or files in your Google Cloud Storage bucket. For guidance and example file configurations, go to:

Then add the Technical Lineage for Custom Technical Lineage (Cloud) capability for Cloud Storage connections.