Create a Google Cloud Platform connection to an Edge site
After you install an Edge site or are granted a Collibra Cloud site, you can create a connection to Google Cloud Platform (GCP).
Complete the prerequisites in your Google Cloud Platform and Collibra environments to create a connection between the two. Once you have created a connection, you can then proceed with metadata ingestion.
Do you use a vault?
|
You can use a vault to add your data source information to your Edge site connection. Check the connection property table below to see which information is available for your vault. Vaults are not available for Collibra Cloud site sites. |
No vault
AWS Secrets Manager
Azure Key Vault
CyberArk Vault
Google Secret Manager
HashiCorp Vault
|
|
|
|
||
|
How to use your vault...
To use your vault, do the following:
To use your vault, do the following:
To use your vault, do the following:
To use your vault, do the following:
To use your vault, do the following:
|
||
Prerequisites
In your Collibra environment
-
You created and installed an Edge site.Note
If you have defined an outbound (forward) proxy on your Edge site, the integration will take that configuration into account when connecting to the data source. The following proxies are supported:
- Pass through (No authentication)
- Pass through (Basic authentication)
- MITM (No authentication)
- MITM (Basic authentication)
- No proxy for noProxy hosts defined by Edge
- You have added a vault to your Edge site.
- Make sure you are on the latest UI because the Dataplex Universal Catalog integration is available only in the latest UI.
- You have a global role that has the Manage connections and capabilities global permission, for example, Edge integration engineer.
In your GCP environment
For more information on Google Cloud Platform and service accounts, go to the Google documentation. For more information on Dataplex roles, go to the Google documentation on Dataplex roles.
- You need a Google Cloud Platform service account that can read the Google Cloud Storage (GCS) file system that you want to integrate. This means that the service account must have the following permissions:
storage.buckets.listto list bucketsstorage.objects.listto list objects in a bucket
- If you use Dataplex, the service account must be able to detect file schemas in GCS resources from Dataplex. This means that the service account must have the following permissions, for example, via the Dataplex Viewer role:
dataplex.*.getdataplex.*.list
- If you want to have Project IDs available for selection when you add Project IDs on the Synchronize Metadata page, ensure that the service account has the
resourcemanager.projects.getpermission to GCP projects where Dataplex is enabled. If the service account does not have this permission, you can enter the Project IDs manually on the Synchronize Metadata page.
Steps
- Open a site.
-
On the main toolbar, click
→
Settings.
The Settings page opens. -
In the tab pane, click Edge.
The Sites tab opens and shows a table with an overview of your sites. - In the table, click the name of the site whose status is Healthy.
The site page opens.
-
On the main toolbar, click
- In the Connections section, click Create connection.
The Create connection page appears. - Select the GCP connection to connect to Google Cloud Platform.
- Enter the required information.
Field Description Required Available for vaults? Name The name of the Edge site connection for Google Cloud Platform.
Yes
No
Description The description of the connection.
No
No
Vault The vault where you store your data source values.
No
No
Connection type The authentication method for your GCP connection. Select one of the following options: - Service account
- Use a Google service account for authentication.
- Workload Identity Federation (WIF)
- Use Workload Identity Federation to authenticate without a service account key.
- Workload Identity Federation (WIF) using GKE
- Use Workload Identity Federation in Google Kubernetes Engine (GKE) to authenticate.
Note- When using a cloud provider for WIF, such as AWS or GCP, your Edge site must be deployed on the same cloud provider. For example, if the Edge site is installed on GCP, you cannot use AWS as the WIF provider.
- Automatic token generation for WIF is supported if your Edge site is installed on AWS using K3s or GCP using GKE. If your Edge site is installed using K3s on any cloud provider other than AWS, automatic token generation is not supported.
Yes
No
Service Account / Workload Identity Federation (WIF) Enter one of the following values: - For the Service Account authentication method, add the full content of the service account key JSON file.
Example
{
"type": "service_account",
"project_id": "PROJECT_ID",
"private_key_id": "KEY_ID",
"private_key": "-----BEGIN PRIVATE KEY-----\nPRIVATE_KEY\n-----END PRIVATE KEY-----\n",
"client_email": "SERVICE_ACCOUNT_EMAIL",
"client_id": "CLIENT_ID",
"auth_uri": "https://accounts.google.com/o/oauth2/auth",
"token_uri": "https://accounts.google.com/o/oauth2/token",
"auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",
"client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/SERVICE_ACCOUNT_EMAIL"}Ensure the service account has the required permissions, as defined in the prerequisites.
For more information about service account keys, go to the Google documentation. - For the Workload Identity Federation (WIF) authentication method, enter the token URL or the token if you're using WIF with a file-based credential source.
- For the Workload Identity Federation (WIF) using GKE authentication method, you can ignore this field.
Yes
if you selected the Service AccountorWorkload Identity Federation (WIF)authentication method
YesProperty If your connection to GCP requires any additional parameters, click Add Property.
No
No
- Click Create.
The connection is added to the Edge site.
If you want to allow for sampling, profiling, and classification, create a BigQuery JDBC connection. If you created a BigQuery JDBC connection previously, you can use that JDBC connection when you configure the synchronization page.
You can then add the Dataplex Universal Catalog capability to an Edge site.




