Fivetran integration preflight checks

To ensure successful metadata ingestion and lineage generation, complete the following preflight checks.

In your Fivetran environment

• A valid API key and secret. The user associated with the key must have at least the Account Reviewer role to list connectors and destinations.
• Optionally, if you want to filter the lineage metadata to collect and manage how data objects are stitched, gather the following information:
  • Destination to filter which lineage metadata Collibra Data Lineage collects. You specify these destinations on the Synchronization page.
  • Group IDs to define the connection mapping used for stitching. You provide these Group IDs in the Source Configuration field when you add the technical lineage for Fivetran capability.

In your CPSH environment

Lineage enablement

• Technical lineage via Edge is enabled in your Collibra environment.

Edge

• You created and installed an Edge site.
  
  Important If you're using a Collibra Cloud site, go the Collibra Cloud site documentation to check if your data source is supported.
• The Edge site status must be Healthy.
• Register your data sources by using JDBC connectors or integrate your data sources, so that Collibra Data Lineage can stitch the data objects in your technical lineage to the assets in Data Catalog. For more information, go to About registering and integrating data sources in Catalog.
  Currently, technical lineage for Fivetran is supported for the following data sources:
  • Azure Synapse
  • Databricks
  • Google BigQuery
  • Google Sheets, MySQL
  • PostgreSQL
  • Redshift.

Network and proxy configuration

• Edge can connect to all Collibra Data Lineage service instances in your geographic location.
• Optionally, you've connected to a proxy server.
• Ensure that your network firewall allows outbound HTTPS traffic to the Fivetran API endpoint at https://api.fivetran.com.

CPSH permissions

You can connect to Collibra Data Lineage by using the basic or OAuth authentication method. The following permissions are required only if you use the basic authentication method. 

• A global role with the following global permissions:
  • Data Stewardship Manager
  • Manage all resources
  • System administration
  • Technical lineage
• A resource role with the following resource permissions on the community level in which you created the domain:
  • Asset > Add
  • Attribute > Add
  • Domain > Add
  • Attachment > Add

To connect to Collibra Data Lineage service instances via OAuth authentication:

• You have a global role with the Product Rights > System administration global permission.
• You have a global role that has the Manage Edge sites global permission.
• You have a global role that has the Manage connections and capabilities global permission.

To create a Fivetran connection:

• You have a global role with the Product Rights > System administration global permission.
• You have a global role that has the Manage Edge sites global permission.
You have added a vault to your Edge site.
If your data source connection requires a file from your vault, the file must be encoded into Base64 and stored as a regular secret in your vault.

To add an Edge capability:

• You have a global role with the Product Rights > System administration global permission.
• You have a global role that has the Manage connections and capabilities global permission, for example, Edge integration engineer.

To synchronize technical lineage:

• A global role that has the following global permission:
  • Catalog, for example Catalog Author
  • View Edge connections and capabilities
• A resource role with Configure external system resource permission, for example Owner.