Technical lineage via Edge (beta)

You can use the technical lineage features on Edge to collect metadata from your data sources and create new relations between data elements from your data source and existing assets into Data Catalog. Technical lineage via Edge can collect transformation logic like SQL scripts and ETL scripts from a specific location, for example a database table or a folder on a file system.

Just like the lineage harvester, technical lineage via Edge connects to different Collibra Data Lineage service instances based on your geographical location and cloud provider.

Using technical lineage via Edge

Technical lineage via Edge is a beta feature. To create a technical lineage for different data sources via Edge, you must enable the features in the Beta features section in the Collibra settings or in Collibra Console.

You can define how technical lineage via Edge accesses the data sources by creating different connections. The following connection types are supported on Edge:

  • JDBC connection, for JDBC data sources and ETL tools.
  • Shared Storage connection, for JDBC data sources and some ETL tools.
  • APIs, for Tableau, Power BI, Informatica Intelligent Cloud Services, and Matillion.

Configurations for technical lineage via Edge include the following:

  • General configuration settings in the Collibra settings or Collibra Console, which apply to all data sources for which you create the technical lineage. For example, you can enter your Collibra Data Intelligence Cloud username and user password in the general configuration settings.
  • Specific configuration settings for each data source. You can add a technical lineage capability for each data source to provide specific configurations.

After you create the connections and configure technical lineage via Edge for different data sources, you can manually synchronize the capabilities or add a synchronization schedules.

For a list of the supported data sources and the technical lineage capabilities and connection types for each data source, go to Supported data sources for technical lineage. For specific steps to create a technical lineage on Edge, go to Creating technical lineage via Edge.

Tip 

For information on ingesting metadata from the following BI tools and creating a technical lineage via Edge, see the dedicated sections:

Permissions

You need a global role with the System Administration global permission, for example Sysadmin. This role must have access to all assets in the data sources and be able to create new relations between these assets.

Specific permissions might be required to access different data sources. Select a data source in the Overview of Collibra-provided JDBC drivers topic to see the required permissions to create a technical lineage.