You can create a custom technical lineage to include metadata of data sources that the lineage harvester does not support or add functionality that is not supported.
To create a custom technical lineage, define the custom technical lineage in a JSON file and refer to the JSON file in the lineage harvester configuration file. The lineage harvester generates a technical lineage based on your definition in the JSON file. You can create the following custom technical lineages:
- A simple custom technical lineage, which defines a basic object hierarchy and creates a lineage between two or more data objects.
- An advanced custom technical lineage, which contains a simple custom technical lineage and uses separate source code files that define lineage transformations to create the lineage.
You can use the custom technical lineage as your only lineage source. You can also combine custom technical lineage with other lineage sources. For example, you can configure the lineage harvester to collect data objects from Oracle, Tableau and the custom technical lineage definition in the JSON file.
For steps to create a custom technical lineage by using the lineage harvester, go to Create custom technical lineage.
For steps to create a custom technical lineage on Edge, go to Creating technical lineage via Edge (beta).
Example
You want to create a technical lineage that shows relations between tables and columns from system A and system B, to system C, to system D (A and B -> C -> D). System A, B and D are supported data sources, but system C is a custom application. You can create a JSON file that contains the metadata of system C and generate the following technical lineage graph.
