Create a custom technical lineage

To create a custom technical lineage, create and configure a JSON file that defines the custom technical lineage. Then add the properties of the JSON file to the lineage harvester configuration file.

Prerequisites

Ensure that you've completed the following tasks:

• To stitch the data objects of your data sources with Data Catalog assets, prepare the Data Catalog physical data layer for technical lineage. When you prepare the Data Catalog physical data layer, you must register your data sources in Data Catalog and use a structure that matches the structure of ingested assets in Data Catalog.
• Determine whether you want to create a simple custom technical lineage or advanced custom technical lineage.

Ensure that you have necessary permissions for all data objects that the lineage harvester accesses. For more information, see data objects.

Steps

1. Create a local folder.
2. Create a JSON file in the local folder and name the JSON file lineage.json.

   There must be only one JSON file in the folder; you can have other types of files in this folder. The JSON file must be named as lineage.json; otherwise, the process fails.

3. If you want to create an advanced custom technical lineage, store all of the source code files that you want to reference in the JSON file in the same local folder.
4. Configure the JSON file to define a simple or an advanced custom technical lineage.
5. Add a path to the folder of the JSON file in the lineage harvester configuration file.

What's next

Complete preparing the lineage harvester configuration file and run the lineage harvester.

For more information about the commands that you can use to run the technical lineage, see Lineage harvesting app command options and arguments.