Technical lineage admin options allow you to manage, analyze, and synchronize lineage data across your configured data sources. You can use these options to inspect source configuration, exclude sources, analyze metadata files, run synchronization, and export lineage data.
Admin options
- List sources
- Lists all data sources that are used to create technical lineage.
The results include:
- Source ID
- Whether the data source is ingested via Edge
- Whether the system name is used
Use this option to verify which data sources are available and how they are configured.
Note This option does not trigger synchronization. - Ignore sources
- Excludes selected data sources from technical lineage processing.
The next time you run synchronization, the selected data sources are ignored.
Note Ensure that the Active checkbox is cleared in the corresponding technical lineage capability for each source you want to ignore. - Analyze files
-
You can use this option to validate and inspect metadata files before running a synchronization. These files are ZIP packages generated by the Collibra Data Lineage service and contain metadata collected from your data sources.
Use this option to identify issues in specific metadata files without affecting the live technical lineage.
Specify the file ID of the ZIP file to analyze. You can obtain the file ID from the job results when metadata is generated.
Note This option does not trigger synchronization. - Sync
- Triggers synchronization of metadata for all configured data sources.
When you run this option:
- A new metadata batch is created from the latest available data.
- The lineage is processed and synchronized with assets in Data Catalog.
Use this option to run or refresh technical lineage.
Synchronizing a technical lineage capability performs the same synchronization process and also refreshes lineage for all configured data sources. The Sync admin option provides an alternative way to trigger this process.
- Export lineage
- Exports technical lineage data as a ZIP file.
You can export data for a single data source or for all data sources.
This option is available for all supported data sources. You can download the file from the Activities page after the job completes.
Export type Description Lineage
Contains a JSON file that includes the lineage, in the custom technical lineage JSON format.
Lineage with transformations
Contains a JSON file that includes the lineage and transformation logic, in the custom technical lineage JSON format. It does not contain analysis or parsing errors.
Transformations
Contains an errors.csv file that lists every transformation and its processing status, not only failed transformations. Filter the status columns to identify failed transformations.
Typical workflow
To run an admin job, complete the following steps: