Synchronize Azure Synapse Analytics lineage via JDBC connection

You can synchronize your technical lineage manually or automatically by adding a synchronization schedule.

If you want to synchronize technical lineage by using the Collibra Catalog Cloud Ingestions API, use the /technicalLineage/harvester/{assetId} API, where {assetId} is the UUID of the asset for which to generate the technical lineage.

If you include multiple databases in your technical lineage capability template, you don't have to synchronize each database separately. One synchronization job will harvest the metadata from all relevant databases.

Warning During the ingestion process, relations of the type "Data Element targets / sources Data Element" are automatically created between certain assets. Any relations of this type that you manually create between assets will be deleted during the synchronization process. If you want to manually create such relations and ensure that they are maintained, you can create a custom technical lineage.

Prerequisites

A global role that has the following global permission:
- Catalog, for example Catalog Author
- View Edge connections and capabilities
A resource role with Configure external system resource permission, for example Owner.
Data source-specific permissions.

Steps

Open a Database asset page of a registered database.
In the tab bar, click Configuration.
On the Lineage Extraction tab pane, click Synchronize Lineage.
A notification indicates synchronization has started.
The synchronization job is started. The lineage is ingested based on the configuration provided.

Open the Database asset page of a registered database.
In the tab bar, click Configuration.
On the Lineage Extraction tab pane, click Add Schedule.

Enter the required information and click Save:

Field	Description
Repeat	The interval when you want to synchronize automatically. The possible values are: Daily, Weekly, Monthly, and Cron expression.
Cron	The Quartz Cron expression that determines when the synchronization takes place. This field is only visible if you select `Cron expression` in the Repeat field.
Every	The day on which you want to synchronize, for example, Sunday. This field is only visible if you select `Weekly` in the Repeat field.
Every first	The day of the month on which you want to synchronize, for example, Tuesday. This field is only visible if you select `Monthly` in the Repeat field.
At	The time at which you want to synchronize automatically, for example, 14:00. You can only schedule on the hour. For example, you can add a synchronization schedule at 8:00, but not at 8:45. This field is only visible if you select `Daily`, `Weekly`, or `Monthly` in the Repeat field.
Time zone	The time zone for the schedule.