Fivetran source configuration
Updated:
The source configuration defines how destination and source system assets are mapped. Data objects collected from Fivetran are stitched to the appropriate System assets in CollibraData Catalog based on this mapping.
True when you enable technical lineage via Edge. If the field is set to
False, data objects are stitched based on the database name. When the Collibra system name field is set to and you do not specify this field, data objects are stitched to assets based on the systems returned by the Fivetran APIs. For more information, go to Collibra system name.
True
The value of the Source configuration field must be a valid block of JSON code, for example:
{
"found_destination=ensue_tradition-groupId123": {
"destinationCollibraSystemName": "GCP_system",
"foundSourceName": [
{
"SourceName": "databricks_db_1",
"sourceCollibraSystemName": "SOurceSYM_1"
}
]
},
"found_destination=alpha_spectrum-groupId456": {
"destinationCollibraSystemName": "Azure_cluster_A1",
"foundSourceName": [
{
"SourceName": "oracle_fin_01",
"sourceCollibraSystemName": "FinSYS_A"
},
{
"SourceName": "oracle_fin_02",
"sourceCollibraSystemName": "FinSYS_B"
},
{
"SourceName": "oracle_fin_backup",
"sourceCollibraSystemName": "FinSYS_Backup"
}
]
}
}
The following table describes the various properties you can use in your JSON code block. If you choose to define the source configuration, all of the following properties are required.
|
Property |
Description |
|---|---|
| found_destination |
The Fivetran destination. Specify this property with the Group IDs in Fivetran. For more information, go to Find your Destination Group ID in the Fivetran documentation. |
|
destinationCollibraSystemName
|
The name of the System asset in Collibra Data Catalog. All metadata from the specified Fivetran data sources is mapped to this system. |
|
foundSourceName
|
A list of all Fivetran source connections. You can specify multiple |
|
SourceName
|
The Fivetran connection name for the source system. To find the connection names, navigate to your Fivetran destination page, scroll to the Associated Connection section. For more information, go to View destinations in the Fivetran documentation. |
|
sourceCollibraSystemName
|
The System asset name in Collibra Data Catalog. All metadata from the specified Fivetran data sources is mapped to this system. |