Fivetran source configuration

Updated:

The source configuration defines how destination and source system assets are mapped. Data objects collected from Fivetran are stitched to the appropriate System assets in CollibraData Catalog based on this mapping.

Note Specify this property only when the Collibra system name field is set to True when you enable technical lineage via Edge. If the field is set to False, data objects are stitched based on the database name.

When the Collibra system name field is set to True and you do not specify this field, data objects are stitched to assets based on the systems returned by the Fivetran APIs. For more information, go to Collibra system name.

The value of the Source configuration field must be a valid block of JSON code, for example:

{
   "found_destination=ensue_tradition-groupId123": { 
     "destinationCollibraSystemName": "GCP_system", 
     "foundSourceName": [ 
       {
         "SourceName": "databricks_db_1", 
         "sourceCollibraSystemName": "SOurceSYM_1" 
        }
      ]
   },

   "found_destination=alpha_spectrum-groupId456": { 
     "destinationCollibraSystemName": "Azure_cluster_A1",
     "foundSourceName": [ 
       {
         "SourceName": "oracle_fin_01",
         "sourceCollibraSystemName": "FinSYS_A" 
       },
       {
         "SourceName": "oracle_fin_02", 
         "sourceCollibraSystemName": "FinSYS_B"
       },
       {
         "SourceName": "oracle_fin_backup", 
         "sourceCollibraSystemName": "FinSYS_Backup"
        }
      ]
    }
}	

The following table describes the various properties you can use in your JSON code block. If you choose to define the source configuration, all of the following properties are required.

Property

Description
found_destination

The Fivetran destination. Specify this property with the Group IDs in Fivetran.

For more information, go to Find your Destination Group ID in the Fivetran documentation.

destinationCollibraSystemName

The name of the System asset in Collibra Data Catalog.

All metadata from the specified Fivetran data sources is mapped to this system.

foundSourceName

A list of all Fivetran source connections.

You can specify multiple SourceName entries and their corresponding sourceCollibraSystemName values in this section.

SourceName

The Fivetran connection name for the source system.

To find the connection names, navigate to your Fivetran destination page, scroll to the Associated Connection section. For more information, go to View destinations in the Fivetran documentation.

sourceCollibraSystemName

The System asset name in Collibra Data Catalog.

All metadata from the specified Fivetran data sources is mapped to this system.