Add a technical lineage capability to an Edge site
After prepared the Data Catalog physical data layer and created a shared storage connection if needed, you can create a technical lineage by adding a technical lineage capability to the Edge site.
Requirements and permissions
A global role that has the following global permissions:
- System administration
- Manage connections and capabilities, for example Edge integration engineer.
- Register profiling information
Steps
|
Select a data source and the connection type if needed to see the related information to create the technical lineage for your data source. Currently, you see the information for: |
Amazon Redshift
Azure SQL Data Warehouse
Azure SQL Server
Azure Synapse Analytics
DB2
Google BigQuery
Greenplum
HiveQL
IBM InfoSphere DataStage
Informatica Intelligent Cloud Services
Informatica PowerCenter
Matillion
Oracle
PostgreSQL
MySQL
Netezza
SAP Hana
Snowflake
Spark SQL
SQL Server
SQL Server Integration Services
Sybase
Teradata
Custom technical lineage
|
Which connection type do you use?
For best technical lineage results, harvest JDBC sources when possible, rather than using the shared storage connection by creating an external directory of source files. |
- Open an Edge site.
-
On the main menu, click
, and then click
Settings.
The Settings page opens. -
In the tab pane, click Edge.
The Edge sites overview appears. - In the Edge site overview, click the name of an Edge site with the status Healthy.
The Edge site page appears.
-
On the main menu, click
- In the Capabilities section, click Add capability. For Collibra Data Lineage to stitch the data objects in your technical lineage to the assets in Data Catalog, add a Catalog JDBC ingestion capability before you add the technical lineage capability.
The Add capability page appears. - Enter the required information.
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Redshift
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Views This query retrieves the view definitions.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability The capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for SparkNameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Select the Technical lineage capability template for your data source to create a technical lineage for the JDBC data source.
Important Technical lineage via Edge is only available in private beta. Please create a support ticket to get access.
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Object names This query retrieves a list of object names from which technical lineage can be created. The objects can include stored procedures, views, macros, and so on.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Azure
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Synonyms This query retrieves the alternative names for the database objects. Views This query retrieves the view definitions. Other queries This query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Azure
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Synonyms This query retrieves the alternative names for the database objects. Views This query retrieves the view definitions. Other queries This query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Azure
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
SchemaThe name of the default schema, if not specified in the data source itself. This corresponds to the name of your Schema asset.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Synonyms This query retrieves the alternative names for the database objects. Views This query retrieves the view definitions. Other queries This query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for DataStage
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
Shared storage connectionThe shared storage connection that you created.
Yes
MaskThe pattern of the file names in the directory. By default, the value is
*.
No
Source configurationThe connection definitions, where you specify relevant translations for each data source. Specify the following properties in JSON format and enter the content in this field.
Connection definition propertiesProperty
Description OdbcDataSources
Open Database Connectivity data sources in IBM InfoSphere DataStage for which you want to create a technical lineage.
<data-source-name>The ODBC data source name that you use in your DataStage projects.
This section contains the properties to translate the database, schema and dialect.
dbnameThe name of your database, to which the ODBC data source connection refers. schemaThe name of your schema, to which the ODBC data source connection refers.
dialectThe dialect of the referenced database.
See the list of allowed values.You can enter one of the following values:
- azure, for an Azure SQL Server data source.
- bigquery, for a Google BigQuery data source.
- db2, for an IBM DB2 data source.
- hana, for a SAP HANA data source.
- hana-cviews, for a SAP HANA data source.Important The
hana-cviewsdialect is supported for SAP HANA (on-premises). It is not supported for SAP HANA Cloud. - hive, for a HiveQL data source.
- greenplum, for a Greenplum data source.
- mssql, for a Microsoft SQL Server data source.
- mysql, for a MySQL data source.
- netezza, for a Netezza data source.
- oracle, for an Oracle data source.
- postgres, for a PostgreSQL data source.
- redshift, for an Amazon Redshift data source.
- snowflake, for a Snowflake data source.
- spark, for a Spark SQL data source.
- sybase, for a Sybase data source.
- teradata, for a Teradata data source.
collibraSystemNameThe name of the data source's system or server.
This property is only required when you set the value of the Collibra system name flag setting to
True. Note Specify this property with the same name as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog. If you don't prepare the physical data layer, Collibra Data Lineage cannot stitch the data objects in your technical lineage to the assets in Data Catalog.NonOdbcConnectors
Other data source connectors in IBM InfoSphere DataStage for which you want to create a technical lineage. For example, DB2, Oracle or Netezza.
Note This section is optional.
<data-source-connector-ID>The data source username and database of the connector that you use in your DataStage projects. This usually looks like for example admin@database-name. The combination of the username and database name should be unique.
The following section contains the properties to translate the database, schema and dialect.
dbnameThe name of your database, to which the data source connection refers. schemaThe name of your schema, to which the data source connection refers.
dialectThe dialect of the referenced database.
See the list of allowed values.You can enter one of the following values:
- azure, for an Azure SQL Server data source.
- bigquery, for a Google BigQuery data source.
- db2, for an IBM DB2 data source.
- hana, for a SAP HANA data source.
- hana-cviews, for a SAP HANA data source.Important The
hana-cviewsdialect is supported for SAP HANA (on-premises). It is not supported for SAP HANA Cloud. - hive, for a HiveQL data source.
- greenplum, for a Greenplum data source.
- mssql, for a Microsoft SQL Server data source.
- mysql, for a MySQL data source.
- netezza, for a Netezza data source.
- oracle, for an Oracle data source.
- postgres, for a PostgreSQL data source.
- redshift, for an Amazon Redshift data source.
- snowflake, for a Snowflake data source.
- spark, for a Spark SQL data source.
- sybase, for a Sybase data source.
- teradata, for a Teradata data source.
collibraSystemNameThe name of the data source's system or server.
This property is only required when you set the value of the Collibra system name flag setting to
True. Specify this property with the same name as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog. If you don't prepare the physical data layer, Collibra Data Lineage cannot stitch the data objects in your technical lineage to the assets in Data Catalog.See an example.
{ "OdbcDataSources": { "oracle-data-source": { "dbname": "my-oracle-database", "schema": "my-oracle-schema", "dialect": "oracle", "collibraSystemName": "my-system" }, "mssql-data-source": { "dbname": "my-mssql-database", "schema": "my-mssql-schema", "dialect": "mssql", "collibraSystemName": "my-system" } }, "NonOdbcConnectors": { "admin@database-name": { "dbname": "my-netezza-database", "schema": "my-netezza-schema", "dialect": "netezza", "collibraSystemName": "my-system" }, "admin@second-database-name": { "dbname": "my-second-netezza-database", "schema": "my-second-netezza-schema", "dialect": "netezza", "collibraSystemName": "my-system" } } }Tip Click
to copy the example to your clipboard.
Tip If you previously created a technical lineage for this data source with connection definitions by using the lineage harvester, you can enter the content from the connection_definitions.conf file in this field.
No
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Db2
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Views This query retrieves the view definitions.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Bigquery
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Project IDThe ID of the project.
Tip You can add extra project IDs by clicking Add property.
Yes
RegionThe location of your BigQuery data. This is the region that you specified when you create a data set.
No
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Columns tail This query retrieves all columns tails. Views This query retrieves the view definitions. Dataset names This query retrieves all logical units in the project. Other queries This query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Greenplum
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Views This query retrieves the view definitions.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Hive
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
External database nameThe database value to be used in the asset path (system -> database -> schema -> table).
No
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Object names This query retrieves a list of object names from which technical lineage can be created. The objects can include stored procedures, views, macros, and so on.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical lineage for IICS
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
IICS connectionThe shared storage connection that you created.
Note A shared storage connection is required for you to synchronize the technical lineage after you add the capability. Use the Login URL and Username fields in the capability to connect to Informatica Intelligent Cloud Services (IICS) environment. This behavior will be changed in a future release so that you can use the IICS connection instead of the shared storage connection.
No
Login URLThe URL of the Informatica Intelligent Cloud Services environment sign-in page. For example:
https://dm-us.informaticaintelligentcloud.com.
No
UsernameThe username that you use to sign in to Informatica Intelligent Cloud Services.
Yes
PasswordThe password that you use to sign in to Informatica Intelligent Cloud Services.
Tip You can select To be encrypted by Edge management server or Encrypted with public key to indicate the encryption method.
Yes
ObjectsThe objects that you want to export. Each object requires a path and a type, for example:
"objects": [ { "path" : "Sales", "type" : "Project" }, { "path" : "Finance/Task_Flows", "type" : "Folder" }, { "path" : "Common/Task_Flows/tf_CalendarDimension", "type" : "Taskflow" } ]Tip For more information about the objects that you can export and the required information, go to the Informatica documentation.
No
Parameter filesThe Informatica Intelligent Cloud Services parameter files.
No
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Informatica
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
Shared storage connectionThe shared storage connection that you created.
Yes
MaskThe pattern of the file names in the directory. By default, the value is
*.
No
Source configurationThe connection definitions and system names. Specify the following properties in JSON format and enter the content in this field.
Connection definitionsProperty
Description connectionDefinitions
This section contains the connection properties to a source in Informatica PowerCenter.
<connectionName>The type of your source or target data source.
This section contains the connection properties to a source or target in Informatica PowerCenter.
dbnameThe name of your source or target database. schemaThe name of your source or target schema.
dialectThe dialect of the referenced database.
See the list of allowed values.You can enter one of the following values:
- azure, for an Azure SQL Server data source.
- bigquery, for a Google BigQuery data source.
- db2, for an IBM DB2 data source.
- hana, for a SAP HANA data source.
- hana-cviews, for a SAP HANA data source.Important The
hana-cviewsdialect is supported for SAP HANA (on-premises). It is not supported for SAP HANA Cloud. - hive, for a HiveQL data source.
- greenplum, for a Greenplum data source.
- mssql, for a Microsoft SQL Server data source.
- mysql, for a MySQL data source.
- netezza, for a Netezza data source.
- oracle, for an Oracle data source.
- postgres, for a PostgreSQL data source.
- redshift, for an Amazon Redshift data source.
- snowflake, for a Snowflake data source.
- spark, for a Spark SQL data source.
- sybase, for a Sybase data source.
- teradata, for a Teradata data source.
collibraSystemNames
This section contains the system or server name that is specified in your database and referenced in your connection.
Note This section is only required whenyou set the Collibra system name flag setting to
True.databasesThis section contains the database information. This is required to connect directly to the system or server of the database.
dbnameThe name of the database. The database name is the same as the name you entered in the <connectionName> section. collibraSystemNameThe system or server name of the database.
connectionsThis section contains the connection information. This is required to reference to the system or server of the connection.
connectionNameThe name of the connection.
collibraSystemNameThe system or server name of the connection.
See an example.
{ "connectionDefinitions": { "oracle_source": { "dbname": "oracle-source-database-name1", "schema": "my Oracle source schema", "dialect": "oracle" }, "oracle_target": { "dbname": "oracle-target-database-name2", "schema": "my other oracle target schema", "dialect": "oracle" } }, "collibraSystemNames": { "databases": [ { "dbname": "oracle-source-database-name1", "collibraSystemName": "oracle-system-name1" }, { "dbname": "oracle-target-database-name2", "collibraSystemName": "oracle-system-name2" } ], "connections": [ { "connectionName": "oracle-connection-name1", "collibraSystemName": "oracle-system-name1" }, { "connectionName": "oracle-connection-name2", "collibraSystemName": "oracle-system-name2" } ] } }Tip Click
to copy the example to your clipboard.Important If you are using variables in Informatica PowerCenter, add the value of the variable instead of the name in the connection definitions. For example, if the parameter file contains$DBConnection_dwh=DWH_EXPORTthen you add the following connection definitions:{ "DWH_EXPORT": { "dbname": "DWH", "schema": "DBO" } }Tip If you previously created a technical lineage for this data source with connection definitions by using the lineage harvester, you can enter the content from the source ID configuration file in this field.
No
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical lineage for Matillion
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
Matillion connectionThe shared storage connection that you created.
Note A shared storage connection is required for you to synchronize the technical lineage after you add the capability. Use the URL, Authentication type, Username and Password/Token fields in the capability to connect to Matillion. This behavior will be changed in a future release so that you can use the Matillion connection instead of the shared storage connection.
No
Authentication typeThe authentication details for signing in to Matillion. You can select one of the following values:
Credentials- Use the username and password authentication type.
Token- Use the token-based authentication type.
Yes
UsernameThe username that you use to sign in to Matillion.
This field is required if you set the Authentication type field to Credentials.Password/TokenThe password or token that you use to sign in to Matillion.
Tip You can select To be encrypted by Edge management server or Encrypted with public key to indicate the encryption method.
Yes
URLThe URL of your Matillion environment. For example, https://<domain name>orhttps://<IP address>.
Yes
Group NameThe name of your group in Matillion.
Yes
Project NameThe name of your project in Matillion.
You can only add the name of one project. If you want to create a technical lineage for other projects, add a technical lineage for Matillion capability for each project.
Yes
Environment NameThe name of your environment in Matillion.
You can only add the name of one environment. If you want to create a technical lineage for other environments, add a technical lineage for Matillion capability for each environment.
Yes
DialectThe dialect of the database.
Select one of the following values:
Snowflake- A Snowflake data source.
Redshift- An Amazon Redshift data source.
Yes
Start timestampThe timestamp of tasks in Matillion, which indicates the amount of metadata that technical lineage via Edge collects.
Specify this field with a UNIX timestamp in milliseconds. The default value is
1, which gets as much history as Matillion provides. Matillion provides 7 days of history by default.
Yes
Source configurationThe source configuration for the data source.
No
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Mysql
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Views This query retrieves the view definitions.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Netezza
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Views This query retrieves the view definitions.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Oracle
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Database links This query retrieves links to other databases. Synonyms This query retrieves the alternative names for the database objects. Views This query retrieves the view definitions. Materialized views This query retrieves materialized view definitions. Other queries This query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Postgres
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Views This query retrieves the view definitions.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Hana
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
SQL activeAn option to determine whether to include or remove the technical lineage of the data source with the SQL based input.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
No
Calculated views activeAn option to determine whether to include or remove the technical lineage of the data source with the calculated views input.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
No
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Views This query retrieves the view definitions. Calculated views This query retrieves calculated views. Dependencies of calculated views This query retrieves dependencies of calculated views. Cross-references of calculated views This query retrieves cross references of calculated views.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Snowflake
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Views This query retrieves the view definitions.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Mssql
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Database links This query retrieves links to other databases. Synonyms This query retrieves the alternative names for the database objects. Views This query retrieves the view definitions. Other queries This query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for SQL Server Integration Services (SSIS)
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
Shared storage connectionThe shared storage connection that you created.
Yes
MaskThe pattern of the file names in the directory. By default, the value is
*.
No
Source configurationThe connection definitions, where you specify relevant translations for each data source. Specify the following properties in JSON format and enter the content in this field.
Connection definitionsProperty
Description ConnStringRegExTranslation
The parent element that opens the connection definitions.
<regular expression>
A regular expression that must match one or more connection strings.
NoteImportant considerations:
- By default, the regular expression is not case sensitive. As a consequence, a regular expression can match with connection strings containing uppercase characters or lowercase characters.
- The connection string is part of the SSIS connection manager.
- SSIS connection managers are included in an SSIS package files (DTSX) or in connection manager files (CONMGR).
ExampleRegular expression:
Server=sb-dhub;User ID=SYB_USER2;Initial Catalog=STAGEDB;Port=6306.*
Explanation: The first section, up to .*, is a literal, but not case-sensitive, match of the characters. The dot (.) can match any single character. The asterisk (*) means zero or more of the previous, in this case any character.
Match: Any connection string that starts withServer=sb-dhub;User ID=SYB_USER2;Initial Catalog=STAGEDB;Port=6306.
Example:Server=sb-dhub;User ID=SYB_USER2;Initial Catalog=STAGEDB;Port=6306;Persist Security Info=True;Auto Translate=False;.dbnameThe name of your database, to which the data source connection refers. schemaThe name of your schema, to which the regular expression refers.
dialectThe dialect of the referenced database.
See the list of allowed values.You can enter one of the following values:
- azure, for an Azure SQL Server data source.
- bigquery, for a Google BigQuery data source.
- db2, for an IBM DB2 data source.
- hana, for a SAP HANA data source.
- hana-cviews, for a SAP HANA data source.Important The
hana-cviewsdialect is supported for SAP HANA (on-premises). It is not supported for SAP HANA Cloud. - hive, for a HiveQL data source.
- greenplum, for a Greenplum data source.
- mssql, for a Microsoft SQL Server data source.
- mysql, for a MySQL data source.
- netezza, for a Netezza data source.
- oracle, for an Oracle data source.
- postgres, for a PostgreSQL data source.
- redshift, for an Amazon Redshift data source.
- snowflake, for a Snowflake data source.
- spark, for a Spark SQL data source.
- sybase, for a Sybase data source.
- teradata, for a Teradata data source.
collibraSystemNameThe name of the referenced data source's system or server.
The system or server names in table references are considered to be represented by different System assets in Data Catalog. The value of this field is used as the default system or server name.
This property is only required when you set the value of the Collibra system name flag setting to
True. Note Specify this property with the same name as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog. If you don't prepare the physical data layer, Collibra Data Lineage cannot stitch the data objects in your technical lineage to the assets in Data Catalog.See an example.
{ "ConnStringRegExTranslation": { "Data Source=dhb-sql-prod;Initial Catalog=SFG_repl_staging;Provider=SQLNCLI11;Integrated Security=SSPI.*": { "dbname": "DATAHUB", "schema": "DBO", "dialect": "mssql", "collibraSystemName" : "WAREHOUSE" }, "Server=sb-dhub;User ID=SYS_USER;Initial Catalog=STAGEDB;Port=6306.*": { "dbname": "STAGEDB", "schema": "STAGE_OWNER", "dialect": "sybase", "collibraSystemName" : "" } } }Tip Click
to copy the example to your clipboard.Tip If you previously created a technical lineage for this data source with connection definitions by using the lineage harvester, you can enter the content from the source ID configuration file in this field.
No
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Sybase
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Views This query retrieves the view definitions.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Teradata
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
JDBC connectionThe JDBC connection that you created for Catalog JDBC ingestion.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
External database nameThe database value to be used in the asset path (system -> database -> schema -> table).
No
Database nameThe name of your database.
Tip You can add extra database names by clicking Add property.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
Queries
The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.
Example Enter the following filter in a Views query:
where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for examplewhere v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.Query Description Columns This query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column. Object names This query retrieves a list of object names from which technical lineage can be created. The objects can include stored procedures, views, macros, and so on.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for Custom Lineage
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
Shared storage connectionThe shared storage connection that you created.
Yes
MaskThe pattern of the file names in the directory. By default, the value is
*.Note Technical lineage via Edge ignores this field. This field will be removed in a future release.
No
Source configurationThe source configuration for the data source.
No
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
Field Description Required? Capability This section contains the general information about the capability.
NameThe name of the Edge capability.
Yes
DescriptionThe description of the Edge capability.
Yes
Capability templateThe capability template, which determines the next available sections.
Select the following Edge capability:
Technical Lineage for SqlDirectory
Yes
Main This section contains the information for creating a technical lineage.
Source IDThe name of the data source. Specify a name that is unique.
Yes
Delete Raw Metadata After ProcessingTechnical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.
Select this option to indicate that the source metadata is deleted after processing.
Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.
Note Selecting this option can negatively impact performance.
No
Shared storage connectionThe shared storage connection that you created.
No
MaskThe pattern of the file names in the directory. By default, the value is
*.
Yes
DialectThe dialect of the database.
See the list of allowed values.You can enter one of the following values:
- azure, for an Azure SQL Server data source.
- bigquery, for a Google BigQuery data source.
- db2, for an IBM DB2 data source.
- hana, for a SAP HANA data source.
- hana-cviews, for a SAP HANA data source.Important The
hana-cviewsdialect is supported for SAP HANA (on-premises). It is not supported for SAP HANA Cloud. - hive, for a HiveQL data source.
- greenplum, for a Greenplum data source.
- mssql, for a Microsoft SQL Server data source.
- mysql, for a MySQL data source.
- netezza, for a Netezza data source.
- oracle, for an Oracle data source.
- postgres, for a PostgreSQL data source.
- redshift, for an Amazon Redshift data source.
- snowflake, for a Snowflake data source.
- spark, for a Spark SQL data source.
- sybase, for a Sybase data source.
- teradata, for a Teradata data source.
Yes
Collibra system nameThe system or server name of the data source. This field is also the full name of your System asset in Data Catalog.
This field is required only if you set the Collibra system name flag field as
True. By default, the Collibra system name flag field is set as
False. For more information about the Collibra system name flag field, go to
Enable and configure technical lineage on Edge.The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.
Yes
Database
The name of your database.
Yes
SchemaThe name of the default schema, if not specified in the data source itself. This corresponds to the name of your Schema asset.
Yes
ActiveAn option to determine whether to include or remove the technical lineage of the data source.
Select this option to include the technical lineage of this data source.
Clear the checkbox to exclude the technical lineage of this data source.
Yes
General This section contains general information about logging.
DebugAn option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.
Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.
No
Log levelAn option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.
No
- Click Save.
The capability is added to the Edge site.
The fields become read-only.