Add a technical lineage capability to an Edge site

After prepared the Data Catalog physical data layer and created a shared storage connection if needed, you can create a technical lineage by adding a technical lineage capability to the Edge site.

Requirements and permissions

A global role that has the following global permissions:

  • System administration
  • Manage connections and capabilities, for example Edge integration engineer.
  • Register profiling information

Steps

Tip 

Select a data source and the connection type if needed to see the related information to create the technical lineage for your data source.

Currently, you see the information for:

  1. Open an Edge site.
    1. On the main menu, click , and then click Settings.
      The Settings page opens.
    2. In the tab pane, click Edge.
      The Edge sites overview appears.
    3. In the Edge site overview, click the name of an Edge site with the status Healthy.
      The Edge site page appears.
  2. In the Capabilities section, click Add capability. For Collibra Data Lineage to stitch the data objects in your technical lineage to the assets in Data Catalog, add a Catalog JDBC ingestion capability before you add the technical lineage capability.
    The Add capability page appears.
  3. Enter the required information.
    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Redshift

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    ViewsThis query retrieves the view definitions.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Spark

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Select the Technical lineage capability template for your data source to create a technical lineage for the JDBC data source.

    Important Technical lineage via Edge is only available in private beta. Please create a support ticket to get access.

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    Object namesThis query retrieves a list of object names from which technical lineage can be created. The objects can include stored procedures, views, macros, and so on.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Azure

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    SynonymsThis query retrieves the alternative names for the database objects.
    ViewsThis query retrieves the view definitions.
    Other queriesThis query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Azure

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    SynonymsThis query retrieves the alternative names for the database objects.
    ViewsThis query retrieves the view definitions.
    Other queriesThis query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Azure

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Schema

    The name of the default schema, if not specified in the data source itself. This corresponds to the name of your Schema asset.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    SynonymsThis query retrieves the alternative names for the database objects.
    ViewsThis query retrieves the view definitions.
    Other queriesThis query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for DataStage

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    Shared storage connection

    The shared storage connection that you created.

    Yes

    Mask

    The pattern of the file names in the directory. By default, the value is *.

    No

    Source configuration

    The connection definitions, where you specify relevant translations for each data source. Specify the following properties in JSON format and enter the content in this field.

    Tip If you previously created a technical lineage for this data source with connection definitions by using the lineage harvester, you can enter the content from the connection_definitions.conf file in this field.

    No

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Db2

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    ViewsThis query retrieves the view definitions.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Bigquery

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Project ID

    The ID of the project.

    Tip You can add extra project IDs by clicking Add property.

    Yes

    Region
    The location of your BigQuery data. This is the region that you specified when you create a data set.

    No

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    Columns tailThis query retrieves all columns tails.
    ViewsThis query retrieves the view definitions.
    Dataset namesThis query retrieves all logical units in the project.
    Other queriesThis query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Greenplum

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    ViewsThis query retrieves the view definitions.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Hive

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    External database name

    The database value to be used in the asset path (system -> database -> schema -> table).

    No

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    Object namesThis query retrieves a list of object names from which technical lineage can be created. The objects can include stored procedures, views, macros, and so on.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical lineage for IICS

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    IICS connection

    The shared storage connection that you created.

    Note A shared storage connection is required for you to synchronize the technical lineage after you add the capability. Use the Login URL and Username fields in the capability to connect to Informatica Intelligent Cloud Services (IICS) environment. This behavior will be changed in a future release so that you can use the IICS connection instead of the shared storage connection.

    No

    Login URL

    The URL of the Informatica Intelligent Cloud Services environment sign-in page. For example: https://dm-us.informaticaintelligentcloud.com.

    No

    Username

    The username that you use to sign in to Informatica Intelligent Cloud Services.

    Yes

    Password

    The password that you use to sign in to Informatica Intelligent Cloud Services.

    Tip You can select To be encrypted by Edge management server or Encrypted with public key to indicate the encryption method.

    Yes

    Objects

    The objects that you want to export. Each object requires a path and a type, for example:

    "objects": [
    	{
    		"path" : "Sales",
    		"type" : "Project"
    	}, 
    	{
    		"path" : "Finance/Task_Flows",
    		"type" : "Folder"
    	},
    	{
    		"path" : "Common/Task_Flows/tf_CalendarDimension",
    		"type" : "Taskflow"
    	}
    ]

    Tip For more information about the objects that you can export and the required information, go to the Informatica documentation.

    No

    Parameter files

    The Informatica Intelligent Cloud Services parameter files.

    No

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Informatica

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    Shared storage connection

    The shared storage connection that you created.

    Yes

    Mask

    The pattern of the file names in the directory. By default, the value is *.

    No

    Source configuration

    The connection definitions and system names. Specify the following properties in JSON format and enter the content in this field.

    Tip If you previously created a technical lineage for this data source with connection definitions by using the lineage harvester, you can enter the content from the source ID configuration file in this field.

    No

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical lineage for Matillion

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    Matillion connection

    The shared storage connection that you created.

    Note A shared storage connection is required for you to synchronize the technical lineage after you add the capability. Use the URL, Authentication type, Username and Password/Token fields in the capability to connect to Matillion. This behavior will be changed in a future release so that you can use the Matillion connection instead of the shared storage connection.

    No

    Authentication type

    The authentication details for signing in to Matillion. You can select one of the following values:

    Credentials
    Use the username and password authentication type.
    Token
    Use the token-based authentication type.

    Yes

    Username

    The username that you use to sign in to Matillion.

    This field is required if you set the Authentication type field to Credentials.
    Password/Token

    The password or token that you use to sign in to Matillion.

    Tip You can select To be encrypted by Edge management server or Encrypted with public key to indicate the encryption method.

    Yes

    URL
    The URL of your Matillion environment. For example, https://<domain name> or https://<IP address>.

    Yes

    Group Name
    The name of your group in Matillion.

    Yes

    Project Name

    The name of your project in Matillion.

    You can only add the name of one project. If you want to create a technical lineage for other projects, add a technical lineage for Matillion capability for each project.

    Yes

    Environment Name

    The name of your environment in Matillion.

    You can only add the name of one environment. If you want to create a technical lineage for other environments, add a technical lineage for Matillion capability for each environment.

    Yes

    Dialect

    The dialect of the database.

    Select one of the following values:

    Snowflake
    A Snowflake data source.
    Redshift
    An Amazon Redshift data source.

    Yes

    Start timestamp

    The timestamp of tasks in Matillion, which indicates the amount of metadata that technical lineage via Edge collects.

    Specify this field with a UNIX timestamp in milliseconds. The default value is 1, which gets as much history as Matillion provides. Matillion provides 7 days of history by default.

    Yes

    Source configuration

    The source configuration for the data source.

    No

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Mysql

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    ViewsThis query retrieves the view definitions.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Netezza

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    ViewsThis query retrieves the view definitions.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Oracle

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    Database linksThis query retrieves links to other databases.
    SynonymsThis query retrieves the alternative names for the database objects.
    ViewsThis query retrieves the view definitions.
    Materialized views This query retrieves materialized view definitions.
    Other queriesThis query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Postgres

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    ViewsThis query retrieves the view definitions.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Hana

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    SQL active

    An option to determine whether to include or remove the technical lineage of the data source with the SQL based input.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    No

    Calculated views active

    An option to determine whether to include or remove the technical lineage of the data source with the calculated views input.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    No

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    ViewsThis query retrieves the view definitions.
    Calculated viewsThis query retrieves calculated views.
    Dependencies of calculated viewsThis query retrieves dependencies of calculated views.
    Cross-references of calculated viewsThis query retrieves cross references of calculated views.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Snowflake

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    ViewsThis query retrieves the view definitions.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Mssql

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    Database linksThis query retrieves links to other databases.
    SynonymsThis query retrieves the alternative names for the database objects.
    ViewsThis query retrieves the view definitions.
    Other queriesThis query retrieves other data that technical lineage needs, for example stored procedures, functions, and packages.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for SQL Server Integration Services (SSIS)

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    Shared storage connection

    The shared storage connection that you created.

    Yes

    Mask

    The pattern of the file names in the directory. By default, the value is *.

    No

    Source configuration

    The connection definitions, where you specify relevant translations for each data source. Specify the following properties in JSON format and enter the content in this field.

    Tip If you previously created a technical lineage for this data source with connection definitions by using the lineage harvester, you can enter the content from the source ID configuration file in this field.

    Copy code

    No

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Sybase

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    ViewsThis query retrieves the view definitions.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Teradata

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    JDBC connection

    The JDBC connection that you created for Catalog JDBC ingestion.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    External database name

    The database value to be used in the asset path (system -> database -> schema -> table).

    No

    Database name

    The name of your database.

    Tip You can add extra database names by clicking Add property.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    Queries

    The queries to download all the data that is required to create technical lineage. The queries vary depending on the data source you use. The query code is automatically available. However, you can modify the query code if needed.

    Example Enter the following filter in a Views query: where v.table_schema not in ('pg_catalog', 'information_schema');. This query excludes the pg_catalog and information_schema schemas, which don't contain customer data. If you want to exclude other schemas, adjust the query to, for example where v.table_schema not in ('pg_catalog', 'information_schema', 'another_schema');.

    QueryDescription
    ColumnsThis query retrieves all columns, tables, schemas, databases or projects in the form: database or project > schema > table > column.
    Object namesThis query retrieves a list of object names from which technical lineage can be created. The objects can include stored procedures, views, macros, and so on.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for Custom Lineage

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    Shared storage connection

    The shared storage connection that you created.

    Yes

    Mask

    The pattern of the file names in the directory. By default, the value is *.

    Note Technical lineage via Edge ignores this field. This field will be removed in a future release.

    No

    Source configuration

    The source configuration for the data source.

    No

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

    FieldDescriptionRequired?
    Capability

    This section contains the general information about the capability.

    Name

    The name of the Edge capability.

    Yes

    Description

    The description of the Edge capability.

    Yes

    Capability template

    The capability template, which determines the next available sections.

    Select the following Edge capability:

    Technical Lineage for SqlDirectory

    Yes

    Main

    This section contains the information for creating a technical lineage.

    Source ID

    The name of the data source. Specify a name that is unique.

    Yes

    Delete Raw Metadata After Processing

    Technical lineage via Edge harvests metadata from specified data sources and uploads it in a ZIP file to a Collibra Data Lineage service instance, for processing. This option indicates whether or not the source metadata should be deleted after it is processed.

    Select this option to indicate that the source metadata is deleted after processing.

    Clear the checkbox to keep the source metadata after processing. The metadata is stored in the Collibra infrastructure.

    Note Selecting this option can negatively impact performance.

    No

    Shared storage connection

    The shared storage connection that you created.

    No

    Mask

    The pattern of the file names in the directory. By default, the value is *.

    Yes

    Dialect

    The dialect of the database.

    Yes

    Collibra system name

    The system or server name of the data source. This field is also the full name of your System asset in Data Catalog.

    This field is required only if you set the Collibra system name flag field as True. By default, the Collibra system name flag field is set as False. For more information about the Collibra system name flag field, go to Enable and configure technical lineage on Edge.

    The value of this field must be the same as the full name of the System asset that you create when you prepare the physical data layer in Data Catalog.

    Yes

    Database

    The name of your database.

    Yes

    Schema

    The name of the default schema, if not specified in the data source itself. This corresponds to the name of your Schema asset.

    Yes

    Active

    An option to determine whether to include or remove the technical lineage of the data source.

    Select this option to include the technical lineage of this data source.

    Clear the checkbox to exclude the technical lineage of this data source.

    Yes

    General

    This section contains general information about logging.

    Debug

    An option to automatically send Edge infrastructure log files to Collibra Data Intelligence Cloud. By default, this option is set to false.

    Note We highly recommend to only send Edge infrastructure log files to Collibra Data Intelligence Cloud when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.

    No

    Log level

    An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.

    No

  4. Click Save.
    The capability is added to the Edge site.
    The fields become read-only.

What's next?