Configure the synchronization of a data source

After you registered your data source via Edge, you configure the synchronization of your data source by means of table rules to determine which schemas and tables are ingested and how they are ingested. After this, you can synchronize them.

Prerequisites

Steps

  1. Open a Database asset page.
  2. In the tab pane, click Configuration.
  3. In the Metadata extraction tab page, select a schema.
    Tip You can search for a schema in the drop-down list or use the filter to show only schemas with or without table rules.
  4. If required, create or edit the table rule:
    1. Do one of the following:
      • To create a new table rule, click Add table rule.
      • To edit an existing table rule, click Edit in the upper right corner.
    2. Enter the required information.
      Table rule fieldDescription
      Include

      A comma-separated list of the names of the tables you want to synchronize. You can use * as a wildcard.

      The default value is *.

      Example Out of all tables in a schema, you only want to synchronize a table with the name "CUSTOMERS" and all tables with a name that start with "ORDER". In the Include field, you enter the following: CUSTOMERS, ORDER*.

      Exclude

      A comma-separated list of the names of the tables you do not want to synchronize. You can use this table rule to do the following:

      • Synchronize all tables in a schema except the ones defined in the Exclude field.
      • Synchronize only tables as defined in the Include field, with the exception of tables that are listed in the Exclude field.

      Example You want to synchronize all tables in a schema, except a table with the name "ADDRESS" and all tables with a name that start with "PHONE". In the Include field, you enter the following: *, and in the Exclude field, you enter the following: ADDRESS, PHONE*.

      Target domain

      The Physical Data Dictionary domain in which the schema is synchronized.

      The default value is Schema domain: the metadata is placed in a domain located in the same community as the domain of your Database asset. If that domain doesn't exist yet, Data Catalog creates it.

      You can select any other Physical Data Dictionary domain for which you have a resource role with the Configure external system resource permission.

      Options

      Additional options to specify which type of tables you want to synchronize.

      Skip database views

      A checkbox to exclude database views from the synchronization process. If selected, no assets of the type Database view are created.

      Tip You can also use the table rules to include or exclude specific database views.

    3. Click Save.
      A table icon () appears next to the schema name in the schema list.
  5. If required, delete a table rule:
    1. Click Edit in the upper right corner.
    2. In the upper-right corner, click → Delete.

Note You can only synchronize schemas that have table rules.

What's next?

You can now synchronize the schemas to ingest the metadata into Collibra.