Synchronize Snowflake Listings

Synchronizing Snowflake Listings is the process of integrating listings metadata from Snowflake and making the data available in Collibra Platform.

You can synchronize manually or automate it by adding a synchronization schedule.

Note The Snowflake Listings integration currently does not support private link connectivity to Snowflake.

Prerequisites

In your Collibra environment:

Steps

  1. On the main toolbar, click Products icon → Catalog.
    The Catalog homepage opens.
  2. Click Integrations.
    The Integrations page opens.
  3. Click the Integration configuration tab.
  4. In the Integration column, click the link for your Snowflake Listings integration.
    The integration settings page opens.
  5. In the Snowflake Listings tab, click Add Configuration.
  6. Complete the fields as needed.
    FieldActionRequired
    System asset

    On the General settings tab, add the System asset that represents your Snowflake connection. If this asset does not exist yet, create it before you synchronize.

    Yes
    Default domain 

    In Default domain, select the domain that receives all listings that are not routed by a distribution-specific domain below.

    Yes
    Domain for organization listingsSelect a domain for ORGANIZATION listings. If left empty, organization listings land in the default domain. No
    Domain for external listings

    Select a domain for EXTERNAL listings. If left empty, external listings land in the default domain.

    No
    Listing states

    Select which listing states to ingest:

    • PUBLISHED
    • DRAFT
    • UNPUBLISHED

    All states are ingested by default.

    No
    Listing types

    Select which distribution types to ingest:

    • ORGANIZATION: These listings are shared within your organization across different Snowflake accounts, also known as internal listings.
    • EXTERNAL: These listings are published by your organization on the Snowflake Marketplace, making the data available to other organizations. These are also known as public listings.

    Both types are ingested by default.

    No
    Asset deletion mode

    Expand Advanced settings and set the Asset deletion mode. 

    • Soft: Assets are archived and can be restored if the model reappears. This is the recommended mode.
    • Hard: Assets are permanently deleted and cannot be recovered.
    No
  7. Click Save.
  8. Click Synchronize.
    A notification indicates the synchronization has started.
  1. On the main toolbar, click Products icon → Catalog.
    The Catalog homepage opens.
  2. Click Integrations.
    The Integrations page opens.
  3. Click the Integration configuration tab.
  4. In the Integration column, click the link for your Snowflake Listings integration.
    The integration settings page opens.
  5. In the Snowflake Listings tab, click Add Configuration.
  6. Complete the fields as needed.
    FieldActionRequired
    System asset

    On the General settings tab, add the System asset that represents your Snowflake connection. If this asset does not exist yet, create it before you synchronize.

    Yes
    Default domain 

    In Default domain, select the domain that receives all listings that are not routed by a distribution-specific domain below.

    Yes
    Domain for organization listingsSelect a domain for ORGANIZATION listings. If left empty, organization listings land in the default domain. No
    Domain for external listings

    Select a domain for EXTERNAL listings. If left empty, external listings land in the default domain.

    No
    Listing states

    Select which listing states to ingest:

    • PUBLISHED
    • DRAFT
    • UNPUBLISHED

    All states are ingested by default.

    No
    Listing types

    Select which distribution types to ingest:

    • ORGANIZATION: These listings are shared within your organization across different Snowflake accounts, also known as internal listings.
    • EXTERNAL: These listings are published by your organization on the Snowflake Marketplace, making the data available to other organizations. These are also known as public listings.

    Both types are ingested by default.

    No
    Asset deletion mode

    Expand Advanced settings and set the Asset deletion mode. 

    • Soft: Assets are archived and can be restored if the model reappears. This is the recommended mode.
    • Hard: Assets are permanently deleted and cannot be recovered.
    No
  7. Click Save.
  8. In the Synchronization Schedule section, click Add schedule.
  9. Enter the required information and click Save:
    FieldDescription
    RepeatThe interval when you want to synchronize automatically. The possible values are: Daily, Weekly, Monthly, and Cron expression.
    Cron

    The Quartz Cron expression that determines when the synchronization takes place.

    This field is only visible if you select Cron expression in the Repeat field.

    Every

    The day on which you want to synchronize, for example, Sunday.

    This field is only visible if you select Weekly in the Repeat field.

    Every first

    The day of the month on which you want to synchronize, for example, Tuesday.

    This field is only visible if you select Monthly in the Repeat field.

    At

    The time at which you want to synchronize automatically, for example, 14:00.

    • You can only schedule on the hour. For example, you can add a synchronization schedule at 8:00, but not at 8:45.
    • This field is only visible if you select Daily, Weekly, or Monthly in the Repeat field.
    Time zoneThe time zone for the schedule.

What's next

The synchronization job synchronizes the Snowflake Listings data.
After the synchronization: