Enable and calculate data similarity

Important 

In Collibra 2024.05, we've launched a new user interface (UI) for Collibra Data Intelligence Platform! You can learn more about this latest UI in the UI overview.

Use the following options to see the documentation in the latest UI or in the previous, classic UI:

The Data similarity feature requires some setup to calculate similarity scores for your data during profiling.

Tip Even if data similarity is enabled, you can specify that you don't want to calculate similarity scores for a data source.

Before you begin

Important 

Data similarity is a cloud-only feature and is not certified for FedRAMP.

Steps

Step More details
1

In the Service Configuration settings, enable the Calculate Data Similarity and define the Data similarity threshold profiling settings.

Data similarity scores can be calculated when you profile a data source via Edge.

Depending on your environment, follow this procedure either on the Services Configuration tab of the Collibra settings or in Collibra Console:

Important Editing the Services Configuration from the Settings page isn't available in the latest UI. If you use the latest UI, you can configure these settings only in Collibra Console. For more information, go to DGC service configuration settings.

Requirements and permissions

Steps

  1. Open the Services Configuration page.
    1. On the main toolbar, click Products icon, and then click Cogwheel icon Settings.
      The Collibra settings page opens.
    2. Click Services Configuration.
    3. Click Edit configuration.
    Open the DGC service settings for editing:
    1. Open Collibra Console.
      Collibra Console opens with the Infrastructure page.
    2. In the tab pane, expand an environment to show its services.
    3. In the tab pane, click the Data Governance Center service of that environment.
    4. Click Configuration.
    5. Click Edit configuration.
  2. In the Data profiling section,
    1. Make sure the Calculate Data Similarity setting is enabled. This setting is enabled by default for cloud environments, except for Public sector.
    2. In Data similarity threshold, define from which similarity score Table assets must be displayed as similar data.
      The default value is 0.5, which means that Table assets with a similarity score higher than 50% will show up as similar data.
      Enter a value between 0.1 and 0.9.
  3. Click Save all.
2

In the Collibra settings, enable the Data Similarity setting for Data Marketplace.
If, for the Table asset, some assets have a similarity score higher than the defined threshold, the Similar Data tab is visible in the Data Marketplace asset preview.

Before you begin

The Settings landing page is enabled.

Requirements and permissions

You are an administrator in Data Marketplace.

Steps

  1. On the main toolbar, click Products icon, and then click Cogwheel icon Settings.
    The Collibra settings page opens.
  2. In the Data Marketplace section, click Extra Options.
  3. In the Search section, click Actions and Preview.
  4. Click the Data Similarity tab.
  5. Make sure the Show Similar Data checkbox is selected. This checkbox is selected by default for cloud environments, except for Public sector.
  6. Click Save.
3

Register a data source via Edge and profile the data.

Similarity scores are calculated for the profiled Table assets.

Important 

If you don't want to calculate similarity scores for a data source during profiling, you can deactivate the calculation via the profiling capability configuration. In the capability, add the following parameter in the Other section:

  • Name: data-similarity
  • Type: Text
  • Encryption: Not encrypted (plain text)
  • Value: false

What's next?

If a data consumer in Data Marketplace opens a Table asset preview, and similar assets are available for this table, the Similar Data tab is shown.