Enable and calculate data similarity

The Data similarity feature requires some setup to calculate similarity scores for your data during profiling.

Prerequisites

• You are using Edge.
• If you want to use standalone Data Marketplace, Data Marketplace is enabled.

Steps

1. In the Service Configuration settings, enable the Calculate Data Similarity and define the Data similarity threshold profiling settings.

   Data similarity scores can be calculated when you profile a data source via Edge.

   Show how

   Depending on your environment, follow this procedure either in Collibra Console or on the Services Configuration tab of the Collibra settings:

   Collibra Console Collibra Settings

   Important You can't edit the service configuration from the Settings page in the latest UI. If you use the latest UI, you can edit the service configuration only in Collibra Console. For more information, go to DGC service configuration settings.

   Prerequisites:

   You have the ADMIN or SUPER role in Collibra Console.
   You have a global role with the Product Rights > System administration global permission.
   The Services Configuration tab is available in the Collibra settings.

   Steps:

   1. Open the Services Configuration tab:

      1. On the main toolbar, click → Settings.
         The Settings page opens.
      2. Click Services Configuration.
      3. Click Edit configuration.

      Open the DGC service settings for editing:

      1. Open Collibra Console.
         Collibra Console opens with the Infrastructure page.
      2. In the tab pane, expand an environment to show its services.
      3. In the tab pane, click the Data Governance Center service of that environment.
      4. Click Configuration.
      5. Click Edit configuration.
   2. In the Data profiling section,
      1. Make sure the Calculate Data Similarity setting is enabled. This setting is enabled by default for cloud environments, except for Public sector.
      2. In Data similarity threshold, define from which similarity score Table assets must be displayed as similar data.
         The default value is 0.5, which means that Table assets with a similarity score higher than 50% will show up as similar data.
         Enter a value between 0.1 and 0.9.
   3. Click Save all.

2. In the Collibra settings, enable the Data Similarity setting for Data Marketplace.
   If, for the Table asset, some assets have a similarity score higher than the defined threshold, the Similar Data tab is visible in the Data Marketplace asset preview.

   Show how

   Prerequisites:

   The Settings landing page is enabled.
   

   You are an administrator in Data Marketplace.

   Steps:

   1. On the main toolbar, click → Settings.
      The Settings page opens.
   2. In the Data Marketplace section, click Extra Options.
   3. In the Search section, click Actions and Preview.
   4. Click the Data Similarity tab.
   5. Make sure the Show Similar Data checkbox is selected. This checkbox is selected by default for cloud environments, except for Public sector.
   6. Click Save.

3. Register a data source via Edge and profile the data.

   Similarity scores are calculated for the profiled Table assets.

   Tip 

   If you don't want to calculate similarity scores for a data source during profiling, you can deactivate the calculation via the profiling capability configuration. To do this, in the capability, add the following parameter in the Other section:

   • Name: data-similarity
   • Type: Text
   • Encryption: Not encrypted (plain text)
   • Value: false
     

What's next

If a data consumer in Data Marketplace opens a Table asset preview, and similar assets are available for this table, the Similar Data tab is shown.