Set up Unified Data Classification

Before you can start configuring and using Unified Data Classification data classes, you have to set up your environment.

Prerequisites

• You have registered a data source via Edge and have synchronized one or more schemas.

  For Databricks Unity Catalog, you have set up and integrated Databricks Unity Catalog data sources.
  For Dataplex Catalog, you have set up and integrated Dataplex Catalog data sources.

• You have a global role with the Product Rights > System administration global permission.
• You have a global role that has the Manage connections and capabilities global permission, for example, Edge integration engineer.

Steps

1. Ensure that the Unified Classification enabled setting is enabled and that the Classification job execution timeout setting is defined as desired.
   

   Show how

   Depending on your environment, follow this procedure either in Collibra Console or on the Services Configuration tab of the Collibra settings:

   Collibra Console Collibra Settings

   Important You can't edit the service configuration from the Settings page in the latest UI. If you use the latest UI, you can edit the service configuration only in Collibra Console. For more information, go to DGC service configuration settings.

   Prerequisites

   You have the ADMIN or SUPER role in Collibra Console.
   You have a global role with the Product Rights > System administration global permission.
   The Services Configuration tab is available in the Collibra settings.

   Steps

   1. Open the Services Configuration tab:

      1. On the main toolbar, click → Settings.
         The Settings page opens.
      2. Click Services Configuration.
      3. Click Edit configuration.

      Open the DGC service settings for editing:

      1. Open Collibra Console.
         Collibra Console opens with the Infrastructure page.
      2. In the tab pane, expand an environment to show its services.
      3. In the tab pane, click the Data Governance Center service of that environment.
      4. Click Configuration.
      5. Click Edit configuration.
   2. In the Data Classification configuration section, verify that the Unified Classification enabled setting is enabled.
      

      Setting

      Description

      Unified Classification enabled

      Enables the Unified Data Classification method on Edge. True (default): The environment uses the new classification method, Unified Data Classification. This has an impact on the available data classes, the required capabilities, and the way you classify data. Note All existing data classes and classifications become unavailable. Tip  A migration process is available via setting Unified Classification migration tool enabled. False: The feature is not enabled.

      Note You don't need to enable the Enable Data Classification setting in the Data Classification configuration section. This setting is no longer applicable because it relates to a deprecated Data Classification method.

   3. Update the Classification job execution timeout if needed.
      This timeout is the maximum amount of time (in seconds) that a data classification job can run until it is canceled. The default value is 604,800, which is 1 week. This is also the maximum value.
      

      Note You can still change timeout limits for various stages in the classification job when you configure a Catalog Data Classification Edge capability.

   4. Click Save all.

2. For each data source that you want to classify, add the Catalog Data Classification capability to the Edge connection.

   Note 

   1. If you used the old Edge classification method before, it's possible that Collibra already created the capabilities for you with the upgrade to 2024.07. For more information, go to Migrating to Unified Data Classification.
   2. If you are classifying data from Databricks Unity Catalog or Dataplex Catalog integration, the Catalog Data Classification capability is created automatically during synchronization. Therefore, you do not need to create one manually.
   Show how

   1. Open a site.
      1. On the main toolbar, click → Settings.
         The Settings page opens.
      2. In the tab pane, click Edge.
         The Sites tab opens and shows a table with an overview of your sites.
      3. In the table, click the name of the site whose status is Healthy.
         The site page opens.
   2. In the Capabilities section, click Add capability.
      The Add capability page is shown.
   3. Enter the required information.

      Field	Description	Required
      Capability	This section contains general information about the capability.
      Name	The name of the capability.	Yes
      Description	The description of the capability.	No
      Capability template	The capability template. The value that you select in this field determines which sections appear on the page. Select the following capability: Catalog Data Classification	Yes
      Connection	This section contains information to connect to the data source.
      JDBC connection	The connection to the data source.	Yes
      Other Settings	This section can contain additional capability properties. Currently, you can use it to configure timeout limits for the data classification job. Click + Add Other Settings to add settings. By default, timeout limits are defined for the various stages in the data classification job. The default value for each stage is 86,400 seconds, which is 1 day. In the capability, you can change these timeouts. Timeout limit for the entire classification process The relevant parameter names are: table-classification-timeout table-classification-timeout-unit The maximum value is 604,800, which is 1 week. Example  Type Value Type Name Example value Text Plaintext table-classification-timeout 2 Text Plaintext table-classification-timeout-unit DAYS Query timeout limit for getting samples from the data source The relevant parameter names are: table-sampling-queries-timeout table-sampling-queries-timeout-unit The maximum value is 604,800, which is 1 week. Example  Type Value Type Name Example value Text Plaintext table-sampling-queries-timeout 43200 Text Plaintext table-sampling-queries-timeout-unit SECONDS Query timeout limit for processing the samples The relevant parameter names are: table-sampling-processing-timeout table-sampling-processing-timeout-unit Example  Type Value Type Name Example value Text Plaintext table-sampling-processing-timeout 18 Text Plaintext table-sampling-processing-timeout-unit HOURS For information on the process, go to Understanding the automatic data classification process For any of the timeout limits, you have to add 2 settings: The first setting is an amount, expressed as an integer, for example 1, 12, or 10,000. The second setting is the unit of time, for example DAYS, HOURS, or SECONDS. You can specify any of the following units of time NANOS: Nanoseconds MICROS: Microsecond MILLIS: Millisecond SECONDS: Seconds MINUTES: Minutes HOURS: Hours DAYS: Days Important  Timeout limits that you configure in the Edge capability can't exceed the value that is set in the Classification job execution timeout setting in Console. The unit value you enter must be in uppercase, for example SECONDS.	No
      General	This section contains general information about logging.
      Debug	An option to automatically send Edge infrastructure log files to Collibra Platform. By default, this option is set to false. Note We highly recommend to only send Edge infrastructure log files to Collibra Platform when you have issues with Edge. If you set it to true, it will automatically revert to false after 24h.	No
      Log level	An option to determine the verbosity level of Catalog connector log files. By default, this option is set to No logging.	No

   4. Click Create.
      The capability is added to the Edge or Collibra Cloud site.
      The fields become read-only.

3. Give the Edge site user the following global permissions:

   • Classification > Data Classes > Read
   • Classification > Data Classes > List Values
   • View Permissions > View All

4. Give your data stewards the global permissions they need. For more information, go to Required permissions.

   Tip 

   The available classification permissions are:

   • Classification > Data Classes > Classify
     
   • Classification > Data Classes > Read
     
   • Classification > Data Classes > Add
     
   • Classification > Data Classes > Update
   • Classification > Data Classes > Remove

What's next

Users with the correct permissions can now start configuring the data classes.

Tip If another classification method was used before, you can migrate the old data classes and classifications to Unified Data Classification. For more information, go to Migrating to Unified Data Classification.