Release 2024.07

Data Catalog

• A migration process for Unified Data Classification is available. The process copies classification information from old, deprecated classification methods into the Unified Data Classification method and creates new data classes based on existing Advanced Data Types (ADTs).
  • If Unified Data Classification was already enabled before 2024.07, nothing changes in your environment.
    If you want to migrate old classification information and ADTs, you can manually start the migration after you have activated the migration setting.
  • If another classification method was in use (old Edge classification or the Cloud Data Classification Platform), we will enable Unified Data Classification and complete the migration process during the 2024.07 upgrade.
    You can, for now, still deactivate Unified Data Classification and restart the migration process later. However, remember that the other classification methods will reach its end of life on September 30, 2024.
  • If the Classification API was used and Unified Data Classification was not enabled, we will enable Unified Data Classification and complete the migration process during the 2024.07 upgrade. You need to update your client applications or workflows that call the API.
    If the Classification API was used and Unified Data Classification was already enabled, nothing changes.
  Note This migration affects Protect. For more information, go to the Protect release note in the Enhancements section below.

Data Lineage and BI integrations

• The shared database model feature is now generally available. Sharing database models allows you to provide table-definition details from an independent data source to a data source that is dependent on those details. This mitigates analysis errors and allows for a complete lineage that includes lineage from the SQL statements from dependent data sources.

• Technical lineage for Databricks Unity Catalog is now generally available.

AI Governance

• You can now:
  • Configure which assessment types you want added in the Lifecycle Tracker when a new AI use case is registered.

  • Configure the assessment types to be added in the Lifecycle Tracker when the AI use case evolves from one lifecycle stage to the next, for example from Ideation to Development.

• “Decision gate” activities are now automatically added to the Lifecycle Tracker when you change the lifecycle stage of an AI use case, for example from Ideation to Development, or vice versa. Decision gates allow you to describe and capture the decisions and justification for advancing or regressing the stage of the use case.
• You can now add “decision record” activities to the Lifecycle Tracker. Decision records allow you to capture any pertinent information regarding the decisions you and other stakeholders make about the AI use case.
• Prior to this release, you could only access the Business User landing page or the AI Legal Review landing page, based on your global role. Those landing pages are now the AI Governance landing page and the AI Legal Reviews page, respectively, and you can access either regardless of your global role. You only need access to AI Governance.
• The following AI Governance-specific workflows are deprecated and are no longer included in Collibra installations. They no longer appear in the Workflow definitions section in the Settings.
  • Register AI Use Case
  • Copy assessment answers to AI Use Case asset
  The functionality previously carried out by these workflows is now integrated in Collibra, instead of being carried out by the workflows. This change does not require any action from you.

Data Governance

• If you have a new license model, you can now request responsibilities for domains or assets via Actions → Request Responsibility.

Protect

• You can now create drafts of standards and rules using the new "Create Draft" button. This allows you to work on a standard or rule without immediately starting the sync. (idea #DCC-I-3011)
  Tip To start the sync, you need to click "Publish."

Miscellaneous

• On the Custom Theme page:

  • You can now customize primary and secondary button colors specifically for a dark background using the new "Primary Button on Dark Background" and "Secondary Button on Dark Background" components.

    Note Your previously customized primary button colors are applied to primary buttons on a light background.

  • The "Secondary Button" component now includes more button types, such as outline buttons, split buttons, and button groups.

    Note Your previously customized secondary button colors are no longer applied. You can customize them again using the updated "Secondary Button" component. When doing so, prioritize readability and accessibility.

Data Catalog

• When Unified Data Classification is activated, the Catalog profiling process no longer starts the old Edge classification process automatically.
• You can now easily view the structure of Array and Struct technical data types by clicking "View Array" or "View Struct" in the "At a Glance" pane on Column asset pages, or in tables on asset pages and asset views.
  See an example

  

• The Catalog Recommender is enhanced to improve its performance and efficiency:
  • When the "Catalog Recommender Enabled" setting is disabled, data similarities are no longer computed. This may result in a delay for customers who re-enable the Recommender as similarities are recalculated.
  • The recommender process now automatically removes old events, helping to reduce disk space and memory consumption.
• We now support copying existing synchronization rules between schemas. In Catalog, you can streamline a database synchronization configuration by copying existing synchronization rules from one schema to other schemas. This saves time and ensures consistency in the synchronization configuration. (idea #DCC-I-739)
• You can now use the “Tableau API timeout” setting in Collibra Console to limit how long (in seconds) an HTTP connection between Collibra and a remote Tableau server will stay open when there is no response from the Tableau server. The default value is 600 seconds.
  
  Note This setting applies only to Tableau integrations via Jobserver. The end of life of Jobserver and all related Jobserver integrations has been announced for September 30, 2024. This means that the Tableau via Jobserver integration method is deprecated and will also reach its end of life on September 30, 2024.
• To make the process of checking the Edge cache for samples much faster, the "Sampling optimization enabled" setting is now enabled by default in all environments.
• When you integrate Google Dataplex, the URL is now synchronized for the Dataplex Lake and Dataplex Zone.

Data Governance

• Rebuilding automatic hyperlinks is now available only .

• You can now enable or disable downloading and uploading attachments. Contact Collibra Support for more information.
• Collections are now generally available. Collections allow you to group assets into organized lists. They help you work more efficiently because they give easy access to the assets you need.
• You can now upload images into text attributes on asset pages. This prevents the issue of reaching your allowed character limit too quickly.
• Script attributes now apply syntax highlighting for better readability.
• In the asset type layout editor, sysadmins can now view the characteristic type description while editing the layout.
• The AI Use Case placeholder is shown on your editor layout and the content is filled in by Collibra.
• Within the Operating Model pages of the Collibra Settings, you can now view the public IDs of asset types, attribute types, relation types, complex relation types, domain types, and scopes. If they are not protected, you can also edit the public ID.
• When you create an articulation score rule with a status in the Condition Value field, suggested statuses are shown first. If the status you want is not in those options, you can also view all the statuses.
• We improved the loading time of the "Assets" tab on domain pages when the view contains a very large amount of assets with many complex relations.
• We improved the performance of sorting by responsibilities for views with a very large amount of assets.
• For a seamless import experience, during an export, Collibra now translates the asset table headers that the import wizard uses to perform auto-mapping.

Assessments

• When editing an assessment, you can now use the new "Cancel" button to view the entire assessment, without having to reopen it from the landing page.
• The "Copy" button in an assessment is now renamed "Retake" to better describe its purpose. The button still allows you to duplicate an assessment in the Draft status. You can also retake an assessment from the Assessments landing page and the Assessment Review asset page using the new "Retake Assessment" button.
  Note An assessment can be retaken even if the template used in the original assessment isn't the latest. The new assessment, however, always uses the latest version of the template.
• When using an asset picker in an assessment, you can now filter the assets by communities and domains using the new "Filter Assets by Organization" checkbox.
• When configuring an asset picker in a template, you can now specify multiple asset types, include child asset types, and specify asset statuses, giving you more control and flexibility over asset selection.
  
  Details

  • The "Asset Types" setting allows you to select more than one asset type for the asset picker, broadening the range of assets available in an assessment.
  • The new "Include Child Asset Types" setting allows you to include both selected asset types and their respective child asset types in the asset picker, providing a more inclusive selection.
  • The new "Asset Status" setting allows you to select the statuses by which you want to filter the assets in the asset picker, ensuring only relevant assets are shown.
• Properties in an assessment are now shown in a sidebar instead of a tab, making them easier to find.
• You can now delete a custom template only if it's not used in an assessment that's in the Draft status.
• When configuring an asset picker in a template, you can now specify multiple asset types, broadening the range of assets available in an assessment.

Protect

• As a result of the migration to Unified Data Classification, the following changes occur in Protect:
  • If data classes were previously used in standards and rules, they are removed from them.
    Important To mitigate this loss, before the migration, capture the data classes used in standards and rules. After the migration, you can add those data classes back to the standards and rules.
  • The synchronization statuses of active standards and rules that use data classes change from "Active" to "Failed" upon the next synchronization.
    Important Although the synchronization status shows “Failed,” such standards and rules continue to be enforced in data sources, ensuring ongoing data protection.
  For more information, go to the Support Portal.
• On the “Groups” tab, you can now filter the groups by group name and system reference, and sort the groups by group name and created date.

Workflows

• Uploading a workflow with a modified description now updates the description saved in Collibra.

Workflow Designer

Note Workflow Designer enhancements become available with the upgrade of production environments.

• You can now add a domain type filter to the Domain Collibra data entry component by specifying the ID of a domain type in the "Domain type ID" field. (idea #DCC-I-1315)
• You can now include assets from meta domains and meta asset types in the Asset and Asset type Collibra data entry components by clearing the "Exclude meta" filter.

Edge

•  We now support the following versions for our managed Kubernetes clusters:
  • AKS 1.29
  • AWS Fargate using EKS 1.29
  • EKS 1.29
  • GKE 1.29
  • OpenShift 4.15

Search

• If your search text doesn't match any existing content, results are now shown for the closest matching text. This increases the chances of finding the correct information, even with typographical errors in the search text.
• If you don't have permission to create a search filter, you're no longer presented with the option to create one.

Usage Analytics

Note Usage Analytics enhancements become available 1-2 days after the upgrade of environments.

• The “Most Visited Assets” section now shows asset names along with their asset type icons and symbols, making it easier to identify and distinguish assets without having to open each one.
• Legend selections on charts are now retained when updating filters, simplifying the comparison of metrics across different filters without having to reselect the legends.

Collibra Console

• You can now use the "Backup compression level" console configuration option to choose the level of compression for backups.

API

• We added a new "License" resource to the REST Core API v2. The GET method of the "license/capabilities" endpoint allows you to check what products and capabilities are enabled in your environment.

Miscellaneous

• If you have a new license model, you can now download a "License assets usage report" from Settings → Users and Subscriptions → Assets. The report contains weekly historical data of the asset allowance and consumption.

Data Governance

• We improved the text editor:
  • When you add plain text, the text editor no longer automatically wraps the text in HTML markup. This provides a cleaner and more intuitive experience.
  • When you apply formatting, such as bold, a new line, or a list, the text editor now consistently applies HTML markup to the entire block of text, including the beginning and the end.
• The global and resource roles tables in Settings → Users and Subscriptions no longer fail to show the "Name" and "Description" columns in some rare cases.
• To provide you with the necessary data for an informed action, you can now see the details of the users while adding a responsibility to a domain or asset even if "Limit user information access" is enabled in Collibra Console.
• To avoid size limitations when exporting to Excel, the images you add to asset attributes using the rich text editor are now stored as attachments instead of inline.

• The text attribute on an asset page is now shown in full width instead of compacted mode when added. This field is shown in full width by default.
• In community tables, the description is now automatically updated without a manual refresh when changes are made.
• You can no longer click outside of a text field on Tailored Asset Pages to save your changes. You can save or discard your changes by using the "Save" and "Cancel" buttons.
• The data quality tab page now loads correctly, even when asset names contain quotes.
• We improved 'Assets' tab page of the Global Create dialog box. When there is an exact match on asset type name, that item is at the top of the list.
• The suggested tab containing the asset types relevant for the domain is now shown for users with 'Asset > Add' permissions when they are on a domain page.
• Opening a workflow definition page no longer results in an error.
• Some existing out-of-the-box attribute types, and relation types related to Dataplex and Google Cloud Platform had a UUID that was not unique. This could cause issues with, for example, the operating model migration feature. Therefore, we changed the UUIDs of the items in the list below.
  
  See the list.

  • For Attribute Type "Project Id" the ID was changed from 00000000-0000-0000-0001-002600000001 to 00000000-0000-0000-0001-003000000003
  • For Attribute Type "Project Number" the ID was changed from 00000000-0000-0000-0001-002600000002 to 00000000-0000-0000-0001-003000000004
  • For Attribute Type "Labels" the ID was changed from 00000000-0000-0000-0001-002600000003 to 00000000-0000-0000-0001-003000000005
  • For Attribute Type "Lake Id" the ID was changed from 00000000-0000-0000-0001-002600000004 to 00000000-0000-0000-0001-003000000006
  • For Attribute Type "Project Status" the ID was changed from 00000000-0000-0000-0001-002600000005 to 00000000-0000-0000-0001-003000000007
  • For Relation Type "[Dataplex Lake] contains / is part of [Dataplex Zone]" the ID was changed from 00000000-0000-0000-0001-002700000001 to 00000000-0000-0000-0001-003000000001
  • For Relation Type "[Dataplex Zone] contains / is part of [Table]" the ID was changed from 00000000-0000-0000-0001-002700000002 to 00000000-0000-0000-0001-003000000002
  • For Attribute Type "Access Type" the ID was changed from 00000000-0000-0000-0001-002800000001 to 00000000-0000-0000-0001-003000000008
    
• You can now delete the duplicate relation Type "Data Quality Rule is executed by/executes Data Quality Metric" (ID 00000000-0000-0000-0000-090000010024) can.
• You can now add large image files to the text editor of attributes.
• Asset pages no longer automatically scroll to a random place when opened.
• If you change the name of an out-of-the-box role, you now see it correctly on the title bar of domain and community pages.
• We improved the breadcrumbs on asset pages to be responsive to your screen size, zoom, and resolution.
• We fixed a Safari browser related issue for the display of workflow labels.
• When adding a comment on an asset page with check boxes and saving, the check boxes aren't shown as if they are interactive.
• Validation results are shown in the activities table and can be opened and downloaded.
• Encoded organization names are now shown correctly in the history.
• You can now select all drop-down options on an asset page regardless if the “At a glance” layout is open or not.
• If you edit complex relation types that are marked as system, the custom leg types or custom attribute types now need a minimum cardinality of 0.
• We improved hyperlinking when two assets are hyperlinked to a text and one is deleted.
• We removed the allowed values from 'Retrain Cycle' since it was transformed to a text attribute in the 2024.05 release.
• If you have a global role with the System Administration global permission, the complex relation type in edit mode no longer has the Delete icon for the system assigned leg types and attribute types.
• We fixed the complex relation types settings page where the table wasn't showing the values for the Relation IDs column correctly when selected.
• The "Save" button is removed from tables on the Operating Model section of the Collibra settings because your changes are saved automatically.
• The tables in the Operating Model section of the Collibra settings now always show the System column.

Data Marketplace

• Data Marketplace no longer shows search results based on relation indexes that go outside of the defined Data Marketplace scope.

Workflows

• Starting a workflow with the "StartWorkflowInstancesRequest" builder from an asynchronous script task no longer ignores any form properties that the script task defines.
• The latest UI now displays regex validation error messages for workflow form fields.
• The "Rich text" form validation now works as expected in the latest UI. (idea #DCC-I-3087)
• The "View relevant changes" section of a workflow task is now visible in dialog boxes, in the latest UI.
• We optimized how the "View relevant changes" section of a workflow task appears in the sidebar, in the latest UI.

Workflow Designer

Note Workflow Designer fixes become available with the upgrade of production environments.

• After a period of inactivity, you no longer see a connection error and are redirected to the sign-in page instead.

Edge

• When you install an older Edge site with automatic upgrade enabled that had not been previously installed, the Edge site now installs with the most recent version of Edge.

• When you install an Edge site via the Edge CLI method, connectivity checks for a forward proxy are now included.

• The Connections tab now loads successfully for offline Edge sites that use Vault integrations.
• If you click the JDBC log file download button multiple times, it no longer starts multiple downloads.
• When you migrate an Edge site with a Shared Storage connection from k3s to a managed Kubernetes cluster, your Edge site now installs in a healthy state, as expected.
• You can now select the Shared Storage connection option on an Edge site installed on a managed Kubernetes cluster, as expected.
• The search filter on the Connections tab of an Edge site now fully loads search results.

Search

• Relation reindexing no longer fails when a relation type is deleted.

API

• The "Output Module" resource of the REST Core API v2 no longer returns duplicate results when sorting on a large number of text attributes, some of which differing in casing.

Miscellaneous

• Adding a photo to an SSO, LDAP, or SCIM user profile no longer causes an error.
• You can no longer edit the user name of an SSO, LDAP, or SCIM account.
• Collibra-generated emails no longer show extra characters for local users that have a period in the user name.
• SCIM provisioned users now have their preferred language set in accordance with the IdP attribute if that language is supported by Collibra.
• You can now order the items in the Counters and Workflows dashboard widgets using the new drag-and-drop icon, instead of deleting and re-adding the items to change the order.
• You can now use the keyboard to navigate an auto-complete drop-down menu.
• If you schedule a job using a cron expression, for example, to synchronize a data source, Collibra DIP now transforms the cron expression to the Unix cron format in the backend. You still have to enter the cron expression in Quartz or Spring format. However, because Unix cron expressions don't include seconds and years, the fields for seconds and years are now ignored.

Collibra maintenance updates