Release 2021.06

This release is the Collibra Data Intelligence Cloud release. The corresponding on-premises Collibra Data Governance Center version is 5.7.10.

Features and enhancements that are marked with cloud-only will never become available for on-premises environments.

Highlights

This scheduled maintenance includes fixes and minor improvements, as well as the below capabilities:

  • The Apache Kafka Catalog connector now supports profiling.
  • You can now register a data source Edge via in preview mode. We encourage customers who'd like early access to Edge to create a support ticket, test the new capability and provide feedback. With this preview, you can now do the following:
    • You can create capabilities and JDBC connections via an Edge site to connect to your data sources via Edge instead of Jobserver.
    • You can ingest all schemas and tables of a database simultaneously.
    • You no longer need Jobserver to synchronize your metadata.
    • Note This release still has a few limitations:
    • You cannot select which tables you want to synchronize.
    • You cannot ingest Oracle or other data sources that do not have a schema.
    • You can no longer profile and classify your metadata.
  • The lineage harvester now supports four new metadata sources in preview. This means that customers can request the lineage harvester to create a technical lineage for these metadata sources or ingest them in Data Catalog. However, we cannot guarantee that the lineage harvester is able to access all necessary metadata. If you test one of the metadata sources that are available, we kindly ask you to provide feedback via a support ticket. The following metadata sources are available for preview:
    • Power BI Report Server. We currently only support ingestion without automatic stitching or technical lineage.
    • SQL Server Reporting Services. We currently only support ingestion without automatic stitching or technical lineage.
    • AWS Glue. We currently only support AWS Glue script annotations.
    • Matillion. We currently only support Redshift and Snowflake databases in Matillion.
  • The following Collibra Data Privacy workflows are deprecated. They are no longer included in the Collibra Data Privacy CMA installation files:
    • CCPA - PIA Threshold Workflow
    • Compliance Self Assessment Start
    • Compliance Self Assessment Wizard
    • DPIA Start
    • DPIA wizard
    • GDPR - DPIA Threshold Workflow
    • Legitimate Interest Assessment Start
    • Legitimate Interest Assessment Wizard
    • PIA Start
    • PIA wizard

    All instances of these workflows in your environment will continue to work. They will not be deleted when you install a new CMA file, but they are no longer updated and no longer supported.

New features

Data Catalog

  • You can now register a data source via Edge and synchronize the metadata of all schemas in a database.
  • The Apache Kafka Data Catalog connector now supports data profiling.

Collibra for Desktop

  • You can now follow hyperlinks within Collibra for Desktop if you enable auto hyperlinking in the Everywhere Desktop configuration section in Collibra Console. By default the feature is disabled. You also must have enabled hyperlinking in the Hyperlinking configuration section.

  • The navigation bar now has a Discover section, which includes a list of assets that may be of interest to you and a list of the most viewed assets in your environment.

API

  • The readability of list boxes in the REST API documentation is now improved, (ticket #58923)

Enhancements

Data Catalog

  • On the Data Classification Dashboard, you can now click on a row to view detailed information about each data class.

Data Lineage and BI integrations

Note Data Lineage is a cloud-only feature.

  • Nodes in the technical lineage graph now show the name and type of the children of the System asset.
  • The lineage harvester for Teradata now accepts "bteq<<EOF" and "EOF" strings in shell scripts.
  • The lineage harvester PostgreSQL JDBC driver is now updated to version 42.2.13.
  • The most common lineage harvester messages now have unique codes that are explained in the troubleshooting section of the Collibra Data Lineage documentation.

Data Governance

  • When exporting views using the Migration feature, you can now use filters and sorting to help you find relevant views.
  • You can now add trusted web domains to a whitelist to ignore the HTTP response headers configuration for calls from those web domains.

Data Privacy

  • Collibra Assessments is now available via the classic navigation of the Collibra user interface.

Edge

Note Edge is only available for cloud environments and is disabled by default. If you want to use Edge, create a Collibra support ticket to enable it and make sure you have the necessary system requirements for Jobserver and Edge.

  • Edge sites are now automatically updated when you upgrade to a newer version of Collibra Data Intelligence Cloud.
  • You can now back up or restore an Edge site.
  • You can now save Catalog connector logs locally.
  • Tables of the type "view" are now ingested as Database View assets instead of Table assets.

Shop4Data

  • The Search service now uses Elasticsearch version 7.12.1, which enables the latest functionality and security features, including TLS1.3 cyphers.

Fixes

Data Catalog

  • Tableau synchronization no longer removes workbooks and views from inconsistent data.
  • In the Physical Data Connector, you can now use the pagination arrows to navigate to the last page of the page set.
  • In the Data Classification Dashboard, children of the Data Attribute asset type, no longer disappear when saving changes in the Data Attributes drop-down menu.

Data Lineage and BI integrations

Note Data Lineage is a cloud-only feature.

  • You no longer need elevated permissions to harvest Snowflake metadata. (ticket #62598, 63576, 62219)
  • The lineage harvester now reuses a JDBC connection for each database name. (ticket #63212)
  • The lineage harvester for Teradata no longer shows "Internal error" when you use the WITH RECURSIVE clause. (ticket #63764)
  • You can now use the timeout <seconds> command to increase the time needed to connect to Microsoft for Power BI ingestion. (ticket #62842)

Data Governance

  • You can no longer edit user fields such as Phone in Collibra if they are synchronized via SSO or LDAP.
  • If you are given a view permission for an asset via a workflow, you no longer have to sign out and in again to be able to see the relevant asset. (ticket #52143)
  • Error messages about a missing global permission now explicitly mention the name of the global permission. (ticket #61327)
  • If you disable LDAP users in Collibra, they can now no longer sign in.
  • On the Data Quality tab page of an asset page, the aggregated values are correct again. (ticket #58719)
  • When you use the Migration feature to import an asset type that has ratings disabled, and that asset type has rating enabled in target environment, you now see a clear error message if one or more assets of that type have ratings in the target environment.
  • If Hierarchy is enabled in an asset table, the table no longer shows the wrong assets as the root node. (ticket #55008, 61857)
  • The Share button in Dashboards is now disabled if you do not have the required permission.
  • In asset tables, if you remove an attribute and apply it to all visible rows, the Last modified date of those assets is now updated correctly. (ticket #58240, 58243)
  • Editing a cell in an asset table and applying the change to other rows is now faster. (ticket #64738)
  • The Preview pane in asset views and diagrams shows the name of related assets again, instead of their full names. (ticket #62095)
  • When moving assets to another domain, the available domains now appear faster in the dialog box. (ticket #58412)
  • You no longer get an error message when editing the interface text in the Settings of Collibra. (ticket #60763, 61369, 62251, 62521, 64141)
  • You no longer get an error message if you create a responsibility in a community right after deleting a domain from that community.
  • You can now export the views of specific domains and communities. (ticket #65690)
  • Fixed an issue where, in certain cases, table views with hierarchy enabled were overusing resources, causing Collibra to become unresponsive. (ticket #65158, 65172, 65269)

Diagrams

  • When you apply to a diagram a filter that is conf3234igured with multiple selected attributes, filtering again works as intended. Specifically, if a view is configured to filter for values (A, B), then assets with values (B, C) pass the filter.
  • In diagrams, the Overview and the Legend are again shown, when enabled.
  • Data quality scores are again visible as overlays on diagrams. (ticket #64894, 65952)

Data Privacy

  • In Collibra Assessments, URLs to Collibra Data Intelligence Cloud now refer to localhost:port, instead of the public hostname. This means that whitelisted access to Collibra no longer results in errors when using Collibra Assessments.
  • In Collibra Assessments, drop-down lists of assets of a single type now work correctly when there are thousands of assets of that type in your Collibra environment.
  • Starting an assessment no longer results in an error.
  • On the asset page of a Business Process asset that is governed by both CCPA and GDPR, the CCPA and GDPR tabs no longer disappear when navigating between the two tabs.

Workflows

  • You can again search by resource and sort by date in the workflow instances table in the Settings section.(ticket #59066, #60204, #62077)
  • Passing an invalid variable type from a parent workflow to a sub-process no longer causes the Tasks page or task bar to crash.(ticket #61158)
  • You can now see the dialog box for the next available user task assigned to you after the start form of a global workflow when the task sidebar option is disabled.(ticket #61607, #64074, #64178)
  • The user task rich text editor field now correctly uses word wrapping.(ticket #55273, #63885)
  • Using the tab key to switch between workflow dialog box elements now correctly selects the input area of the rich text editor field.(ticket #55273, #63885)
  • You can now clear the selected value of a single value drop-down form in a workflow dialog box.(ticket #58629, #64100, #64481)
  • Custom workflow buttons now reset their value after a failed validation.(ticket #30347, #64558)
  • You can now use the drag-and-drop feature of the user task file upload field in Internet Explorer 11.(ticket #58957)
  • Clicking the label of a check box in a workflow dialog box, using Internet Explorer 11 no longer causes the dialog box to become unusable.(ticket #61639)

Collibra for Desktop

  • The details of an asset without relations are now correctly shown.
  • You can now open links that are added to attributes on domain and community pages. (ticket #64557)
  • Collibra for Desktop now correctly opens hyperlinks that contain query strings.
  • In a workflow task, any default values in rich text fields are correctly shown and sent to Collibra.

Miscellaneous

  • Links to Collibra resources that are part of a comment now work as expected in comment notification emails.(ticket #56227)

Patches

Patch 1

  • You can again sign into Collibra via SSO when a CSFR token enabled via Collibra Console.

Patch 2

  • Improved performance of checking the page permissions in Collibra environments with many domains. (ticket #63462)
  • Custom dashboard widgets no longer cause the Edge user interface to crash. (ticket #66591)

Patch 3

  • Views that have hierarchy enabled load correctly again.

Patch 4

  • The number of search results, as shown in the UI or returned via API, is again the same. (ticket #67403)