2020.11

This release is only available for Collibra Data Intelligence Cloud. Features and enhancements that are marked with cloud-only will never become available for on-premises environments.

Generally available features

New features

Collibra Console

  • The Migration feature is no longer supported for backups of versions 5.1.x and older.

Collibra Data Catalog

  • Data Catalog can now ingest Tableau 2020.2 and newer if you enable the Tableau metadata API in Collibra Console.
  • Power BI Data Set Column asset pages now show a technical lineage tab.
  • Sensitive data is now obfuscated after profiling if you enable the Anonymize data option in Collibra Console.

Collibra Data Lineage

  • You can now ingest Power BI metadata into Data Catalog using the Power BI harvester.

Collibra Integrations

  • Collibra Data Intelligence Cloud now supports JSON Web Token (JWT)-based authentication for applications using the REST API.
  • To avoid any confusion about versions, the APIs have a now a new field "displayVersion", next to the existing "fullVersion". The displayVersion is the version that will be shown in all user interfaces. Also, the versions of Collibra Data Intelligence Cloud and Collibra Console will now be identical.

Collibra Data Governance

  • You can now enable refreshed navigation in Collibra Console, with following improvements:
    • You now see a Home button in the upper left corner.
    • You now see an expandable browser pane with the Organization Browser and Asset Views.
    • Dashboards are now presented as tabs.
    • You now see an expandable product menu to switch between products.
    • Quick search is now contextual for communities and domains, but you can no longer select a search filter or category.

    Collibra will monitor the user adoption of the refreshed navigation and aims to sunset the classic navigation in 6 months.

    Note For upgrades to 2020.11:
    • Refreshed navigation is automatically enabled in your testing environments.
    • Classic navigation is enabled in your production environment.

  • When refreshed navigation is enabled, you may have to update any former UI customizations such as background colors, the global create button and logo.
  • The color scheme of Collibra Data Intelligence Cloud is updated.
  • You can now check whether a migration fails before running the actual migration.
  • The usability and accessibility of the Responsibilities tab pages are now improved.

API

  • You can now enable and disable users using the Java and REST API v2.
  • You can now get the current user's global permissions using the REST API.

Enhancements

Collibra Data Catalog

  • Catalog experience is now enabled on asset pages of BI assets.
  • You can now use push down sampling for a range of SQL-based data sources.

Collibra Data Lineage

  • Data objects are now grouped by node type instead of table type in the Browse tab pane.
  • Custom lineages are now stitched.
  • Data objects now show their node type in the tool-tip in the technical lineage diagram.

Collibra Data Governance

  • If opening a diagram takes too long or causes Collibra Data Intelligence Cloud to read too much data, the diagram does not open but an error message appears. You can configure the limits in Collibra Console.
  • The buttons in the diagram editor and the filter pane have been updated to improve accessibility.
  • Newly created and copied views are now private by default.
  • If you have the "Manage shared Views, Dashboard and Search Filter" permission, you can now save a relation table view on an asset page and apply it for all users.
  • When using SAML IdP as authentication provider, you no longer have to provide a first name and last name in the token. Fields with an empty value are set to blank in Collibra.
  • When exporting scoped assignment of one or more asset types, you now also automatically export their global assignment, even when it is not selected. This avoids conflicts when the target environment does not have a global assignment for the asset types.
  • All logged user actions now mention the session ID.
  • The authentication logs now contain the full user agent information.
  • Session IDs are now hashed in the logs to increase security.
  • The logs now contain more information about authentication events.
  • The UserAuthenticationListener logs now shows the final result of a user login attempt.
  • When using Open API with basic authentication, only one session is created for the user, which improves performance and logging.
  • We have fixed some security issues by removing a flash plugin in the text editor.

  • The "Upgrade history" button now upgrades the activity history after you have upgraded to 2020.11|5.7.7, instead of migrating "activity stream" entries from Collibra DGC 4.x to Collibra DGC 5.x "history" entries.

Collibra Data Privacy

  • In accordance with GDPR Article 30 requirements, we've added new business-critical attribute types to the global assignments of asset types Party and Business Process assets. This enhancement is also reflected in:
    • The Process Register Tableau report and the Process Register Athena view associated with Collibra Insights.
    • The Third Party Privacy Profile Import template that you can use to import and map your third-party information for GDPR and CCPA.

Collibra Insights

  • In the Data Maturity report, the Ownership metric now takes into account responsibilities that are assigned to both users and user groups. Previously, only responsibilities assigned to users were taken into account.
  • When applying an Athena schema, all previously created tables are now deleted and replaced by new tables that reflect the applied schema of the reporting data layer.
  • New information logs for ETL processing are now available.
  • A new complex relations view is now available for Collibra Data Governance Center (on-premises) customers.

API

  • The JavaDoc of fields of class PagedResponse is now updated to include information about replacements for deprecated fields.

Performance

  • The Repository database size has reduced by approximately 30% due to several database changes.
  • The data to store hyperlinks now consumes up to 70 times less storage.
  • The performance to bulk remove data is now up to five times faster.
  • Database schema optimizations has improved the performance of export jobs by 20% to 50%.

Fixes

Collibra Data Catalog

  • Assets created by synchronizing Tableau, S3 and Data sources are now properly indexed and available in the search. (ticket #53581)
  • Jobserver ingestion and profiling logs now show information about the driver, database and schema selection.
  • Quantile calculation no longer fails for timestamp columns.
  • Jobserver no longer profiles a table if all columns have unsupported data types.
  • Collibra Data Intelligence Cloud now correctly detects columns with data type Whole Number and shows the profiling and sample data on the Column's asset page.

Collibra Console

  • When creating a diagnostics file, the benchmark report is now correctly created. (ticket #53006)
  • The Collibra Console and Jobserver service logs are now correctly purged. (ticket #51542)
  • The SAML configuration option "14.5.1.k.Ignore endpoint scheme differences" in the DGC service configuration is no longer available.
  • You can now configure a number of HTTP security headers in Collibra Console.

Collibra Data Governance

  • An error message is erroneously shown when you delete an asset.
  • Improved search results for resources that include an underscore (_) in their names.
  • If SAML is enabled and sign in fails because the Search service is down, a more helpful error message is now shown on the sign in page.
  • When a job is canceled, the job status is now immediately updated in the Activities table.
  • If you open a direct link to a resource for which you do not have view permission, you now see the message 403 Forbidden.
  • After logging in using a SAML IdP, you are now redirected to the original URL instead of your default dashboard.
  • You no longer see a blank page when SSO is enabled and guest access has been disabled.
  • The system asset types "String type" and "Script type" are no longer used in 2020.11 or newer and can thus be deleted if you migrated them from a 4.x environment.
  • When you crop a diagram, you see again nothing but the selected content.

Collibra Insights

  • All fields in the reporting data layer parquet files are now correctly marked as optional.
  • When a responsibility is assigned to a user group, corresponding data is now shown at the group level, instead of at the level of the users in the group. Two new fields, group_id and group_name, have been added to the reporting data layer Responsibility table.
  • Asset reports now correctly include only assets.
  • Elements of the Collibra meta model for which the meta flag is set to True are no longer included in the reporting data layer.

API

  • The REST API call to fetch all workflow tasks of a user now retrieves the correct data. Also, the performance of this call is improved.