Release 2021.07

This release is the Collibra Data Intelligence Cloud release. The corresponding on-premises Collibra Data Governance Center version is 5.7.10.

Features and enhancements that are marked with cloud-only will never become available for on-premises environments.

• Highlights
• New features
• Enhancements
• Fixes
• Patches

Highlights

This scheduled maintenance includes fixes and minor improvements, as well as the below capabilities:

• Collibra Data Lineage now supports MicroStrategy as a lineage harvester integration in preview mode. If you want to test MicroStrategy ingestion in Data Catalog, create a support ticket to request access.
• When you export your technical lineage information to CSV files, the following files and columns have been deprecated:
  • The full_indirect_constants CSV file
  • The procedure_name column in the current_graph_column lineage CSV file and the full_batch_column_lineage CSV file.
• Dynamics 365 Business Central is now available on Marketplace as a certified Catalog connector.
• After registering a data source via Edge in preview mode, you can now do the following via the Configuration tab page of a registered database's asset page:
  • Include or exclude specific schemas and tables from the synchronization process.
  • Profile and classify the synchronized metadata via Edge.
  • Enable data quality to calculate the quality score of your synchronized metadata.
• Asset Grid is a new data visualization application to make data more accessible, insightful and actionable for a variety of users and use cases. It has the potential to become a driver for Data Discovery and Data Promotion. Asset Grid is a cloud-only application.
  

New features

Data Governance

• You can now subscribe to and unsubscribe from maintenance announcements via your profile page.

Asset Grid

Note   Asset Grid is a cloud-only application.

• Asset Grid is a new data visualization application to make data more accessible, insightful and actionable for a variety of users and use cases.
• A new global role, Asset Grid Admin, and global permission, Asset Grid Administration, come packaged with your Collibra environment. This role and permission is required to use Asset Grid.

Enhancements

Data Catalog

• You can now register a data source without schemas via Edge. After registering a database that has no schema, a new Schema asset is automatically created with the same name as the database.
• The queued jobs are evaluated for execution separately from their submission to avoid thread contention and dead locks, hence enhancing the stability of an import or of any other job. (ticket #64285)
• Import jobs are now making sure that their related files are not deleted by the cleanup mechanism if the job is queued for a long time. This will ensure resiliency of long running jobs and of jobs queued for a long time.
• The default maximum number of jobs that can run in parallel in the core DIC process has increased from 5 to 15 and you can change it in the configuration. Please notice this limit only relates to the total number of running jobs. Additional limits may exist per job type. This allows you to run more jobs in parallel.
• When an import job is queued for a long time, the related files remain available until the job is completed.

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

• Collibra Data Lineage now supports SQL syntax with WITH clauses.
• The lineage harvester for Informatica Intelligent Cloud Services now supports SQL overrides.
• The most common Power BI harvester messages now have unique codes that are explained in the Collibra Data Lineage documentation.
• The lineage harvester for IBM DataStage now supports environment files.
• The lineage harvester can now process column aliases in SQL queries that are native to Teradata.
• The Power BI harvester configuration now refers to "workspaces" instead of "groups". As a result, the "groupFilter" property in the Power BI harvester configuration file is changed to "workspaceFilter".

Data Privacy

• The Assessments workflow has been renamed the Assessments Approval workflow. To enable the workflow for non-privacy contexts, you no longer have to work with the Privacy Steward resource role, which was previously hard-coded. Business Steward is now the default resource role, but as with all other workflows, you can now configure this workflow for any resource role that has the required resource permissions. You can now also configure a start event to trigger the workflow.
• When working with templates in Collibra Assessments, you can now disable the automatic numbering of questions.

Security

• jQuery is updated to version 3.6. (ticket #58052, 64717, 65320, 66237)

API

• You can now use external entity mappings in the REST Import API as an identifier for complex relations in addition to their UUID and their relation types.
• You can now use the GET method of the REST Core API /jobs endpoint to search for all the jobs managed by the Job service.

Fixes

Data Catalog

• Newline characters in the full name of a Database asset are now replaced by a space character. (ticket #64626)
• You can now show the data class of an asset on the search page again.
• When you delete a data class via the Data Classification Dashboard, the Data Classification Platform rejects the data class.

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

• The lineage harvester for Teradata now processes RENAME TABLE queries correctly. (ticket #65578)
• The technical lineage source code pane now properly displays the source code name of a predefined lineage.
• Collibra Data Lineage now correctly removes assets of the type Looker Data Set and Looker Query when you delete ML models and queries in Looker and run the lineage harvester again to synchronize your Looker metadata in Data Catalog. (ticket #65604)
• When a tile in Looker has no title, Data Catalog shows the full name of the Looker Tile asset as the display name. (ticket #67680)
• Data objects in a predefined technical lineage are now stitched again to assets in Data Catalog.

Data Governance

• The preview panel again shows responsibilities for communities, domains and assets. (ticket #64815)
• Deleting groups with many responsibilities is now faster. (ticket #64738)
• LDAP synchronization no longer fails when there are over 30 000 users. (ticket #65094)
• The dgc log now mentions an HTTP 401 Unauthorized error if authentication failed. (ticket #58278)
• Resource permissions related to attachments now only require a consumer license. (ticket #32453, 36007)
• Collibra now validates the X.509 certificates found in SAML signatures, using the certificates found in SAML Identity Provider metadata as trust anchors. (ticket #64163)
• Collibra now verifies that the X.509 certificates found both in SAML Identity Provider metadata and in SAML signatures have a validity period that covers the time at which authentications are processed. (ticket #64163)
• You can again sign into Collibra via SSO when a CSRF token is enabled in Collibra Console. (ticket #65588, 65776, 66379, 66381, 66497, 66517, 66660)
• The Validate button is now always available in asset views on application pages and the global view.
• When using the Migration feature to export views of domains and communities, you can now increase the height of rows containing long names.
• If you start a Migration export right after canceling an export, the canceled export is no longer resumed.
• You customize the logo in the Help menu again. (ticket #63700)
• You can download exported files again using Internet Explorer 11. (ticket #66671)
• When Collibra starts exporting assets or complex relations to XLS(X) or CSV, the activities icon in the top menu now spins again. (ticket #65516)
• If you have a global role with the Manage your own Views, Dashboards, Search filters global permission, you can no longer access other users' private dashboards via their URL. (ticket #59603)
• If refreshed navigation is enabled and you click one of the buttons in the top navigation bar, the button image no longer turns gray.
• In the Collibra users table, you can now correctly filter by the User Source column. Also, sorting by any column no longer shows a DataFetchingException. (ticket #65564, 66394, 66579, 67025, 67127, 67295, 67942)
• Expanding table row no longer leads to too much white space.
• Dashboards no longer load twice. (ticket #61739)
• Dashboard names now handle special characters, such as ampersands (&), better. (ticket #66347)
• If you export the user table as a CSV file, the last login date is now formatted correctly. (ticket #60714)
• The preview panel again shows responsibilities for communities, domains and assets. (ticket #64815)
• If you change the UI language on your profile page, the UI of Collibra now immediately switches to the selected language.
• The avatar of the Everyone group now appears correctly when you add it to a global role.
• If you create an asset, you can now choose from all relevant domains.
• The History tables of communities and domains now correctly show the old and the new values. (ticket #66021)
• In the quickfilter of global create dialog box, you can filter again on the letters O-B-J-E-C and T. (ticket #65807, 67564)
• You no longer see the Edit icon for complex relations on an asset page if you don't have the required resource permissions.

Diagrams

• In the diagram view editor, nodes for complex relation types have rounded corners again.
• In the diagram view editor, when Business Qualifier filtering is enabled, you can add filters on a node again.
• In a diagram, the preview panel is again shown when enabled and no longer disappears if you right-click on the node. (ticket #63717)
• In the diagram view text (JSON) editor, you can remove a name/value pair again.
• You can again open diagram pictures that were taken in Collibra 5.7.6 and older. (ticket #66504)

Data Privacy

• In Collibra Assessments, an error message is again shown if you try to submit or save a draft of a template that doesn’t have a title.
• The Review Request Handler workflow now correctly accommodates user groups, when they are assigned the Business Steward resource role.
• The Invite to Business Process Register workflow now correctly accommodates user groups, when they are assigned the Business User resource role.
• If you submit an assessment, but no Business Steward is assigned to the domain you specified, the submission fails and the “Submitted on” timestamp and value are no longer shown on the assessment’s details page.

Workflows

• The Asset Removed start event now works as expected. (ticket #13236, #16264, #26834, #27898, #45463, #54682, #58708)
• The title of a workflow error message that occurs after a sub-process finishes now displays correctly. (ticket #65112)
• The task sidebar now always displays a scrollbar for overflowing content. (ticket #63285, #63545)
• Having a scope other than Global for a workflow that returns a link to a newly created resource in a confirmation message no longer causes different final confirmation messages. (ticket #60042, #63444)
• Starting the packaged Issue Creation workflow no longer displays two confirmation messages. (ticket #60042)
• You can now click outside a workflow dialog box date picker to close it.

Edge

Note   Edge is only available for cloud environments and is disabled by default. If you want to use Edge, create a Collibra support ticket to enable it and make sure you have the necessary system requirements for Jobserver and Edge.

• You can now correctly download the Catalog connector logs.

Shop4Data

• An invalid warning is no longer shown if you're searching in Collibra with a filter applied and there are no search results. (ticket #64104)

API

• The REST Core API documentation for the workflowTasks endpoint now correctly mentions the returned information.

Miscellaneous

• A browsing session issue no longer prevents users from accessing an asset page following a search result or workflow link. (ticket #58909, #65768, #65858)

Patches

Patch 1

• Optional JDBC connection properties with empty values no longer cause profiling jobs on Edge to fail.

Patch 2

• The Asset Grid menu link is now shown in the main menu of Collibra when you enable Asset Grid in Collibra Console.
• You can now correctly add the data quality capability to Edge, which is necessary to ingest data quality information in Collibra.

Patch 3

• The product permission is no longer validated for Collibra system users. This validation caused the Asset Grid authentication to fail.
• Collibra no longer stops processing workflow action emails due to session timeouts. (ticket #66784)
• The Groovy libraries groovy-sql, groovy-macro, and groovy-templates can again be used in workflows' groovy scripts. (ticket #67270)
• When adding a schema to a data set, the loading time of the Add to data set window is reduced significantly.

Patch 4

• In workflow forms, text editors again appear correctly. (tickets #67736, 67769, 68273, 68362, 68443, 68491, 68556, 68560, 69065, 69168, 69306, 69486, 69795, 70945)
• When advancing through a workflow task, a "Task complete" notification is no longer shown after each form. (tickets #69757, 69167, 69493)
• The authentication cookie ConsoleSessionID now includes the Secure cookie attribute, to prevent it being sent by a browser over an unencrypted HTTP connection.

Patch 5

• Fixed an issue where diagrams didn't load with a filter containing a relation. (ticket #70078, 70884)