Collibra Data Intelligence Cloud

The content of this section is only available for Collibra Data Intelligence Cloud. For the release notes of on-premises Collibra Data Governance Center, see Collibra Data Governance Center On-Premises 5.7.10.

Tip   Please upgrade any on-premises Jobserver that interacts with Collibra 2021.10 to version 2021.09.0-51.

Note   Some items included in this release may require an additional cost. Please contact your Collibra representative or Customer Success Manager with any questions.

Current release status

 

Current

Upcoming

 Supported versions (*)
Collibra Data Intelligence Cloud 2021.10
  • Product release: October 10
  • Upgrade pre-production environments: October 10
  • Upgrade production environments: October 31
 2021.11
  • Product release: November 7
  • Upgrade pre-production environments: November 7
  • Upgrade production environments: November 21
  • 2021.09
  • 2021.07

(*) The supported versions only apply to cloud environments. We support the current version and the two previous versions. The current version is considered released on the day production environments are upgraded to the latest version.

2021.10

Highlights

  • You can now import and export assessment templates via the Assessments user interface. This is particularly useful for exporting templates from a testing environment and importing them to a production environment.
  • The Apache HBase and Dynamics 365 Sales Catalog connectors are now certified.
  • The Settings page has been redesigned, including a new landing page.
  • The Global Permissions and the Resource Permissions pages now have a read-only mode and an edit mode.
  • You can now install an Edge site also on CentOS/RedHat Enterprise Linux 8.1, 8.2, 8.3 and 8.4 and CentOS 8.0.
  • You can now adjust the flow depth in a diagram.
  • You can now specify the maximum flow depth in a diagram view via the user interface. Previously, you could only specify the maximum flow depth for a diagram view via JSON text editor. You can still edit the system-wide maximum in Collibra Console.

New features

Data Catalog

  • You can now configure a test connection timeout when configuring a Jobserver.

Data Governance

Enhancements

Data Catalog

  • When you register a data source via Edge, the Data Source Type attribute of the resulting Database asset now contains the name of the actual data source instead of "Collibra driver".

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

  • You can now create a technical lineage for ODBC data sources in Power BI. (ticket #72499)
  • The SQL Server Reporting Services and Power BI Report Server operating models are now merged.
  • The relation type that is used for Power BI column and JDBC column stitching results has changed. It is now "Data Element targets / sources Data Element".
  • The lineage harvester log output now includes Collibra Data Lineage server processing information.

Assessments

  • There is a new Assessment tab on Assessment Review asset pages. This tab shows all of the responses that were provided in the assessment.
  • Business Process custom asset pages no longer show relations to deprecated LIA, PIA and DPIA assets. They now show relations to Assessment Review assets. For more information, see What happens when you save, complete or submit an assessment?.

Workflows

  • You can now see the exact date of a past comment or rating in a tooltip when you hover your pointer over the relative date.
  • You can now see an activity indicator after submitting a workflow user task that takes time to complete.

Collibra for Mobile

  • You now receive a push notification when a new task is assigned to you.

Asset Grid

  • Several improvements have been added to make grids more accessible for end users.

Miscellaneous

  • Page definitions are XML files that describe the contents of a page together with the rules that determine when this should be used. You can now use the OR operator in these rules. (ticket #63094)

Fixes

Data Catalog

  • The profiling results "Date", "Time" and "Date and Time" columns are now correctly formatted and classified. (ticket #69656)
  • Fixed an issue in Edge where the status of renamed tables and columns remained 'Missing from source', even after the name change was reverted.
  • When you synchronize a schema while it is already being synchronized, you again see the correct error message.

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

  • The useCollibraSystameName property now exists in the Power BI configuration file that is bundled in the installation ZIP file. By default, the property is set to False.
  • Variables names in BigQuery are now case-insensitive, in accordance with BigQuery documentation. (ticket# 72175)
  • Synchronization batch cycles are again successfully processed, allowing the lineage harvester to run. (ticket# 72103)
  • When running the Power BI harvester to upload Power BI metadata, the Collibra Data Lineage server now waits until the full batch is processed, before ending the harvesting process and posting the results of the scan.

Data Governance

  • Deleting the content of an attribute now has the same effect on the articulation score as deleting the attribute itself. (ticket #68779)
  • When importing a CMA file using the Migration feature, the order of assignment lines is now always taken into consideration. (ticket #66806)
  • Fixed an issue where the Migration feature did not allow you to migrate the assignments of the Business Qualifier and BI Report Attribute asset types. (ticket #67378, 69327, 69737)
  • Direct links to asset pages no longer work if there are extra characters in front of the ID of the asset. (ticket #68337)
  • If you open an asset page from a relation table, the asset page now opens at the start of the page. (ticket #67587)
  • The See All links in the Responsibilities section of the preview pane of assets now point to the Responsibilities tab page of the relevant asset.
  • Collibra now works correctly if a custom context path is set. (ticket #68174, 70715, 70886, 71777)
  • Filtering asset views now takes your time zone into consideration. (ticket #64778)
  • Fixed an issue where column filters in table views were still applied after switching to another view. (ticket #57351)
  • Fixed an issue where not all users were added to the Everyone group. (ticket #66167, 67661)
  • If you change the number of rows in a table view after wrapping text, you no longer see an empty table.
  • Dashboard widgets no longer refresh when you are not on the dashboard page.
  • Dashboard widgets no longer prevent automatic signing out if you are inactive for the set amount of time and do not have the dashboard open.
  • Fixed an issue where changes to the dashboard sharing options were not saved correctly if refreshed navigation was enabled. (ticket #70511, 70601, 70774, 71791, 72068, 72170, 72700, 72712, 72752, 73126, 73219, 73262)
  • The See All links in the Responsibilities section of the preview pane of assets now point to the Responsibilities tab page of the relevant asset.

Assessments

  • You can now edit any of your custom templates. There was previously an issue with older templates that were created before Collibra started storing the "created on" metadata.
  • Improved error message if an error occurs while trying to publish a template or edit a template.

Workflows

  • You can no longer clear a "datetime" user task form that has the "Writeable" parameter set to "false". (ticket #70863)
  • You can again select "Asset" to indicate all asset types when adding a workflow assignment rule. (ticket #63705)

Edge

  • When Edge is not enabled, it is no longer added to the log files. (ticket #64176, 64322, 65040, 65276, 65707, 67463)

Collibra Console

  • Log retention configurations are again supported through the 'collibra_data/dgc/config/logging.properties' file. (ticket #70788)

API

  • Using the REST API, you can no longer edit the head and tail asset types of relation types with the system flag.
  • You can now create relation types with an empty description via the API. (ticket #69327)
  • Using the REST API, you can no longer edit the head and tail asset types of relation types with the system flag. (ticket #66618)
  • Assets that were no longer present in an external system and had their status changed instead of being deleted as a result of a synchronization regain the asset type default status when they reappear in the external system on subsequent synchronizations.

Miscellaneous

  • If LDAP is enabled and the same user occurs on multiple LDAP servers, the user information is taken from the same server when LDAP is synchronized as when the user is authenticated. (ticket #69201)
  • If the header parameter "x-collibra-api-username" or "x-collibra-api-key" is missing or wrong, you now see the correct HTTP 401 error code instead of HTTP 500.

2021.09

Highlights

  • Since the 2020.11 release, we introduced displayVersion next to fullVersion in the API call rest/2.0/application/info. The fullVersion was hard-coded since that version.
    As of this version, fullVersion has the format YYYY.MM.PATCH-buildnumber, displayVersion has the format YYYY.MM.PATCH (cloud version) or MAJOR.MINOR.PATCH-buildnumber (on-premises version).
  • Edge is now readily available in all Collibra cloud environments. The following capability templates are now available out of the box:
    • Catalog JDBC ingestion
    • JDBC Profiling
    • DQ Connector

    Note   Data Quality is still in preview mode. To get access to this feature, you have to create a support ticket.

  • You can now enable database registration and profiling and classification via Edge via Collibra Console to register a data source, profile and classify via Edge instead of Jobserver.
  • New component versions:
    • Apache Tomcat: 8.5.69
    • Java Azul Zulu: 8.0.292
    • PostgreSQL: 10.17

New features

Data Governance

  • You can now wrap all text in the cells of a table view, and, optionally, save the view so the text is wrapped when the view opens.

Collibra for Desktop

  • You now have a specific Windows installer which allows you to install the application even if you don't have administrator rights, for example, due to limitations of the corporate IT policy. You can also still leverage the automatic updates.
  • You can now expand and collapse the task sidebar.
  • You can now reassign a task to another user, role or user group.
  • You can now cancel a task.
  • Recommendations in the Discover tab now load much faster.
  • On the Most Visited Assets page, you now see the number of page visits for each shown asset.
  • The Discover tab in the navigation bar is only shown if there are most visited assets.

Collibra for Mobile

  • On mobile devices, you receive a push notification when a new task is assigned to you.

Asset Grid

  • Filters that are applied on a grid, are captured in the grid's URL. This means that you can bookmark a grid including its filters.

Enhancements

Data Catalog

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

  • You can now use the customConnectionProperties field for SAP HANA, DB2, Netezza and Sybase sources.

Data Governance

  • Hierarchies in asset tables now load faster.
  • The configuration of hierarchies is removed from Collibra Console.

Edge

  • You now see a warning when there is not enough disk space for the installation of an Edge site. You need at least 50 GB.
  • You can now use a custom certificate authority in your proxy configuration.

Reports and Insights

  • Insights processing times are changed, to mitigate processing capacity limitations. Please check the processing timetable and adjust the timing of your downstream pipelines, as necessary. (ticket #69977)

Collibra for Desktop

  • On the Most Visited Assets page, you now see the number of page visits for each shown asset.
  • The Discover tab in the navigation bar is only shown if there are most visited assets.

Collibra for Mobile

  • You can now look up and consult communities and domains in Collibra for Mobile.

API

  • Legacy Semantics of Business Vocabulary and Rules (SBVR) terminology used in the Output Module API is now deprecated. All deprecated terms have alternatives that you should switch to. This is part of the REST Core API. ClosedRead more
    DeprecatedCurrent
    TermAsset
    ConceptTypeAssetType
    ConceptTypeSpecializedConceptsChildAssetTypes
    VocabularyDomain
    VocabularyTypeDomainType
    VocabularyTypeSpecializedConceptsChildDomainTypes
    Source SourceAsset
    TargetTargetAsset
    BinaryFactTypeRelationType
    HeadTermSourceAssetType
    TailTermTargetAssetType
    MemberResponsibility

    Learn more about the Output Module terminology in The Hitchhiker’s Guide to the Output Module.

  • You can now configure the REST Import API synchronization process to change the status of resources that have been removed from the external source instead of deleting them.

Fixes

Data Catalog

  • When adding a Schema asset to a data set, the loading time of the Add to data set window is reduced significantly.
  • You can now successfully set the context path of Collibra Console. (ticket #68174)
  • You can now profile columns of the type “Date” and “Time” that have the same “Maximum value” and “Minimum Value". (ticket #66368, 69906)
  • When you register Snowflake in Data Catalog, schemas and tables with an underscore in their name are now synchronized faster and do no longer trigger a full database scan. (ticket #66129)
  • The Summary tab page of a Table asset that has a large number of columns now loads faster. (ticket #70291)

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

  • The Sources tab page now shows the source ID of all sources in the configuration file. (ticket #70376)
  • The lineage harvester for Google BigQuery can now process STRUCT types with sub-select and UNNEST correctly. (ticket #65685)
  • The Collibra Data Lineage server now supports double quotes for delimited identifiers. (ticket #68865)
  • You no longer get an error about columns with dummy names.
  • The lineage harvester for Informatica PowerCenter now skips invalid XML files.
  • Collibra Data Lineage has now improved parsing Teradata metadata. (ticket #67453)
  • Collibra Data Lineage now supports ALL keywords in UPDATE statements and BEGIN/END QUERY LOGGING statements. (ticket #67450)
  • Collibra Data Lineage has now improved the Looker integration in Collibra Data Intelligence Cloud:
    • Tiles in Looker that have a relation to a non-existing Looker dashboard are now skipped. (ticket #69675)
    • Invalid queries are now skipped. (ticket #68622)
    • When you ingest a Looker tile that has a relation to a previously deleted Looker look, Collibra Data Lineage no longer creates a relation between the Looker Look asset and a Looker Dashboard asset in Data Catalog. (ticket #68374)

Data Governance

  • Product permissions are no longer validated for Collibra system users. This validation caused the Asset Grid authentication to fail.
  • Collibra no longer stops processing workflow action emails due to session timeouts. (ticket #66784)
  • When access to Collibra is denied by the SSO you are now redirected to the Sign in page with the message that SSO authentication failed.
  • Methods related to licenseType are no longer marked as deprecated in APIv2. (ticket #67290)
  • Collibra now validates the X.509 certificates found in SAML signatures, using the certificates found in SAML Identity Provider metadata as trust anchors. (ticket #64163)
  • Collibra now verifies that the X.509 certificates found in SAML Identity Provider metadata have a validity period that covers the time at which authentications are processed. (ticket #64163)
  • If you have a global role with the User Administration or System Administration global permission, you can now always edit the username of a user, even if the user is disabled.
  • If LDAP is enabled and the same user occurs on multiple LDAP servers, the user information is taken from the same server when LDAP is synchronized as when the user is authenticated. (ticket #69201)
  • Fixed an issue with the quickfilter in the Field dialog box. (ticket #67201)
  • If the responsibilities of an asset don't fit in a table cell of an asset view, it is now indicated by means of an ellipsis sign (...). (ticket# 63887, 64253, 65398, 65817, 66893)
  • Sorting an asset table on the Owner column now works correctly.
  • When you export large amounts of assets or complex relations to an Excel file, the file is now downloaded automatically.
  • You can now copy-paste more content into a text widget of a dashboard. (ticket #62826, 66964)
  • You can now edit all attributes and relations of a complex relation if you have a resource role that has the Update attribute resource permission.

Diagrams

  • Fixed an issue where diagrams didn't load with a filter containing a relation. (ticket #70078, 70884)

Data Privacy

  • Assessments is now accessible if the base URL of your Collibra environment changes.

Workflows

  • Starting a workflow for more than one resource no longer causes the start form dialog box to remain open after you submit it. (ticket #59337, #66752)
  • The HTML tags in the descriptions of some tasks are again rendered as expected. (ticket #69088, #69396, #69548, #69929)
  • Collibra no longer stops processing workflow action emails due to session timeouts. (ticket #66784)

Search

  • The number of search results, as shown in the UI or returned via API, is again the same. (ticket #67403)
  • Improved handling of quotation marks (") when included as text in the search field.

Collibra for Desktop

  • Asset pages now show the correct asset types for relation names.
  • When autostart is enabled, the keyboard shortcut is now functioning correctly after signing in. (ticket #68851)
  • Complex relations are now only shown if they belong to the assignment.
  • When completing a user task, typing in the Data Steward field to look up a user, no longer makes Collibra for Desktop crash. (ticket #68773)

Collibra for Mobile

  • Collibra Data Intelligence Cloud 2021.05.2 no longer hides the Actions section in the navigation bar. (ticket #66953)
  • The environment URL set via a mobile device management system is now correctly shown in Collibra for Mobile. (ticket #68641)
  • The environment URL is now deleted from your iOS device if you remove Collibra for Mobile or if you clear the local storage of Collibra for Mobile.
  • Asset names in camel case are now also in camel case in Collibra for Mobile.

Patches

Patch 1

  • A query to filter by responsibilities no longer causes slow loading times of a global view. (ticket #69580)
  • The performance of the Collibra platform has improved thanks to a new way of checking the view permissions.
  • Fixed an issue where changes to the dashboard sharing options were not saved correctly if refreshed navigation was enabled. (ticket #70511, 70601, 70774, 71791, 72068, 72170, 72700, 72712, 72752, 73126, 73219, 73262)
  • The workflow analysis feature, which is still under development, has been moved to feature flag. Contact Collibra Support for more information. (ticket #69594, 71143)

Patch 2

  • If you use the IAM role to synchronize Amazon S3, the Synchronize now button is now available without entering an Access key ID and Secret access key. (ticket #73196, 73420, 73579, 73581)

2021.07

Highlights

This scheduled maintenance includes fixes and minor improvements, as well as the below capabilities:

  • Collibra Data Lineage now supports MicroStrategy as a lineage harvester integration in preview mode. If you want to test MicroStrategy ingestion in Data Catalog, create a support ticket to request access.
  • When you export your technical lineage information to CSV files, the following files and columns have been deprecated:
    • The full_indirect_constants CSV file
    • The procedure_name column in the current_graph_column lineage CSV file and the full_batch_column_lineage CSV file.
  • Dynamics 365 Business Central is now available on Marketplace as a certified Catalog connector.
  • After registering a data source via Edge in preview mode, you can now do the following via the Configuration tab page of a registered database's asset page:
    • Include or exclude specific schemas and tables from the synchronization process.
    • Profile and classify the synchronized metadata via Edge.
    • Enable data quality to calculate the quality score of your synchronized metadata.
  • Asset Grid is a new data visualization application to make data more accessible, insightful and actionable for a variety of users and use cases. It has the potential to become a driver for Data Discovery and Data Promotion. Asset Grid is a cloud-only application.

New features

Data Governance

Asset Grid

Note   Asset Grid is a cloud-only application.

  • Asset Grid is a new data visualization application to make data more accessible, insightful and actionable for a variety of users and use cases.
  • A new global role, Asset Grid Admin, and global permission, Asset Grid Administration, come packaged with your Collibra environment. This role and permission is required to use Asset Grid.

Enhancements

Data Catalog

  • You can now register a data source without schemas via Edge. After registering a database that has no schema, a new Schema asset is automatically created with the same name as the database.
  • The queued jobs are evaluated for execution separately from their submission to avoid thread contention and dead locks, hence enhancing the stability of an import or of any other job. (ticket #64285)
  • Import jobs are now making sure that their related files are not deleted by the cleanup mechanism if the job is queued for a long time. This will ensure resiliency of long running jobs and of jobs queued for a long time.
  • The default maximum number of jobs that can run in parallel in the core DIC process has increased from 5 to 15 and you can change it in the configuration. Please notice this limit only relates to the total number of running jobs. Additional limits may exist per job type. This allows you to run more jobs in parallel.
  • When an import job is queued for a long time, the related files remain available until the job is completed.

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

  • Collibra Data Lineage now supports SQL syntax with WITH clauses.
  • The lineage harvester for Informatica Intelligent Cloud Services now supports SQL overrides.
  • The most common Power BI harvester messages now have unique codes that are explained in the Collibra Data Lineage documentation.
  • The lineage harvester for IBM DataStage now supports environment files.
  • The lineage harvester can now process column aliases in SQL queries that are native to Teradata.
  • The Power BI harvester configuration now refers to "workspaces" instead of "groups". As a result, the "groupFilter" property in the Power BI harvester configuration file is changed to "workspaceFilter".

Data Privacy

  • The Assessments workflow has been renamed the Assessments Approval workflow. To enable the workflow for non-privacy contexts, you no longer have to work with the Privacy Steward resource role, which was previously hard-coded. Business Steward is now the default resource role, but as with all other workflows, you can now configure this workflow for any resource role that has the required resource permissions. You can now also configure a start event to trigger the workflow.
  • When working with templates in Collibra Assessments, you can now disable the automatic numbering of questions.

Security

  • jQuery is updated to version 3.6. (ticket #58052, 64717, 65320, 66237)

API

  • You can now use external entity mappings in the REST Import API as an identifier for complex relations in addition to their UUID and their relation types.
  • You can now use the GET method of the REST Core API /jobs endpoint to search for all the jobs managed by the Job service.

Fixes

Data Catalog

  • Newline characters in the full name of a Database asset are now replaced by a space character. (ticket #64626)
  • You can now show the data class of an asset on the search page again.
  • When you delete a data class via the Data Classification Dashboard, the Data Classification Platform rejects the data class.

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

  • The lineage harvester for Teradata now processes RENAME TABLE queries correctly. (ticket #65578)
  • The technical lineage source code pane now properly displays the source code name of a predefined lineage.
  • Collibra Data Lineage now correctly removes assets of the type Looker Data Set and Looker Query when you delete ML models and queries in Looker and run the lineage harvester again to synchronize your Looker metadata in Data Catalog. (ticket #65604)
  • When a tile in Looker has no title, Data Catalog shows the full name of the Looker Tile asset as the display name. (ticket #67680)
  • Data objects in a predefined technical lineage are now stitched again to assets in Data Catalog.

Data Governance

  • The preview panel again shows responsibilities for communities, domains and assets. (ticket #64815)
  • Deleting groups with many responsibilities is now faster. (ticket #64738)
  • LDAP synchronization no longer fails when there are over 30 000 users. (ticket #65094)
  • The dgc log now mentions an HTTP 401 Unauthorized error if authentication failed. (ticket #58278)
  • Resource permissions related to attachments now only require a consumer license. (ticket #32453, 36007)
  • Collibra now validates the X.509 certificates found in SAML signatures, using the certificates found in SAML Identity Provider metadata as trust anchors. (ticket #64163)
  • Collibra now verifies that the X.509 certificates found both in SAML Identity Provider metadata and in SAML signatures have a validity period that covers the time at which authentications are processed. (ticket #64163)
  • You can again sign into Collibra via SSO when a CSRF token is enabled in Collibra Console. (ticket #65588, 65776, 66379, 66381, 66497, 66517, 66660)
  • The Validate button is now always available in asset views on application pages and the global view.
  • When using the Migration feature to export views of domains and communities, you can now increase the height of rows containing long names.
  • If you start a Migration export right after canceling an export, the canceled export is no longer resumed.
  • You customize the logo in the Help menu again. (ticket #63700)
  • You can download exported files again using Internet Explorer 11. (ticket #66671)
  • When Collibra starts exporting assets or complex relations to XLS(X) or CSV, the activities icon in the top menu now spins again. (ticket #65516)
  • If you have a global role with the Manage your own Views, Dashboards, Search filters global permission, you can no longer access other users' private dashboards via their URL. (ticket #59603)
  • If refreshed navigation is enabled and you click one of the buttons in the top navigation bar, the button image no longer turns gray.
  • In the Collibra users table, you can now correctly filter by the User Source column. Also, sorting by any column no longer shows a DataFetchingException. (ticket #65564, 66394, 66579, 67025, 67127, 67295, 67942)
  • Expanding table row no longer leads to too much white space.
  • Dashboards no longer load twice. (ticket #61739)
  • Dashboard names now handle special characters, such as ampersands (&), better. (ticket #66347)
  • If you export the user table as a CSV file, the last login date is now formatted correctly. (ticket #60714)
  • The preview panel again shows responsibilities for communities, domains and assets. (ticket #64815)
  • If you change the UI language on your profile page, the UI of Collibra now immediately switches to the selected language.
  • The avatar of the Everyone group now appears correctly when you add it to a global role.
  • If you create an asset, you can now choose from all relevant domains.
  • The History tables of communities and domains now correctly show the old and the new values. (ticket #66021)
  • In the quickfilter of global create dialog box, you can filter again on the letters O-B-J-E-C and T. (ticket #65807, 67564)
  • You no longer see the Edit icon for complex relations on an asset page if you don't have the required resource permissions.

Diagrams

  • In the diagram view editor, nodes for complex relation types have rounded corners again.
  • In the diagram view editor, when Business Qualifier filtering is enabled, you can add filters on a node again.
  • In a diagram, the preview panel is again shown when enabled and no longer disappears if you right-click on the node. (ticket #63717)
  • In the diagram view text (JSON) editor, you can remove a name/value pair again.
  • You can again open diagram pictures that were taken in Collibra 5.7.6 and older. (ticket #66504)

Data Privacy

  • In Collibra Assessments, an error message is again shown if you try to submit or save a draft of a template that doesn’t have a title.
  • The Review Request Handler workflow now correctly accommodates user groups, when they are assigned the Business Steward resource role.
  • The Invite to Business Process Register workflow now correctly accommodates user groups, when they are assigned the Business User resource role.
  • If you submit an assessment, but no Business Steward is assigned to the domain you specified, the submission fails and the “Submitted on” timestamp and value are no longer shown on the assessment’s details page.

Workflows

  • The Asset Removed start event now works as expected. (ticket #13236, #16264, #26834, #27898, #45463, #54682, #58708)
  • The title of a workflow error message that occurs after a sub-process finishes now displays correctly. (ticket #65112)
  • The task sidebar now always displays a scrollbar for overflowing content. (ticket #63285, #63545)
  • Having a scope other than Global for a workflow that returns a link to a newly created resource in a confirmation message no longer causes different final confirmation messages. (ticket #60042, #63444)
  • Starting the packaged Issue Creation workflow no longer displays two confirmation messages. (ticket #60042)
  • You can now click outside a workflow dialog box date picker to close it.

Edge

Note   Edge is only available for cloud environments and is disabled by default. If you want to use Edge, create a Collibra support ticket to enable it and make sure you have the necessary system requirements for Jobserver and Edge.

  • You can now correctly download the Catalog connector logs.

Shop4Data

  • An invalid warning is no longer shown if you're searching in Collibra with a filter applied and there are no search results. (ticket #64104)

API

  • The REST Core API documentation for the workflowTasks endpoint now correctly mentions the returned information.

Miscellaneous

  • A browsing session issue no longer prevents users from accessing an asset page following a search result or workflow link. (ticket #58909, #65768, #65858)

Patches

Patch 1

  • Optional JDBC connection properties with empty values no longer cause profiling jobs on Edge to fail.

Patch 2

  • The Asset Grid menu link is now shown in the main menu of Collibra when you enable Asset Grid in Collibra Console.
  • You can now correctly add the data quality capability to Edge, which is necessary to ingest data quality information in Collibra.

Patch 3

  • The product permission is no longer validated for Collibra system users. This validation caused the Asset Grid authentication to fail.
  • Collibra no longer stops processing workflow action emails due to session timeouts. (ticket #66784)
  • The Groovy libraries groovy-sql, groovy-macro, and groovy-templates can again be used in workflows' groovy scripts. (ticket #67270)
  • When adding a schema to a data set, the loading time of the Add to data set window is reduced significantly.

Patch 4

  • In workflow forms, text editors again appear correctly. (tickets #67736, 67769, 68273, 68362, 68443, 68491, 68556, 68560, 69065, 69168, 69306, 69486, 69795, 70945)
  • When advancing through a workflow task, a "Task complete" notification is no longer shown after each form. (tickets #69757, 69167, 69493)
  • The authentication cookie ConsoleSessionID now includes the Secure cookie attribute, to prevent it being sent by a browser over an unencrypted HTTP connection.

Patch 5

  • Fixed an issue where diagrams didn't load with a filter containing a relation. (ticket #70078, 70884)

2021.06

Highlights

This scheduled maintenance includes fixes and minor improvements, as well as the below capabilities:

  • The Apache Kafka Catalog connector now supports profiling.
  • You can now register a data source Edge via in preview mode. We encourage customers who'd like early access to Edge to create a support ticket, test the new capability and provide feedback. With this preview, you can now do the following:
    • You can create capabilities and JDBC connections via an Edge site to connect to your data sources via Edge instead of Jobserver.
    • You can ingest all schemas and tables of a database simultaneously.
    • You no longer need Jobserver to synchronize your metadata.
    • Note   This release still has a few limitations:
    • You cannot select which tables you want to synchronize.
    • You cannot ingest Oracle or other data sources that do not have a schema.
    • You can no longer profile and classify your metadata.
  • The lineage harvester now supports four new metadata sources in preview. This means that customers can request the lineage harvester to create a technical lineage for these metadata sources or ingest them in Data Catalog. However, we cannot guarantee that the lineage harvester is able to access all necessary metadata. If you test one of the metadata sources that are available, we kindly ask you to provide feedback via a support ticket. The following metadata sources are available for preview:
    • Power BI Report Server. We currently only support ingestion without automatic stitching or technical lineage.
    • SQL Server Reporting Services. We currently only support ingestion without automatic stitching or technical lineage.
    • AWS Glue. We currently only support AWS Glue script annotations.
    • Matillion. We currently only support Redshift and Snowflake databases in Matillion.
  • The following Collibra Data Privacy workflows are deprecated. They are no longer included in the Collibra Data Privacy CMA installation files:
    • CCPA - PIA Threshold Workflow
    • Compliance Self Assessment Start
    • Compliance Self Assessment Wizard
    • DPIA Start
    • DPIA wizard
    • GDPR - DPIA Threshold Workflow
    • Legitimate Interest Assessment Start
    • Legitimate Interest Assessment Wizard
    • PIA Start
    • PIA wizard

    All instances of these workflows in your environment will continue to work. They will not be deleted when you install a new CMA file, but they are no longer updated and no longer supported.

New features

Data Catalog

  • You can now register a data source via Edge and synchronize the metadata of all schemas in a database.
  • The Apache Kafka Data Catalog connector now supports data profiling.

Collibra for Desktop

  • You can now follow hyperlinks within Collibra for Desktop if you enable auto hyperlinking in the Everywhere Desktop configuration section in Collibra Console. By default the feature is disabled. You also must have enabled hyperlinking in the Hyperlinking configuration section.

  • The navigation bar now has a Discover section, which includes a list of assets that may be of interest to you and a list of the most viewed assets in your environment.

API

  • The readability of list boxes in the REST API documentation is now improved, (ticket #58923)

Enhancements

Data Catalog

  • On the Data Classification Dashboard, you can now click on a row to view detailed information about each data class.

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

  • Nodes in the technical lineage graph now show the name and type of the children of the System asset.
  • The lineage harvester for Teradata now accepts "bteq<<EOF" and "EOF" strings in shell scripts.
  • The lineage harvester PostgreSQL JDBC driver is now updated to version 42.2.13.
  • The most common lineage harvester messages now have unique codes that are explained in the troubleshooting section of the Collibra Data Lineage documentation.

Data Governance

  • When exporting views using the Migration feature, you can now use filters and sorting to help you find relevant views.
  • You can now add trusted web domains to a whitelist to ignore the HTTP response headers configuration for calls from those web domains.

Data Privacy

  • Collibra Assessments is now available via the classic navigation of the Collibra user interface.

Edge

Note   Edge is only available for cloud environments and is disabled by default. If you want to use Edge, create a Collibra support ticket to enable it and make sure you have the necessary system requirements for Jobserver and Edge.

  • Edge sites are now automatically updated when you upgrade to a newer version of Collibra Data Intelligence Cloud.
  • You can now back up or restore an Edge site.
  • You can now save Catalog connector logs locally.
  • Tables of the type "view" are now ingested as Database View assets instead of Table assets.

Shop4Data

  • The Search service now uses Elasticsearch version 7.12.1, which enables the latest functionality and security features, including TLS1.3 cyphers.

Fixes

Data Catalog

  • Tableau synchronization no longer removes workbooks and views from inconsistent data.
  • In the Physical Data Connector, you can now use the pagination arrows to navigate to the last page of the page set.
  • In the Data Classification Dashboard, children of the Data Attribute asset type, no longer disappear when saving changes in the Data Attributes drop-down menu.

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

  • You no longer need elevated permissions to harvest Snowflake metadata. (ticket #62598, 63576, 62219)
  • The lineage harvester now reuses a JDBC connection for each database name. (ticket #63212)
  • The lineage harvester for Teradata no longer shows "Internal error" when you use the WITH RECURSIVE clause. (ticket #63764)
  • You can now use the timeout <seconds> command to increase the time needed to connect to Microsoft for Power BI ingestion. (ticket #62842)

Data Governance

  • You can no longer edit user fields such as Phone in Collibra if they are synchronized via SSO or LDAP.
  • If you are given a view permission for an asset via a workflow, you no longer have to sign out and in again to be able to see the relevant asset. (ticket #52143)
  • Error messages about a missing global permission now explicitly mention the name of the global permission. (ticket #61327)
  • If you disable LDAP users in Collibra, they can now no longer sign in.
  • On the Data Quality tab page of an asset page, the aggregated values are correct again. (ticket #58719)
  • When you use the Migration feature to import an asset type that has ratings disabled, and that asset type has rating enabled in target environment, you now see a clear error message if one or more assets of that type have ratings in the target environment.
  • If Hierarchy is enabled in an asset table, the table no longer shows the wrong assets as the root node. (ticket #55008, 61857)
  • The Share button in Dashboards is now disabled if you do not have the required permission.
  • In asset tables, if you remove an attribute and apply it to all visible rows, the Last modified date of those assets is now updated correctly. (ticket #58240, 58243)
  • Editing a cell in an asset table and applying the change to other rows is now faster. (ticket #64738)
  • The Preview pane in asset views and diagrams shows the name of related assets again, instead of their full names. (ticket #62095)
  • When moving assets to another domain, the available domains now appear faster in the dialog box. (ticket #58412)
  • You no longer get an error message when editing the interface text in the Settings of Collibra. (ticket #60763, 61369, 62251, 62521, 64141)
  • You no longer get an error message if you create a responsibility in a community right after deleting a domain from that community.
  • You can now export the views of specific domains and communities. (ticket #65690)
  • Fixed an issue where, in certain cases, table views with hierarchy enabled were overusing resources, causing Collibra to become unresponsive. (ticket #65158, 65172, 65269)

Diagrams

  • When you apply to a diagram a filter that is conf3234igured with multiple selected attributes, filtering again works as intended. Specifically, if a view is configured to filter for values (A, B), then assets with values (B, C) pass the filter.
  • In diagrams, the Overview and the Legend are again shown, when enabled.
  • Data quality scores are again visible as overlays on diagrams. (ticket #64894, 65952)

Data Privacy

  • In Collibra Assessments, URLs to Collibra Data Intelligence Cloud now refer to localhost:port, instead of the public hostname. This means that whitelisted access to Collibra no longer results in errors when using Collibra Assessments.
  • In Collibra Assessments, drop-down lists of assets of a single type now work correctly when there are thousands of assets of that type in your Collibra environment.
  • Starting an assessment no longer results in an error.
  • On the asset page of a Business Process asset that is governed by both CCPA and GDPR, the CCPA and GDPR tabs no longer disappear when navigating between the two tabs.

Workflows

  • You can again search by resource and sort by date in the workflow instances table in the Settings section.(ticket #59066, #60204, #62077)
  • Passing an invalid variable type from a parent workflow to a sub-process no longer causes the Tasks page or task bar to crash.(ticket #61158)
  • You can now see the dialog box for the next available user task assigned to you after the start form of a global workflow when the task sidebar option is disabled.(ticket #61607, #64074, #64178)
  • The user task rich text editor field now correctly uses word wrapping.(ticket #55273, #63885)
  • Using the tab key to switch between workflow dialog box elements now correctly selects the input area of the rich text editor field.(ticket #55273, #63885)
  • You can now clear the selected value of a single value drop-down form in a workflow dialog box.(ticket #58629, #64100, #64481)
  • Custom workflow buttons now reset their value after a failed validation.(ticket #30347, #64558)
  • You can now use the drag-and-drop feature of the user task file upload field in Internet Explorer 11.(ticket #58957)
  • Clicking the label of a check box in a workflow dialog box, using Internet Explorer 11 no longer causes the dialog box to become unusable.(ticket #61639)

Collibra for Desktop

  • The details of an asset without relations are now correctly shown.
  • You can now open links that are added to attributes on domain and community pages. (ticket #64557)
  • Collibra for Desktop now correctly opens hyperlinks that contain query strings.
  • In a workflow task, any default values in rich text fields are correctly shown and sent to Collibra.

Miscellaneous

  • Links to Collibra resources that are part of a comment now work as expected in comment notification emails.(ticket #56227)

Patches

Patch 1

  • You can again sign into Collibra via SSO when a CSFR token enabled via Collibra Console.

Patch 2

  • Improved performance of checking the page permissions in Collibra environments with many domains. (ticket #63462)
  • Custom dashboard widgets no longer cause the Edge user interface to crash. (ticket #66591)

Patch 3

  • Views that have hierarchy enabled load correctly again.

Patch 4

  • The number of search results, as shown in the UI or returned via API, is again the same. (ticket #67403)

2021.05

Highlights

This scheduled maintenance includes fixes and minor improvements, as well as the below capabilities:

  • Impala is now available on Marketplace as a certified Catalog connector.
  • The Classification Dashboard introduces a new interface through which users can evaluate and understand their current classification infrastructure. The Classification Dashboard lists all available data classes, shows the performance metrics of used data classes and enables you to add, delete or merge data classes.

New features

  • You can now use the Classification Dashboard to view performance metrics and add data classes.
  • Impala is now available on Marketplace as a certified Catalog connector.

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

  • The lineage harvester configuration file now has a useCollibraSystemName property. You use this property to enable the lineage harvester to process the values in the collibraSystemName properties of all sections of the configuration file and in the external directory configuration files.
  • The lineage harvester and Power BI harvester now process additional configuration files for individual sources. This configuration file should only be used when you want to add connection definitions oor when you have enabled useCollibraSystemName in the lineage or Power BI configuration file.

Data Governance

  • The Collibra Product Delivery team can now configure security headers for your Collibra Data Intelligence Cloud.
  • You can now use the Migration feature to migrate workflows that include Flowable forms.
  • You can now choose more precisely which asset views, diagram views, dashboards and search filters you want to migrate.

Data Privacy

  • When working with an assessment template, a Governance option now allows you to specify whether or not an assessment conducted from the template will result in the creation of an Assessment Review asset and trigger the Assessments workflow.

Collibra for Desktop

  • You can now follow hyperlinks within Collibra for Desktop if you enable auto hyperlinking in the "Everywhere Desktop configuration" section in Collibra Console.

Collibra for Mobile

  • You can now complete workflow tasks such as reviewing an asset or voting for an asset.
  • You can start workflows such as proposing a new business term or asking a question to an expert. It is possible that complex workflows, for example a workflow with multiple step forms, won't work.
  • You can now set up workflows in Collibra for Mobile via Collibra Console.

Enhancements

Data Catalog

  • Collibra Data Intelligence Cloud now supports Tableau version 2021.01.
  • Data profiling of MSSQL data sources using push down sampling is now faster.

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

  • You can now use the test-connection command to check the connectivity between the lineage harvester and the Collibra Data Lineage server and Data Catalog.

Data Governance

  • Resizing a column of a table no longer reloads the page.

Data Privacy

  • The questions in the DPIA and PIA threshold assessment templates have been edited and regrouped, for clarity.

Edge

Note   Edge is only available for cloud environments and is disabled by default. If you want to use Edge, create a Collibra support ticket to enable it and make sure you have the necessary system requirements for Jobserver and Edge.

  • The Edge site installation steps are now improved to enable data classification via Edge.

Fixes

Data Catalog

  • Spark DataFrame now closes the CSV files after profiling a table via Jobserver. (ticket #58544, 56203, 52388)
  • The description of a Tableau Report Attribute asset is no longer deleted after synchronizing a Tableau Server.
  • Data Catalog no longer downloads the JDBC driver every time you ingest or refresh a data source. When you install a Jobserver for the first time, Jobserver now downloads all drivers. After that, Jobserver only downloads a driver when you change the driver configuration. (ticket #59712)
  • You can now define Advanced Data Type patterns with up to 2000 characters. (ticket #61968)
  • When you synchronize Tableau, the relation type "Report Attribute is source for / is target of Report Attribute" between Tableau Report Attributes is now created correctly. (Ticket #62424)
  • The synchronization of Tableau Server version 2021.02 or newer no longer fails when you create relations of the type "Data Set contains / is part of Data Element" between one Tableau Data Model and many Tableau Data Entity assets.

Data Lineage and BI integrations

Note   Data Lineage is a cloud-only feature.

  • Collibra Data Lineage for SQL data sources can now correctly parse strings that contain escaped quotes or apostrophes and unquoted table references that have a dash in the project name. (ticket #60682, 60956, 60125)
  • If the lineage harvester tries to read a non-UTF-8 SQL file of a data source with connection type SqlDirectory, it now shows a clear error message.
  • The lineage harvester now correctly concatenates SQL statements in HiveQL sources.
  • The Technical lineage Stitching tab now correctly shows spaces in the asset path.
  • The lineage harvester now works correctly when you create a technical lineage for Amazon Redshift, Azure SQL server, Greenplum, HiveQL, SAP Hana and Spark SQL. (ticket #65586)

Data Governance

  • When using SAML_ATTRIBUTES SSO mode, the Address, Phone number and IM account fields now only update if they are mapped in the SAML configuration. (ticket #55245,57944)
  • When generating a SAML authentication request, Collibra now correctly uses the value of the Service Provider Entity ID field in the SPNameQualifier of the NameIDPolicy section of the request. (ticket #63993, 64040, 64046, 64098)
  • The Migration feature now takes the order of articulation rules into account when importing a CMA file.
  • In an asset view, clicking a link to an attachment in an attribute now works correctly. (ticket #57816)
  • In dashboards, the "Add Dashboard" and "Save as" buttons are now disabled if you don't have the "Manage your own Views, Dashboards, Search filters" global permission. (ticket #61058)
  • Months in calendar selectors are now translated correctly. (ticket #57502, 63850)
  • The History tab page of assets now handles special characters correctly. (ticket #58759)
  • Expanding a row of a table now takes into account the content of all cells in the row. (ticket #60475)
  • You can no longer move a System asset type to another parent asset type. (ticket #55889)
  • REST v1 endpoints now also use security headers.

Diagrams

  • In diagram views, the boxing node options are again shown when they apply to the selected node.
  • When adding a Community overlay on a node, it is again shown on the result diagram.
  • The view editor again shows the correct list of characteristics for display name, overlays and filters, for a complex relation type.

Workflows

  • A refresh issue no longer causes the workflows instances page to display recently deleted workflow instances in some cases.(ticket #60317, #61865)

Edge

Note   Edge is only available for cloud environments and is disabled by default. If you want to use Edge, create a Collibra support ticket to enable it and make sure you have the necessary system requirements for Jobserver and Edge.

  • The Edge site administrator global role now includes the User Administration global permission.

Collibra for Mobile

  • When you add or delete a comment, you now remain on the Comments tab instead of returning to the Overview tab of an asset page.
  • Report images are again shown on an asset page.

API

  • If you use the output module to export an attribute to a JSON file, and the attribute's type allows multi-selection, the values now follow the industry-standard rules for quotes and escape characters:
    • The value is only contained in quotes if there are quotes or separators in the value.
    • Quotes inside the value are escaped by a quote.
    (ticket #64024)

Patches

Patch 1

  • Improved performance when editing attribute cells in multiple rows in a single go in an asset table view.
  • Fixed an issue where, in certain cases, table views with hierarchy enabled were overusing resources, causing Collibra to become unresponsive.

Patch 2

  • You can now export the views of specific domains and communities. (ticket #65690)

Patch 3

  • LDAP synchronization no longer fails when there are over 30,000 users. (ticket #65094)
  • You can again sign into Collibra via SSO when a CSRF token is enabled via Collibra Console.

Patch 4

  • You can download exported files again using Internet Explorer 11. (ticket #66671)

Patch 5

  • If LDAP is enabled and the same user occurs on multiple LDAP servers, the user information is taken from the same server when LDAP is synchronized as when the user is authenticated. (ticket #69201)
Visit the archive section for older versions.
Related Topics Link IconRelated Topics