2022.03

• Release information
• Highlights
• New features
• Enhancements
• Fixes
• Patches

Release information

• Release date of 2022.03.0: March 6, 2022
  • Upgrade non-production environments: March 6, 2022
  • Upgrade production environments: March 27, 2022

Highlights

• You can now show a disclaimer upon successful login. When enabled, you must accept the disclaimer after signing in, or else you are signed out.
  
• The default installation of Edge installs a Kubernetes cluster with Edge deployed on a Linux box that is fully managed by the customer. It is now possible to install Edge on an Edge-dedicated Amazon EKS (Elastic Kubernetes Service) cluster that is fully managed by the customer.
  
• S3 integration on Edge is now generally available.

New features

Data Lineage and BI integrations

• You can now benefit from the new Tableau integration method, via the lineage harvester, even if you have Tableau assets resulting from integration via the Data Catalog user interface. A new migration script enables you to migrate your existing Tableau assets and their characteristics, to the new Tableau operating model. The migration script is available in beta only. You can request access by creating a support ticket. Collibra Product Management will determine if you should be included in the private beta testing.

Collibra for Desktop

• You now see the last updated information on an asset page.
• Filter suggestions can show asset type, community, or domain filters that are based on the user's browsing history that is stored in Collibra for Desktop.
• DEV-6345: The Collibra for Desktop settings now includes a tip page with useful hints to use the app.
• Collibra for Desktop can now suggest asset recommendations based on your browsing history.
• An acronym's asset page now shows the description of the corresponding business term.

Collibra Console

• You can now show a disclaimer upon successful login. When enabled, you must accept the disclaimer after signing in, or else you are signed out.

Enhancements

Data Catalog

• You now see a relevant message when running an S3 synchronization and the Jobserver is offline. (ticket #61856)
• You cannot run an S3 ingestion if you have not defined any crawlers.
• The Technical Lineage tab is now available in the asset pages of asset types that support Technical Lineage, even if Catalog experience is disabled.

Data Lineage and BI integrations

• When ingesting Tableau metadata, you can now leave empty the collibraSystemName property in your configuration file, even if the useCollibraSystemName property is set to true.
• When ingesting Power BI metadata, you can now include wildcards in the Power BI <source ID> configuration file.
• The Collibra Data Lineage servers now benefit from the following parsing enhancements when integrating Informatica PowerCenter data sources:
  • Source tables and columns for LOOKUP transformations.
  • SQL overrides.
• Postgres JDBC driver is upgraded to version 42.3.2.
• Improved lineage harvester Edge capability for BigQuery data sources (available in beta).
• Enhancements to the user-experience when configuring the lineage harvester as a capability on Edge, for JDBC data sources (in beta):
  • The UUID of database assets are now shown in the Activities list.
  • Improved logs, to aid troubleshooting.
  • Improved user feedback when a JDBC Lineage capability is not specified for a database asset.
  Lineage harvester on Edge is available in beta only. You can request access by creating a support ticket. Collibra Product Management will determine if you should be included in the private beta testing. You can still use the lineage harvester as a standalone app.
• By default, the lineage harvester no longer harvests images. If you want to include images, include the optional excludeImages property in your configuration file and set the value to false.

Data Governance

• You can now add the "Last modified by" field in a view and use it in the filter pane of asset views.
• The Organization page of the Stewardship application can now include inherited responsibilities.
• The Browse pane now only shows the views for which you have view permissions and the relevant global permissions.

API

• You can now use different labels to define multiple columns in the table output query that contain the same data referenced by the "fieldName".
• The console API has a new endpoint to upload backups and process the uploaded file asynchronously. (ticket #76760).
• JSON requests with malformed JSON, such as syntax errors and missing JSON fields, now result in standard API error responses.

Miscellaneous

• Log messages about signing in and out no longer include implementation details and, whenever possible, now contain the user ID instead of the username.

Fixes

Data Catalog

• You can now revalidate assets from the Actions menu in Catalog asset pages, if Catalog experience is enabled. (ticket #77368)
• You can now cancel jobs running via Jobserver without restarting the DGC service. (ticket #77611, 78564, 81416, 82221)
  
• The Add to Data Set button is now again visible in the Physical Data Dictionary domain pages. (ticket #72814, 79646)
• Fixed an issue where schema assets were wrongfully marked as "Missing from source" when synchronizing a single schema via Edge.

Data Lineage and BI integrations

• Protobuf upgraded to version 3.19.3. (ticket #81820)
• Fixed an issue when ingesting Tableau metadata via lineage harvester that resulted in an UnexpectedConnectionClosureException error.
• Fixed an issue that was causing the ingestion of Looker metadata to fail. (ticket #80154)
• Fixed an issue that was causing a JsonParseError when ingesting Tableau metadata.

Data Governance

• You no longer see the edit icon in table cells on Overview tab pages of domain and community pages if you don't have the permissions to edit the cell content. (ticket #75328)
• You can once again resize columns on community pages. (ticket #78287)
• You can now wrap the text in cells on the Organization page of the Stewardship application.
• The names of domain types and asset types can no longer consist of only spaces.
• Fixed an issue where you couldn't add relation type fields to a view if you used an advanced filter that contained an "OR" operator. (ticket #79342)
• Fixed an issue where new roles didn't appear in the column picker of the Permission pages.
• Fixed an issue where empty relation tables wrongly appeared on asset pages. (ticket #74634)
• Fixed an issue in the Complex Relation Type field when importing complex relations. (ticket #75736)
• Domains whose name contain an underscore now correctly appear in the Domain field of the Create Asset dialog box.

Workflows

• The purge job now correctly clears out the workflow history. (ticket #70514)
• Inserting an image into a workflow form no longer causes an error or prevents the image from being stored. You can paste images of up to 2 MB in PNG, JPG, JPEG, or GIF format. (ticket #59568, 75092)

Collibra Console

• Upgrading Collibra no longer resets the option to show the API documentation menu item to admins only. (ticket #74974)

Security

• The current session endpoint of the REST API v2 now includes the associated CSRF token when applicable, and, optionally, the user information for the session.

API

• You can now use the API to delete a domain if it has a view. (ticket #77202)
• The REST Import API now interprets correctly column values in a CSV file where the multivalue quote is "|". (ticket #71853)
• The Java User API now returns the correct exception if a user is not found when searching on username.
• The batches of the Relations REST Core API method no longer have overlapping content.
• The batches of the ComplexRelations REST Core API no longer have overlapping content. (ticket #80323)
• Fixed an issue that led to inconsistent results in the output module. (ticket #73570, 76795)

Miscellaneous

• If you have Collibra open in multiple tabs, your session now times out correctly. (ticket #65867)

Patches

Patch 1

• Fixed an issue where a CSRF token was missing from the response when no cookies were set for the auth/session API. (ticket #83781, 83808, 83822, 83862, 83892, 83920, 84009, 84054, 84164, 84182, 84455, 84767)
• Azul Zulu JRE (Java Runtime Environment) is updated to version 8.0.322. (ticket #83442)
• You can again use the 'BETWEEN' filter in the Output Module. (ticket #83068, 83202)
• The Argo-cd redis for Edge is updated to remediate vulnerabilities. (ticket #83135)

2022.02

• Release information
• Highlights
• New features
• Enhancements
• Fixes
• Patches

Release information

• Release date of 2022.02.0: February 6, 2022
  • Upgrade non-production environments: February 6, 2022
  • Upgrade production environments: February 27, 2022
• Release date of 2022.02.1: February 27, 2022

Highlights

• You can now use a browser extension to easily access Tableau or PowerBI Dashboard metadata.
• You can now ingest Tableau metadata via the lineage harvester. This allows you to ingest embedded data sources and allows for custom SQL parsing, automatic stitching and much more.
• When profiling on Edge, you can now choose which synchronized schemas are to be profiled. See Configure the profiling and classification options via Edge.
• The following Catalog connectors are now certified for Edge:
  • Sybase
  • SQL Server
  • Couchbase
  • Cloudant
  • Azure Synapse
• iOS 11 is no longer supported for Collibra for Mobile 1.5.2 and newer.

New features

Data Catalog

• You can now use partial scan to profile most columns of Impala data sources via Jobserver, except for those in views, Kudu tables, and HBase tables.
• You can now use partial scan to profile Google BigQuery data sources via Jobserver.
• When profiling on Edge, you can now choose which synchronized schemas are to be profiled. See Configure the profiling and classification options via Edge.
• The following Catalog connectors are now certified for Edge:
  • Sybase
  • SQL Server
  • Couchbase
  • Cloudant
  • Azure Synapse

Data Governance

• You can now use views on the Organization page of the Stewardship application.
• The Scope page is now redesigned to make it more user friendly. For example, you can now easily see which domains and communities belong to which scope, and you also see a warning if a community or domain is in multiple scopes.

Collibra for Desktop

• The following settings can now only be defined in Collibra Console and no longer in the Collibra for Desktop settings:
  • Default filter
  • Reporting
• When the user settings are disabled, the keyboard shortcut is no longer visible in the user settings.
• Via the unattended installation, you can now only configure the environment URL, session timeout and initial message. All other options can only be configured via Collibra Console.
• You can now change the colors and logo of Collibra for Desktop to be more in line with your company's brand.

Collibra for Mobile

• iOS 11 is no longer supported for Collibra for Mobile 1.5.2 and newer.

Enhancements

Data Catalog

• You can configure the maximum number of characters to take into account per cell when profiling via Edge, by changing the Maximum value length field. See Configure data profiling behavior.
• The Jobserver component has been updated and requires an upgrade. See Compatibility between Jobserver and Collibra.

Data Lineage and BI integrations

• When ingesting metadata from Tableau Server 2021.3 or newer, Tableau workbooks in Personal Space are not ingested. For complete information on Personal Space in Tableau, see the Tableau documentation. (tickets #77501, 80903)
• Upgraded JDBC drivers for MySQL, PostgreSQL, Teradata, Snowflake, HiveQL, Spark SQL and Microsoft SQL Server data sources. Discontinued support for Active directory authentication for Azure data sources. (Ticket #73867)
• The new Tableau integration via lineage harvester supports the Tableau Explorer role.
• The lineage harvester includes mitigations for the following log4j vulnerabilities:
  • CVE-2021-44228 (December 10, 2021)
  • CVE-2021-45046 (December 14, 2021)
  • CVE-2021-45105 (December 18, 2021)
• Netty libraries are upgraded to version 4.1.72. (ticket #79732)
• Hive JDBC driver is upgraded to AmazonHiveJDBC42-2.6.17.1020.

Data Governance

• If moving a domain or community causes a conflict of scopes, the moved domain and community is now removed from its original scope.

Assessments

• URLs for conducting assessments are simplified, to facilitate the integration of assessments in dashboards and workflows.
  
  Note When implementing this change, we also adjusted the terminology used in the URL to reflect terminology used in the Assessments app. This could result in broken links if you use the URLs outside of the Assessments app. We encourage you to verify such links if you use them, for example, in dashboards or workflows.

Collibra for Mobile

• The Expo SDK is upgraded to version 43 to fully support iOS 15.
• General performance and stability improvements.

Fixes

Data Catalog

• When profiling on Edge, Collibra now takes a configurable maximum number of characters into account per cell. The default maximum is 1,000. This allows to profile cells containing long values, for example cells of the Long data type in Oracle. (ticket #73469)
• If you have the Technical Lineage global permission, you can now see the Technical Lineage tab on the Database View asset page. (ticket #70049)

Data Lineage and BI integrations

• When viewing transformations in a technical lineage, you can again right-click on nodes that have duplicate names, to open the context menu. (ticket #77458)
• When using a parameter file during the ingestion of metadata from Informatica PowerCenter data sources, parameter names are now correctly replaced by the values in the source table name override. (tickets #75833, 78084)
• When processing a report file, the SSRS scanner now creates an SSRS Data Model asset in Collibra Data Intelligence Cloud for each dataset of the report. SSRS Columns related to those SSRS Data Model assets are now also created in Collibra. (ticket #78930)
• When metadata from Snowflake data sources are analyzed, schema names are no longer wrapped in double-quotes. (ticket #77213)
• When ingesting metadata from Microsoft SQL Server data sources, the dash character "-" in database names no longer causes ingestion to fail. (ticket #75860)
• The lineage harvester now renews the Looker API token if harvesting takes longer than one hour, to avoid an HTTP 401 Unauthorized error.
• The lineage harvester now correctly shows the help overview when you run the --help command.
• The Collibra Data Lineage servers now benefit from the following parsing enhancements for data sources of the following types:
  • SQL Server Integration Services: components of type "Microsoft.ScriptComponentHost", which is a subtype of the "Microsoft.ManagedComponentHost". (ticket #76036)
  • Redshift:
    • Optional enclosing brackets [] for table references. (ticket #77184)
    • DELETE queries that have WITH statements. (ticket #74380)
  • Oracle:
    • ON OVERFLOW clause of LISTAGG function. (ticket #73709)
    • ENCRYPT algorithm in CREATE TABLE column definition.
  • Microsoft SQL Server: all variants of hexadecimal literals. (ticket #78078)
  • BigQuery: PARTITION BY clause in CREATE TABLE statements. (ticket #77044)
• Support for Oracle package specifications split into multiple source files (e.g. package definition in one source file and package body in another source file). (ticket #74529)
• Support added for ALTER TABLE RENAME TO statement in Postgres. (ticket #75894)
• If you change the domain reference ID in the lineage harvester configuration file, Tableau assets are now successfully deleted from the previous domain and recreated in the new domain.
• Fixed the computational inefficiency in the SQL scanner in the case of multiple nested subSELECTs with wildcards. (ticket #76637)
• Fixed a NullPointerException when no column data type is harvested.

Data Governance

• You can now create a filter based on asset types of all subcommunities in the filter pane of a root community page. (ticket #71357, 76104)
• The References tab page of asset pages now show references to assets with parentheses in their names. (ticket #67907)
• The popup that appears if you point to a hyperlink in an attribute now shows long breadcrumbs correctly. (ticket #76626)
• Log messages about signing in and out no longer include implementation details and, whenever possible, now contain the user ID instead of the username.
• If you open an asset page from a relation table, the asset page now opens at the start of the page. (ticket #67587)
• Fixed an issue where the Task Duration widget in a dashboard kept spinning indefinitely. (ticket #71492)
• Fixed an issue where the Automatic Hyperlinking feature sometimes created hyperlinks to assets whose type was excluded in the configuration.
• Fixed an issue that occurred when editing cells in the Group column of the users table. (ticket #74109)
• Fixed an issue that caused the import feature to fail if you imported assets with relations. (ticket #79963, 79989, 79995, 80010, 80011, 80046, 80077, 80088, 80110, 80145, 80148, 80151, 80153, 80171, 80182, 80193, 80196, 80204, 80214, 80229, 80238, 80288, 80300, 80307, 80318, 80321, 80341, 80360)
• Fixed an issue in the error message that appears if you import complex relations with too many legs. (ticket #73694)
• Fixed an issue in the Complex Relation Type field when importing complex relations. (ticket #75736)

Assessments

• Assessment templates with very long names no longer cause the UI to malfunction.

Workflows

• Completing a workflow task in the task bar no longer causes a task bar refresh error in some cases.

Collibra for Desktop

• Date and time is now correctly shown in Collibra for Desktop. (ticket #76283)
• Collibra for Desktop now correctly shows diagram pictures that are public or shared with the Everyone group. (ticket #73212, 74810)

API

• The typeId parameter of the GET/Assets is now deprecated in favor of typeIds. (ticket #75809)
• The REST Import API documentation now mentions that the finalization method requires at least one of the optional parameters to be specified.
• JSON requests with malformed JSON, such as syntax errors and missing JSON fields, now result in standard API error responses.
• Fixed an error in the response schema for the POST /assetTypes/bulk and POST /attributeTypes/bulk methods of the REST Core API v2. (ticket #74894)

Patches

Patch 1

• You can once again open communities in a new tab page from a link. (ticket #80081, 81342)
• Search fields in dialog boxes of workflows now correctly filter on asset types and show all relevant assets. (ticket #76946, 80426)
• Log4j is upgraded to version 2.17.1. For technical information regarding the Log4j 2.17.1 release, please consult the Log4j release notes.

Patch 2

• Jobserver has been upgraded to a higher version (2022.02.2-47) to improve security. We recommend you to install this new Jobserver version without delay to remediate the vulnerabilities.

Patch 3

• You can again use the 'BETWEEN 'filter in the Output Module. (ticket #83068, 83202)
• The Postgres driver is upgraded to org.postgresql 42.3.3.
• The Browse pane no longer contains domains and communities for which you don't have view permissions. (ticket #82447, 82986, 83313, 83393, 83470)
• Azul Zulu JRE (Java Runtime Environment) is upgraded to version 8.0.322. (ticket #83442)

Lineage harvester patch 1

• The lineage harvester now correctly shows the help overview when you run the --help command.
• Fixed a NullPointerException when no column data type is harvested.
• When you change the domain reference ID in the lineage harvester configuration file, Tableau assets are now successfully deleted from the previous domain and recreated in the new domain.

Lineage harvester patch 2

• Fixed an issue that was causing incomplete technical lineage and stitching issues when using custom SQL in Tableau.
• Fixed an issue that resulted in a TableauHarvesterError when ingesting Tableau metadata via the linage harvester. (ticket #82097)

Edge capability patch 1

• jdbc profiling capability: The profiling job now waits 20 minutes for a response when submitting profiling results to Catalog, instead of waiting indefinitely. After 20 minutes, the profiling job starts to process the next table.
• Catalog jdbc ingestion capability: If you receive an Out Of Memory error when you synchronize or profile a data source via Edge, you can now retrieve a diagnostics log file to investigate the issue in detail.

2022.01

• Release information
• Highlights
• New features
• Enhancements
• Fixes
• Patches

Release information

• Release date of 2022.01.0: January 9, 2022
  • Upgrade non-production environments: January 9, 2022
  • Upgrade production environments: January 30, 2022
• Release date of 2022.01.1: January 16, 2022
• Release date of 2022.01.2: February 3, 2022

Highlights

• The Edge management API is now available to authenticated users via https://<your_collibra_platform_url>/edge/docs/rest-api/index.html.

New features

Data Catalog

• Collibra now supports partial scan for Google BigQuery via Edge.
• Collibra now supports partial scan for Apache Hive and Cloudera Hive via Edge.

Reports and Insights

Note Collibra Insights is a cloud-only feature.

• The Reporting Data Layer and Dashboard Reports Configuration Guide v1.5 is now available. It includes guidance on how to configure the Reporting Data Layer on Google Cloud Platform.

Collibra for Desktop

• In Collibra Console, you can now configure to automatically open Collibra for Desktop when you start up your computer.

Collibra Console

• You can now configure HTTP response headers for Collibra Console.

API

• Authenticated users can now use the Edge management API via https://<your_collibra_platform_url>/edge/docs/rest-api/index.html.

Enhancements

Data Catalog

• The import functionality now groups commands in batches internally so that commands that have dependencies are executed after their dependencies. For example, domains are always created before assets and assets are always created before their relations.
• Partial scan of Microsoft SQL Server data sources via Edge is now faster.
• The Profiling and Classification tab on a Database asset's Configuration tab is now hidden when you don't have the required permissions to profile and classify or when there is no capability with the JDBC Profiling capability template for the connection.
• The Profile Database job is now called "Database Profiling of <database name>".

Data Lineage and BI integrations

Note Data Lineage is a cloud-only feature.

• The lineage harvester can now harvest parameter files in Informatica Intelligent Cloud Services (IICS) data sources.
• A new lineage harvester error message MSG-LIN-4000 now helps to identify when a Collibra Data Lineage server can’t connect to Data Catalog.
• The following new Collibra Data Lineage server is now available: 34.152.20.240 (techlin-gcp-ca).

Diagrams

• You can now configure business qualifier filtering for complex relations.

API

• The OutputVisitor component is now decoupled from the dgc-model package to improve performance. However, custom multi-node queries in the GraphQuery Engine no longer work.

Miscellaneous

• You can now only use refreshed navigation, classic navigation is no longer available.
• The time to load the Quality tab on asset pages is significantly reduced.(ticket #67755, 74771)
• When adding responsibilities or view permissions to an asset, the time to load the users or groups in the dropdown is significantly reduced.
• Java JRE is now upgraded from version 8.0.292 to latest patch version 8.0.312 to improve security. (ticket #75764)
• Elasticsearch is upgraded to version 7.16.2, which includes an upgrade of log4j to version 2.17.0 and mitigations for the following log4j vulnerabilities:
  • CVE-2021-44228 (December 10, 2021)
  • CVE-2021-45046 (December 14, 2021)
  • CVE-2021-45105 (December 18, 2021)
  For technical information regarding the Elasticsearch 7.16.2 release, please consult the Elasticsearch release notes.

Fixes

Data Catalog

• Fixed an issue where Collibra didn't delete your previously saved sample data after refreshing with 'Store Sample Data' disabled. (ticket #71425, 74017)
• Attributes containing plain text with special characters (<>) now expand correctly in tables. (ticket #72613)
• Attributes that are numbers no longer cause the import dialog box to get stuck loading. (ticket #72920)
• If the synchronization via Jobserver of an S3 file system fails and leads to partial results, Collibra no longer deletes affected assets but gives them the 'Missing from source' status. During the next successful synchronization, the assets are deleted or the their status is restored. (ticket #69705, 71673, 76936)

Data Lineage and BI integrations

Note Data Lineage is a cloud-only feature.

• The lineage harvester now correctly handles the * EXCEPT syntax for SQL scripts in BigQuery. (ticket #71656)
• When harvesting SAP HANA metadata, the lineage harvester now correctly identifies entity dataflows independently of column dataflows. (ticket #76533)
• On the Sources tab page, the column widths again adjust correctly to fit the content. (ticket #77045)
• The technical lineage viewer now includes tab pagination when there are more than six lineage view tabs. (tickets #70370, 76091)
• The technical lineage transformation logic CSV export file now:
  • Uses a comma as the delimiter, instead of a semicolon.
  • Shows values in double quotations.
  • Uses a double quotation as an escape character.
    (tickets #75374, 76351)
• The Collibra Data Lineage servers now benefit from the following parsing enhancements when integrating IBM DB2 data sources:
  • Support for the STRIP function.
  • Support for ¬=, ¬>, ¬<, !> and !< operators.
  • Support for special registers, for example CURRENT SQLID and CURRENT SERVER.
  • Support for CCSID clauses in CREATE TABLE statements.
  • Support for APPEND clauses in CREATE TABLE statements.
  • Support for VOLATILE clauses in CREATE TABLE statements.
  • Support for DATA CAPTURE clauses in CREATE TABLE statements.
  • Support for AUDIT clauses in CREATE TABLE statements.
  • Fixed CASE expression.
  • Some keywords allowed as column names and column aliases.
• The Collibra Data Lineage servers now benefit from the following parsing enhancements when integrating HiveQL data sources:
  • Support for table references starting with numerical digits.
  • Support for "pivot" as a table alias.
    (ticket #75359)
• Fixed a communication issue between Catalog and lineage servers. (ticket #74601)

Data Governance

• You can once again export asset views with a filter on roles. (ticket #73570, 74060, 74103, 74336, 74471, 74521, 74788, 74929, 75195)
• Fixed an issue with exporting asset views which were sorted on an attribute column. (ticket #74929, 75195, 76850)
• Fixed an issue in the tables of the Migration export feature that have a Modified by column containing a user that was deleted. (ticket #74188)
• Fixed an issue where your browser's Back button didn't behave correctly. (ticket #73869, 75054, 75110, 75277, 75323, 76084, 76157, 76220, 76392, 76559, 76699, 77075, 77223)
• You can now use the Recently Viewed section to easily find the relevant assets in fields of the Diagrams and the Collibra Privacy & Risk features.
• Dashboard widgets now show Tableau reports correctly. (ticket #70820, 72848, 74431, 80669)
• Long names of domains and communities are now correctly shown in dropdown fields. (ticket #72524, 76725)
• Fixed an issue where the global Create button disappeared if you didn't have certain resource permissions. (ticket #69606, 73803, 74076, 74157)
• You can now wrap text in asset tables of Catalog application pages.
• If an asset appears many times in an hierarchical asset view and you select one of those instances, all asset instances are now selected. (ticket #70573)
• Fixed an issue which caused some dashboards to load twice. (ticket #69451)
• You can again sort asset views and diagram views on the Sharing column. (ticket #67365)
• The height of the Browse pane now matches the full height of the page.

Diagrams

• You can again sort asset views and diagram views on the Sharing column. (ticket #67365)

Data Privacy

• When completing an assessment, answers that are provided for questions of the type Multiline Input are again correctly formatted.
• You can again start your Collibra environment, even if you don’t have an active Internet connection.
• If, on multiple attempts, you try to submit an assessment but don’t have the necessary permissions for the specified domain or domains, only a single instance of the draft is now saved.
• Error logs for time-based workflows now show the correct messaging.

Workflows

• You can again use the "T" designator when defining user task duration variables. (ticket #74215, 72645)
• Completing a workflow on a dashboard page no longer hides the page's scrollbar.
• The runAsUser logic from one workflow no longer influences other workflow instances. (ticket #71828)
• Using check boxes or radio fields without any options no longer distort the dialog box layout. (ticket #70865, 69495)
• The packaged Assessments Approval workflow is no longer enabled during an upgrade or restart if it was previously disabled. (ticket #75138, 70476)
• Using double quotes in some dialog box forms no longer causes a display issue. (ticket #69491)

Search

• Fixed the Search REST API example in the API documentation. (ticket #73115)
• When you edit a tag, the new name is now indexed in the search database and assets can be found by the new tag name.
• If you have specified fields in which a search should be performed and the search yields no results, you can again change the fields on the search page, to expand the scope of your search.
• Improved performance of the “Show more” and “Show less” buttons associated with the Organization facet.
• In the Organization facet, the links to expand the organizational hierarchy again work correctly.

Collibra for Desktop

• If the user configuration is disabled in Collibra Console, you can no longer edit the keyboard shortcut. (ticket 76829)
• Long names of related assets are now properly wrapped.

Collibra for Mobile

• Replying to a comment a second time, no longer results in an exception error.
• The option to secure the user credentials is now correctly saved, even after signing out.
• If you search for a value in a drop-down list in a workflow step and remove your search query, the drop-down list is again reset.
• Opening a shared link in a mobile browser, now correctly shows "Open in mobile" instead of "Open in desktop".
• When you click a shared link in Collibra for Mobile, the correct asset is now shown.
• Reopening a shared link in Collibra for Mobileno longer makes the app crash.

Security

• Users no longer encounter sign in issues during an active LDAP synchronization. (ticket #72891, 75184)

API

• The REST Core API now correctly supports the "Responsibility" field. (ticket #73379)
• The data classification DELETE rest api (/dataClassification/classifications/{classificationId}) now returns the 404 response code instead of 500 if no classification with given classificationId exists in the system.

Patches

Patch 1

• Fixed an issue that caused the import feature to fail if you imported assets with relations.

Patch 2

• Fixed an issue in the Complex Relation Type field when importing complex relations. (ticket #75736)

Edge capability patch 1

• jdbc profiling capability: The profiling job now waits 20 minutes for a response when submitting profiling results to Catalog, instead of waiting indefinitely. After 20 minutes, the profiling job starts to process the next table.
• Catalog jdbc ingestion capability: If you receive an out of memory (OOM) error when you synchronize or profile a data source via Edge, you can now retrieve a diagnostics log file to investigate the issue in detail.

2021.11

• Release information
• Highlights
• New features
• Enhancements
• Fixes
• Patches

Release information

• Release date of 2021.11.0: November 7, 2021
  • Upgrade non-production environments: November 7, 2021
  • Upgrade production environments: November 21, 2021
• Release date of 2021.11.1: November 21, 2021
• Release date of 2021.11.2: December 19, 2021
• Release date of 2021.11.3: January 9, 2022

Highlights

• Collibra Data Lineage now supports technical lineage for Matillion. Redshift and Snowflake projects in Matillion are supported.
• You can now use the S3 integration on Edge.

  Note S3 on Edge is available as a limited preview only. You can request to be evaluated for access by creating a support ticket.

• Refreshed Navigation is now enabled by default in production environments.
• You can now use a top and bottom banner to post announcements and security disclaimers to all users.

New features

Data Catalog

• After registering a data source via Edge, you can now schedule synchronization and profiling jobs.
• You can now select the domain in which you want to synchronize a schema.

Data Lineage and BI integrations

Note Data Lineage is a cloud-only feature.

• You can now configure the lineage harvester as a capability on Edge, for JDBC data sources. Benefits include:
  • Seamless integration with Data Catalog.
  • User Interface (UI), instead of Command Line Interface (CLI).
  • JDBC connections from Edge are used instead of lineage harvester drivers.
  • Job scheduling via Data Catalog.

  Lineage harvester on Edge is available for preview only. You can request access by creating a support ticket. Collibra Product Management will determine if the customer should be included in the private preview.

  You can still use the lineage harvester as a standalone app.

Data Governance

• If you search for an asset in a dialog box, for example while adding a relation or creating a manual hyperlink, you now see a Recently Viewed section to easily find the relevant assets. (ticket #59318, 61276, 64700)
• You can now use a top and bottom banner to post announcements and security disclaimers to all users.

Collibra for Desktop

• You can now select asset content in Collibra for Desktop, for example the asset's description, and immediately paste it into the application you're working in, by using the key combination Alt+Enter (Windows) or Option+Enter (macOS).
• On the Responsibilities tab of an asset, you can now see the list of users in a user group when that user group is assigned a resource role for the asset.

Collibra Console

• When configuring single sign-on for Collibra Console, you can now use your own certificate with an anchored trust model for SSO SAML AuthN Request signing.

Security

• When configuring single sign-on for Collibra, you can now use your own certificate with an anchored trust model for SSO SAML AuthN Request signing.
• Due to the end of life of the used version, we have upgraded Spring Boot to 2.5.6.

Enhancements

Data Catalog

• Collibra now uses native sampling if you enable push down sampling for Databricks and you profile via Edge.
• You can now profile a Google BigQuery data source via Edge if partial scan is enabled.
• The Apache Kafka Catalog connector now supports data profiling.

Data Lineage and BI integrations

Note Data Lineage is a cloud-only feature.

• The lineage harvester log output now includes Collibra Data Lineage server processing information.
• The lineage harvester now supports Snowflake syntax for the CONNECT BY clause. (ticket #69770)
• When preparing the lineage harvester configuration file for SQL sources, if the useCollibraSystemName property is:
  • false (default), system or server names in table references in analyzed SQL code are now ignored. This means that a table that exists in two different systems or servers is identified (either correctly or incorrectly) as a single data object, with a single asset full name.
  • true, system or server names in table references are considered to be represented by different System assets in Data Catalog. The value of the collibraSystemName property is used as the default system or server name.
• There are now two CSV options for exporting a technical lineage graph. The new Full CSV option allows you to export the full technical lineage graph. The CSV option now includes only the technical lineage graph of the selected column or table, which takes less time to generate.
• The technical lineage Sources tab page now includes a “Last sync time” column.

Data Privacy

• You can now delete any assessment, regardless of its status. If you delete a submitted assessment, the linked Assessment Review asset will not be deleted. You need to manually delete it in your Collibra environment.

Miscellaneous

• The performance of the Collibra platform has improved thanks to a new way of checking the view permissions.
• A query to filter by responsibilities no longer causes slow loading times of a global view. (ticket #69580, 70992)

Fixes

Data Catalog

• If you use the IAM role to connect to an Amazon S3 file system, you no longer have to add the Access key ID and Secret access key to enable the 'Synchronize now' button. (ticket #73196,73420,73579,73581)
• On the Physical Data Connector page of the Stewardship application, changing the number of rows, to show fewer rows per page than there are rows in total, no longer causes an error. (ticket #67745)
• Tableau synchronization no longer removes workbooks and views from inconsistent data.
• Fixed an issue with the reversed proxy server which caused problems with the communication between Jobserver and Collibra Data Catalog. (ticket #70243, 70631, 72071, 74902, 74986, 76014).

Data Lineage and BI integrations

Note Data Lineage is a cloud-only feature.

• When harvesting metadata from Snowflake data sources, the lineage harvester now preserves case-sensitive identifiers. (ticket #69769)
• Fixed a monitoring issue that was causing a timeout error when running the lineage harvester. (ticket #74158)

Data Governance

• Custom and packaged workflows can be started again in any time. (ticket #67776)
• Fixed an issue where changes to the dashboard sharing options were not saved correctly if refreshed navigation was enabled. (ticket #70511, 70601, 70774, 71791, 72068, 72170, 72700, 72712, 72752, 73126, 73219, 73262)
• Fixed an issue where rebuilding automatic hyperlinks failed. (ticket #69583, 71881)
• Fixed an issue where switching global views resulted in an error.
• Fixed an issue where wrapping text in an asset table didn't work if you had first wrapped text and then collapsed the rows again.
• The Migration feature no longer shows views that were saved on a hidden domain. (ticket #69327)
• Exporting all views from the "Asset views - in Communities and Domains" category no longer exports views that were saved on a hidden domain. (ticket #69327)
• Fixed an issue where you could not edit the description of a community after navigating to it from the root level via organization tree. (ticket #70512)
• Fixed an issue where scrolling in the Edit mode of the Global Permissions and the Resource Permissions pages caused the checkboxes to display incorrectly. (ticket #74600)
• The diagram views that are either public or shared with a role are once again visible and selectable in the Migration export UI.
• Fixed an issue where the global Create button disappeared if you didn't have certain resource permissions. (ticket #69606, 73803, 74076, 74157)
• Changing the license while Collibra is running no longer results in exceptions in the log.

Diagrams

• Fixed an issue where diagrams didn't load with a filter containing a relation. (ticket #68266, 70078, 70884)
• Clicking the name of a diagram picture of a Tableau Data Source asset, again opens the picture, instead of showing the asset details. (ticket #67517)

Data Privacy

• User interface fonts now load correctly when running multiple Collibra environments on the same domain. (tickets #70715, 73871)

Workflows

• You can no longer remove the default value of a workflow start form that has the "Readable" property set to "false" in the XML editor.
• The workflow dialog box whitespace and width of form fields are now correctly sized. (ticket #69492, 69495)
• The workflow task sidebar now adapts to resizing browser windows. (ticket #66589)

Search

• Search indexes no longer become out-of-sync due to a version conflict when calling an indexed document in ElasticSearch. (ticket #71522)
• Tags that are created by the REST Import API are now indexed in the search database and can be found via the search. (ticket #64161)

Collibra for Desktop

• Search filter suggestions no longer hide the content of a workflow form.
• Searching for "report" no longer suggests a Tableau Dashboard search.

Collibra Console

• Adding more than one group to the Collibra Console SSO configuration no longer breaks the permissions. (ticket #69642)

Patches

Patch 1

• You can once again export asset views with a filter on roles. (ticket #73570, 74060, 74103, 74336, 74471, 74521, 74788, 74929, 75195)
• Fixed an issue with exporting asset views which were sorted on an attribute column. (ticket #74929, 75195)
• The workflow engine resolves the utility bean as intended for time-based workflows, in accordance with the specified namespace. (ticket #74718)
• Fixed an issue with password encryption when using the reverse proxy server. (ticket #76158, 76170, 76249, 76262, 76277, 76369, 76683)

Patch 2

• Java JRE is now upgraded from version 8.0.292 to latest patch version 8.0.312 to improve security. (ticket #75764)
• Elasticsearch is upgraded to version 7.16.1, with mitigations for the following log4j vulnerabilities:
  • CVE-2021-44228 (December 10, 2021)
  • CVE-2021-45046 (December 14, 2021)
  For technical information regarding the Elasticsearch 7.16.1 release, please consult the Elasticsearch release notes.

Patch 3

• Elasticsearch is upgraded to version 7.16.2. This includes an upgrade of log4j to version 2.17.0, which mitigates the following log4j vulnerability:
  • CVE-2021-45105 (December 18, 2021)
  For more information regarding the Elasticsearch 7.16.2 release, please consult the Elasticsearch release notes.

2021.10

• Release information
• Highlights
• New features
• Enhancements
• Fixes
• Patches

Release information

• Release date of 2021.10.0: October 10, 2021
  • Upgrade non-production environments: October 10, 2021
  • Upgrade production environments: October 31, 2021
• Release date of 2021.10.1: October 31, 2021
• Release date of 2021.10.2: January 9, 2022
• Release date of 2021.10.3: January 16, 2022

Highlights

• You can now import and export assessment templates via the Assessments user interface. This is particularly useful for exporting templates from a testing environment and importing them to a production environment.
• The Apache HBase and Dynamics 365 Sales Catalog connectors are now certified.
• The Settings page has been redesigned, including a new landing page.
• The Global Permissions and the Resource Permissions pages now have a read-only mode and an edit mode.
• You can now install an Edge site also on CentOS/RedHat Enterprise Linux 8.1, 8.2, 8.3 and 8.4 and CentOS 8.0.
• You can now adjust the flow depth in a diagram.
• You can now specify the maximum flow depth in a diagram view via the user interface. Previously, you could only specify the maximum flow depth for a diagram view via JSON text editor. You can still edit the system-wide maximum in Collibra Console.

New features

Data Catalog

• You can now configure a test connection timeout when configuring a Jobserver.

Data Governance

• The Global Permissions and the Resource Permissions pages now have a read-only mode and an edit mode.
• The Settings page has been redesigned, including a new landing page.

Collibra Console

• Log files of the Data Governance Center service now have the prefix "dgc." instead of "dgc-", for example dgc.2021-10-01.0.log.

Enhancements

Data Catalog

• When you register a data source via Edge, the Data Source Type attribute of the resulting Database asset now contains the name of the actual data source instead of "Collibra driver".

Data Lineage and BI integrations

Note Data Lineage is a cloud-only feature.

• You can now create a technical lineage for ODBC data sources in Power BI. (ticket #72499)
• The SQL Server Reporting Services and Power BI Report Server operating models are now merged.
• The relation type that is used for Power BI column and JDBC column stitching results has changed. It is now "Data Element targets / sources Data Element".

Assessments

• There is a new Assessment tab on Assessment Review asset pages. This tab shows all of the responses that were provided in the assessment.
• Business Process custom asset pages no longer show relations to deprecated LIA, PIA and DPIA assets. They now show relations to Assessment Review assets. For more information, see What happens when you save, complete or submit an assessment?.

Workflows

• You can now see the exact date of a past comment or rating in a tooltip when you hover your pointer over the relative date.
• You can now see an activity indicator after submitting a workflow user task that takes time to complete.

Collibra for Mobile

• You now receive a push notification when a new task is assigned to you.

Miscellaneous

• Page definitions are XML files that describe the contents of a page together with the rules that determine when this should be used. You can now use the OR operator in these rules. (ticket #63094)
• The performance of the Collibra platform has improved thanks to a new way of checking the view permissions.

Fixes

Data Catalog

• The profiling results "Date", "Time" and "Date and Time" columns are now correctly formatted and classified. (ticket #69656)
• Fixed an issue in Edge where the status of renamed tables and columns remained 'Missing from source', even after the name change was reverted.
• When you synchronize a schema while it is already being synchronized, you again see the correct error message.

Data Lineage and BI integrations

Note Data Lineage is a cloud-only feature.

• The useCollibraSystameName property now exists in the Power BI configuration file that is bundled in the installation ZIP file. By default, the property is set to False.
• Variables names in BigQuery are now case-insensitive, in accordance with BigQuery documentation. (ticket# 72175)
• Synchronization batch cycles are again successfully processed, allowing the lineage harvester to run. (ticket# 72103)
• When running the Power BI harvester to upload Power BI metadata, the Collibra Data Lineage server now waits until the full batch is processed, before ending the harvesting process and posting the results of the scan.

Data Governance

• Deleting the content of an attribute now has the same effect on the articulation score as deleting the attribute itself. (ticket #68779)
• When importing a CMA file using the Migration feature, the order of assignment lines is now always taken into consideration. (ticket #66806)
• Fixed an issue where the Migration feature did not allow you to migrate the assignments of the Business Qualifier and BI Report Attribute asset types. (ticket #67378, 69327, 69737)
• Direct links to asset pages no longer work if there are extra characters in front of the ID of the asset. (ticket #68337)
• If you open an asset page from a relation table, the asset page now opens at the start of the page. (ticket #67587)
• The See All links in the Responsibilities section of the preview pane of assets now point to the Responsibilities tab page of the relevant asset.
• Collibra now works correctly if a custom context path is set. (ticket #68174, 70715, 70886, 71777)
• Filtering asset views now takes your time zone into consideration. (ticket #64778)
• Fixed an issue where column filters in table views were still applied after switching to another view. (ticket #57351)
• Fixed an issue where not all users were added to the Everyone group. (ticket #66167, 67661)
• If you change the number of rows in a table view after wrapping text, you no longer see an empty table.
• Dashboard widgets no longer refresh when you are not on the dashboard page.
• Dashboard widgets no longer prevent automatic signing out if you are inactive for the set amount of time and do not have the dashboard open.
• Fixed an issue where changes to the dashboard sharing options were not saved correctly if refreshed navigation was enabled. (ticket #70511, 70601, 70774, 71791, 72068, 72170, 72700, 72712, 72752, 73126, 73219, 73262)
• The See All links in the Responsibilities section of the preview pane of assets now point to the Responsibilities tab page of the relevant asset.

Assessments

• You can now edit any of your custom templates. There was previously an issue with older templates that were created before Collibra started storing the "created on" metadata.
• Improved error message if an error occurs while trying to publish a template or edit a template.

Workflows

• You can no longer clear a "datetime" user task form that has the "Writeable" parameter set to "false". (ticket #70863)
• You can again select "Asset" to indicate all asset types when adding a workflow assignment rule. (ticket #63705)

Edge

• When Edge is not enabled, it is no longer added to the log files. (ticket #64176, 64322, 65040, 65276, 65707, 67463)

Collibra Console

• Log retention configurations are again supported through the 'collibra_data/dgc/config/logging.properties' file. (ticket #70788)

API

• Using the REST API, you can no longer edit the head and tail asset types of relation types with the system flag.
• You can now create relation types with an empty description via the API. (ticket #69327)
• Using the REST API, you can no longer edit the head and tail asset types of relation types with the system flag. (ticket #66618)
• Assets that were no longer present in an external system and had their status changed instead of being deleted as a result of a synchronization regain the asset type default status when they reappear in the external system on subsequent synchronizations.

Miscellaneous

• If LDAP is enabled and the same user occurs on multiple LDAP servers, the user information is taken from the same server when LDAP is synchronized as when the user is authenticated. (ticket #69201)
• If the header parameter "x-collibra-api-username" or "x-collibra-api-key" is missing or wrong, you now see the correct HTTP 401 error code instead of HTTP 500.

Patches

Patch 1

• Fixed an issue where dialog boxes of workflows become unresponsive if one of its fields has invalid content. (ticket #74583, 74686, 74869, 74871, 74936)
• Fixed an issue where the output module filter didn't correctly parse LONG and DOUBLE values set as a JSON number. (ticket #73835)

Patch 2

• Java JRE is now upgraded from version 8.0.292 to latest patch version 8.0.312 to improve security. (ticket #75764)
• Elasticsearch is upgraded to version 7.16.1, with mitigations for the following log4j vulnerabilities:
  • CVE-2021-44228 (December 10, 2021)
  • CVE-2021-45046 (December 14, 2021)
  For technical information regarding the Elasticsearch 7.16.1 release, please consult the Elasticsearch release notes.

Patch 3

• Elasticsearch is upgraded to version 7.16.2. This includes an upgrade of log4j to version 2.17.0, which mitigates the following log4j vulnerability:
  • CVE-2021-45105 (December 18, 2021)
  For more information regarding the Elasticsearch 7.16.2 release, please consult the Elasticsearch release notes.