Only show release notes of Collibra Cloud for Government-certified featuresRelease 2024.02
Release information
- Publication dates:
- Release notes: January 22, 2024
- Documentation Center: February 1, 2024
- Release date of Collibra 2024.02.0: February 4, 2024
- Upgrade non-production environments: February 4, 2024
- Upgrade production environments: February 25, 2024
- Release date of Collibra 2024.02.1: February 11, 2024
- Release date of Collibra 2024.02.2: February 25, 2024
- Release date of Collibra 2024.02.3: On demand only
- Release date of Collibra 2024.02.4: On demand only
- Release date of Collibra 2024.02.5: On demand only
- Release date of Collibra 2024.02.6: On demand only
- Release date of Collibra 2024.02.7: On demand only
- Release date of Edge 2024.02-0: February 4, 2024
- Release date of Edge 2024.02-14: February 18, 2024
- Release date of Edge 2024.02-21: February 25, 2024
- Release date of Edge 2024.02-28: March 3, 2024
- Release date of Edge 2024.02-42: March 17, 2024
- Release date of Edge 2024.02-49: March 24, 2024
- Release date of Edge 2024.02-63: April 7, 2024
- Release date of Edge 2024.02-70: April 14, 2024
- Release date of Edge 2024.02-77: April 21, 2024
- Release date of Edge 2024.02-105: May 19, 2024
- Release date of Edge 2024.02-112: May 26, 2024
Highlights
- New look and feel (beta)
-
This release includes the public beta for our new, refreshed Collibra experience. A completely redesigned look and feel is now applied across the platform. With improved color selection, layouts, visual separation and many other design elements, the platform is now more engaging and easier to use than ever. Additionally, many new features have been built upon this new look and feel, such as our Tailored asset pages, AI Governance, and many more.
Learn more about the changes and features that come with the new look and feel and participate in this beta to get your hands on our new Collibra user interface.Important In the documentation, the new user interface is referred to as 'latest', and the previous user interface is referred to as the classic. You can find options to switch the information between the two available user interfaces.
- Collibra AI Governance (beta)
-
Collibra AI Governance (beta) is now available! AI Governance offers a holistic end-to-end view of all your organization's AI projects, and is designed to help you with the following:
- Improve your organizational access to, and adoption of, AI systems.
- Promote visibility, productivity, compliance, and accountability around AI use cases.
- Mitigate the data privacy, intellectual property, and ethical risks associated with AI.
- Prevent the duplication of efforts in the development and adoption of AI systems.
- Drive meaningful business evaluations of AI use cases prior to investing in them.
- Provide cross-functional collaboration, to address the internal use of AI systems for common business functions.
If you would like to participate in beta testing, please apply on the Collibra Beta Platform.
- Data Catalog
-
The new data classification method via Edge, Unified Data Classification, is now generally available. (idea #DCC-I-2411, DCC-I-1965)
- This method is activated by default in new environments.
- It allows for the creation of custom data classes based on classification rules that can be used and detected by an automatic data classification process on Edge.
The classification rules can be regular expressions and lists of values. The method also includes a list of out-of-the-box data classes. - The data classification capability is independent from the profiling capability. This means you can start the classification of tables and columns separately.
Important Currently, no data classification migration is available.
If you use data classification already and you activate the new data classification method, your current data classes and classifications are no longer visible.
The migration process will become available in future releases. - This method is activated by default in new environments.
-
The Google Dataplex Catalog Metadata integration via Edge is now generally available. When you integrate Google Dataplex Catalog, you integrate the metadata of all data of Dataplex projects into Collibra Platform. The resulting assets represent the projects, lakes, zones, tables, and columns.
- Data Lineage
- You can now create technical lineage for SAP HANA Cloud/Advanced on Edge by adding an SAP HANA capability with the Use Hana Cloud option selected.
- Edge
- You can now use vaults to implement your management and rotation policies for your data source credentials and applicable connection properties used in your Edge site connections.
-
The following vault providers can be integrated with your Edge sites:
- CyberArk Vault
- HashiCorp Vault
- Azure Key Vault
- AWS Secrets Manager
- Google Secret Manager
Vaults allow you to:
- More easily manage your sensitive data source details. As they are stored in your vault, you only need to update, rotate, or delete the details from the vault rather than also within your Edge site.
- Add your data source details to your Edge site connections. Rather than entering the details manually into each Edge site connection, you can enter your vault details which then pull these details into your connection.
- The Edge site system requirements have been updated for k3s or EKS.
- K3s:
- We no longer provide support for Edge sites installed before 2023.11 with a k3s version older than 1.27. You must reinstall your Edge site to upgrade to the latest Edge supported k3s version.Note While we do not anticipate this change to break existing Edge sites, support will be limited for troubleshooting Kubernetes versions that are no longer officially supported by the Kubernetes foundation. You will need to reinstall your Edge site to upgrade to the latest version of k3s before the 2024.02 release. For more information, go to the Edge Compatibility table.
You now only need to add one URL to your allow-list in order to connect Edge to Datadog. We have simplified our Datadog connectivity checks, so that only one URL end point needs to be added to your allow-list. With this change, the endpoint from Edge to Datadog is fixed, which means that you should not need to update this link every time Datadog releases a URL change. When you upgrade to Edge 2024.02, you must add one of the following URLs to your network allow-list:
- Commercial - https://http-intake.logs.datadoghq.com:
- Fedramp: https://http-intake.logs.ddog-gov.com
- We no longer provide support for Edge sites installed before 2023.11 with a k3s version older than 1.27. You must reinstall your Edge site to upgrade to the latest Edge supported k3s version.
- EKS:
- We no longer provide support for Edge sites installed on an EKS version older than 1.27. You must upgrade your EKS version to 1.27.Note While we do not anticipate this change to break existing Edge sites, support will be limited for troubleshooting Kubernetes versions that are no longer officially supported by the Kubernetes foundation. Go to our Support site to follow the instructions on how to upgrade your Edge sites using EKS from EKS 1.24 and lower to EKS 1.27 before the 2024.02 release. For more information, go to the Edge Compatibility table.
- We no longer require EBS volumes.
You now only need to add one URL to your allow-list in order to connect Edge to Datadog. We have simplified our Datadog connectivity checks, so that only one URL end point needs to be added to your allow-list. With this change, the endpoint from Edge to Datadog is fixed, which means that you should not need to update this link every time Datadog releases a URL change. When you upgrade to Edge 2024.02, you must add one of the following URLs to your network allow-list:
- Commercial - https://http-intake.logs.datadoghq.com:
- Fedramp: https://http-intake.logs.ddog-gov.com
- We no longer provide support for Edge sites installed on an EKS version older than 1.27. You must upgrade your EKS version to 1.27.
- K3s:
- Knowledge Graph API
- The Collibra Knowledge Graph API is now generally available. The new GraphQL API simplifies the retrieval of Knowledge Graph data, including communities, domains, assets, and complex relations, in a synchronous manner.
Learn more:
New features
Data Governance
- There is a new asset type property 'lockStatuses'. When this property is set to true, Collibra will manage the lifecycle of assets of this type. This means you can not add your own statuses to the assignments of this asset type. It won’t be possible to create or update an asset of this type to have a different status than the ones listed on the assignment. For all existing asset types, the value of this new property was set to false, so you can still customize the list of statues the same way as before. Only on the newly introduced out-of-the-box asset type 'AI Use Case', will have an enabled status restriction.
There is another new asset type property 'finalType'. When this property is set to true, you cannot create subtypes of this asset type and you cannot create scoped assignments on this asset type. For all existing asset types, the value of this new property was set to false, so you can still extend the asset type the same way as before. Only on the newly introduced out-of-the-box asset type 'AI Use Case', will not be able to create subtypes and scoped assignments.
In this release, the value of these new properties can only be consulted via the API, but we plan to adjust the UI so you can show the value of these property in an upcoming release.
Assessments
- You can now choose to hide all out-of-the-box assessment templates for all users from the template gallery. This also hides the templates from the template drop-down list when conducting an assessment. To facilitate this feature, the "Show out of the box templates" setting has been added to Collibra Console and Collibra settings.
Edge
- The Google Dataplex Lineage synchronization via Edge setting in Services Configuration is added for the feature to be released in a future release.
- You can now use vaults to implement your management and rotation policies for your data source credentials and applicable connection properties used in your Edge site connections.
Security
- You can now use a dedicated dgc/custom-dashboards folder to upload custom dashboards via the back up and restore process. This new folder is behind authentication and its contents are not available to users that are not signed in.
API
- To help you remove existing classification matches, the following endpoints of the Collibra Catalog Classification REST API now have a DELETE method available:
- /dataClassification/classificationMatches/bulk
- /dataClassification/classificationMatches/{classificationMatchId}
- To help you remove existing classification matches, the following classes and interfaces are now available for the Collibra Catalog Classification Java API:
- DeleteClassificationMatchesRequest
- DeleteClassificationMatchRequest
- ClassificationMatchApi
Enhancements
Data Catalog
-
We made several enhancements to the new data classification method:
- You can create a classification rule with a list of more than 1,000 values. To do this, you must upload a file that contains the list of values with one value per line.
Any list of values can now also be downloaded. - The maximum number of values for all the lists of values in one data class is now 25,000.
- You now need the global permission Classification > Classify to start the automatic Unified Data Classification process.
- The “Examples” field in the data class details now supports multiple examples. Each example needs to be added on a separate line.
- When you import out-of-the-box data classes, we no longer select any classes by default.
- You can create a classification rule with a list of more than 1,000 values. To do this, you must upload a file that contains the list of values with one value per line.
- You can add up to 10 synchronization rules for a schema. (idea #2427)
- We have enhanced the Databricks Unity Catalog integration.
- The following fields are now generally available in the Databricks Unity Catalog capability: "Filters and Domain Mapping" and "Extensible Properties Mapping".
- In the "Extensible Properties Mapping" field in the Databricks Unity Catalog capability, we allow a new format where you can map views separately from tables. If you use format version 0.2 in this field, validation checks now run on both tables and views. (ticket #132723)
- For Databricks Unity Catalog, we now support the integration of source tags in Database, Schema, Table, and Column assets. The tags are available in the "Source Tags" field. (idea #DCC-I-2495)
- For Databricks Unity Catalog, we now support the integration of the owner in Database, Schema, and Table assets. The owner is available in the "Owner in Source" field. (idea #DCC-I-2562)
- The following Databricks Unity Catalog fields can now also be integrated via the Extensible Properties Mapping (ticket #132712):
- Table: table_type , securable_type, and securable_kind.
- Schema: securable_type and securable_kind.
- To reduce the number of API calls during the S3 synchronization via Edge, the programmatic user for S3 now needs additional permissions.
- glue:BatchGetCrawlers
- glue:ListCrawlers
Important If you created the programmatic user with an AWS managed policy: AWSGlueServiceRole, you don’t need to specify these permissions.
Data Lineage and BI integrations
- Optimized memory profile when harvesting database models during the integrating of JDBC data sources via Edge. This helps reduce the chances of Out Of Memory (OOM) errors. (ticket #130766)
- All supported BI tools now benefit from SQL extension v2:
- The Collibra Data Lineage service instances can now successfully process more SQL queries. This results in a more complete lineage, including nodes that represent queries which previously could not be processed.
- The source code is more intuitively grouped in the transformations table [link] and includes names, for example, “source code 1”, where previously names were “None”. Queries and their relevant assets are now combined into a single line in the transformations table. Because of this, the source code processed count in the Done column is reduced and the success rate might differ. The lineage itself is unchanged.
- Improved folder filtering for Looker integrations. The following improvements are applicable when filtering by folder ID.
- Filtering is now carried out via the API, instead of on the Collibra Data Lineage service instances. This means that the lineage harvester accesses only the specified folders, and sends the metadata to the Collibra Data Lineage service instance for processing and ingestion in Data Catalog. Previously, metadata from all folders was sent to the Collibra Data Lineage service instance, where filtering was then carried out. This change greatly improves Looker integration flexibility, speed, and performance.
- The log files now include more detailed information about the filter results.
- When integrating JDBC data sources via the lineage harvester, with the “Folder connection” method, you can now include the new "databaseSystemMapping" property in your configuration file, to map specific databases to specific systems, to obtain stitching. Previously, stitching was missing, as all databases were associated with the default system name provided in the "collibraSystemName" property.
Data Governance
- The import results summary now contains information about created or updated tags.
Data Marketplace
- If you are using Collibra Protect, you can now see the data access rules and standards applicable for tables and columns in the Data Marketplace asset preview. This will help users to set expectations before they launch an access request.
An extra tab, Policies, is available in Data Set, Table, and Column asset previews. (idea #DCC-I-1980)
Workflows
- We have improved the logic of the workflow information purge mechanism.
- We have upgraded the Collibra workflow engine to use Jakarta EE instead of Javax EE. If you have workflows that use Javax EE javax.* functions, see Upgrading your scripts for Collibra 2024.02 compatibility on the Developer Portal for additional details.
- With the current release we are gradually adding more thorough checks for scripts used in workflows. You will not be able to deploy workflows with scripts that contain critical violations, while non-critical violations are going to be logged. If you encounter issues as a result of these checks, contact Collibra Support.
Workflow Designer
Note Workflow Designer enhancements become available with the upgrade of production environments.
- Trying to export an empty Workflow Designer app now displays an error message about missing a business process model.
- Trying to deploy an empty Workflow Designer app now displays an error message.
Edge
- We have updated our system requirements for Edge sites installed on k3s or EKS.
- K3s:
- We no longer provide support for Edge sites installed before 2023.11. You must reinstall your Edge site in order to update to the latest Edge supported version of k3s.
You now only need to add one URL to your allow-list in order to connect Edge to Datadog.
- EKS:
- We no longer provide support for Edge sites installed on an EKS versions older than 1.27. You must upgrade your EKS version to 1.27.
- You no longer need EBS volumes.
- You now only need to add one URL to your allow-list in order to connect Edge to Datadog.
- K3s:
Miscellaneous
- The Product Documentation link on the Help menu now directly opens the new Collibra Documentation Center instead of the Product Resource Center.
Fixes
Data Catalog
- In a Configuration tab of a Database asset, for schemas with the status "Removed from Source", we no longer display the "Synchronize Schema" button and we now provide the option to remove the synchronization rules.
- In the Metadata Synchronization tab of the Configuration in a Database asset, we now correctly indicate if the list of schemas is empty. Before this change, the interface kept on loading.
- We increased the reliability of the database registration job status. (ticket #128092)
- When an environment stopped while a refresh of a list of schemas for a database was ongoing, the Configuration tab of the Database asset now loads properly after a restart. (ticket #116158)
- The Database Registration REST API now provides location headers in responses. (ticket #128782)
- The REST API now returns the classifications in a fixed order. This ensures that you don’t miss any classification or that you have any duplicates when pagination is needed. (ticket #124769)
- When a user creates a new data class via the new classification method, the correct user is logged as the creator and we display the correct creator name in the Data Classification page.
- You can no longer see data classes in the Data Classification page if you don't have the Classification > Data Classes > Read permission when using the new classification method.
Data Lineage and BI integrations
- The Power BI Data Mart asset type now has candidate as status when first ingested. (ticket #126870)
- The MicroStrategy Data Entity asset type now correctly has the BI Catalog domain type as the assigned domain in the global assignment.
Data Governance
- Previously, users were receiving an error when removing an assigned Data Quality rule from an asset type. This issue has been resolved from versions 2024.02 versions and lower. You can now remove a Data Quality rule assigned to an asset type without error.
- Searching for communities with applied filters is now working as expected for lower case, upper case, and camel case values. (ticket #127486)
- When you add attributes to a complex relation table, the attributes are now immediately visible after you save. This means that you don't have to refresh the page to see this new addition. (ticket #127278)
- When you delete a attribute type, relation type, complex relation type, domain type, status, articulation score rule, validation rule, or data quality rule that is part of an assignment, the last modification date and the user who last modified are now correctly updated on the assignment object. This information is not visible in the UI, but you can retrieve it via the assignment API.
- A new information message appears on the Articulation score rule assignment page. The new message is as follows: “Articulation scores are recalculated when an asset is edited. Changing the rule itself won’t trigger recalculation. The maximum articulation score is always 100.” The message better reflects the current business logic.
- We updated the description of the total field in the ActivityPagedResponse object to explain it returns a constant value rather than the actual amount of activities in the system, because of performance reasons.
- We marked the field countLimit as deprecated on the Java FindActivitiesRequest object. We also marked the field countLimit as deprecated as an input parameter on the REST GET /activities API. We marked the fields total, offset, and limit as deprecated in the response object ActivitiesPagedResult, that is returned by the REST API call GET /activities. This was done in order to align the REST API documentation with the deprecation notice that was already added on the Java API documentation for the PagedResponse<T> class.
- Previously, when trying to create a domain via the Global Create pop-up, communities with a Meta=true flag were not filtered out of the community drop down options. This issue has been resolved. Meta=true communities are not shown.
- We have fixed an issue where a limited set of asset type icons were displayed as a Warning in the top-navigation search bar and in other pages. (ticket #128354)
- Co-roles for relations are now shown for complex relations in Data Quality.
- The articulation score has been recalculated and optimized to improve performance.
- We have fixed an issue of Data Quality results in the Quality tab displaying incorrectly. The Data Quality metrics have been updated. (ticket #125271)
- We have optimized the validation job for TermImpl entities so there is no unnecessary fetching of asset entities.
- Assets without any assigned validation script that are submitted for validation do not trigger database requests to create asset models.
- You can again import tags and relations simultaneously. (ticket #130625)
- Importing a file with an empty column no longer causes the import wizard to incorrectly map column values.
- We have fixed an issue where, during antivirus scanning of a new file upload, NIST logging files were taking an excessive amount of time to scan. (ticket #127574)
Data Marketplace
- We no longer display the "Add to Data Basket" button twice, if you don't use Catalog experience. (ticket #129392, 130519)
- To search for a URL, you can now use "" quotes, for example "collibra.com/documentation". When you use quotes. the number of / in the URL does not impact your search results. (ticket #123952)
- If you use a special character in a search query with quotes, for example "customer data [", we no longer show an error message.
Assessments
- If you have the Assessments Admin global role, you can now also view private assessments and edit the permissions of any assessment. (ticket #130919)
Protect
- Protect now correctly reads its scheduler fixed delay configuration for Console-based deployments.
Workflow Designer
Note Workflow Designer fixes become available with the upgrade of production environments.
- The Event-based gateway component is now part of the Gateways section in the Workflow Designer Shape repository.
- Signing out of the Workflow Designer no longer causes an internal server error. (ticket #130670)
Edge
- We fixed an issue that prevented the configuration of JDBC connections that have the `OAuthSettingsLocation` property defined from working correctly.
Search
- In the search results, terms that match your search text are again highlighted. (ticket #123870)
Browser Extension
- Legacy icons are now shown in Collibra Browser Extension 1.4.1. (ticket #132966)
Collibra Console
- We have improved the logic of retrieving the status of a backup operation.
- Usage Analytics no longer prevents some restored environments from starting. (ticket #130475)
- We have removed inaccurate metrics from the Collibra Console Monitoring tab. (ticket #127243)
- Signing in to Collibra Console no longer takes an unusual amount of time in some cases. (ticket #115370)
Security
- Not agreeing to the disclaimer when both the frontend (shell) and the Homepage are enabled now redirects you immediately to the sign-in page.
- The password reset form now uses version 2 of the Collibra Core REST API.
Miscellaneous
- We have improved the security of Jobserver.
- In a view for which you have enabled the hierarchy, if one or more relation types in the hierarchy are deleted, the view no longer crashes, and you can now create the hierarchy view using the available relation types. (ticket #114508)
- Upgrading from Collibra version 5.9.1 to Collibra Platform Self-Hosted when the installation directory and collibra_data directory are on different partitions no longer fails.
Beta features
A public beta is an upcoming feature or product that is made available to all customers before it is fully ready for general availability so it can be tested and evaluated early. Learn more
New look and feel
This release includes the public beta for our new, refreshed Collibra experience. A completely redesigned look and feel is now applied across the platform. With improved color selection, layouts, visual separation and many other design elements, the platform is now more engaging and easier to use than ever. Additionally, many new features have been built upon this new look and feel, such as our Tailored asset pages, AI Governance, and many more.
Learn more about the changes and features that come with the new look and feel and participate in this beta to get your hands on our new Collibra user interface.
Important In the documentation, the new user interface is referred to as 'latest', and the previous user interface is referred to as the classic. You can find options to switch the information between the two available user interfaces.
AI Governance
Collibra AI Governance is now available! AI Governance offers a holistic end-to-end view of all your organization's AI projects, and is designed to help you with the following:
- Improve your organizational access to, and adoption of, AI systems.
- Promote visibility, productivity, compliance and accountability around AI use cases.
- Mitigate the data privacy, intellectual property and ethical risks associated with AI.
- Prevent the duplication of efforts in the development and adoption of AI systems.
- Drive meaningful business evaluations of AI use cases prior to investing in them.
- Provide cross-functional collaboration, to address the internal use of AI systems for common business functions.
If you would like to participate , please reach out to your Customer Success Manager, for more information and access to the Collibra Beta Platform.
Data Marketplace: Collections
-
Collections can be meaningful for many colleagues. That's why it's now possible to share collections with colleagues. (idea #DCC-I-2377)
-
The person who creates the collection is the owner.
-
A collection can be shared by the owner or the editor of a collection. Both of them, can add and remove assets.
-
The collection owner can update the name and the description.
The editor can update only the description.
Viewers can only open the assets in the collection.
-
- Only 100 collections are displayed to the user.
If collections were shared with the user, and the sum of shared and own collections is bigger than 100, the user will only see 100 and will need to use the search input in order to see other collections.
Data Marketplace: Data Similarity
-
You can now define the data similarity threshold. The threshold is the similarity score from which a Table is considered as similar data.
Data Lineage
- Collibra Data Lineage support for Databricks Unity Catalog is now available in beta testing. You can create technical lineage for Databricks Unity Catalog by using technical lineage via Edge.
- When integrating Power BI, you can now enable DAX parsing (in beta), to allow for column-level lineage of calculated columns and measures. (idea #265)
Knowledge Graph API
- The response returned by the Knowledge Graph API no longer contains an additional "extensions" field.
- In case of a timeout error, the Knowledge Graph API error message now mentions the cause of the error.
Data Catalog
- You can now enabled a setting to that optimizes the retrieval of cached sample data, making the data visible faster.
Collibra maintenance updates
Collibra 2024.02.1
- Data Similarity for Table assets in Data Marketplace is now generally available and enabled by default for Cloud environments, except for Public sector. This feature allows you to see similar Table assets inside of a Table asset preview. This will help your data analysts to navigate the data landscape and find alternative data, and will therefore reduce their time to value.
If the Data Similarity feature is enabled, extra AI algorithms, which use privacy enhancing technologies, will run during data profiling. These algorithms detect similar data across all data sources that you have profiled after this feature was enabled.
With 2024.02, you can also define the data similarity threshold. The threshold is the similarity score from which a Table is considered as similar data. - Signing in with SSO and SAML no longer prevents you from accessing your Collibra environment. (ticket #136309, 136311, 136312, 136317, 136319, 136323, 136329, 136330, 136331, 136335, 136344, 136346, 136349, 136355, 136356, 136358, 36363, 136369, 136382, 136385, 136386, 136388, 136389, 136396, 136405)
- Session timeouts no longer prevent very long running jobs from finishing.
- If you have multiple databases for the same data source, the data protection standards or data access rules no longer fail during the synchronization. (ticket #134881)
Collibra 2024.02.2
- Redeploying a workflow with a sub-process when a user task of the sub-process is still active no longer prevents you from completing the user task. (ticket #134284, 137412)
- The Edge Site role is now by default assigned the View Permission - View All permission.
Collibra 2024.02.3
- We made some performance improvements related to assignments, which impacted asset pages load times. (ticket #138695, 138397)
- You can once again use attributes with True/False values in the filter of Bar Chart widgets. (ticket #137637, 138206, 138578, 138875, 139335)
Collibra 2024.02.4
- Collibra data entry asset components that retrieve more than 1,000 proposed values in a workflow task no longer cause an error. (ticket #136622, 137219)
Collibra 2024.02.5
- Relation reindexing now continues even if the confirmation response times out during the indexing request. (ticket #138154)
Collibra 2024.02.6
- Responding to workflow action emails works again as expected. (ticket #139637)
- The performance of relational indexing is now improved significantly. (ticket #138154)
- An API request to modify a resource locks again that resource, preventing other API requests from modifying the same resource while the request is under way. (ticket #139836)
Collibra 2024.02.7
- We fixed an issue that blocked upgrades from Collibra 5.9.1 on separate partitions to CPSH 2024.02. (ticket #138783, 142212)
Data Lineage 2024.02.1
- Technical lineage for Snowflake in SQL-API mode now supports lineage from batches that drop/replace tables frequently. For details, go to Snowflake SQL-API lineage missing due to frequent table replacement in Collibra Support Portal.
- Technical lineage for DataStage now shows full lineage for jobs that contain a shared container stage. Previously there was a break in the lineage.
- When ingesting Oracle data sources, the Collibra Data Lineage service instances now support the MEMBER OF operator and EXCEPTION block inside IF. (ticket #132216, 135477)
- When integrating Power BI, the expression used to derive a calculated table is now included in the Calculation Rule attribute on the asset page.
- When integrating Tableau, characters in the Tableau source code are now correctly parsed. (ticket #135893)
Data Lineage 2024.02.2
- Collibra Data Lineage can now process Databricks adapters in dbt Core appropriately.
- Previously, Collibra Data Lineage did not parse native expressions in IBM DataStage, and a parsing error was shown. Now, The native expressions are replaced with the string "DATASTAGE_EXPRESSION" and lineage is parsed.
- When you create technical lineage for PowerCenter, the connection definitions now support global values for the collibraSystemName and dialect properties. Additionally, the db and schema properties are not required.
- When integrating Power BI or Tableau via Edge, duplicate Column assets are no longer created in Data Catalog. The issue was related to SQL extension v2. (ticket #134427)
Data Lineage 2024.02.3
- When integrating MicroStrategy, the data model embedded in the project is no longer called "dummy data model”; instead, it now inherits the name of the project.
- When ingesting Spark SQL data sources, the Collibra Data Lineage service instances now support the table COMMENT keyword in CREATE TABLE statements.
- When ingesting BigQuery data sources, the Collibra Data Lineage service instances now support:
- The OPTIONS (description) keyword in CREATE TABLE statements. (ticket #135638)
- The NOT ENFORCED keyword in CREATE TABLE statements. (ticket #135638)
Data Lineage 2024.02.4
- When integrating Power BI with DAX analysis enabled, we have improved the error messaging in the source code to better inform in case of the following scenarios (ticket #137338):
- The Collibra Data Lineage service instance can't parse the DAX analysis result returned from Vertex AI.
- Vertex AI didn't return analysis results for a particular expression.
- You've reached the character limit, as described in DAX analysis via Collibra AI.
- When integrating Tableau, project filtering now works when the Tableau REST API is used without metadata API. In other words, project filtering now works if the “restOnly” property is set to “true” in your lineage harvester configuration file, or the “REST only” checkbox is selected, if you’re using Edge.
- When integrating Tableau, if you use the “hostnameMapping” property in your <source ID> configuration file to map a database to its host system, the database is now correctly mapped to the system you specify.
- Technical lineage for DataStage now supports the =: in update sql statement.
- Technical lineage for SQL Server Integration Services (SSIS) now supports the UpsertDestination component used by Solar Winds' TaskFactory.
- If you have a technical lineage for SAP HANA capability with the SQL Active option selected and the synchronization fails with the Missing required parameter hanaUseCloudScanner error message, update the capability so that technical lineage for SAP HANA Classic can work properly. For details, go to In Edge Harvester, previously configured/working SAP HANA Classic capabilities fail to submit to Edge in Collibra Support Portal.
Edge and Data Lineage updates 
These updates contain security and bug fixes for Data Lineage, Edge sites and their capabilities. These releases may be planned outside the regular monthly or quarterly release. You'll see the fix versions if you are manually upgrading an Edge site or reviewing logs.
February 18, 2024 (collibra-edge-2024.02.14-12) 
This is the version of the Edge release. You'll see it if you are manually upgrading an Edge site or reviewing Edge logs.

Infrastructure
- New Edge sites can now be installed on the following managed, dedicated clusters:
- Azure Kubernetes Service (AKS)
- AWS Fargate using EKS
- Google Kubernetes Enginer (GKE)
Note- Edge sites deployed on EKS or k3s are not impacted and can't be migrated to a new kubernetes cluster.
- Forward proxies are not currently supported for Edge sites installed on a new kubernetes cluster.
- We fixed an issue where Classification via Edge did not work because the
imagepullsecretvalue was empty within the Collibra-edge application. With this fix, Classification via Edge works as expected. (ticket #136295, 136575, 136703, 136710, 136782, 136892, 136893) - Kubernetes has released a patch which removes the Leaky Vessels vulnerability. You will need to ensure you upgrade your kubernetes version to ensure you receive this patch.
- For k3s installations:
- Manual Upgrade: download the latest Edge site version, and then reinstall your Edge site with this version.
- Automatic upgrade: reinstall your Edge site with the latest Edge site version.
- For EKS installations:
- Coordinate with your infrastructure team to receive the latest EKS version update with the Leaky Vessels patch.
Protect
- Protect for AWS Lake Formation can now handle columns that contain partition keys.
Data classification
- We updated the Sampling and Data Classification capabilities to allow the request for sample data from Snowflake. (ticket #137053)
Metadata integrations
- The new Dataplex Location field is added to the synchronization configuration page for Google Dataplex Catalog. With this new field, you can add any new Dataplex locations when you synchronize the capability.
Technical lineage
- Technical lineage for Databricks Unity Catalog can handle arbitrary amounts of data.
February 25, 2024 (collibra-edge-2024.02.21) 
This is the version of the Edge release. You'll see it if you are manually upgrading an Edge site or reviewing Edge logs.

Infrastructure
- We fixed an issue where Edge sites failed to be restored from backups that were larger than 1MB. (ticket #135278)
Data classification
- We have improved the security of data classification.
Technical lineage
- When integrating JDBC data sources via Edge, with the Shared Storage Connection method, you can now use the new Database-System Mapping field to map specific databases to specific systems, to obtain stitching. Previously, stitching was missing, as all databases were associated with the default system name provided in the Collibra System Name field.
March 3, 2024 (collibra-edge-2024.02.28) 
This is the version of the Edge release. You'll see it if you are manually upgrading an Edge site or reviewing Edge logs.

Infrastructure
- New Edge sites can now be installed on a managed, dedicated OpenShift kubernetes cluster. If you subscribe to OpenShift services, you can now operate Edge with system requirements aligned to your preferred infrastructure.
Note
- Edge sites deployed on EKS or k3s are not impacted and can't be migrated to an OpenShift cluster.
- Forward proxies are not currently supported for Edge sites installed on an OpenShift cluster.
Technical lineage
- When integrating Power BI via Edge or the lineage harvester:
- If the harvester connection to Power BI expires, the connection is now automatically reestablished, instead of triggering a time out error.
- If you enter incorrect Power BI credentials, the ingestion job fails as expected, but now the log files better explain the related issue.
These fixes help reduce the chances of HTTP 401 and HTTP 403 errors.
March 17, 2024 (collibra-edge-2024.02.42) 
This is the version of the Edge release. You'll see it if you are manually upgrading an Edge site or reviewing Edge logs.

Security
- We have improved the security of Edge.
Collibra Protect
- Protect for BigQuery no longer reports an error when a schema or table does not exist.
March 24, 2024 (collibra-edge-2024.02.49) 
This is the version of the Edge release. You'll see it if you are manually upgrading an Edge site or reviewing Edge logs.

Security
- We have improved the security of Edge, Data Classification via Edge, Collibra Protect, Dataplex synchronization, Databricks Unity Catalog synchronization, ADLS synchronization and Technical Lineage for Databricks Unity Catalog.
Technical lineage
- When creating technical lineage for SAP HANA data sources, the order of the columns (and the associated lineage) in views is now correct.
April 7, 2024 (collibra-edge-2024.02.63) 
This is the version of the Edge release. You'll see it if you are manually upgrading an Edge site or reviewing Edge logs.

Infrastructure
- We fixed an issue where Edge JDBC logging output files were missing from the Edge site. With this fix, these output files are available on the Jobs tab, as expected. (ticket #141484)
Security
- We have improved the security of the ADLS, Databricks, and GCS Dataplex synchronization via Edge, and the Technical Lineage for Databricks via Edge.
Protect
- Protect for BigQuery can now update tables containing columns of type RECORD or STRUCT. (ticket #139635)
- Creating data access rules using data classes with overlapping columns no longer leads to Protect incorrectly reporting masking conflicts. (ticket #139268)
Technical lineage
- When you created technical lineage for Databricks Unity Catalog, the technical lineage graph excluded tables that did not have lineage information. Now, the technical lineage graph accurately includes all tables collected from Databricks Unity Catalog, regardless of whether lineage information is present. (ticket #137243)
- When you create technical lineage for Databricks Unity Catalog, Collibra Data Lineage now collects unique lineage entries from the lineage table. This enhancement expedites the process of creating technical lineage for Databricks Unity Catalog.
April 14, 2024 (collibra-edge-2024.02.70) 

Technical lineage
- We made small improvements to a feature that is currently in private beta.
April 21, 2024 (collibra-edge-2024.02.77) 
This is the version of the Edge release. You'll see it if you are manually upgrading an Edge site or reviewing Edge logs.

Security
- We have improved the security of Data Classification.
Collibra Protect
- Creating data access rules using data classes with overlapping columns no longer leads to Protect incorrectly reporting masking conflicts. (ticket #139268)
- Protect for BigQuery can now update tables containing columns of type RECORD or STRUCT. (ticket #139635)
Metadata integrations
- A Databricks access token with the BROWSE privilege can now also integrate metadata from Databricks Unity Catalog. It doesn't require the USE CATALOG and USE SCHEMA privilege. (beta) (ticket #141283)
- We fixed an issue where the ADLS synchronization failed because of special characters, such as { { ! * ' ( ) ; : @ & = + $ , ? % # [ ] . } in names. (ticket #136498)
Technical lineage
- When ingesting Snowflake (SQL mode) via Edge or the lineage harvester, Collibra Data Lineage now harvests the metadata of stored procedures. We are currently doing the backend work to be able to generate lineage for stored procedures. We will keep you informed of our progress.
- When enabling technical lineage via Edge, you no longer have to configure any of the following settings via Collibra Console or the Collibra Settings. They are now obsolete.
- Power BI and Tableau synchronisation enabled
- Technical lineage via JDBC connection enabled
- Technical lineage for SQL via folder, ETL tools, and custom lineage on Edge enabled
- Updated an SQL query to harvest data object names when ingesting Teradata data sources, to mitigate failure during ingestion.
- The new Time Frame field is added to the technical lineage for Databricks Unity Catalog capability for you to specify the days of data that Collibra Data Lineage collects when creating technical lineage for Databricks Unity Catalog. This field is required, so you must enter a value before synchronizing the capability.
May 19, 2024 (collibra-edge-2024.02.105) 
This is the version of the Edge release. You'll see it if you are manually upgrading an Edge site or reviewing Edge logs.

Security
- We have improved the security of Edge, Catalog JDBC ingestion, JDBC Profiling, Catalog Data Classification and Catalog JDBC Sampling.
May 26, 2024 (collibra-edge-2024.02.117) 
This is the version of the Edge release. You'll see it if you are manually upgrading an Edge site or reviewing Edge logs.

Security
- We have improved the security of Edge.