Edit the AI trust score settings
The AI trust score helps users evaluate the maturity, safety, and operational health of AI assets. Shows the average Trust Score of all AI assets in your Collibra environment, with consideration of any asset type filter selections.
As an AI administrator, you can fine-tune the score range and weight values to ensure your AI trust scores reflect what matters most to your organization.
The following example image shows the AI Trust Score widget that is included on the asset pages of your AI-related Technology Assets.
If you're a Business User and want more information on interpreting and improving a score, go to Interpreting and improving the AI trust score of an asset.
Prerequisites
-
You've ensured that the AI Trust Score widget is included in the Page Editor layout for the following asset types:
- AI Use Case
- AI Agent
- AI Base Model
- AI Model Version
- All subtypes of these asset types
By default, the widget is included in the asset page layout for all of these asset types.
Steps
- In
Settings, click AI Command Center.
- Click the AI Trust Score tab.
The AI Trust Score settings page opens. - Enter the required information.
Setting Description Show AI Trust Score visualization Determines whether the AI trust score is shown on AI asset pages. Trust score range Defines the low (red), medium (orange), and high (green) trust score ranges used to visually classify AI model trustworthiness.
Use case trust score Determines the weight for each of the following 5 themes, to control how much each one influences the total trust score for AI Use Case assets. Higher weights give a theme greater influence on the overall score. The Total weighted score chart updates dynamically as you edit the values, to reflect the relative weight of each theme.
Every theme must have a weight value. If you want to remove a theme from consideration, enter "0". Use the Reset all to 1 button to return all weights to their default equal values.
Data AssetsThe criteria for this theme is met if a relation exists between the AI Use case asset and at least one Data Asset. DocumentationThe criteria for this theme are the following:
- At least one user or user group is assigned the Owner resource role on the community or domain of the asset.
- On the asset page, there is a description in the Description field.
- A relation exists between the AI Use case asset and at least one Technology Asset.
The contribution from this theme is derived as follows:
- If none of the criteria are met, the Documentation score is 0.
- If one of the criterion is met, the Documentation score is 40.
- If two of the criteria are met, the Documentation score is 60.
- If all of the criteria are met, the Documentation score is 100.
Lifecycle progressThe criterion for this theme is the advancement of the AI Use Case asset through its lifecycle, as determined in the Lifecycle tab in the global assignment of AI Use Case asset type.
The contribution from this theme increases incrementally as the AI Use Case progresses through its lifecycle.
For example, if 5 lifecycle statuses are configured for the AI Use Case asset type, the score increases by 20% for every successive stage reached.
Linked Technology AssetsThe criteria for this theme is met if a relation exists between the AI Use case asset and at least one Technology Asset.
The contribution from this theme is the average trust score of all Technology Assets that are related to the AI use case.
For example, if the AI use case has a relation to 3 Technology Assets, of which the AI trust scores are 20, 20, and 80, the contribution from this theme will be (20 + 20 + 80) / 3 = 40.
Risk ratingThe criterion for this theme is the value of the "overall risk rating" of the AI use case, as prompted in the out-of-the-box Risks and Safeguards assessment.
The contribution from this theme is derived as follows:
- If the Risks and Safeguards assessment was not completed or no value was provided for the overall risk rating, the Risk rating score is 0.
- If the overall risk rating is set to "High" in the assessment, the Risk rating score is 10.
- If the overall risk rating is set to "Medium" in the assessment, the Risk rating score is 50.
- If the overall risk rating is set to "Low" in the assessment, the Risk rating score is 100.
AI technical asset trust score Determines the weight for each of the following 3 themes, to control how much each one influences the total trust score for assets of the following types:
- AI Agent
- AI Base Model
- AI Model Version
- All subtypes of these asset types
Higher weights give a theme greater influence on the overall score. The Total weighted score chart updates dynamically as values are adjusted, to reflect the relative weight of each theme.
Every theme must have a weight value. If you want to remove a theme from consideration, enter "0". Use the Reset all to 1 button to return all weights to their default equal values.
Data integrityThe criteria for this theme are the following:
- Data lineage: A relation exists between the AI asset and at least one Data Asset, for example a Table asset or View asset.
- Data sensitivity: Related input data assets have a value (True or False) for the "Personally Identifiable Information" attribute type.
The contribution from this theme is derived as follows:
- If none of the criteria are met, the Documentation score is 0.
- If one of the criterion is met, the Documentation score is 60.
- If both of the criteria are met, the Documentation score is 100.
DocumentationThe criteria for this theme are the following:
- At least one user or user group is assigned the Owner resource role on the community or domain of the asset.
- On the asset page, there is a description in the Description field.
- A relation exists between the asset and an AI Use Case asset.
The Documentation score is derived as follows:
- If none of the criteria are met, the score is 0.
- If one of the criterion is met, the score is 40.
- If two of the criteria are met, the score is 60.
- If all of the criteria are met, the score is 100.
Lifecycle progressThe criterion for this theme is the advancement of the asset through its lifecycle, as determined in the Lifecycle tab in the global assignment of the asset type.
The contribution from this theme increases incrementally as the asset progresses through its lifecycle.
For example, if 5 lifecycle statuses are configured for the asset type, the score increases by 20% for every successive stage reached.
- Click Save.