Conduct an assessment of an AI Governance asset

When you register an AI model or AI use case:

  • An AI Model or AI Use Case asset, respectively, is created.
  • A default set of lifecycle activities are added to the Lifecycle tracker.
  • One assessment is automatically started.
  • The Owner of the AI Model or AI Use Case asset is notified and prompted to conduct the assessment.
Tip You can configure which assessment types and sign-off activities are automatically added to the Lifecycle tracker, and which assessment type starts automatically when a new AI model or AI use case is registered. For complete information, go to Configuring AI Governance asset types.

Typically, you register an asset and then conduct the assessment. However, you can also conduct an assessment before registering an AI Use Case asset, which can be useful in guiding the onboarding process. Both approaches are addressed in this topic.

Note AI Governance uses the Collibra Assessments app and features. For complete information on working with assessments, go to Collibra Assessments.

Where to start an assessment

There are three places from which to start an assessment:

All three options are addressed in this topic.

Requirements and permissions

You have the following permissions to work with assessments:

  • A global role with the Product Rights > Assessments global permission.
  • A global role with the Assessments > Conduct Assessments global permission.

The out-of-the-box AI Business User and Data Scientist global roles have these permissions.

Important 
  • At least one user must be assigned the Business Steward resource role on the domain (or its community) that is specified when submitting the assessment; however, it doesn't have to be the person submitting the assessment.
  • The Business Steward has a global role with the Workflow > Participate in Workflow global permission, for example AI Business User or Data Scientist.

How do you want to start an assessment?

  1. Open the relevant asset page.
  2. In the Lifecycle tracker, click Start in the row of the assessment you want to start.
    The assessment opens in the Collibra Assessments app.
    Note If you don't see the Start button, it means you don't have the Assessments > Conduct assessments global permission. The out-of-the-box AI Business User and Data Scientist global roles have this permission.
  3. Respond to the assessment questions.
  4. In the Properties sidebar, set the assessment permissions:
      SectionOptionDescription
      Permission to ViewEveryoneEveryone can view the assessment.

      Only Owner and Assignees

      Only the owner and the assignees you select in the Assignees field can view the assessment.

      Tip You can use the View Permissions setting in the assessment template to set the default view permission for all assessments that use that template.
      Permission to EditOwner

      Shows your name by default and can't be changed. You can always edit your own assessment.

      Tip If you are an administrator and want to change the owner of the assessment, in the Owner field, select the name of the new owner.
      Assignees

      Only the assignees can view and edit the assessment. The owner can always edit their own assessment.

  5. Do one of the following depending on which button is shown:
    • Click Complete, and then, in the Complete This Assessment dialog box, click Complete.
      The status of the assessment becomes Completed.
    • Click Submit for Review. Then, in the Submit This Assessment dialog box, select the domain in which you want the Assessment Review asset to be created, and then click Submit.
      Note  In the Domain field in the Submit assessment dialog box, only domains of the type Assessment Review Register are shown. If you don't have the option to select a domain, it means that a single target domain has been specified in the Eligible domains setting in the assessment template.

      The status of the assessment becomes Submitted, and the Open the Review Asset button appears to enable you to view the Assessment Review asset.
  1. Open the AI Legal Reviews page.
  2. Click Start Assessment.
    The Start Legal and Ethics Assessment dialog box appears.
    Note If you don't see the Start Assessment button, it means you don't have the Assessments > Conduct assessments global permission. The out-of-the-box AI Business User and Data Scientist global roles have this permission.
  3. Does the asset that you want to assess already exist in Collibra?
    • If the asset already exists:
      1. Click Yes.
      2. In the Select the Asset drop-down list, find and select the asset that you want to assess.
        Note When creating assessment templates, you can specify for which assets types the assessment template can be used. If the template you choose has not been configured for the type of asset you are assessing, the asset will not appear in the Asset drop-down list.
    • If the asset does not yet exist:
      1. Click No.
      2. In the Assessment Name field, enter a name for the assessment you are about to conduct.
  4. Click Confirm.
    A new assessment is created.
  5. Respond to the assessment questions.
  6. On the Properties sidebar, set the assessment permissions:
    SectionOptionDescription
    Permission to ViewEveryoneEveryone can view the assessment.

    Only Owner and Assignees

    Only the owner and the assignees you select in the Assignees field can view the assessment.

    Tip You can use the View Permissions setting in the assessment template to set the default view permission for all assessments that use that template.
    Permission to EditOwner

    Shows your name by default and can't be changed. You can always edit your own assessment.

    Tip If you are an administrator and want to change the owner of the assessment, in the Owner field, select the name of the new owner.
    Assignees

    Only the assignees can view and edit the assessment. The owner can always edit their own assessment.

  7. Do one of the following depending on which button is shown:
    • Click Complete, and then, in the Complete This Assessment dialog box, click Complete.
      The status of the assessment becomes Completed.
    • Click Submit for Review. Then, in the Submit This Assessment dialog box, select the domain in which you want the Assessment Review asset to be created, and then click Submit.
      Note  In the Domain field in the Submit assessment dialog box, only domains of the type Assessment Review Register are shown. If you don't have the option to select a domain, it means that a single target domain has been specified in the Eligible domains setting in the assessment template.

      The status of the assessment becomes Submitted, and the Open the Review Asset button appears to enable you to view the Assessment Review asset.
  1. Go to the Assessments landing page.
  2. In the Conduct Assessment side pane, select the assessment template that you want to use.
    Note If you don't see the Conduct an Assessment side pane, it means you don't have:
    • The Assessments > Conduct assessments global permission.
    • The Assessments > Manage Templates global permission.

    The out-of-the-box AI Business User and Data Scientist global roles have these permissions.

  3. Does the asset that you want to assess already exist in Collibra?
    • If the asset already exists:
      1. Click Yes.
      2. In the Asset drop-down list, find and select the asset that you want to assess.
        Note When creating assessment templates, you can specify for which assets types the assessment template can be used. If the template you choose has not been configured for the type of asset you are assessing, the asset will not appear in the Asset drop-down list.
    • If the asset does not yet exist:
      1. Click No.
      2. In the Assessment Name field, enter a name for the assessment you are about to conduct.
  4. Click Conduct Assessment.
    A new assessment is created.
  5. Respond to the assessment questions.
  6. On the Properties sidebar, set the assessment permissions:
      SectionOptionDescription
      Permission to ViewEveryoneEveryone can view the assessment.

      Only Owner and Assignees

      Only the owner and the assignees you select in the Assignees field can view the assessment.

      Tip You can use the View Permissions setting in the assessment template to set the default view permission for all assessments that use that template.
      Permission to EditOwner

      Shows your name by default and can't be changed. You can always edit your own assessment.

      Tip If you are an administrator and want to change the owner of the assessment, in the Owner field, select the name of the new owner.
      Assignees

      Only the assignees can view and edit the assessment. The owner can always edit their own assessment.

  7. Do one of the following depending on which button is shown:
    • Click Complete, and then, in the Complete This Assessment dialog box, click Complete.
      The status of the assessment becomes Completed.
    • Click Submit for Review. Then, in the Submit This Assessment dialog box, select the domain in which you want the Assessment Review asset to be created, and then click Submit.
      Note  In the Domain field in the Submit assessment dialog box, only domains of the type Assessment Review Register are shown. If you don't have the option to select a domain, it means that a single target domain has been specified in the Eligible domains setting in the assessment template.

      The status of the assessment becomes Submitted, and the Open the Review Asset button appears to enable you to view the Assessment Review asset.

What's next?

The Assessments Approval workflow notifies the Business Steward (by default) that an Assessment Review asset is ready for review and prompts them to approve or reject the assessment. For complete information about the workflow, go to The Assessments Approval workflow.

If necessary, you can:

When the assessment is approved, depending on the assessment type, certain assessment responses are copied to the AI Model or AI Use Case asset page. The following table shows the conditions under which responses are copied to the asset page.

If the assessment type is... Then...
One of the out-of-the-box AI Governance assessment types

Certain assessment responses are automatically copied over to the asset page.

For a complete list of questions for which responses are copied to the asset page, and how they map to the characteristics on the asset page, go to Mapping of copied assessment responses and asset characteristics.

Any custom assessment type

The response to every question for which the "Copy Response to Assessed Asset" option is selected in the assessment template, are copied to the asset page.

For complete information, go to Copy response to asset.