Using the utility CLI to register your AI model versions in Collibra

The utility CLI is a unified command-line tool that packages API calls, allowing you to manage your Collibra products directly from the terminal. It allows you to manually interact with your environment and seamless integrate into automation workflows.

AI framework detection
The utility CLI scans your local Python projects to identify AI models. It automatically detects common AI frameworks, including TensorFlow, PyTorch, scikit-learn, pandas, and numpy.
Automated manifest management
A collibra.yaml manifest file is automatically created the first time you successfully complete the registration process. It is updated during each subsequent registration to ensure your local project remains synchronized with Collibra. The manifest serves as a persistent record of which AI models have been registered, storing metadata such as AI use case IDs and base model associations, to prevent redundant registrations in future scans.
On-demand help
The utility CLI has a --help flag to retrieve built-in reference documentation. Run ./collibra --help to view a list of all available commands and flags.
Streamlined registration flow
You initiate the entire governance workflow with a single command. This process scans your source code for AI model patterns and loads existing YAML manifest files to filter out any models that have already been registered or rejected. The CLI then guides you through the model version registration process, where you can also register new AI Use Cases and Base Models or link your versions to existing assets.

Set up and configure the utility CLI

To use the CLI, you have to set it up and configure it locally.

Prerequisites

Steps

  1. Download the CLI from GitHub, and extract it.
    1. Download the appropriate file for your operating system and processor:
      • Windows amd64, for most Windows units.
      • Windows arm64, for Surface and others.
      • Linux amd64, for most Linux units.
      • Linux arm64, for Linux units with ARM architecture.
      • darwin-macos all, for Mac.
    2. Open your terminal or command prompt.
    3. Navigate to the folder where you saved the utility CLI file you downloaded.
      For example:
      • Windows: cd C:\Users\YourUserName\Downloads
      • Linux: cd ~/Downloads
      • Mac: cd ~/Downloads
    4. Unarchive or unzip the binary file.
      For example:
      • Windows: tar -xf collibra-x.x.x-windows_xxx64.zip
      • Linux: tar -xf collibra-x.x.x-linux_xxx64.tar.gz
      • Mac: unzip collibra-x.x.x-darwin-macos_all.zip
    5. For Mac only:
      Important You may encounter a standard macOS security prompt during installation. This occurs because the current version is pending an official Apple signing key. We are working with Apple to automate this process.

      If your Mac prevents the file from running because the developer isn't verified:
      1. Open System Settings/Preferences > Security & Privacy.
      2. Look for a message about the "collibra" file being blocked and click Open Anyway.
        Tip Alternatively, run the following command to verify the file: xattr -d com.apple.quarantine <file>.
    6. Run the binary file without any arguments to confirm it's working.
      • Windows: .\collibra
      • Linux: ./collibra
      • Mac: ./collibra
      A help message is shown.
  2. Set the environment variables.
    1. Open your terminal or command prompt.
    2. Run the following commands, depending on your operating system.
      Replace the place-holder information with your information. If you use a proxy, use the variable https_proxy combined with the following structure.
      Windows CMD

      SET COLLIBRA_URL=https://<YourCollibraEnvironment>.collibra.com

      SET COLLIBRA_USERNAME=<YourUsername>

      SET COLLIBRA_PASSWORD=<YourPassword>

      Windows Powershell

      $env:COLLIBRA_URL="https://<YourCollibraEnvironment>.collibra.com"

      $env:COLLIBRA_USERNAME="<YourUsername>"

      $env:COLLIBRA_PASSWORD="<YourPassword>"

      Mac and Linux

      export COLLIBRA_URL='https://<YourCollibraEnvironment>.collibra.com'

      export COLLIBRA_USERNAME='<YourUsername>'

      export COLLIBRA_PASSWORD='<YourPassword>'


    Tip Setting the environment variables as described here is temporary and only lasts for the duration of your current terminal session. To make it permanent, open a configuration file by running, for example ~/.bashrc, ~/.zshrc, or ~/.bash_profile. Then add the 3 lines mentioned in the table above, save the file, and then restart your terminal.
  3. Run the following command to confirm that the utility CLI setup was successful:
    • Windows .\collibra info
    • Mac and Linux: ./collibra info

Register an AI model version to your Collibra environment

  1. Open your terminal or command prompt.
  2. The Collibra CLI operates relative to your current working directory. Therefore, run the following command to navigate to the root of your Python project: cd /path/to/your/ml-project
  3. Run the command: collibra ai-gov register
    The CLI guides you through registering AI model versions and linking them to a new or existing (in Collibra) AI base model and AI use case.

Let's go through the registration process

In addition to registering your AI model versions in Collibra, the process enables you to register an AI use case and an AI base model, or link to an existing AI base model. Let's go through the typical process.

Step 1: Detecting AI model versions

When you run the command: collibra ai-gov register, the utility CLI scans the current or specified directory for AI frameworks and loads the collibra.yaml manifest file, if one exists. A manifest file is automatically created the first time you successfully complete the registration process. It is updated during each subsequent registration.

Note: By default, the command scans only the top-level directory. To scan all subdirectories recursively, use the -r flag.

Note:  If you previously rejected some models during registration and want to reconsider them, use the --rescan flag:

-r, --recursive Scan subdirectories recursively. (Default: current directory only)

--rescan Include previously rejected models in the scan results

Step 2: Fetching an AI use case

Step 3: Fetching an AI base model

Phase 4: Fetching an AI model version

Select one or more AI Model Version assets to link to your selected AI Base Model asset.

A final review screen shows the proposed registration.

If you want to edit the names and descriptions of the new assets before finalizing the registration, arrow down and press Enter on the asset you want to edit.

Phase 5: Finalize

When you enter y to confirm the registration, the CLI imports the assets to Collibra.

If this was a first-time registration, the CLI generates a new collibra.yaml manifest file. If it's not a first-time registration, the CLI updates the existing manifest file.

A successful registration summary is shown.