Integrated Databricks AI data

After the synchronization, the assets are available in the specified domain.

Warning Do not move the assets to another domain. Doing so may lead to errors during future synchronizations.

Asset status

By default, the assets are shown in a plain list, but you can enable a multi-path hierarchy to show it in a tree structure.

The Default Asset Status field in the capability determines the status of synchronized assets.

  • If you select No Status, newly created assets receive the first status listed in your Operating Model statuses, and existing assets keep their assigned status.
  • If you select Implemented, all assets receive the "Implemented" status.
Note For more information about AI Model Version asset statuses, go to Configure the lifecycle stages of AI Governance assets.

Synchronized metadata

Important considerations:

  • We always integrate the latest version of a model.
  • The integrated attributes depend on training run type.
  • If you don't see the listed synchronized metadata, you can add characteristics to the layout on the asset type page.

Collibra catalogs several kinds of Databricks AI agents: Knowledge Assistants, Multi-Agent Supervisors, AI Information Extraction tiles, and Genie spaces. They expose different metadata to Databricks, so what is synchronized in Collibra differs by type. The most common differences are:

  • Genie spaces do not provide a creation date or an owner, so those attributes are empty. A Genie space that does not have governed tables in Collibra is registered as an AI Agent asset only, without a version or tools.
  • Instructions are synchronized for AI Information Extraction tiles and Genie spaces only when they are defined in the source.
  • AI Agent Tools and the data lineage they link to your tables and Databricks Volume (in preview) are created for Knowledge Assistants, Multi-Agent Supervisors, AI Information Extraction tiles, and Genie spaces.
  • An AI Endpoint is created only for agents served by a Databricks serving endpoint. AI Information Extraction tiles and Genie spaces do not have a serving endpoint.
  • Databricks Volume (in preview) lineage from an agent's tools applies to Knowledge Assistant file sources and AI Information Extraction tiles. Other agent types either link to Table assets or do not reference Volumes.

If an agent is missing metadata you expected, it is likely due to one of these type-specific cases rather than a synchronization failure.

Asset type

Synchronized metadata

 Public ID
AI Base Model Description Description
Retirement Date in Source RetirementDateInSource
Required Content Filtering ContentFilter
AI Trust Score AITrustScore
 Databricks AI Model Version Description Description
Model Accuracy ModelAccuracy
Model Precision ModelPrecision
Mean Squared Error MeanSquaredError
Mean Absolute Error MeanAbsoluteError
Model Type ModelType
Feature Importance FeatureImportance
Version Version
Description from source system DescriptionFromSourceSystem
Repository Repository
Required Content Filtering ContentFilter
AI Trust Score AITrustScore

Any custom metrics defined via the configuration. If you use custom metrics, ensure that you add them to the assignment and layout on the asset type page.

  • accuracy_score,
  • exact_match
  • example_count
  • f1_score
  • f1_score_micro
  • f1_score_macro
  • false_negatives
  • false_positives
  • log_loss
  • max_error
  • mean_absolute_error
  • mean_absolute_percentage_error
  • mean_on_target
  • mean_squared_error
  • precision
  • precision_recall_auc
  • r2_score
  • recall
  • roc_auc
  • root_mean_squared_error
  • sum_on_target
  • token_count
  • true_negatives
  • true_positives
  
AI Model Deployment Description from source system DescriptionFromSourceSystem
Initiating User in Source InitiatingUserInSource
Creation Date in Source CreationDateInSource
Modification Date in Source ModificationDateInSource
Retirement Date in Source RetirementDateInSource
Implemented Content Filtering ImplementedContentFiltering
Compute Configuration ComputeConfiguration
AI Agent Description Description
Description from source system DescriptionFromSourceSystem
Instructions Instructions
Creation Date in Source CreationDateInSource
Tool Usage ToolUsage

Any custom metrics defined via the configuration. If you use custom metrics, ensure that you add them to the assignment and layout on the asset type page.

  
AI Agent has version / is version of AI Agent Version AgentHasVersion
AI Agent Tool AI Agent Tool can consult data source / can be consulted via Inference Data AIAgentToolCanReadInferenceData
AI Agent Tool delegates to / can receive requests from AI Agent Version AIAgentToolCallsAIAgentVersion
AI Agent Tool delegates to / can receive requests from AI Endpoint AIAgentToolCallsAIAgentEndpoint
AI Agent Version Version Version
Owner in Source OwnerInSource
AI Agent Version can call / can be called by AI Agent Tool AgentVersionCallsTool
Databricks Volume (in preview) Volume ID VolumeId
Volume Type VolumeType
Catalog Name CatalogName
Schema Name SchemaName
File Location FileLocation
Owner in Source OwnerInSource
Description from source system DescriptionFromSourceSystem
AI Endpoint Access Method AccessMethod
Access Instructions AccessInstructions
Traffic Split TrafficSplit
AI Monitor Data Drift Detection Enabled DataDriftDetection
Prediction Drift Detection Enabled PredictionDriftDetection
Schedule Schedule
Alert Configuration AlertConfiguration
URL Url
File Description Description
URL Url
Document size DocumentSize
File Type FileType
Document creation date DocumentCreationDate
Document modification date DocumentModificationDate
Access Type AccessType
Storage Container Description Description
URL Url
Location Location
External System Label ExternalSystemLabel
Database Description from source system DescriptionFromSourceSystem
Owner in source OwnerInSource
Data Source Type DataSourceType
Schema

Description from source system

 DescriptionFromSourceSystem
Owner in source OwnerInSource
Data Source Type DataSourceType
Table

Description from source system

 DescriptionFromSourceSystem
Owner in source OwnerInSource
Column

Description from source system

 DescriptionFromSourceSystem
Column Position ColumnPosition
Is Nullable IsNullable
Is Primary Key IsPrimaryKey
Primary Key Name (if the column is the primary key) PrimaryKeyName
Original Name OriginalName

Technical Data Type

Tip 

You see the technical data type in the Technical Data Type field in the At a glance sidebar of the Column asset. If the At a glance sidebar is hidden, click Info icon. For columns that have a structured technical data type, Array or Struct, click the hyperlink to see the structure of the data in a dialog box. In other locations, for example, in Table assets, click the View Array or View Struct button to open the dialog box.



 TechnicalDataType