Synchronize Azure AI Foundry

Synchronizing Azure AI Foundry is the process of integrating metadata from Azure AI Foundry and making the data available in Collibra Platform.

You can synchronize manually, or you can automate it by adding a synchronization schedule.

Before you begin

Required permissions

  • You have the following Azure AI Foundry permissions:
    • Microsoft.MachineLearningServices/workspaces/onlineEndpoints/read
    • Microsoft.MachineLearningServices/workspaces/onlineEndpoints/deployments/read
    • Microsoft.MachineLearningServices/workspaces/read
    • Microsoft.MachineLearningServices/workspaces/connections/read
    • Microsoft.CognitiveServices/accounts/deployments/read
    • Microsoft.CognitiveServices/accounts/models/read
    • Microsoft.Insights/Metrics/Read
    • Microsoft.MachineLearningServices/workspaces/*/read
    • Microsoft.Insights/Logs/Read
    • Microsoft.CognitiveServices/accounts/OpenAI/assistants/read
    • Microsoft.CognitiveServices/accounts/OpenAI/*/read
  • You have a resource role with the Configure external system resource permission, for example, Owner.
  • You have a global role with the Catalog global permission, for example, Catalog Author.
  • You have a global role with the View Edge connections and capabilities global permission, for example, Edge integration engineer. For example, Edge integration engineer.

Steps

  • Manually synchronize Azure AI Foundry
  • Add a synchronization schedule
  1. On the main toolbar, click Products icon → Catalog.
    The Data Catalog Home opens.
  2. On the main toolbar, click .
    The Create dialog box appears.
  3. In the Register with Edge section of the Create dialog box, click Integration Configuration.
    The Integration Configuration page opens.
  4. In the Connection name column, locate the Azure connection that you used when you added the Azure AI Foundry capability and click the link in the Capabilities column.
    The Synchronization page opens.
  5. In the Synchronization Configuration section, click Add Configuration.
  6. In Domain, select the Domain asset in which you want to add the Azure AI Foundry assets.
  7. In Resource Group Name, enter the name of the resource group which holds resources related to your Azure AI Foundry model. For more information, go to Azure's resources documentation.
  8. In Workspace Name, enter a name for your workspace. This must be a unique name within your resource group. For more information, go to Azure's resources documentation.
  9. Optionally, in Custom AI Metrics Mappings, define which custom Azure AI Foundry model metrics you want to integrate. You do this by adding the mapping between the custom metric and the Collibra attribute.
    Important 

    If you use this feature, make sure to add any custom attributes/characteristics, as needed, to the asset type assignment.

    1. Click Add Custom AI Metrics Mappings.
    2. In Metric, type the name of the custom metric manually.
      Use the exact name as in Azure AI Foundry asset.
    3. In Attribute, select the attribute in which you want to see the value.
      Make sure to select an attribute that is included in the Azure AI Foundry Model asset type assignment.
  10. Click Save.
  11. Click Synchronize.
    A notification indicates the synchronization has started.
  1. On the main toolbar, click Products icon → Catalog.
    The Data Catalog Home opens.
  2. On the main toolbar, click .
    The Create dialog box appears.
  3. In the Register with Edge section of the Create dialog box, click Integration Configuration.
    The Integration Configuration page opens.
  4. In the Connection name column, locate the Azure connection that you used when you added the Azure AI Foundry capability and click the link in the Capabilities column.
    The Synchronization page opens.
  5. In the Synchronization Configuration section, click Add Configuration.
  6. In Domain, select the Domain asset in which you want to add the Azure AI Foundry assets.
  7. In Resource Group Name, enter the name of the resource group which holds resources related to your Azure AI Foundry model. For more information, go to Azure's resource documentation.
  8. In Workspace Name, enter a name for your workspace. This must be a unique name within your resource group. For more information, go to Azure's resources documentation.
  9. Optionally, in Custom AI Metrics Mappings, define which custom Azure AI Foundry model metrics you want to integrate. You do this by adding the mapping between the custom metric and the Collibra attribute.
    Important 

    If you use this feature, make sure to add any custom attributes/characteristics, as needed, to the asset type assignment.

    1. Click Add Custom AI Metrics Mappings.
    2. In Metric, type the name of the custom metric manually.
      Use the exact name as in Azure AI Foundry asset.
    3. In Attribute, select the attribute in which you want to see the value.
      Make sure to select an attribute that is included in the Azure AI Foundry Model asset type assignment.
  10. Click Save.
  11. In the Synchronization Schedule section, click Add schedule.
  12. Enter the required information and click Save:
    FieldDescription
    RepeatThe interval when you want to synchronize automatically. The possible values are: Daily, Weekly, Monthly, and Cron expression.
    Cron

    The Quartz Cron expression that determines when the synchronization takes place.

    This field is only visible if you select Cron expression in the Repeat field.

    Every

    The day on which you want to synchronize, for example, Sunday.

    This field is only visible if you select Weekly in the Repeat field.

    Every first

    The day of the month on which you want to synchronize, for example, Tuesday.

    This field is only visible if you select Monthly in the Repeat field.

    At

    The time at which you want to synchronize automatically, for example, 14:00.

    • You can only schedule on the hour. For example, you can add a synchronization schedule at 8:00, but not at 8:45.
    • This field is only visible if you select Daily, Weekly, or Monthly in the Repeat field.
    Time zoneThe time zone for the schedule.

What's next?

The synchronization job synchronizes the Azure AI Foundry data.
After the synchronization: