Synchronize Dataiku
Tip You can set up this integration in the unified integrations experience (in preview). This feature is in public preview and applies to metadata, AI, SAP, and lineage integrations. In one guided flow, you select an Edge site, create the connection, add the integration, and configure it. To get started, in the banner on the Integration configuration tab, click Try the new Integrations page. For more information, go to About the unified integrations experience (in preview).
Synchronizing Dataiku is the process of integrating metadata from Dataiku and making the data available in Collibra Platform. You can either synchronize manually or automate the process by adding a synchronization schedule.
Prerequisites
In your Collibra environment:
- To use the Dataiku integration, you need Collibra Platform 2026.11 or newer and Edge version 2026.10.35 or newer.
- You have created an Dataiku connection.
- You have added the Dataiku capability to the Dataiku connection.
- You have a resource role with the Configure external system resource permission, for example, Owner.
- You have a global role with the Catalog global permission, for example, Catalog Author.
- You have a global role with the View Edge connections and capabilities global permission, for example, Edge integration engineer. For example, Edge integration engineer.
Steps
-
On the main toolbar, click
→
Catalog.
The Catalog homepage opens. - Click Integrations.
The Integrations page opens. - Click the Integration configuration tab.
- In the Integration column, click the link for your Dataiku integration.
The integration settings page opens. - In the Synchronization configuration section, click Add configuration.
- Complete the fields as needed.
Field Action Required Updated: <timestamp> Click Updated: <timestamp> next to Synchronization configuration, where
timestampindicates the last time when the data was loaded from Dataiku.
The projects are loaded to the dropdown list of the Projects field. This can take some time.A scheduled refresh job is also automatically created when you complete the capability configuration. The scheduled refresh job appears on the Jobs dashboard of your Edge site with the same name as your metadata capability. Unlike the metadata synchronization job, it appears only on the Jobs dashboard and not in the Activities list. If two jobs with the same name appear on the Jobs dashboard, one is the scheduled refresh job and the other is the metadata synchronization job. By default, the scheduled refresh job runs daily at 23:00 server time.
No
Target Domain In Target Domain, select the Domain asset in which you want to add the Dataiku assets.
Yes
Projects In Projects, select the Dataiku projects from which you want to integrate assets. Each entry in the list shows the project name and, within brackets, its project key. If you choose none, all projects that the connection can access are synchronized.
If you type one instead, use the project key, not the name. The key is the short, all uppercase ID in the project's web address in Dataiku, for example,
MY_PROJECT.
No
Include LLM Mesh Models Select the Include LLM Mesh Models option to integrate LLM Mesh models (for example, OpenAI or Bedrock models) as AI Model Version assets. Integrating LLM Mesh models requires Dataiku DSS 12.4 or later.
This option is turned on by default.
No
Include Input Datasets Select the Include Input Datasets option to integrate the datasets your models were trained on, from S3 storage or SQL tables, and link them to the AI Model Version assets. Datasets stored in Dataiku (uploaded or local), SQL query datasets, and datasets on connections that your API key cannot read are skipped. This option is turned on by default.
When input datasets are included, the integration also creates the assets that represent the training data:
- A Storage Container and File asset for an S3-backed dataset
- A Database, Schema, and Table asset for a SQL table dataset
Assets are named after the data location, so the same data used by several models is a single asset.
No
- Click Save.
- Click Synchronize.
A notification indicates the synchronization has started.
-
On the main toolbar, click
→
Catalog.
The Catalog homepage opens. - Click Integrations.
The Integrations page opens. - Click the Integration configuration tab.
- In the Integration column, click the link for your Dataiku integration.
The integration settings page opens. - In the Synchronization configuration section, click Add configuration.
- Complete the fields as needed.
Field Action Required Updated: <timestamp> Click Updated: <timestamp> next to Synchronization configuration, where
timestampindicates the last time when the data was loaded from Dataiku.
The projects are loaded to the dropdown list of the Projects field. This can take some time.A scheduled refresh job is also automatically created when you complete the capability configuration. The scheduled refresh job appears on the Jobs dashboard of your Edge site with the same name as your metadata capability. Unlike the metadata synchronization job, it appears only on the Jobs dashboard and not in the Activities list. If two jobs with the same name appear on the Jobs dashboard, one is the scheduled refresh job and the other is the metadata synchronization job. By default, the scheduled refresh job runs daily at 23:00 server time.
No
Target Domain In Target Domain, select the Domain asset in which you want to add the Dataiku assets.
Yes
Projects In Projects, select the Dataiku projects from which you want to integrate assets. Each entry in the list shows the project name and, within brackets, its project key. If you choose none, all projects that the connection can access are synchronized.
If you type one instead, use the project key, not the name. The key is the short, all uppercase ID in the project's web address in Dataiku, for example,
MY_PROJECT.
No
Include LLM Mesh Models Select the Include LLM Mesh Models option to integrate LLM Mesh models (for example, OpenAI or Bedrock models) as AI Model Version assets. Integrating LLM Mesh models requires Dataiku DSS 12.4 or later.
This option is turned on by default.
No
Include Input Datasets Select the Include Input Datasets option to integrate the datasets your models were trained on, from S3 storage or SQL tables, and link them to the AI Model Version assets. Datasets stored in Dataiku (uploaded or local), SQL query datasets, and datasets on connections that your API key cannot read are skipped. This option is turned on by default.
When input datasets are included, the integration also creates the assets that represent the training data:
- A Storage Container and File asset for an S3-backed dataset
- A Database, Schema, and Table asset for a SQL table dataset
Assets are named after the data location, so the same data used by several models is a single asset.
No
- Click Save.
- In the Synchronization Schedule section, click Add schedule.
- Enter the required information and click Save:
Field Description Repeat The interval when you want to synchronize automatically. The possible values are: Daily, Weekly, Monthly, and Cron expression. CronThe Quartz Cron expression that determines when the synchronization takes place.
This field is only visible if you select
Cron expressionin the Repeat field.EveryThe day on which you want to synchronize, for example, Sunday.
This field is only visible if you select
Weeklyin the Repeat field.Every firstThe day of the month on which you want to synchronize, for example, Tuesday.
This field is only visible if you select
Monthlyin the Repeat field.At
The time at which you want to synchronize automatically, for example, 14:00.
- You can only schedule on the hour. For example, you can add a synchronization schedule at 8:00, but not at 8:45.
- This field is only visible if you select
Daily,Weekly, orMonthlyin the Repeat field.
Time zone The time zone for the schedule.
The synchronization job synchronizes the Dataiku data.
After the synchronization:
- You can view a summary of the results from the
Activities list on the main menu.
- The resulting assets get a relation to the Domain that you selected.
For information on the integrated data, go to Integrated Dataiku data.