Configuring archive break records for Pullup jobs
This topic shows you how to configure archive break records to send details of breaking records from Pullup jobs to your data source. Enabling this feature allows you to automatically store row-level data for failed quality checks directly in your database.
You can configure the storage location at the connection level to align with your organization's data architecture.
Prerequisites
To archive break records, you need the following permissions and configurations:
| Requirement | Details |
|---|---|
| Collibra permissions |
|
| Existing PostgreSQL connection and Data Quality Pullup Processing capability |
For more information on Pullup-compatible connections, go to Supported data sources for Data Quality & Observability. |
| Data source privileges for break records |
Because exact permission models vary significantly across different data platforms, consult your organization's database administrator to provision the exact permissions. The service account connecting to your data source requires the following generalized privileges: On the source data (to monitor records):
On the destination schema (to archive break records):
Note You only need
create access once per break records table, or you can create it manually with explicit update access. All monitors write to the same break records table, so create access can be safely revoked after initial setup. If the break records storage location changes, create access is required again to generate a new table. |
Enabling archive break records
Important Ensure that the service account used for the connection has all the privileges listed above. If any privilege is missing, the system cannot archive break records.
-
On the main toolbar, click
→
Settings.
The Settings page opens. -
In the tab pane, click Edge.
The Sites tab opens and shows a table with an overview of your sites. - In the site overview, click the name of the site where the Pullup connection is configured.
The site page appears. - Click the Capabilities tab.
- Click the Data Quality Pullup Processing capability where you want to archive break records.
- Set Archive Break Records Connection to your desired archive destination.
- Click Save.
-
On the main toolbar, click
→ Data Quality.
Data Quality & Observability opens. - Click Connections.
The Connections page opens. - Open your desired Pullup connection.
- Click the Archive break records switch to enable archive break records.
- Select the destination database and schema from the drop-down menus, where break records will be written.
Note The database and schema must already exist in your connection.
- Create and run a Pullup job on this connection.
- Create a rule that will return breaking records.
- Re-run your job.
When breaking records occur, Collibra writes them to the database you selected in step 12.
Note As of Collibra 2026.10, only PostgreSQL is available as an archive destination.