Dataset Manager

Apply one or many filters to refine the list of datasets based on:

Sensitivity

Filter by sensitivity labels associated with datasets in your Collibra Data Quality & Observability environment.

Run Mode

Filter datasets based on whether they are in published or draft status.

Connection Type

Filter datasets by Pushdown or Pullup processing mode.

Attributes

Filter datasets that only contain rules without alerts or alerts without rules.

Source Type

Filter datasets by data source.

Data Class Type

Filter datasets by data class.

Business Units

Filter datasets by business unit.

Data Categories

Filter datasets by data category.

Row Count

Filter datasets by the number of rows they contain.

Column Count

Filter datasets by the number of columns they contain

Integrations

Filter datasets based on whether they are integrated into Collibra Data Intelligence Platform.

# of DQ Scans

Filter datasets by the number of times they have been run as DQ Jobs.

Select the checkbox options in the column to the left of the Dataset column, then click Bulk Actions and select an option from the dropdown menu. The available Bulk Actions options include:

Bulk Manage Host

Allows admin users to update the host URL of multiple datasets at once. Select the checkbox options next to the datasets you want to manage, then click Bulk Manage Host from the Bulk Actions dropdown menu. From the Bulk Manage Host dialog, enter the new host URL and click Save.

Bulk Manage Agent

Allows admin users to update the agent of multiple Pullup datasets at once. Select the checkbox options next to the datasets you want to manage, then click Bulk Manage Agent from the Bulk Actions dropdown menu. From the Bulk Manage Agent dialog, select the new agent from the dropdown menu and click Save.

Important Updating the host of multiple datasets at once applies changes to both scheduled and unscheduled DQ Jobs. The connection of any dataset included in the bulk update is mapped to agent you select.

Bulk Manage Spark Settings

Allows admin users to update the Spark settings of multiple Pullup datasets at once. Select the checkbox options next to the datasets you want to manage, then click Bulk Manage Spark Settings from the Bulk Actions dropdown menu. From the Bulk Manage Spark Settings dialog, fill out the required fields and click Save.

Show fields

Option	Description
Number of Executors	The default number of executors allocated per DQ Job. The default is 1.
Driver Memory	The default driver RAM allocated per DQ Job. The default is 1 gigabyte.
Executor Memory	The default RAM per executors allocated per DQ Job. The default is 1 gigabyte.
Executor Cores	The default number of cores per executors allocated per DQ Job. The default is 1.
Conf	Additional spark-submit parameters appended to the DQ Job run command.
Master	The Spark Master URL copied from the Spark cluster verification screen. For example, spark://...
Deploy Mode	The Spark deployment mode can be either Client or Cluster. While we recommend Cluster, there are best practices to follow: If you only have one Spark Worker node, it is best practice to select Client. If you have more than one Spark Worker node, it is best practice to select Cluster.

Bulk Manage Business Units

Allows you to apply a business unit to multiple datasets at once. Select the checkbox options next to the datasets you want to manage, then select Bulk Manage Business Units from the Bulk Actions dropdown menu. From the dropdown menu, select your preferred business unit and click Save.

Note To assign a business unit to a dataset, you need to have dataset access or ROLE_DATASET_ACTIONS.

Bulk Manage Data Categories

Allows you to apply a data category to multiple datasets at once. Select the checkbox options next to the datasets you want to manage, then select Bulk Manage Data Categories from the Bulk Actions dropdown menu. From the dropdown menu, select your preferred data category and click Save.

Note To assign a data category to a dataset, you need to have dataset access, ROLE_DATASET_TRAIN, or ROLE_DATASET_ACTIONS.

Bulk Delete

Allows you to delete multiple datasets at once. Select the checkbox options next to the datasets you want to delete, then select Bulk Delete from the Bulk Actions dropdown menu.

Note To delete a dataset, you need to be its owner or have ROLE_ADMIN or ROLE_DATASET_MANAGER.

Bulk Enable Integrations

Allows you to update the host URL of multiple datasets at once. Select the checkbox options next to the datasets you want to manage, click Bulk Enable Integrations from the Bulk Actions dropdown menu, then click Enable integrations.

Note To toggle a dataset integration, you need to have ROLE_ADMIN, ROLE_DATASET_MANAGER, ROLE_DATASET_ACTIONS.

This table lists all datasets in your Collibra DQ environment and provides the high-level data points described in the following table.

Column	Description
	Click these options to select one or more datasets to allow you to apply bulk actions. You can also select in the column header to select all datasets.
Dataset	The name of your dataset. You can also see the following in this column: When a dataset is in draft status, a displays beneath the dataset name. When a dataset is in published status, a displays beneath the dataset name. When a dataset does not have alerts configured, a displays beneath the dataset name. When a dataset has alerts configured, a displays beneath the dataset name. When a dataset does not have rules configured, a displays beneath the dataset name. When a dataset has rules configured, a displays beneath the dataset name. Click the to the right of the dataset name to drill down into the dataset.
Business Unit	The business unit with which the dataset is associated.
Update Timestamp	The timestamp of the last run of the dataset in YYYY-MM-DD hh-mm-ss format.
Source Type	The data source of the dataset. For example, SQL Server or BigQuery.
Connection Name	The unique name of the data source. For example, EXAMPLE_SQLSERVER_CXN.
Schema/Parent Folder	The schema or parent folder from which the dataset originates.
Table/File Name	The table or file name from which the dataset was created.
Meta Tags	The meta tags with which the dataset is associated. Optionally click Actions Edit, then enter meta tags in the Meta Tags input fields. Note Meta tags have a 40 character limit.
Server/File Path	The server or file path associated with the origin of your dataset.
Actions	Click to take a variety of actions on your dataset. Available actions include: Edit your dataset. Rename your dataset. Publish your dataset or revert it To Draft. Assign a Data Category to your dataset. Assign a Business Unit to your dataset. Enable or Disable Integrations of your dataset into Collibra Data Intelligence Platform. Delete your dataset. Note You can also create a clone of the dataset from the Findings page by using the Clone Dataset option on the Job tab.

Opens the Data Categories page in the Admin Console where you can create and manage data categories.

Note ROLE_ADMIN or ROLE_DATA_GOVERNANCE_MANAGER is required to access the Admin Console.

Opens the Business Units page in the Admin Console where you can create and manage business units.

Note ROLE_ADMIN or ROLE_DATA_GOVERNANCE_MANAGER is required to access the Admin Console.

Click the to the right of the dataset name to drill down into the dataset and reveal the following high-level data points.

Field	Description
Stats
Daily Rows	The number of rows scanned in the last run.
Columns	The number of columns in the dataset.
Active Rules	The number of active rules included in the last run.
Active Alerts	The number of alerts configured to notify specified users when their conditions were met in the last run.
Data Category	The data category assigned to your dataset on the Rule Workbench or Metadata Bar.
Quick Links
Profile	Click the to open the Profile page of your dataset.
Rules	Click the to open the Dataset Rules page of your dataset.
Description	The description of your dataset given to it on the Explorer Review page.

This section of the dataset drill down shows the following column-level details of all columns in your dataset.