Review monitor results

From the Monitors tab in the Job Details page, you can:

  • Review the results of monitors for a closer look at their details.
  • Find details on quality issues.
  • Adjust tolerance levels or suppress rules that are outdated, irrelevant, or no longer necessary.
  • View and copy the SQL queries of custom rules.
  • Manage notifications for custom rules.
  • Adaptive rule monitors
  • Custom rule monitors

Configuring tolerance levels

Tolerance levels allow you to control how rigidly the adaptive levels of monitors are enforced. By default, the adaptive level for all monitors is set to neutral, but you can choose to enforce them more strictly or leniently.

Example In the screenshot, the details of the column "column2-Row_count" are expanded to show its row count evolution over a period of time. With this information, you may decide to leave this adaptive rule in its current state, or click Advanced and change the tolerance level to instruct the behavioral model to enforce it differently.

screenshot of monitor details drawer

Prerequisites

You need a global role with the Product Rights > Data Quality global permission or the Data Quality Editor or Data Quality Manager resource role with the Data Quality Job > Train Monitors resource permission.

Steps

  1. Open the Job Details page of a Data Quality Job.
  2. Click Monitors.
  3. In the monitor details table, go to the adaptive rule monitor whose tolerance levels you want to configure.
  4. On the right side of the monitor row, click More icon, then click Open.
    5. The Details drawer appears.
  5. Click Console icon Advanced.
    6. The tolerance options are shown in the Advanced tab.
  6. Select a tolerance option.
    7. Tolerance Description
    Strict

    Rigidly enforce and flag any data points that fall outside what Data Quality & Observability's behavioral model learns to be normal. Any values outside the strict boundaries will be flagged as potential data quality issues.
    Neutral Automatically enforce and flag any data points that fall outside what Data Quality & Observability's behavioral model learns to be normal. Any values outside the neutral boundaries will be flagged as potential data quality issues.
    Lenient

    Relax the enforcement and flagging when data points fall outside of the range that Data Quality & Observability's behavioral model learns to be normal. Any values outside the lenient boundaries will be flagged as potential data quality issues.

    Tip This can help avoid excessive alerts when Data Quality & Observability is in the learning phase of a new Data Quality Job.

Managing a custom rule

Whether passing or breaking, you can open the rule actions drawer to:

You can open the rule actions drawer to:

  • View a summary of your rule output to allow you to begin scoping remediation efforts for your data quality issue.
  • Suppress or activate a rule monitor to exclude or include its findings from the Data Quality Job results.
  • View and copy the query of your rule to access the SQL and retrieve the results from the rule run in your data source.
  • Manage the recipients of notifications associated with your rule to ensure the appropriate stakeholders are informed about breaking records.
  • Preview a limited sample of break records for your rule to effectively plan remediation efforts.

Prerequisites

You have a global role with the Product Rights > Data Quality global permission or the following permissions based on the actions you want to perform:

  • To pass or fail the results of a monitor, you have the Data Quality Editor or Data Quality Manager resource role with the Data Quality Job > Train Monitors resource permission.
  • To edit, suppress, or activate a monitor, you have the Data Quality Editor or Data Quality Manager resource role with the Edit Monitor resource permission.
  • To delete a rule monitor, you have the Data Quality Editor or Data Quality Manager resource role with the Delete Monitor resource permission.
  • To preview rule breaks, you have the Preview Rule Break Records resource permission.

Open the rule actions drawer

  1. Open the Job Details page of a Data Quality Job.
  2. Click Monitors.
  3. In the monitor details table, go to the rule monitor you want to manage.
  4. On the right side of the monitor row, click More icon, then click Open.
    5. The rule actions drawer appears.
  5. On the left side of the rule actions drawer, click an option. Options include:
    1. Overview
    2. Query
    3. Notifications
    4. Break records

Tip Some options include additional actions, such as activating or suppressing the rule and copying the SQL. Refer to the tabs below for more information.

  • Overview
  • Query
  • Notifications
  • Break records

Understanding the rule overview

The rule overview shows details of the rule monitor, including:

  • The run date.
  • Whether the rule is passing or failing.
  • The number and percentage of breaking records.
  • The rule tolerance percentage, when applicable.
  • The number and percentage of passing records.
  • The number of total records.
  1. When you open the rule actions drawer, the Overview tab opens by default.
  2. Click a run to view the rule break details.
    3. Tip 
    • In the upper-right corner of the rule actions drawer, click Report icon to view breaks and metadata from past runs as a chart or Legend icon to view them as a list.
    • When there are more runs than can fit on the screen, you can click Beak left icon or Beak right icon to scroll through the run history.
    • When the SQL exception details setting is enabled, if a SQL exception is detected when the rule runs, click View exception details to see the full error message on the Query tab.

Suppress or activate a rule

You can suppress a rule monitor when it is passing or breaking to exclude its findings from the Data Quality Job results. You can also activate a suppressed rule monitor to include its findings in the results when the job runs again.

To do this, click the switch in the upper-right corner to activate or suppress the rule monitor.
A message confirms whether the monitor is activated or suppressed.

View or copy the SQL query

You can view and copy the query of your rule to access the SQL from the most recent job run so you can retrieve the results from the rule run in your data source.

  1. Click Backup icon Query.
    2. The SQL query of the rule monitor is shown in the Query tab.
  2. Optionally, click Content copy icon in the upper-right corner of the drawer to copy the SQL query to your clipboard.

Note When the SQL exception details setting is enabled, if a SQL exception is detected when the rule runs, the full error message is shown beneath the SQL query.

Manage notifications for a rule

You can add notifications to your rule so users or user groups receive notifications when the rule fails to run and throws an exception message, is breaking, or is passing. Alternatively, you can update or remove an existing notification.

  1. Click Notification icon Notifications.
    2. The notifications for the rule are shown in the Notifications tab.
  2. Click Status and select an option from the drop-down list.
    The rule is added to your job.
  3. Optionally, enter a unique custom message in the Message input field to include with the notification.
  4. Click the Recipients drop-down list and select a user or user group to add them to the list of recipients, or click Grey close icon to the right of a recipient's username to remove them.
    5. Note 
    • The drop-down list of users includes all active users in Collibra.
    • By default, the creator of the rule is included as a notification recipient.
  5. Click Plus icon Add notification.
    The notification is added to the Notifications table.
Tip 
  • To remove a notification, click Delete outline rounded icon to the right of the notification you want to remove.
  • To update a notification, double-click the status, message, or recipients cell of the notification you want to update, then make your desired updates. When you're done, click anywhere outside of the cell you updated to finalize your updates.

Preview a sample of break records

You can preview a sample of up to 500 break records for your rule from the most recent job run. This allows you to analyze the specific records that violate the rule and plan your remediation efforts effectively. Since the preview shows only a sample of breaking records, you can copy the SQL query from the SQL option in the rule actions drawer and run it on your data source to retrieve the complete list of breaking records.

To preview a sample of breaking records present in the data source at the time you open the Break records tab, the session manager uses the rule query and, if applicable, the filter query to retrieve data from the data source. If no breaking records are found, the Break records tab does not show any data.

Important To preview break records, you need the Preview Rule Break Records resource permission. If you do not have this permission, this option is unavailable.

  1. Click Backup icon Break records.
    2. A limited sample of the break records for the rule monitor is shown in the Break records tab.
    Tip 
    • In the upper-right corner, you can click Content copy outlined icon to copy the contents of the break records table to your clipboard, or click Download icon to download a CSV file of the break records table.
    • Click the header of any column to sort it in ascending or descending order. To filter a column, hover your pointer over it and click Search icon. You can filter by alphanumerical values or by date when the column contains dates.
    • For a complete list of break records, copy the SQL from the SQL option and run it on your data source.
    • You can set a maximum number of records of up to 500 by configuring the break records preview limit on the global rules settings page.

Note The number of break records in the sample can vary between runs. Additionally, because the break records are based on a live query to the data source, changes in the underlying data source can cause the records shown on the Break records tab to differ from the initial results at the time of job run.

Suppress or activate a rule

You can suppress a rule monitor when it is passing or breaking to exclude its findings from the Data Quality Job results. You can also activate a suppressed rule monitor to include its findings in the results when the job runs again.

To do this, click the switch in the upper-right corner to activate or suppress the rule monitor.
A message confirms whether the monitor is activated or suppressed.

What's next