Patterns

The Patterns monitor detects similarities between string values across columns and down-scores any uncommon observations.

The following table describes the information available on the Patterns tab of the Findings page.

Column Description
Plus icon

A data preview of the actual value and the predicted value.

Click Plus icon to expand the observation. The first row in the data preview is the actual value and the second row is the predicted value.

Type The type of pattern detected, for example, Suggestive.
Observation An overview of the pattern observation. The format of this column is [actual value in columns where a pattern is detected -> predicted value in columns where a pattern is detected].
Count The number of patterns detected in the column.
Status

Lets you label and train a finding. The available dropdown menu options are Validate, Invalidate, and Resolve.

Validate instructs Collibra DQ to either assign a finding to a specific user for review, which then appears in the View the Assignment Queue or acknowledge without an assignee that the finding is a valid observation.

Invalidate instructs Collibra DQ to ignore a finding and allow the value to pass. There are two invalidation options:

  • Save lets you mark a finding as invalidated.
  • Save & Retrain lets you invalidate a finding and any previously saved invalidated findings, if any.

Tip When you have many findings to invalidate, it may be best to use the Save option to invalidate them at the same time, once all findings are reviewed.

Resolve Instructs Collibra DQ to mark the finding as an observation and prevents it from appearing in future runs. Resolving a finding does not immediately affect data quality scores.

Profile

The user account that is assigned to this pattern finding. When the Status is Assigned, a user profile displays in this column.

Note When a pattern finding is unassigned, the profile column is empty.

Adjusting the downscore value

You may find that the default downscore value of 1 does not meet your requirements. Click the input field to the upper-left of the findings table and enter any whole number next to DownScore Value to adjust the downscore value of the pattern observations that Collibra DQ detects.

Exporting rule break records

There are two options to export the details of your rule break records as .xlsx files:

  • Export generates an Excel file with the details from the drill-in.
  • Export with Details generates an Excel file with the details from the drill-in and the data preview, when available.