Add quick monitoring

You can use quick monitoring to deploy basic Data Quality Jobs in one click across an entire schema. This helps you understand the contents of your tables before applying advanced data quality monitoring.

Prerequisites

  • The DQ Pushdown Edge capability is enabled for your data source.
  • You have a global role with the Product Rights > Data Quality global permission or the following permissions based on the actions you want to perform:
    • To create quick monitoring jobs, you must have the Data Quality Manager resource role with the Data Quality Job > Create resource permission.
    • To run quick monitoring jobs, you must have the Data Quality Editor or Data Quality Manager resource role with the Data Quality Job > Run resource permission.

Steps

  1. On the main toolbar, click Products icon → Data Quality.
    Monitoring Overview opens.
  2. Click a data source in the data explorer to expand its schemas.
  3. Click the schema to which you want to add quick monitoring.
  4. In the upper-right corner of the schema view, click Plus icon Add quick monitoring.
    5. The Add quick monitoring dialog appears.
  5. Update the quick monitoring options according to your preferences.

    6. Tip We recommend using the default options in your initial quick monitoring deployment.

    Option Description Default setting
    Select tables The tables within the schema that are included in the quick monitoring deployment. All tables within the schema are selected.
    Sample rows

    A random selection of the number of rows you specify, which is used to evaluate data profiling results.

    The minimum number of sample rows is 30 and the maximum is 100,000.

    Important A row sample is required to deploy quick monitoring. To customize the job query to include only recent rows or apply other row filters, create jobs at the table-level.

    		 20,000
    Row count Enables a row count monitor that detects significant changes in the row count between job runs. On
    Show descriptive statistics

    Controls whether descriptive profiling statistics are visible in the UI.

    The descriptive statistics returned in a quick monitoring deployment may include the following values:

    • Min
    • Median
    • Max
    • 1st quartile
    • 3rd quartile
    • Min/max scale
    • Min/max precision

    While quick monitoring always returns descriptive statistics, disabling this option helps you reduce the risk of exposing potentially sensitive data as you begin to check the health of your data.

    Example The max value in a column called "Social Security Number" is likely a sensitive social security number. In this case, consider leaving this option disabled to avoid exposing it in the UI.

    		 Off
    Repeat

    Quick monitoring frequency: hourly, daily, weekly on certain days, on weekdays only, monthly, or never.

    Note If you select Never, the job runs only once, when you initiate the job run.

    		 Never
  6. Click Create and run [number of Jobs based on number of tables] now.

What's next?

  • About monitoring coverage of your schema and refine the jobs within them.
  • Create individual Data Quality Jobs at the table-level.

    • Note After you run a job once, such as via quick monitoring, you can modify the job query, add a time slice, apply row and limit filters, profile all rows in scope, or choose a sample size. These options allow you to control the scope of your job and determine what is observed in the data profile.