Configure job limits

Limits help you control data thresholds, to ensure consistency and relevance.

Prerequisites

  • You have the Data Quality Admin global role.

Steps

  1. On the main toolbar, click Products icon → Settings.
  2. Click the Data Quality tab.
  3. Click Limits.
  4. Update the limits, as needed.
    5. Limit Description
    Lookback limit

    The lookback limit is the number of previous job runs that Data Quality & Observability examines to train the adaptive rules model.

    The default value is 21. You can adjust it by entering a value greater than 0.
    Maximum concurrent jobs

    The maximum concurrent jobs limit is the number of Pushdown jobs that can run at the same time.

    The default is 5. You can adjust it by entering a value between 1 and 25.
    Observation storage limit

    The observation storage limit is the number of adaptive rule findings that can be stored in the Metastore. No sensitive data is stored.

    The default limit is 200. You can adjust it by entering a value greater than 0.
    Score thresholds

    Score thresholds are specific data quality scores that you can configure to determine whether a job is passing or failing. Scores between the passing and failing thresholds are marked as warnings to alert users to possible or emerging data quality issues.

    The scoring scale uses two sliders for the passing and failing thresholds and is visually represented in color-coded segments:

    • Red for failing scores (default 0-75)
    • Yellow for warning scores (default 76-89)
    • Green for passing scores (default 90-100)

    screenshot of scoring thresholds settings

    To set custom scoring thresholds, click and drag the passing or failing slider until the associated number matches your desired score threshold.
  5. Click Save changes.