Admin Limits

Admin Limits define the maximum values of parameters passed during the execution of a DQ Job.

Note You should generally modify the following Admin Limits settings to prevent too much data from being stored in the database. For example, if you set the datashapelimit to 50 and the datashapelimitui to 25, when you run a check, only 50 shape issues get stored in the database and only the first 25 records display in the UI on the Findings page.

The following table shows the available settings on the Admin Limits page.

Setting Description
categoricallimit Limit of categorical outlier storage findings that get stored in the database.
categoricallimitui Limit of categorical outlier findings that display in the UI.
categoricalscore Default categorical outlier score, per record.
datashapelimit Limit of datashape storage findings that get stored in the database.
datashapelimitui Limit of datashape findings that display in the UI.
datashapescore Default datashape score, per record.
dupelimit Limit of dupe storage findings that get stored in the database.
dupelimitui Limit of dupe findings that display in the UI.
dupescore Default dupe score, per record.
fpglimit Limit of frequent pattern mining storage findings that get stored in the database.
fpglimitui Limit of frequent pattern mining findings that display in the UI.
fpgscore Default frequent pattern mining score, per record.
histlimit Limit of histogram storage findings that get stored in the database.
histlimitui Limit of histogram findings that display in the UI.
lookbacklimit Limit of lookback intervals findings that get stored in the database.
maxcellcountforparalleljdbc Maximum number of cells for a DQ scan before it is recommended to use parallel JDBC, which gets stored in the database.
maxcolumnlimit Limit of maximum columns display findings that get stored in the database.
maxconcurrentjobs Maximum number of Pushdown jobs that can run concurrently.
maxexecutorcores Maximum number of executors cores to be set during estimation on a DQ scan, which gets stored in the database. Set the default value at the agent level.
maxexecutormemory Maximum number of executor memory (GB) to be set during estimation on a DQ scan, which gets stored in the database. Set the default value at the agent level.
maxnumexecutors Maximum number of executors to be set during estimation on a DQ scan, which gets stored in the database. Set the default value at the agent level.
maxpartitions Maximum number of partitions to be set during estimation of a DQ scan.
maxworkermemory Agent Worker Maximum Memory (WMM)
maxworkercores Maximum cores per worker.
minworkermemory Agent Worker Minimum Memory (WMI)
obslimit Limit of observation storage findings that get stored in the database.
obslimitui Limit of observation storage findings that display in the UI.
obsscore Default observation score, per record.
outlierlimit Limit of outlier findings that get stored in the database.
outlierlimitui Limit of outlier findings that get stored in the database.
outlierscore Default outlier score, per record.
partitionautocal Calculate the number of Spark partitions automatically for optimal performance.
passfaillimit Limit of passing or failing threshold findings that get stored in the database.
pergbpartitions Per 1 GB memory partitions
schemascore Default schema score, per record.
scorecardsize Limit of scorecard size display findings that get stored in the database.
sourcedupelimit Source dupe limit for Pushdown jobs (0 = unlimited)
sourceoutlierlimit Source outlier limit for Pushdown jobs (0 = unlimited)
sourceoutputenabled Source output for Pushdown jobs
sourcerulelimit Source rule limit for Pushdown jobs (0 = unlimited).
sourcesampleenabled Source sample for Pushdown jobs.
sourceshapelimit Source shape limit for Pushdown jobs (0 = unlimited).
totalworkers Total number of workers available.
valsrcdisableaq Disable the assignment Q for validate source.
valsrclimit Limit of validate source storage findings that get stored in the database.
valsrclimitui Limit of validate source findings that display in the UI.
valsrcscore Default validate source score, per record.

Note Settings with "score" in their name represent the default score for that setting's type of findings.