Builds

This page provides information about Docker images and other information related to Collibra DQ build packages. Builds follow a naming convention to indicate which Optional Drivers drivers are packaged.

Note The optional drivers only impact container versions of Collibra DQ and do not impact Standalone installation packages.

Available Containers

Note The default build is considered the secure build without optional drivers or critical vulnerabilities.

2024

Collibra Data Quality & Observability

  • 2024.04-ABDGCSHILM-249
  • 2024.04-ABDGCSHILMH-248
  • 2024.04-250

Spark

  • 3.4.1-2024.04-ABDGCSHILM-249
  • 3.4.1-2024.04-ABDGCSHILMH-248
  • 3.4.1-2024.04-250

Collibra Data Quality & Observability

  • 2024.03-ABDGCSHILM-240
  • 2024.03-ABDGCSHILMH-242
  • 2024.03-239

Spark

  • 3.4.1-2024.03-ABDGCSHILM-240
  • 3.4.1-2024.03-ABDGCSHILMH-242
  • 3.4.1-2024.03-239

Collibra Data Quality & Observability

  • 2024.02-ABDGCSHILM-211
  • 2024.02-ABDGCSHILMH-209
  • 2024.02-210

Spark

  • 3.4.1-2024.02-ABDGCSHILM-211
  • 3.4.1-2024.02-ABDGCSHILMH-209
  • 3.4.1-2024.02-210

Collibra Data Quality & Observability

  • 2024.01-ABDGCSHILM-227
  • 2024.01-ABDGCSHILMH-228
  • 2024.01-229

Spark

  • 3.4.1-2024.01-ABDGCSHILM-227
  • 3.4.1-2024.01-ABDGCSHILMH-228
  • 3.4.1-2024.01-229

2023

Note As of Collibra Data Quality & Observability 2023.11, the default Spark version for cloud native deployments is 3.4.1.

Collibra Data Quality & Observability

  • 2023.11-ABDGCSHILM-220
  • 2023.11-ABDGCSHILMH-223
  • 2023.11-221

Spark

  • 3.4.1-2023.11-ABDGCSHILM-220
  • 3.4.1-2023.11-ABDGCSHILMH-223
  • 3.4.1-2023.11-221

Collibra Data Quality & Observability

  • 2023.10-ABDGCSHILM-310
  • 2023.10-ABDGCSHILMH-312
  • 2023.10-311

Spark

  • 3.2.2-2023.10-ABDGCSHILM-310
  • 3.2.2-2023.10-ABDGCSHILMH-312
  • 3.2.2-2023.10-311

Note As of Collibra DQ 2023.09, owl-web, owl-agent, owl-livy, and spark are now dq-web, dq-agent, dq-livy, and dq-spark.

Collibra Data Quality & Observability

  • 2023.09-ABDGCSHILM-3539
  • 2023.09-ABDGCSHILMH-3530
  • 2023.09-3529

Spark

  • 3.2.2-2023.09-ABDGCSHILM-3539
  • 3.2.2-2023.09-ABDGCSHILMH-3530
  • 3.2.2-2023.09-3529

Collibra Data Quality & Observability

  • 2023.08-ABDGCSHILM-3292
  • 2023.08-3298

Spark

  • 3.2.2-2023.08-ABDGCSHILM-3292
  • 3.2.2-2023.08-3298

Collibra Data Quality & Observability

  • 2023.06-ABDGCSHILM-2957
  • 2023.06-2958

Spark

  • 3.2.2-2023.06-ABDGCSHILM-2957
  • 3.2.2-2023.06-2958

Collibra Data Quality & Observability

  • 2023.03-LM-2341
  • 2023.03-ABDGCSILM-2340
  • 2023.03-ABDGCSHILM-2339
  • 2023.03-2342

Spark

  • 3.2.2-2023.03-LM-2341
  • 3.2.2-2023.03-ABDGCSILM-2340
  • 3.2.2-2023.03-ABDGCSHILM-2339
  • 3.2.2-2023.03-2342

Collibra Data Quality & Observability

  • 2023.02-LM-2188
  • 2023.02-ABDGCSILM-2187
  • 2023.02-ABDGCSHILM-2186
  • 2023.02-2189

Spark

  • 3.2.2-2023.02-LM-2188
  • 3.2.2-2023.02-ABDGCSILM-2187
  • 3.2.2-2023.02-ABDGCSHILM-2186
  • 3.2.2-2023.02-2189

Collibra Data Quality & Observability

  • 2023.01-LM-2067
  • 2023.01-ABDGCSILM-2066
  • 2023.01-ABDGCSHILM-2065
  • 2023.01-2068

Spark

  • 3.2.2-2023.01-LM-2067
  • 3.2.2-2023.01-ABDGCSILM-2066
  • 3.2.2-2023.01-ABDGCSHILM-2065
  • 3.2.2-2023.01-2068

Config Map Example

These are the configs to change the versions. For a complete list of versions for Collibra DQ and Spark, refer to the Available Containers section above.

Copy
--set global.version.dq=2024.01-1234 --set global.version.spark=3.4.1-2024.01-1234

Pull Examples

Note As of Collibra Data Quality & Observability 2023.09, owl-web, owl-agent, owl-livy, and spark are now dq-web, dq-agent, dq-livy, and dq-spark.

docker pull https://gcr.io/owl-hadoop-cdh/dq-web:2024.01-ABDGCSHILM-1234

docker pull https://gcr.io/owl-hadoop-cdh/dq-agent:2024.01-ABDGCSHILM-1234

docker pull https://gcr.io/owl-hadoop-cdh/dq-livy:3.4.1-2024.01-ABDGCSHILM-1234

docker pull https://gcr.io/owl-hadoop-cdh/dq-spark:3.4.1-2024.01-ABDGCSHILM-1234

Description

Example: 2024.01-ABDGCSHILM-1234

2024.01: Release number (YYYY.MM).

ABDGCSHILM: A package with optional drivers Athena, BigQuery, Databricks, Google Cloud Storage, Hive, Impala, Livy, and MongoDB.

1234 - A unique number appended to each build.

Default Drivers

Always Packaged

  • SQL Server
  • Oracle
  • Snowflake
  • Redshift
  • S3
  • ADLS
  • PostgreSQL
  • MySQL
  • Teradata
  • Sybase
  • Db2
  • Dremio

Optional Drivers

Please select drivers

  • ABDGCSHILM (Drivers Initial in alphabetical order):
    • A : Athena
    • B : BigQuery
    • D = Databricks
    • GCS : Google Cloud Storage
    • H : Hive
    • I : Impala
    • L : Livy
    • M : MongoDB
    • H: Hudi