Connecting to MongoDB

This section contains details for MongoDB connections.

Select an option from the dropdown menu to display information for a particular driver class.

General information

Field	Description
Data source	MongoDB
Supported version	3.12.1122.0.8326.0
Connection string	`jdbc:mongodb://`
Packaged?	No Yes
Certified?	No Yes
Supported features
Estimate job	Yes
Analyze data	Yes
Schedule	Yes No
Processing capabilities
Pushdown	No
Spark agent	Yes
Yarn agent	Yes No
Parallel JDBC	No Yes
Java Platform version compatibility
JDK 8	Yes
JDK 11	Yes

Minimum user permissions

In order to bring your MongoDB data into Collibra Data Quality & Observability, you need the following permissions.

Read access on your MongoDB tables.
ROLE_ADMIN assigned to your user in Collibra DQ.

Recommended and required connection properties

Required	Connection Property	Type	Value
Yes	Name	Text	The unique name of your connection. Ensure that there are no spaces in your connection name.
Yes	Connection URL	String	The connection string path of your MongoDB connection. For successful job execution, you must first configure a Spark Scratch Directory to allocate space for a schema cache. After you configure the Spark Scratch Directory, add to the connection string the temporary writable location `schema=/tmp/scratch/${mongo_example_file_name.xml}` for the schema cache to write, as shown in the example below. Replace `${mongo_example_file_name.xml}` with the file name corresponding to the database name. When referring to the example below, replace the value between the { } in the `${value}` sections of the connection URL with your actual value. Example `jdbc:mongodb://${host}.mongodb.net?AuthDatabase=admin&AuthScheme=SCRAM-SHA-1&UseSSL=true&schema=/tmp/scratch/${mongo_example_file_name.xml}jdbc:mongodb://${host}.mongodb.net?AuthDatabase=admin&AuthScheme=SCRAM-SHA-1&UseSSL=true&database=${dbName}`
Yes	Driver Name	String	The driver class name used for your connection. `mongodb.jdbc.MongoDrivercdata.jdbc.mongodb.MongoDBDriver`
Yes	Port	Integer	The port number to establish a connection to the datasource. The default port is `443`
No	Source Name	String	N/A
No	Target Agent	Option	The Agent used to submit your DQ Job.
Yes	Auth Type	Option	The method to authenticate your connection. Note The configuration requirements are different depending on the Auth Type you select. See Authentication for more details on available authentication types.
No	Driver Properties	String	The configurable driver properties for your connection. Multiple properties must be comma delimited. For example, abc=123,test=true

Authentication

This data source supports the following authentication type:

Username/Password

Required	Field	Description
Yes	Username	The username of your MongoDB account.
Yes	Password	The password of your MongoDB account.

Command line example for basic spark-submit job

Copy

-lib "/opt/owl/drivers/mongodb/" 
-h localhost:5432/postgres 
-master local[*] 
-ds tpch.lineitem_7 
-br 10 -deploymode client 
-q "select * from tpch.lineitem where l_shipdate between '${rd} 00:00:00.000+0000' 
and '${rdEnd} 00:00:00.000+0000' " 
-bhlb 10 -rd "1998-12-01" 
-driver "mongodb.jdbc.MongoDriver" 
-loglevel INFO -cxn MongoDB -rdEnd "1998-12-02"

Note For more details about the various Create and Alter SQL statements and table-level actions, see the official MongoDB documentation.