Simple
This is the condition after the "where" clause.
Depending on the complexity, users can choose from short form or long form rules.
Simple
Just the condition (short form). For example, using the column email_address. This runs against the dataframe and uses Spark SQL syntax. Simple rules can be thought of as everything after the where clause.
Copy
email_address is not null and email_address != ''
Note All built-in spark functions are available to use. For more information about simple and freeform SQL rules, see the official Apache Spark documentation.