Profile and classify data via Edge

After you have configured the profiling and classification options, you can start the profiling and classification process for the schemas in the data source.

Tip Collibra Data Intelligence Cloud only has access to synchronized metadata, profiling results (that are automatically anonymized for columns with data type Text or Geo), and classification suggestions, not to the actual data from your data source.

Important Advanced data types are not taken into account when profiling via Edge.

Before you begin

You have created and installed an Edge site.
Your Edge site has a JDBC profiling capability.
You have enabled data source registration via Edge.
You have enabled profiling and classification via Edge.
You have registered a data source via Edge.
You have synchronized one or more schemas of a registered database.
You have configured the profiling and classification options.

Required permissions

Your Edge site has a global role with the following global permissions: Data Catalog and Register Profiling Information.

Steps

Manually profile and classify
Automatically profile and classify after each synchronization
Profile and classify based on a schedule

Open the Database asset page of a registered database.
In the tab pane, click Configuration.
Click the Profiling and Classification tab.
The Profiling and classification options open.
Tip Only the synchronized schemas are available in the list.
Important If you only want to profile and classify one or more schemas, ensure the default profiling and classification option is set to Do not Profile and Classify (unless specified in the schema-specific rule, and that you have only defined a specific rule for the relevant schemas.
On the Profiling and Classification tab page, click Run Profiling and Classification.
Data Catalog triggers the Edge site to start a profiling and classification job.
Depending on your profiling and classification options, the Edge site profiles and classifies all or some schemas, based on all synchronized metadata or on a subset.

Open the Database asset page of a registered database.
In the tab pane, click Configuration.
Click the Profiling and Classification tab.
The Profiling and classification options open.
Tip Only the synchronized schemas are available in the list.
In the Default Profiling and Classification Rule section, click Edit.
Select Automatically run when a metadata extraction is synchronized.
Synchronize one or more schemas.
When the schemas are synchronized, Data Catalog automatically triggers the Edge site to start a profiling and classification job.
Depending on your profiling and classification options, the Edge site profiles and classifies all or some schemas, based on all synchronized metadata or on a subset.

Open the Database asset page of a registered database.
In the tab pane, click Configuration.
Click the Profiling and Classification tab.
The Profiling and classification options open.
Tip Only the synchronized schemas are available in the list.
In Synchronization Schedule, click Add Schedule to add a new schedule, or to edit an existing schedule.
The Edit Schedule dialog box appears.

Enter the required information.

Field	Description
Repeat	The interval when you want to synchronize automatically. The possible values are: Daily, Weekly, Monthly, and Cron expression.
Cron	The Quartz Cron expression that determines when the synchronization takes place. This field is only visible if you select `Cron expression` in the Repeat field.
Every	The day on which you want to synchronize, for example, Sunday. This field is only visible if you select `Weekly` in the Repeat field.
Every first	The day of the month on which you want to synchronize, for example, Tuesday. This field is only visible if you select `Monthly` in the Repeat field.
At	The time at which you want to synchronize automatically, for example, 14:00. This field is only visible if you select `Daily`, `Weekly`, or `Monthly` in the Repeat field.
Time zone	The time zone for the schedule.

Click Save.
The profiling and classification job starts according to the schedule.
Depending on your profiling and classification options, the Edge site profiles and classifies all or some schemas, based on all synchronized metadata or on a subset.

What's next?

The Edge site completes the profiling and classification process and sends the results to Collibra Data Intelligence Cloud.

You can see the profiling and classification job in the list of activities.
When the activity is completed, the results page gives an overview of the profiled and classified data.
If something goes wrong, the job is reported as failed. By default, the capability will try to collect the data, calculate the statistics, and send the results two times with each attempt taking 30 minutes. You can change this in the capability configuration.
You can find the profiling results and charts in the Table and Column asset pages.
Note Columns mapped to following java.sql.Types are excluded from the profiling queries: ARRAY, BINARY, BLOB, CLOB, DATALINK, DISTINCT, JAVA_OBJECT, LONGVARBINARY, NCLOB, NULL, OTHER, REF, REF_CURSOR, ROWID, SQLXML, STRUCT, VARBINARY.
You can find the suggested data classes and provide feedback on them either via the Table asset page (in the Columns tab page), Column asset page (in the Data Profiling tab page), or the Physical Data Connector.
In the Configuration tab page of the Database asset, if a schema is profiled and classified, you see a check symbol () next to the schema name. If the profiling or classification of a schema failed, an exclamation mark () is shown.