About synchronizing Azure Data Lake Storage

Synchronizing Azure Data Lake Storage file system (ADLS) is the process of ingesting metadata from a selected ADLS repository and making the data available in Collibra Data Intelligence Platform.

When you synchronize ADLS, the content of your repository is analyzed and represented in Collibra by means of assets and their characteristics. Collibra also takes the defined crawlers into account.

You can synchronize manually, or you can automate it by adding a synchronization schedule.

You can only synchronize one ADLS File System at a time.

  • If a synchronization job is in progress and a second one is triggered, manually or automatically, it will be queued.
  • If a synchronization job is still running and a new synchronization of the same ADLS File System is triggered (manually or automatically), the running synchronization will continue and the new synchronization request is ignored.