When you make changes in your Collibra Data Intelligence Cloud environment—for example, you import millions of assets—the changes are logged in a PostgreSQL database table. The changes then need to be reflected in the search index. Instead of processing these millions of changes all at once, the Search service processes them in batches or processing cycles. This helps to ensure optimal performance of your environment.
Note Although asynchronous indexing allows you to continue using your Collibra environment during a significant change to your environment, it may take some time to process all of the changes. For example, if you are importing millions of assets, while the changes are being processed, search results targeting the imported assets might be incomplete until processing is complete.
You can enable or disable asynchronous indexing in Collibra Settings or via Collibra Console. You can also edit the settings.
Benefits
-
Fewer occasions where reindexing is necessary.
-
Allows you to continue to use Collibra even after significant changes to your environment (for example, when importing millions of assets).
-
Reduced memory demand when importing.
Limitations
-
Importing performance could be slightly reduced.
-
When processing changes, search results targeting the imported assets might be incomplete until processing is complete.