Warning Jobserver and all related Jobserver integrations are end of life starting October, 2024, with the exception of Public Sector customers using GovCloud or on-prem environments.
For information on the integration of S3 via Edge, go to Integrating an Amazon S3 file system via Edge.

Add an S3 synchronization schedule

To keep the content of Collibra Data Intelligence Platform synchronized with your Amazon S3 File System, you can synchronize manually or create a schedule to automatically do this with a fixed interval.

Note You can only create one synchronization schedule.

Prerequisites

• You have a resource role with the Configure external system resource permission on the community or domain that contains the S3 File System, for example Owner.
• You have a global role with the Catalog global permission, for example, Catalog Author.
• You have registered an Amazon S3 file system.
• You have a programmatic AWS user and IAM role with the required permissions.
• You have configured one or more Jobservers in Collibra Console. If there is no available Jobserver, the Register data source actions will be grayed out in the global create menu of Collibra Data Intelligence Platform.
• You have connected an S3 File System asset to Amazon S3.
• You have created one or more crawlers.
• You have a role with the following resource permissions on the S3 community you created when you registered an Amazon S3 file system:
  • Asset: add
  • Attribute: add
  • Domain: add
  • Attachment: add

Steps

1. Open an S3 File System asset page.
2. In the tab panebar, click Configuration. In the tab panebar, click Configuration.
3. In the Synchronization Schedule section, click Add Schedule.
4. Enter the required information.
   

   Field	Description
   Repeat	The interval when you want to synchronize automatically. The possible values are: Daily, Weekly, Monthly, and Cron expression.
   Cron	The Quartz Cron expression that determines when the synchronization takes place. This field is only visible if you select Cron expression in the Repeat field.
   Every	The day on which you want to synchronize, for example, Sunday. This field is only visible if you select Weekly in the Repeat field.
   Every first	The day of the month on which you want to synchronize, for example, Tuesday. This field is only visible if you select Monthly in the Repeat field.
   At	The time at which you want to synchronize automatically, for example, 14:00. You can only schedule on the hour. For example, you can add a synchronization schedule at 8:00, but not at 8:45. This field is only visible if you select Daily, Weekly, or Monthly in the Repeat field.
   Time zone	The time zone for the schedule.

5. Click Save.