Spark SQL: Create an AWS connection

Before you begin

• You either created and installed an Edge site or were granted a Collibra Cloud site.
If you want to add connection values from a vault, you have added the vault to your Edge site. If your data source connection requires a file from your vault, the file must be encoded into Base64 and stored as a regular secret in your vault. For more information, go to the Vault documentation.
Note  Vaults are not supported on Collibra Cloud sites.
• If you want to use EC2 authentication for the AWS connection, configure the EC2 instance hosting your Edge site with the required IAM permissions to read source files from Amazon S3.

Required permissions

• You have a global role with the Product Rights > System administration global permission.
• You have a global role that has the Manage connections and capabilities global permission, for example, Edge integration engineer.

Steps

1. Open a site.
   1. On the main toolbar, click → Settings.
      The Settings page opens.
   2. In the tab pane, click Edge.
      The Sites tab opens and shows a table with an overview of your sites.
   3. In the table, click the name of the site whose status is Healthy.
      The site page opens.
2. In the Connections section, click Create connection.
   The Create connection page appears.
3. Select the AWS connection to connect to Amazon S3.
4. Enter the required information.

   Field	Description	Required
   Name	The name of the Edge or Collibra Cloud site AWS connection.	Yes
   Description	The description of the connection.	No
   Vault	The vault where you store your data source values.	No
   Authentication type	The type of authentication you use. Select one of the following values: IAM Use the AWS Identity and Access Management (IAM) authentication method. EC2 Use this authentication method if your Edge site runs on an AWS EC2 instance with an attached IAM role. This allows Collibra Data Lineage to authenticate securely by using the instance profile, without requiring access keys. Both authentication types require you to configure S3 permissions before creating the AWS connection.	Yes
   Access Key ID	The access key ID of the programmatic AWS user. You can add this property from your vault. For more information, go to the vault documentation.	Yes
   Secret Access Key	The secret access key of the programmatic AWS user. You can add this property from your vault. For more information, go to the vault documentation.	Yes

5. Click Create.
   The connection is added to the Edge or Collibra Cloud site.
   The fields become read-only.