Install an Edge site

Important 

In Collibra 2024.05, we launched a new user interface (UI) for Collibra Data Intelligence Platform! You can learn more about this latest UI in the UI overview.

Use the following options to see the documentation in the latest UI or in the previous, classic UI:

After you have created the Edge site in Collibra Data Intelligence Platform, you have to install the Edge software on a server.

Tip 

Every time you download an Edge site installer, the previously downloaded Edge site installer becomes outdated. If you use this outdated installer, the Edge site cannot communicate with Collibra.

Prerequisites

Steps

  1. Download the installer:
    1. Open an Edge site.
      1. On the main toolbar, click Products icon, and then click Cogwheel icon Settings.
        The Collibra settings page opens.
      2. In the tab pane, click Edge.
        The Sites tab opens and shows a table with an overview of the Edge sites.
      3. In the Edge site overview, click the name of an Edge site.
        The Edge site page appears.
    2. Click Download in the Installer and properties files section.Click Download Installer.

      Tip When you download the installer, an Edge user is automatically created in Collibra.

    3. Depending on your operating system and browser, follow the regular steps for downloading files.
      The installer file is a TGZ archive that contains the files proxy.properties, properties.yaml and registries.yaml.

      Warning If you download an installer, the previously downloaded Edge site installer becomes invalid.

  2. Extract the TGZ archive on the server on which you want to install the Edge site software.
    Copy
    tar -xf <edge-site-id>-installer.tgz
    Note 
    • Keep the installer or the contents of the extracted installer in a secure location on your server. These contents contain various tools that you may need later, for example to troubleshoot issues.
    • If you want to run a script or executable file from the extracted directory, ensure that the directory is not mounted as noexec. If a directory is mounted as noexec, scripts and executable files will be prevented from being run within the directory.
  3. Run the installation. Use the correct path to the mounted storage as described in the prerequisites.
      Important 
    • If the Edge site has to connect via a forward HTTP proxy, then first configure the forward proxy before executing the installation.
    Copy
    sudo sh install-master.sh properties.yaml -r registries.yaml
    • If you want to use a private docker registry, add the following parameters to the install command:
      ParametersDescription
      --registry-url (required)

      The URL of your private docker registry.

      For example:

      https://edge-docker-delivery.repository.collibra.io

      --registry-host (optional)

      Where your private docker is hosted. If you do not specify this parameter, it is automatically derived from --registry-url

      For example:

      edge-docker-delivery.my-registry.docker.io

      --registry-user (optional)The username of the private docker registry. This parameter is not required if registry is public.
      --registry-pass (optional)The password of the private docker registry. This parameter is not required if registry is public.
    • Optional, if you want to use a proxy, add --proxy <path to properties file> to the install command.
    • Optional, if you want to use a custom certificate, add --ca ca.pem to the install command.
    In the Edge sites overview, you can see the status of the deployment.
  4. Run the following commands to verify the status of the installation.
    • To ensure that Kubernetes is running and that there is an existing node:
      Copy
      sudo /usr/local/bin/kubectl get nodes
    • To ensure the state of all pods are installed and running:
      Copy
      sudo /usr/local/bin/kubectl get pods --all-namespaces
Tip 
What is your Edge site installation method?
Which Edge CLI method do you want to use?

Important The default Edge CLI method is an easier solution for installing your Edge site via the Edge CLI. Edge creates the cluster level objects, such as namespaces, CRDs, and priority classes for you. This method can be used for both dedicated and shared clusters.

Important The restrictive Edge CLI method allows you or your company to create the cluster level objects, such as namespaces, CRDs, and priority classes, for your Edge site. This method may be required if your company has security requirements or process that do not allow Edge sites to create the cluster level objects for you. This method can be used for both dedicated and shared clusters.

Warning Collibra Support will not assist with custom Helm or Kubernetes configurations. The following steps are an example, and any assistance for configurations or issues outside of these steps is unsupported. We recommend using the Edge CLI method for managed Kubernetes installations.

A common example of custom Helm configurations is, but not limited to, using an unsupported private repository. At this time, we only support a JFrog repository.

Prerequisites

  • You have a global role with the Install Edge sites and the User Administration global permission, for example Edge site administrator.
  • You have created an Edge site.
  • You have configured the forward proxy, if a forward proxy is required for Edge to connect to Collibra, Datadog, OpenTelemetry and jFrog. Contact your network administrator if this is applicable.
  • Your server meets all system requirements.
  • You will install your Edge site on a supported Kubernetes cluster.
  • You must have namespace level access to the Kubernetes cluster where you want to install your Edge site.
  • You must have admin level access to your the Kubernetes cluster where you want to install your Edge site.
  • You must have admin privileges to create the collibra-edge namespace, priority classes, and CRD’s when executing the install script.
  • You must run the following commands on a virtual machine where yq version 4.18.1 or later, and jq can be executed.

Steps

  1. Download the installer:
    1. Open an Edge site.
      1. On the main toolbar, click Products icon, and then click Cogwheel icon Settings.
        The Collibra settings page opens.
      2. In the tab pane, click Edge.
        The Sites tab opens and shows a table with an overview of the Edge sites.
      3. In the Edge site overview, click the name of an Edge site.
        The Edge site page appears.
    2. Click Download in the Installer and properties files section.Click Download Installer.

      Tip When you download the installer, an Edge user is automatically created in Collibra.

    3. Depending on your operating system and browser, follow the regular steps for downloading files.
      The installer file is a TGZ archive that contains the files proxy.properties, properties.yaml, and registries.yaml.

      Warning If you download an installer, the previously downloaded Edge site installer becomes invalid.

  2. Extract the TGZ archive on the server on which you want to install the Edge site.
    Copy
    tar -xf <edge-site-id>-installer.tgz
    Note 
    • Keep the installer or the contents of the extracted installer in a secure location on your server. These contents contain various tools that you may need later, for example to troubleshoot issues.
    • If you want to run a script or executable file from the extracted directory, ensure that the directory is not mounted as noexec. If a directory is mounted as noexec, scripts and executable files will be prevented from being run within the directory.
  3. Set the EDGE_INSTALLER_PATH environment variable to the path of the root of the extracted installer.
  4. Run the following command to confirm that the Kubeconfig environment variable has been set to a valid kubeconfig:
    Copy
    echo $KUBECONFIG  
  5. Deploy cluster level objects:
    • Create the namespace for collibra-edge.
      Note Clusters that have more than one Edge site installed must have unique namespaces.
    • If you are using an Openshift cluster, deploy Security Context Constraints (SCC) which provide Edge service accounts with the required permissions.
    • For all cluster types, deploy Custom Resource Definitions (CRDs).
      Note If you already have Argo Workflow CRDs on your cluster, you only need to add the priority class to your existing CRDs.
    • For all cluster types, deploy priority classes:
      Copy
      kubectl apply -f resources/custom/priorityclass.yaml
  6. Run one of the following installation commands on the machine that has the Kubernetes connection:
    Note 
    • You can install your Edge site with either terminal logging or terminal and file logging. Both options log the output of your Edge site installation.
      • Terminal logging only saves the output to the Edge terminal.
      • Terminal and file logging saves the output both to the terminal and a separate file. This file will be saved in the current directory with the naming format: edge-installer-$(date +"%Y-%m-%d_%H-%M-%S").log
    In the Edge sites overview, you see the status of the installation.
  7. Run the following command to verify the status of the installation.
    Copy
    kubectl get pods -n <my-namespace>
  1. Download the installer:
    1. Open an Edge site.
      1. On the main toolbar, click Products icon, and then click Cogwheel icon Settings.
        The Collibra settings page opens.
      2. In the tab pane, click Edge.
        The Sites tab opens and shows a table with an overview of the Edge sites.
      3. In the Edge site overview, click the name of an Edge site.
        The Edge site page appears.
    2. Click Download in the Installer and properties files section.Click Download Installer.

      Tip When you download the installer, an Edge user is automatically created in Collibra.

    3. Depending on your operating system and browser, follow the regular steps for downloading files.
      The installer file is a TGZ archive that contains the files proxy.properties, properties.yaml, and registries.yaml.

      Warning If you download an installer, the previously downloaded Edge site installer becomes invalid.

  2. Extract the TGZ archive on the server on which you want to install the Edge site.
    Copy
    tar -xf <edge-site-id>-installer.tgz
    Note 
    • Keep the installer or the contents of the extracted installer in a secure location on your server. These contents contain various tools that you may need later, for example to troubleshoot issues.
    • If you want to run a script or executable file from the extracted directory, ensure that the directory is not mounted as noexec. If a directory is mounted as noexec, scripts and executable files will be prevented from being run within the directory.
  3. Set the EDGE_INSTALLER_PATH environment variable to the path of the root of the extracted installer.
  4. Run the following command to confirm that the Kubeconfig environment variable has been set to a valid kubeconfig:
    Copy
    echo $KUBECONFIG 
  5. If you intend to have multiple Edge sites in your Kubernetes cluster, you must give each Edge site a unique namespace.
  6. If you are using an Openshift cluster, deploy Security Context Constraints (SCC) which provide Edge service accounts with the required permissions.
  7. Run one of the following installation commands on the machine that has the Kubernetes connection:
    Note 
    • You can install your Edge site with either terminal logging or terminal and file logging. Both options log the output of your Edge site installation.
      • Terminal logging only saves the output to the Edge terminal.
      • Terminal and file logging saves the output both to the terminal and a separate file. This file will be saved in the current directory with the naming format: edge-installer-$(date +"%Y-%m-%d_%H-%M-%S").log
    In the Edge sites overview, you see the status of the installation.
  8. Run the following command to verify the status of the installation.
    Copy
    kubectl get pods -n collibra-edge
  1. Download the installer:
    1. Open an Edge site.
      1. On the main toolbar, click Products icon, and then click Cogwheel icon Settings.
        The Collibra settings page opens.
      2. In the tab pane, click Edge.
        The Sites tab opens and shows a table with an overview of the Edge sites.
      3. In the Edge site overview, click the name of an Edge site.
        The Edge site page appears.
    2. Click Download in the Installer and properties files section.Click Download Installer.

      Tip When you download the installer, an Edge user is automatically created in Collibra.

    3. Depending on your operating system and browser, follow the regular steps for downloading files.
      The installer file is a TGZ archive that contains the files proxy.properties, properties.yaml, and registries.yaml.

      Warning If you download an installer, the previously downloaded Edge site installer becomes invalid.

  2. Extract the TGZ archive directory on the server on which you want to install the Edge site.
    Copy
    tar -xf <edge-site-id>-installer.tgz
    Note 
    • Keep the installer or the contents of the extracted installer in a secure location on your server. These contents contain various tools that you may need later, for example to troubleshoot issues.
    • If you want to run a script or executable file from the extracted directory, ensure that the directory is not mounted as noexec. If a directory is mounted as noexec, scripts and executable files will be prevented from being run within the directory.
  3. From inside the extracted TGZ archive directory, run the helm installer script, including any additional Helm install script flags you may need to configure. For example, if you want to use a custom namespace or install your Edge site on an OpenShift cluster.
    Copy
    sh edge-cd-helm-chart/helm-install-prerequisites.sh --namespace <my-namespace> --installer .
  4. Install your Edge site with helm:
    • Without a custom docker registry:
      Copy
      helm install edge-cd edge-cd-helm-chart/edge-cd -n <my-namespace> --set edgecd.collibraEdgeReleaseName=collibra-edge
    • With a custom docker registry:
      Copy
      helm install edge-cd edge-cd-helm-chart/edge-cd -n <my-namespace> --set edgecd.image.repository=<registry_url> --set edgecd.collibraEdgeReleaseName=collibra-edge