Create Metadata connector log files

If you have an issue with a JDBC connection, for example, while registering a data source via Edge, you can create the Metadata connector log files and then save and review them locally. If you create a support ticket, attach the reviewed Metadata connector log files to your ticket so that Collibra Support can help you with your issue.

Job logs are only kept for 15 days after the job is created. Job logs that are older than 15 days are removed from the platform, however, you can find records of these jobs on the Jobs tab of an Edge site or the Jobs (beta) dashboard of Edge.

Tip You can also download the output file of a JDBC job from the Job dashboard.

Prerequisites

Steps

  1. Edit the Edge capability that contains the JDBC connection for which you want to create a log file.
    1. Click the name of the Edge capability to open it.
    2. Click Edit.
    3. In the General section, click the Log level drop-down menu.
    4. Select the log verbosity level.
      Tip The level must be at least low.
    5. Click Save.
      The fields become read-only.
  2. Click Run to rerun the Edge capability.
  3. Contact Collibra support to request the Edge job ID of the Edge capability.
  4. Run the following command:
    edge catalog-connector --jobid <Edge job ID> --dst <path to destination>
    The log file is created and stored in the predefined destination.

    Important If the Edge command is not available, you will need to download the Edge tool and make it available in /usr/local/bin/edge

Prerequisites

  • You have a Linux host with kubectl access to your EKS installation.
  • You have mc (minio client) installed in /usr/local/bin:
    sudo curl -L "https://dl.min.io/client/mc/release/linux-amd64/mc" -o /usr/local/bin/mc
    sudo chmod +x /usr/local/bin/mc

Steps

Execute the following commands:

kubectl -n collibra-edge port-forward service/minio 9000:9000 &

MC_ACCESSKEY="$(kubectl get secrets edge-minio -n collibra-edge -o jsonpath="{.data.accesskey}" | base64 --decode)"
MC_SECRETKEY="$(kubectl get secrets edge-minio -n collibra-edge -o jsonpath="{.data.secretkey}" | base64 --decode)"
export MC_HOST_edge="http://${MC_ACCESSKEY}:${MC_SECRETKEY}@localhost:9000"
mc cp --quiet --recursive edge/cdata/<jobId> <destination_directory>
pkill -f "port-forward"