To install and run the lineage harvester, you have to meet the following requirements.
Software requirements
Java Runtime Environment version (JRE) 17 or newer, or OpenJDK 17 or newer.
Hardware requirements
You need to meet the hardware requirements to install and run the lineage harvester.
Minimum hardware requirements
You need the following minimum hardware requirements:
- 2 GB RAM
- 1 GB free disk space
Recommended hardware requirements
The minimum requirements are most likely insufficient for production environments. We recommend the following hardware requirements:
- 4 GB RAMTip 4 GB RAM is sufficient in most cases, but more memory could be needed for larger harvesting tasks. For instructions on how to increase the maximum heap size, see the advice on how to resolve Java heap space errors, in the Collibra Support Portal.
- 20 GB free disk space
Specific requirements for Power BI
- If you have more than 50,000 actively used workspaces, we recommend increasing the heap size to at least 6 GB.
- Ensure that the Power BI certificate exists in the Java TrustStore.
Network requirements
The lineage harvester uses the HTTPS protocol by default and uses port 443.
You need firewall rules so that the lineage harvester can connect to:
- The host names of all data sources in your lineage harvester configuration file.
- All Collibra Data Lineage service instances in your geographic location:
Region DNS name aws-ca techlin-ca-central-1.collibra.com aws-eu techlin-eu-central-1.collibra.com aws-me techlin-me-central-1.collibra.com aws-sg techlin-ap-southeast-1.collibra.com aws-us techlin-us-east-1.collibra.com gcp-au techlin-australia-southeast1.collibra.com gcp-ca techlin-northamerica-northeast1.collibra.com gcp-eu techlin-europe-west1.collibra.com gcp-sg techlin-asia-southeast1.collibra.com gcp-uk techlin-europe-west2.collibra.com gcp-us techlin-us-east1.collibra.com NoteThe lineage harvester connects to different Collibra Data Lineage service instances based on your geographic location and cloud provider. If your location or cloud provider changes, the lineage harvester rescans all your data sources.
- You have to allow all Collibra Data Lineage service instances in your geographic location.
-
Regardless of your geographic location, you have to allow one of the following. This is required to retrieve the API Key. No other data is transferred.
Region DNS name aws-ca techlin-ca-central-1.collibra.com aws-eu techlin-eu-central-1.collibra.com aws-us techlin-us-east-1.collibra.com gcp-us techlin-us-east1.collibra.com In addition, we highly recommend that you always allow the "techlin-us-east-1" instance as a backup for license verification, in case the lineage harvester cannot connect to other Collibra Data Lineage service instances.
Region DNS name aws-us techlin-us-east-1.collibra.com