Creating technical lineage via Edge (beta)
This topic includes an overview of the tasks to complete to create a technical lineage for the JDBC data sources and ETL tools or a custom technical lineage on Edge.
Before you begin
- Create an Edge site in Collibra Data Intelligence Cloud.
- Install an Edge site.
- Create a JDBC connection.
- Register a data source via Edge.
Steps
|
Select a data source and the connection type if needed to see the related information to create the technical lineage for your data source. Currently, you see the information for: |
Amazon Redshift
Azure SQL Data Warehouse
Azure SQL Server
Azure Synapse Analytics
DB2
Google BigQuery
Greenplum
HiveQL
IBM InfoSphere DataStage
Informatica Intelligent Cloud Services
Informatica PowerCenter
Matillion
Oracle
PostgreSQL
MySQL
Netezza
SAP Hana
Snowflake
Spark SQL
SQL Server
SQL Server Integration Services
Sybase
Teradata
Custom technical lineage
|
Which connection type do you use?
For best technical lineage results, harvest JDBC sources when possible, rather than using the shared storage connection by creating an external directory of source files. |
- Enable and configure technical lineage via Edge.
- If you set the value of the Collibra system name flag setting to
True in the previous step, prepare the Data Catalog physical data layer for technical lineage via Edge. - Create a shared storage connection.Note A shared storage connection is required for you to synchronize the technical lineage after you add the capability. When you create the shared storage connection, there is no need to store files in the folder. This behavior will be changed in a future release so that you can use the IICS connection instead of the shared storage connection.Note A shared storage connection is required for you to synchronize the technical lineage after you add the capability. When you create the shared storage connection, there is no need to store files in the folder. This behavior will be changed in a future release so that you can use the Matillion connection instead of the shared storage connection.
- Prepare the data source files and store the data source files in the folder that you created when you created the shared storage connection in the previous step.
- Create a custom technical lineage JSON file and store the JSON file in the folder that you created when you created the shared storage connection in the previous step.
- Add a technical lineage capability to an Edge site.