dbt Core: Prepare the data source files for Shared Storage connection

Prepare the data source files and store them in the folder that you created when you created the Shared Storage connection.

1. In the dbt Core environment, locate the target/ directory of your dbt project. The target/ directory must contain the manifest JSON file and compiled SQL files. This directory is created by running the dbt run and dbt compile commands.
2. If the target/ directory does not exist or the directory does not contain the manifest JSON file or compiled SQL files, complete the following steps to create the directory and the required files:
   1. Set the profile of your dbt Core to the environment that you want to retrieve the lineage information from.
   2. Use the dbt compile command to generate SQL files. For details, go to About dbt compile command and Manifest JSON file in dbt documentation.
3. Store the target/ directory in your Shared Storage connection folder and ensure that you maintain the folder structure. Your Shared Storage connection folder must contain all files and subdirectories, such as target/manifest.json and target/compiled/project-name/models/.
   Note If you use Collibra Platform 2024.05 or newer, ensure that you use the Edge CLI tool for creating the Shared Storage connection and storing files in the Shared Storage connection folder. Go to the following Create a Shared Storage connection step for detailed instructions. For more information, go to Edge Command Line Interface (CLI).

What's next

Add the Technical Lineage for dbt capability for Shared Storage connections.