Supported transformation details
Collibra Data Lineage supports the most commonly used transformations in the following sources:
- Informatica PowerCenter
- Informatica Intelligent Cloud Services
- SQL Server Integration Services
- IBM DataStage (parallel job stages)
Informatica PowerCenter transformations
The following table shows a non-exhaustive list of supported and unsupported transformations in Informatica PowerCenter.
|
Supported transformations |
Unsupported transformations |
|---|---|
|
|
Informatica Intelligent Cloud Services
Collibra Data Lineage supports the following non-exhaustive list of transformations in Informatica Intelligent Cloud Services. Specifically, transformations in the Cloud Data Integration service.
- Expression
- Filter
- Joiner
- Lookup
- Mapplet
- Sequence Generator
- Source
- Target
- Union
SQL Server Integration Services (SSIS)
Collibra Data Lineage supports the following non-exhaustive list of transformations in SQL Server Integration Services:
- Aggregate
- Cache Transform
- Conditional Split
- Data Conversion
- Derived Column
- Fuzzy Grouping
- Lookup
- Merge Join
- Multicast
- OLE DB Command
- Row Count
- Script Component
- Slowly Changing Dimension
- Sort
- Union All
- Collibra Data Lineage supports SQL, but cannot parse other languages or scripts, for example SHELL and BAT scripts.
- All SQL queries must be preceded by the keyword SELECT, or else they will be skipped. Furthermore, if a comment precedes the keyword SELECT, the query will be skipped.
IBM DataStage
Instead of transformations, IBM DataStage uses jobs with stages. IBM Datastage has three job types: parallel jobs, sequence jobs and server jobs. Collibra Data Lineage only supports the IBM DataStage stages of parallel jobs.
For a list of all job stages per job type in IBM DataStage, read the IBM documentation.