Migrate your existing Power BI assets to the new integration method

The following process allows you to migrate Power BI assets that you integrated via the Power BI harvester, to the new integration method.

Prerequisites

  • You have Collibra Data Intelligence Cloud 2020.11 or newer.
  • You have downloaded the newest Power BI harvester on the Downloads page, and have the system requirements to install and use it.
  • You have purchased the Power BI metadata connector and lineage feature.
  • You meet the minimum system requirements.
  • You have completed all prerequisite tasks.
    • You have registered Power BI in Microsoft Azure.
    • You have enabled the service principal option in the Power BI Admin portal.
  • You have added Firewall rules so that the Power BI harvester and lineage harvester can connect to the Collibra Data Lineage server with one of the following IP addresses:
    • 15.222.200.199 (techlin-aws-ca)
    • 18.198.89.106 (techlin-aws-eu)
    • 54.242.194.190 (techlin-aws-us)
    • 51.105.241.132 (techlin-azure-eu)
    • 20.102.44.39 (techlin-azure-us)
    • 35.197.182.41 (techlin-gcp-au)
    • 34.152.20.240 (techlin-gcp-ca)
    • 35.205.146.124 (techlin-gcp-eu)
    • 34.87.122.60 (techlin-gcp-sg)
    • 35.234.130.150 (techlin-gcp-uk)
    • 34.73.33.120 (techlin-gcp-us)
  • You have a global role with the Catalog global permission, for example Catalog Author.
  • You have a global role with the Technical lineage global permission.
  • You have a global role with the Data Stewardship Manager global permission.
  • You have a resource role with the following resource permission on the community level in which you created the BI Data Catalog domain:
    • Asset: add
    • Attribute: add
    • Domain: add
    • Attachment: add
  • Java Runtime Environment version 11 or newer or OpenJDK 11 or newer.
  • You have a global role that has the Manage all resources global permission.
  • You have created a BI Catalog domain (or domains) in which you want to ingest the Power BI assets.
  • For a full ingestion, we highly recommend to have a Power BI Premium subscription.

Steps

  1. Download and install the Power BI harvester, so that mappings can be applied.
  2. Prepare the Power BI configuration file, to provide the connection information that you need to connect your Power BI application to Collibra. An empty configuration file is included in the Power BI harvester installation folder.
    3. Important For this procedure, the useCollibraSystemName property in your Power BI configuration file must be set to true.
  3. Prepare a Power BI <source ID> configuration file, to define the system name of databases in Power BI. Collibra Data Lineage uses the system names to match the structure of databases in Power BI to assets in Data Catalog.
  4. Make a random call to the Metadata API, to ensure that you can communicate with the Power BI server. For example:
    5. GET https://api.powerbi.com/v1.0/myorg/admin/workspaces/modified
  5. Manually refresh your Power BI datasets, to ensure that the data in your Power BI datasets is up-to-date. For complete information, see:
  6. Download and install the lineage harvester, to trigger the creation of Power BI assets, their relations and a technical lineage in Data Catalog.
  7. Prepare the lineage harvester configuration file and run the lineage harvester, to import the results of the Power BI integration and the technical lineage for Power BI into Data Catalog.
    Important For this procedure, the useCollibraSystemName property in your Power BI configuration file must be set to true.
    Warning You must use the same Power BI <source ID> configuration file that you prepared in step 4.