Configuring Microsoft Fabric Workspace

How to connect SnapLogic to Microsoft Fabric OneLake using Azure Data Lake Storage (ADLS) Gen2 and load data into Lakehouse tables.

Microsoft Fabric is a digital warehouse that can store complex data tools (like databases, data movers, and reporting tools). This article explains how to connect SnapLogic to Microsoft Fabric OneLake using Azure Data Lake Storage Gen 2 OAuth2 Account and load data into Lakehouse tables.

Steps

Create Fabric Workspace

  1. Sign in to the Microsoft Fabric portal.
  2. Click New workspace. The Create a workspace dialog box displays.

    create-new-workspace.png
  3. Specify the following details:
    • Name: Name for the workspace.
    • Workspace type: Determines what a user can do in a workspace.
    • Details: Select the remote computing resources your items will use with this workspace.
  4. Click Apply. The new workspace is created.

    workspace-created.png

Create Lakehouse in Workspace

  1. Open your newly created workspace.
  2. Click +New item and search for Lakehouse in the Filter box.

    new-item.png
  3. Click Lakehouse and specify the Name and Location.

    create-lakehouse.png
    • Name: Name for the lakehouse.
    • Location: Location to save the lakehouse.
    Note: Make sure to deselect the Lakehouse schemas checkbox, because Load API has known limitations with schema-enabled lakehouses.
  4. Click Create. The lakehouse is created. You can now view the Files folder and Tables folder.

    new-lakehouse.png

Create Azure AD Service Principal (App Registration)

  1. Log in to the Microsoft Azure portal.
  2. Search App registrations.

    azure-app-registrations.png
  3. Click New registration.

    new-registration.png
  4. Specify the following details:

    register-an-app.png
    • Name: Name for the application.
    • Supported account types: Select Single tenant only
  5. Click Register. The application is created.

    registered-application.png
  6. Secure the Client ID and Tenant ID.
  7. Create Client Secret. Navigate to Certificates & secrets.

    add-client-secret.png
  8. Click Add a certificate or secret.
  9. Click New client secret.

    new-client-secret.png
  10. Optional. In the Add a client secret pop-up, specify the description.
  11. Click Add. The client secret is generated.

    client-secret-generated.png
    Important:

    The client secret is visible only once; copy and securely store it. Copy the Value, not the Secret ID.

Add Service Principal to Fabric Workspace

  1. Navigate to your Fabric Workspace and click Manage access.

    manage-access.png
  2. Click Add people or groups.

    add-people-group.png
  3. Add your Service Principal, and assign a role (for example, Contributor).

    add-service-principal.png

Write data to Microsoft Fabric instance using File Writer Snap via ADLS Gen2 OAuth2 Account

  1. Add the File Writer Snap and add Azure Data Lake Storage Gen 2 OAuth2 Account Account.
  2. Configure the account details:
    • Account name: onelake
    • Endpoint: dfs.fabric.microsoft.com
    • Tenant ID, Access ID, Secret key: Use the values obtained after creating the app in Step 3.
  3. Click Validate and Apply.

    adls-acct-successful.png
  4. Go to the File Writer Snap settings.
  5. Set the file name using the ABFSS format:

    Format: abfss:///workspace_name/lakehouse_Name.Lakehouse/Files/data.parquet

    Example: abfss:///fabric-jdbc-test/Abc_New_lakehouse.Lakehouse/Files/data50million.parquet

  6. Validate the Snap.