Basic Use Case (PolyBase Bulk Load)

This example demonstrates a simple ETL pipeline that uses the PolyBase Bulk Load Snap to load records into a SQL Server table with PolyBase enabled. A JSON Generator Snap supplies the input data, a Mapper Snap aligns the schema, and the PolyBase Bulk Load Snap writes the records to the target table.



Download this Pipeline
  1. Extract: Configure a JSON Generator Snap to supply the records to be loaded into the PolyBase table.
  2. Transform: Add a Mapper Snap to align the input document schema with the PolyBase Bulk Load Snap's metadata requirements.
  3. Load: Configure the PolyBase Bulk Load Snap with the Table Name set to the target table (for example, dbo.9181) and Bulk insert mode set to Append.


    Note: Microsoft PolyBase does not support varchar entries containing more than 1000 characters. Use the Azure SQL - Bulk Load Snap as an alternative for such data.
  4. Execute the pipeline. The Snap converts the input stream to temporary CSV files in Azure Blob storage, then executes SQL Server commands to load the data into the target table. The output view displays the load status confirmation.
To reuse the example pipelines:
  1. Download and import the SLP file into your Environment.
  2. Configure Snap accounts.
  3. Provide Pipeline parameters, if any.