Advanced Use Case

The following describes a Pipeline, with a broader business logic involving multiple ETL transformations, that shows how typically in an enterprise environment, Azure SQL Bulk Load functionality is used. The Pipeline download is available below.



Download this Pipeline
  1. In the below Pipeline, the records from a table on the SQL Server are loaded into a table on the Azure SQL. The Azure SQL Execute Snap reads the records the loaded records on the Azure SQL table.


  2. Extract: The SQL Server Select reads the records form a table on SQL Server.
  3. Transform: The Mapper Snap maps the metadata from the input schema (SQL Server) to the output schema (Azure SQL)
  4. Load: Azure SQL Bulk Load Snap loads the records into the Azure SQL table.
  5. Read: The Azure Execute Snap reads the loaded records on the Azure SQL table.
  6. A similar enterprise scenario where the records from the Oracle server are loaded into the Azure SQL Server. The loaded records are transformed to JSON and written to a file. The Azure SQL Execute Snap reads the records from the table on the Azure SQL.The pipeline download is available below.


  7. Extract: The Oracle Select reads the records form a table on the Oracle Server.
  8. Transform: The JSON Formatter Snap transforms the output records in to a JSON format and writes them to a file using the File Writer Snap.
  9. Load: Azure SQL Bulk Load Snap loads the records into the Azure SQL table.
  10. Read: The Azure Execute Snap reads the loaded records on the Azure SQL table.
To reuse the example pipelines:
  1. Download and import the SLP file into your Environment.
  2. Configure Snap accounts.
  3. Provide Pipeline parameters, if any.