Create file in AWS S3 Using REST AWS SigV4 Account

The following example Pipeline demonstrates how we can create a new file in AWS S3 bucket.

Broadly, creating a new file in AWS S3 is a three step process:
  1. Create File
  2. Upload File
  3. Complete File

Create, upload and complete file pipeline

Download this Pipeline

Prerequisites

  • Configure a valid REST AWS SigV4 Account to authenticate the REST APIs.
  • Configure Filename as your Pipeline parameter and an S3 account for the bucket.

Create File Operation

  1. Configure the REST POST Snap to perform the create file operation. To this end, we configure the Snap as follows:
    Create Multipart

  2. Configure the Mapper Snap to map the response.entity to the XMLOutput column.
    Get XML Output - Mapper Snap

  3. Configure another Mapper Snap to extract the uploadId of the entity.
    Get Upload ID - Mapper Snap

  4. Upon validation, the Snap generates the output with uploadId as follows:
    Get Upload ID Output

Upload File operation

  1. Configure the REST PUT Snap as follows to perform the upload file operation.
    Upload Multipart

  2. Configure the Mapper Snap to extract the etag and uploadId.
    Get Etag and Upload ID

  3. Upon validation, the Snap generates the output with etag and uploadId entities as follows:
    Get Etag and Upload ID Output

Complete File operation

  1. Configure the REST HTTP POST Snap to complete the file operation.
    Complete Multipart

  2. Upon validation, the Snap generates the output preview as follows:
    Complete Multipart output

  3. Configure the REST GET Snap to extract the required details from the uploaded file.
    Rest Get Snap

  4. Upon validation, the Snap generates the output preview as follows:
    Rest Get Snap Output

  1. Ensure that you have a valid SnapLogic account and project creation permissions.
  2. Verify that the REST Post Snap successfully creates a project before running the REST Delete Snap.
  3. Confirm that the REST Delete Snap output indicates successful deletion.