Binary Snap Pack examples

Example Snaps used
File Delete

Deleting a File from Your SnapLogic Database

The following pipeline describes a File Delete Snap that deletes a file from your SnapLogic database.

File Poller

Write a List of Files in a Specific Directory

This example pipeline demonstrates how to list out files from a specific directory. After the File Poller Snap lists the files, then write the output to a file and run the File Poller Snap again to check whether the new file was created as expected. To ensure that the File Poller Snap doesn't pick up any existing files, you use an unusual extension for this example.

Poll a Directory Using a Trigger Task from ServiceNow

In this example, you call a Trigger Task from ServiceNow to poll a directory for files of a specific type.

File Operation

Moving File from Local System to Azure Blob Container

This example Pipeline demonstrates how to move files from your local system to the Azure blob for improved performance.

Copying and Moving of File from One Folder to Another Folder

This example Pipeline demonstrates copying and moving of files with ABFS protocol from one folder to another folder.

File Operation - Basic Use Case

The following Pipeline describes how the Snap functions as a standalone Snap in a Pipeline.

File Operation - Typical Snap Configuration

The following pipeline describes the typical Snap Configuration of File Operation .

File Reader

HDFS

This example pipeline demonstrates how to read data from HDFS files using a File Reader Snap configured with hdfs:// protocol on an on-premises Groundplex.

SFTP File Read

SFTP File Read securely connects to SFTP servers using encrypted protocols to download and read files from remote locations.

File Writer

File Writer - HDFS File Access

Use File Writer with HDFS protocol on an on-premises Groundplex within the Hadoop cluster, requiring no account credentials as SSH authentication is pre-established.

SLDB File Write

This example pipeline describes a file processing workflow that reads multiple JSON files from a parameterized location, parses and reformats the JSON data through transformation Snaps, then writes the processed output to "out.csv" using overwrite mode.

Multi File Reader

Pipeline: Multi File Reader with S3

This example helps you read multiple files from S3 and write it to a single file back in S3.

Multipart Writer

Multipart Write Snap Using the JSON Format Data

In the following pipeline, the Multipart Writer Snap reads the data in a JSON format and displays the result as a multipart output stream.

Multipart Write Snap Using the Raw Data from a REST Client

This pipeline demonstrates multipart data processing by generating JSON records, formatting them to extract message content, and writing them as grouped multipart output.

PGP Encrypt and PGP Decrypt

Encrypting Data Using the PGP Encrypt Snap

In this example, the PGP Encrypt Snap receives formatted JSON data from the JSON Formatter and encrypts it using PGP encryption, transforming the binary stream into a secure, encrypted format that protects sensitive information during storage or transmission.

Decrypting Data Using the PGP Decrypt Snap

In this example, the PGP Decrypt Snap receives encrypted binary data from the File Reader that contains the previously encrypted "File_encrypt.pgp" file, and uses PGP decryption with the appropriate private key to restore the original data format.

PGP Sign

PGP Sign a Salesforce File

In this example pipeline we download a file from Salesforce that uses the normal signature, which creates a signed file with the file available. We then upload the file to S3, where it could be used as a standard signature to pass to a downstream use case for someone to verify.

PGP Sign a Salesforce File - (Detached)

This example pipeline shows how to use the Binary Copy Snap to include both the original file stream as well as the signature stream.We then upload both files to S3 with different names.

S3 File Reader

Read Data from the S3 Bucket

This example pipeline demonstrates how to read data from an S3 bucket using the S3 File Reader Snap.

S3 File Reader - Typical Snap Configurations

The following pipeline describes the typical Snap configurations of S3 File Reader .

S3 File Writer

Providing User-defined Object Metadata and Object Tags using the S3 File Writer Snap

This example is a basic use case for the File Writer Snap. It also demonstrates how you can configure the Snap with custom object metadata and object tags to classify the data.

S3 File Writer - Typical Snap Configuration

This example demonstrates how the same Snap can handle both hardcoded file paths for consistent outputs and parameterized expressions for reusable, environment-specific configurations across different pipeline deployments.

Compress

File compression (GZIP)

The following example pipeline demonstrates how to read a file and compress it using the GZIP Compression scheme. It consists of a single segment that handles the file reading and compression operations.

Decompress

PDF BZIP2-Compression decompression

The following example pipeline demonstrates how to read a PDF file, compress it using BZIP2 compression, and then decompress it back to its original format. It demonstrates a simple data compression and decompression workflow.