Redshift Snap Pack
Overview
Amazon Redshift is a data warehousing service in the cloud. Use Snaps in this Snap Pack to:
- Lookup records in Redshift tables.
- Output the list of tables in the specified schema.
- Fetch data from Redshift tables.
- Execute bulk load or bulk upsert operations.
- Execute SQL statements (DDL/DML), stored procedures, and other commands in Redshift.
- Provide Slowly Changing Dimension Type 2 (SCD2) functionality for tracking and managing changes to dimension data over time.
This Snap Pack has the following Snaps:
- Redshift - Bulk Load: Loads data into Redshift tables using the COPY command with Amazon S3 as a staging area.
- Redshift - Bulk Upsert: Performs bulk insert, update, or upsert operations on Redshift tables.
- Redshift - Delete: Deletes rows from Redshift tables based on specified conditions.
- Redshift - Execute: Executes SQL statements, DDL/DML commands, and stored procedures in Redshift.
- Redshift - Insert: Inserts data into Redshift tables.
- Redshift - Lookup: Performs lookups on Redshift tables to enrich data.
- Redshift - Multi Execute: Executes multiple SQL statements in sequence.
- Redshift - S3 Upsert: Performs upsert operations using Amazon S3 as a staging area.
- Redshift - SCD2: Implements Slowly Changing Dimension Type 2 logic for tracking historical changes.
- Redshift - Select: Selects data from Redshift tables using SQL queries.
- Redshift - Table List: Retrieves a list of tables from a specified Redshift schema.
- Redshift - Unload: Unloads data from Redshift to Amazon S3 using the UNLOAD command.
- Redshift - Update: Updates rows in Redshift tables based on specified conditions.
Prerequisites
- A valid Redshift Account with the required permissions.
- For bulk load and unload operations, an Amazon S3 bucket configured for staging files.
- Appropriate IAM roles and permissions configured for cross-account access if using IAM role-based authentication. For more information, see Setting Up a Cross-Account IAM Role.
Limitations
Redshift operations against Redshift system views and tables are not supported.
Supported versions
This Snap Pack is tested with:
- PostgreSQL 8.0.2
- Redshift 1.0.69065 (Redshift-JDBC 42-2.1.0.29.jar)