Open Table Iceberg Snap Pack

Overview

Apache Iceberg is an open table format for large-scale analytic datasets. The Open Table Iceberg Snap Pack connects SnapLogic pipelines to an Iceberg REST catalog (such as Polaris) backed by S3-compatible object storage, enabling you to read and write Iceberg tables using Spark SQL.

Use Snaps in this Snap Pack to:

  • Open Table Iceberg - Select: Read data from Iceberg tables using SQL SELECT statements, with optional time travel to query historical snapshots.
  • Open Table Iceberg - Insert: Insert data into existing or new Iceberg tables, with support for multiple storage formats and partition strategies.
  • Open Table Iceberg - Execute: Execute arbitrary Spark SQL statements against the Iceberg catalog, including DDL and DML operations.

Prerequisites

Before using the Open Table Iceberg Snap Pack, ensure the following:

  • An Iceberg REST catalog (for example, Polaris) is deployed and accessible.
  • An S3-compatible object storage bucket is provisioned and the Iceberg catalog is configured to use it.
  • OAuth2 client credentials (client ID and client secret) with appropriate catalog permissions are available.
  • AWS access credentials with read/write access to the S3 bucket are available.

Supported versions

  • Apache Iceberg 1.6.1
  • Apache Spark 3.5.7
  • Hadoop Client 3.3.4
  • AWS SDK v2