Configure Hadoop accounts

Overview

You must configure accounts in Hadoop Snaps to enable them to connect to Hadoop tables. You can configure your account from SnapLogic Platform using the Designer or Manager.

Snap-account compatibility

Snaps in the Hadoop Snap Pack work with different accounts and protocols per the following table:

Snap AWS S3 Account for Hadoop AWS S3 Dynamic Account Azure Storage for Hadoop Azure Data Lake Storage Gen 2 OAuth2 Kerberos Protocols Supported
Hadoop Directory Browser Cross Icon Cross Icon Cross Icon Tick Icon Tick Icon
  • ABFS
  • HDFS
HDFS Reader Cross Icon Cross Icon Tick Icon Tick Icon Tick Icon
  • WASB
  • WASBS
  • ABFS
  • HDFS
  • ADL
HDFS Writer Cross Icon Cross Icon Tick Icon Tick Icon Tick Icon WASB, WASBS, ABFS, HDFS, ADL
HDFS ZipFile Reader Cross Icon Cross Icon Cross Icon Tick Icon Tick Icon ABFS, HDFS
HDFS ZipFile Writer Cross Icon Cross Icon Cross Icon Tick Icon Tick Icon ABFS, HDFS
ORC Reader Tick Icon Tick Icon Cross Icon Tick Icon Cross Icon AWS S3, WASB, WASBS, ABFS, HDFS
ORC Writer Tick Icon Tick Icon Cross Icon Tick Icon Cross Icon AWS S3, ABFS, HDFS
Parquet Reader Tick Icon Tick Icon Tick Icon Tick Icon Tick Icon AWS S3, WASB, WASBS, ABFS, HDFS, ADL
Parquet Writer Tick Icon Tick Icon Tick Icon Tick Icon Tick Icon AWS S3, WASB, WASBS, ABFS, HDFS, ADL
RC File Formatter Cross Icon Cross Icon Cross Icon Cross Icon Cross Icon N/A
RC File Parser Cross Icon Cross Icon Cross Icon Cross Icon Cross Icon N/A
Sequence Formatter Cross Icon Cross Icon Cross Icon Cross Icon Cross Icon N/A
Sequence Parser Cross Icon Cross Icon Cross Icon Cross Icon Cross Icon N/A

Account encryption

Standard Encryption If you are using Standard Encryption, follow the High sensitivity settings under Enhanced Encryption.
Enhanced Encryption If you have the Enhanced Account Encryption feature, the following describes which fields are encrypted for each sensitivity level selected for this account:
  • High: Password
  • Medium + High: Username, Password
  • Low + Medium + High: Username, Password