Binary Snap Pack

The Binary Snap Pack contains core Snaps for reading data and writing data out.

Supported Protocols
  • ABFS
  • ABFSS
  • ADLS Gen 2 Storage
  • FTP
  • SFTP
  • FTPS
  • SFTP SSH
  • S3
  • S3 Dynamic
  • S3 Server KMS
  • S3 IAM
  • S3 Client KMS
  • S3 Cross IAM
  • S3 Cross Role Key
  • SMB v1, v2, v3
  • WASB
  • WASBS
  • ADL
  • Windows FTP
  • Windows FTPS
  • Google Service
  • Google Storage
  • SLDB
  • SLDB File
Warning:
  • Binary Snaps that support the FTPS file protocol work only in explicit mode. The implicit mode is not supported.
  • This Snap Pack does not natively supports RSA-SHA1 authentication with the Secure File Transfer Protocol (SFTP). Refer to the Configuration Settings for Snaps for more information on regaining support if you need it.
    • With the 4.33 GA release of Snaps, inclusion of some SFTP key-exchange algorithms in all connections was removed (listed in the following table). With the 433patches21645 release of the Binary Snap Pack , you can set the new sftp-prefixed global properties to append the algorithms that you use in your SFTP connections, in case they are no longer included by default. Refer to the Configuration Settings for Snaps documentation for details.

Hadoop Library Setup for Windows

Binary Snaps work well in a Linux environment. However, because of limitations in the Hadoop library on Windows, their functioning in a Windows environment might not always be as expected. We recommend that you use a Linux environment. To use Binary Snaps on a Windows Snaplex, set up the Hadoop library as follows:

  1. Download hadoop.dll and winutils.exe from https://github.com/cdarlint/winutils/tree/master/hadoop-3.3.6/bin (SnapLogic's Hadoop version is 3.3.6).
  2. Create the C:\hadoop\bin directory.
  3. Place the hadoop.dll and winutils.exe files in this path: C:\hadoop\bin
  4. Set the environment variable HADOOP_HOME to point to C:\hadoop
  5. Add C:\hadoop\bin to the environment variable PATH.
  6. In the Node Properties tab of your target Snaplex, add the following key/value pair under Global Properties:

    • Key: jcc.jvm_options

    • Value: -Djava.library.path=C:\hadoop\bin

      If you already have an existing jvm_options value, append -Djava.library.path=C:\hadoop\bin after a space.

    Click Save.

  7. Restart the JCC for the configurations to take effect.

Deprecated Algorithms

Algorithms removed (by default) in the 4.33 GA release are listed in the following table:

Algorithm Type Algorithm removed by default
kex ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group14-sha1,diffie-hellman-group-exchange-sha256,diffie-hellman-group-exchange-sha1,diffie-hellman-group1-sha1
server_host_key ssh-rsa,ssh-dss,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521
client_pubkey ssh-rsa,ssh-dss,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521
cipher(s) aes128-ctr,aes128-cbc,3des-ctr,3des-cbc,blowfish-cbc,aes192-ctr,aes192-cbc,aes256-ctr,aes256-cbc
mac(s) None
check_ciphers aes256-ctr,aes192-ctr,aes128-ctr,aes256-cbc,aes192-cbc,aes128-cbc,3des-ctr,arcfour,arcfour128,arcfour256
check_kexes diffie-hellman-group14-sha1,ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521
check_signatures ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521
check_macs [email protected],hmac-sha2-512-etm@openssh.com,hmac-sha2-256,hmac-sha2-512

Known issues

SFTP connections may experience connectivity issues because of the removal of some deprecated algorithms. To add these connections back, refer to Configuration Settings for Snaps for details.