Amazon S3 as a target

You can load from any source to Amazon S3 storage. AutoSync transforms objects and tables to CSV, JSON, or Parquet files—each to a file with the same name. To provide the information AutoSync needs to connect to S3, supply new credentials in the wizard or select saved credentials. The account must have write permissions for the file storage location.

Supported Account types

Designer and Classic Manager provide multiple account types for most endpoints and not all types are compatible with AutoSync. When you create or edit a data pipeline, the existing credentials list only includes compatible Accounts.

For S3, AutoSync supports:

• Amazon S3 Account

Supported load types

• Full load

Connection configuration

When you create S3 credentials in AutoSync, the properties include :

• Account Properties:
  • Credential label: A unique, meaningful name such as S3-Shared-Sales. If a configuration with the same name exists, AutoSync displays an Asset conflict error message.
  • Access-key ID: The S3 Access key ID for authentication. For example, NAVRGGRV7EDCFVLKJH.
  • Secret Key: The S3 Secret key for authentication. For example, NXXxXxXNxXxxxXXxXxXXXXNxXXXxXXx+xxXXxx.
  • Share: (Optional) Select a user group to share this configuration with. Org admins create user groups to share credentials. If you are a member of a user group, you can select it from the dropdown. You can also select the global shared folder, which shares the credentials with everyone in your Org.
• Validate and save: After saving and validating, AutoSync adds the configuration to the list of saved credentials.
• File type: After selecting your configuration, choose the file type, CSV, JSON, or Parquet.
• Folder path: Bucket and folder names are case sensitive. Enter the target file path in one of the following formats:
  • bucket-name/folder-name
  • s3:///bucket-name/folder-name.