• CSV Formatter
• JSON Formatter
• XML Formatter

Example output:

{
  "filename": "hdfs://ec2-54-198-212-134.compute-1.amazonaws.com:8020/user/john/input/sample.csv",
  "fileAction": "overwritten"
}

• Mapper

String

Required. Specify a unique name for the Snap. Modify this to be more appropriate, especially if more than one of the same Snaps is in the pipeline.

Default value: HDFS Writer

Example: HDFS Writer

String/Expression/ Suggestion

Specify the URL for HDFS directory. It should start with hdfs file protocol in the following format:

• hdfs://<hostname>:<port>/<path to directory>/
• wasb:///<container name>/<path to directory>/
• wasbs:///<container name>/<path to directory>/
• abfs(s):///filesystem/<path>/
• abfs(s)://[email protected]/<path>

The Directory property is not used in the Pipeline execution or preview and used only in the Suggest operation. When you click the Suggestion icon, the Snap displays a list of subdirectories under the given directory. It generates the list by applying the value of the Filter property.

Default value: hdfs://<hostname>:<port>/

Example:

• hdfs://ec2-54-198-212-134.compute-1.amazonaws.com:8020/user/john/input/
• wasb:///snaplogic/testDir/
• wasbs:///snaplogic/testDir/
• $dirname
• abfs(s):///filesystem2/dir1
• abfs(s)://[email protected]/dir1

String/Expression

Specify the Glob filter pattern.

Default value: *

String/Expression/ Suggestion

Specify the filename or a relative path to a file under the directory given in the Directory property. It should not start with a URL separator "/". The File property can be a JavaScript expression which will be evaluated with values from the input view document. When you click the Suggest icon, it will display a list of regular files under the directory in the Directory property. It generates the list by applying the value of the Filter property.

Default value: N/A

Example:

• sample.csv
• tmp/another.csv
• $filename

Interval

Specify the flush interval in kilobytes to flush a specified size of data during the file upload. This Snap can flush the output stream each time a given size of data is written to the target file server.

Default value: -1

Example: 0

Integer/Expression

Specify the maximum number of attempts to be made to receive a response.

Default value: 0

Example: 1

Integer/Expression

Specify the time interval between two successive retry requests. A retry happens only when the previous attempt resulted in an exception.

Default value: 1

Example: 5

Dropdown list

Select an action to perform if the specified file already exists:

• Overwrite - The Snap attempts to write the file without checking for the file's existence for a better performance, and the "fileAction" field will be "overwritten" in the output view data.
• Append - The Snap appends records in the incoming documents to the existing file.
• Ignore - If the file already exists, the Snap does not throw an exception and does not overwrite the file, but writes an output document indicating that it has been 'ignored'.
• Error - The error displays in the Pipeline Run Log if the file already exists.

Default value: Overwrite

Example: Append

Checkbox

Select this check box to enable user impersonation.

Default value: Deselected

Checkbox

Enables you to produce a different output document for each file that is written. If the Snap receives multiple binary input data and the File expression property is dynamically evaluated to a filename by using the Content-Location field from the input metadata, each binary data can be written to a different target file.

By default, the Snap produces only one output document with a filename that corresponds to the last file that was written.

Default value: Deselected

Checkbox

Select this checkbox to write an empty file to all the supported protocols when the binary input document has no data.

Default value: Deselected

Dropdown list

Default value: Validate & Execute

Example: Execute only