Clean Missing Values

Overview

The Clean Missing Values is a Transform type Snap that is used to process any missing values in an incoming dataset by dropping or imputing (replacing) values. The Clean Missing Values Snap supports the following four approaches to process missing values:

Drop Row
Impute with Average
Impute with Popular
Impute with Custom Value

Transform-type Snap
Works in Ultra Tasks

Prerequisites

None.

Limitations and known issues

None.

Snap views


View	Description	Examples of upstream and downstream Snaps
Input	A document containing the missing values. A document containing data statistics computed by the Profile Snap.	Mapper CSV Generator
Output	A document where all missing values have been processed.	Mapper JSON Formatter
Error	Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter when running the pipeline by choosing one of the following options from the When errors occur list under the Views tab. The available options are: Stop Pipeline Execution Stops the current pipeline execution when an error occurs. Discard Error Data and Continue Ignores the error, discards that record, and continues with the remaining records. Route Error Data to Error View Routes the error data to an error view without stopping the Snap execution. Learn more about Error handling in Pipelines.

Snap settings

Legend:

Expression icon (): JavaScript syntax to access SnapLogic Expressions to set field values dynamically (if enabled). If disabled, you can provide a static value. Learn more.
SnapGPT (): Generates SnapLogic Expressions based on natural language using SnapGPT. Learn more.
Suggestion icon (): Populates a list of values dynamically based on your Account configuration.
Upload : Uploads files. Learn more.

Learn more about the icons in the Snap settings dialog.


Field / field set	Type	Description
Label	String	Required. Specify a unique name for the Snap. Modify this to be more appropriate, especially if more than one of the same Snaps is in the pipeline. Default value: Example: Clean Missing Values
Policy	Specifies the preferences for fields, missing values, and handling methods. For each policy, select the field with missing values, the handling method, the custom value for Impute with Custom Value, and the missing value to be handled.
Field	String/Suggestion	The field that contains missing values. This is a suggestible field that suggests all the fields in a dataset.
Rule	Dropdown list	The handling method for missing values in the selected field. The available options are: Drop Row: The Snap discards all rows that contain the missing values. Impute with Average: This is applicable only to numeric fields. The Snap replaces missing values with the average computed by the Profile Snap. In the second input view, the Snap requires the data statistics computed by the Profile Snap. Impute with Popular: The Snap replaces all missing values with the most popular value. In the second input view, the Snap requires the data statistics computed by the Profile Snap. Impute with Custom Value: The Snap replaces all missing values with the value you specify in Custom value. In case of an ambiguous data type, you must specify Custom value type.
Custom Value	String/Expression	The value the Snap uses to replace missing values when you select Impute with Custom Value option.
Custom value type	Dropdown list	The type of value that the Snap must use to replace missing values when you select Impute with Custom Value option. The available options are: Auto Integer Floating Point String Date Time
Missing value (Value to be replaced)	String/Expression	Specify the missing value here. This option is available only when the field has specific missing values. For example, fields that contain "N/A", "None", "Unknown", "-1", etc as the missing value.
Snap execution	Dropdown list	Select one of the three modes in which the Snap executes. Available options are: Validate & Execute: Performs limited execution of the Snap and generates a data preview during pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during pipeline runtime. Execute only: Performs full execution of the Snap during pipeline execution without generating preview data. Disabled: Disables the Snap and all Snaps that are downstream from it. Default value: Execute only Example: Validate & execute