Load types

The load types available for a data pipeline depend on what is supported for all selected sources and the target. Available types include:

• Full load: If tables exist in the target, AutoSync drops them and does a full reload.
• Incremental: Requires tables and objects to have a primary or a composite key and a timestamp field that updates when a record is created or changes. After the first load, AutoSync performs an upsert operation to load only new and updated records. Learn more. If you can't change the schema to add a timestamp, use Full load instead.
• Append: for CSV files only, appends data when a file of the same name is uploaded more than once. Learn more.
• SCD2: Slowly Changing Dimension Type 2 (SCD2) tracks historical values. Requires tables and objects to have a primary or a composite key along with a timestamp field that tracks the last update. Refer to SCD2 for a matrix of supported destination and source endpoints.

The first time a data pipeline runs, SnapLogic AutoSync does a full load of the source data. If synchronization is scheduled and the target supports upsert, by default AutoSync loads incrementally for subsequent runs. Edit the data pipeline to change the load type.

The following section describes how to change the load type. Learn more about using Multiple sources in one data pipeline.