Synchronization schedules

SnapLogic AutoSync offers options for keeping the data in your CDW synchronized with the source. Cloud storage and CDW providers charge based on data volumes. For data pipelines that will move a lot of data, you might want to do a cost benefit analysis that weighs the importance of data freshness against the cost.

For example, an analytics package might tally up monthly expenses, so weekly or monthly synchronization might work well. However, when tracking data that changes frequently, such as buying trends, synchronizing every few minutes could enable a quicker response. When a use case involves historical data or data that changes infrequently, it might make sense to run the data pipeline on demand.

The following sections describe how to:

Create a data pipeline without setting a schedule.
Run a data pipeline once.
Schedule a begin and an end date for synchronization in the wizard or when changing the schedule.
Change a schedule.
Run a data pipeline on demand..
Run a data pipeline for a specified number of times.

Set the synchronization schedule

The last step in the AutoSync wizard gives you the option to set a synchronization schedule.

You can do any of the following:

Save the data pipeline without running it by selecting No schedule.
Run the data pipeline once by selecting Run once. At the bottom of the screen, optionally select the time to start synchronization.
Choose one of the preset schedules and optionally select the time to start.
Choose Custom if none of the preset schedules meet your needs. This option allows you to choose an end date to discontinue synchronization or set the schedule to run the data pipeline a specified number of times.

Run a data pipeline on demand

You can run a data pipeline at any time from the dashboard in two ways:

Click the three dot menu on the card and select Run now:
Click the card to open the details panel and click Run now:

Change the synchronization schedule

To change the synchronization schedule:

Click the edit icon on the data pipeline card:
The Edit data pipeline screen opens. Click the Auto synchronize tab:
Set the schedule:
Click Save.

Set the start and end time for synchronization

You can set a start and end time for synchronization when creating or editing a data pipeline.

To set the synchronization schedule:
- When creating a data pipeline, in the wizard How often do you want to synchronize your data? screen, click Custom to open the dialog:
- To edit an existing schedule:
  1. Click the edit icon on the data pipeline card:
  2. The Edit data pipeline screen opens. Click the Auto synchronize tab:
For the Start on field, select a date and time.
Select Run once or a value for Repeat every.
From the Ends dropdown, select On.
Set a time for the schedule to end.
Click Done.

Run a data pipeline for a specific number of times

Specify the number of times a data pipeline will run when creating or editing a data pipeline.

Open the synchronization schedule in one of the following ways:
- When creating a data pipeline, in the wizard How often do you want to synchronize your data? screen, click Custom to open the dialog:
- To edit an existing schedule:
  1. Click the edit icon on the data pipeline card:
  2. The Edit data pipeline screen opens. Click the Auto synchronize tab:
For the Start on field, select a date and time.
Select a value for Repeat every.
From the Ends dropdown, select After.
Set a number of times to run.
Click Done.

Note: AutoSync keeps track of data pipeline runs. To start counting runs from the time you edit the schedule, reset the run counter. In this example, the data pipeline already ran four times. To reset the counter to run three times in the future, click Reset the run count to 0.