Data preview from pipeline

Overview

Data Preview helps verify that your pipeline's mappings and transformations are working as expected. When you save or validate a pipeline, SnapLogic processes a sample of real data through the Snaps. Key features include:
  • Preview Data Output: View sample data from successful Snaps or error documents from failed ones.
  • Encryption: SnapLogic encrypts all sample data before storing it.
  • Defaults: By default, the preview includes up to 50 records or 15 MB. Exceeding this limit causes validation errors.

Org admins can adjust the preview record limit or disable pipeline validation in Admin Manager. Users can modify the record limit in their Project's User Settings (up to the admin-defined maximum).

Data Preview appears as a table by default. Choose JSON or raw format for unstructured views. Use DataViz to create visualizations like pie charts, bar charts, or scatter plots.

  • Pie chart - Organizes data in sectors, where each sector represents a group proportionate to the whole.

  • Line chart - Compares trends visually for multiple fields or a single field over time.

  • Bar chart - Compares a category from a data set, similar to a pie chart. The simple bar chart displays the number of instances for a field. The group and count bar chart compares data sets from two categories against an index, such as time or geographical location.

  • Scatter chart - Plots the data set for two fields as a map of coordinates and optionally aggregates the data by a third category.

Limitations

In preview data, number fields do not always display the expected values:

  • JavaScript has limitations in displaying numbers. The actual value is maintained in the data; however, the preview might not display the numbers accurately. For example:
    • Numbers greater than the JavaScript constant Number.MAX_VALUE display as Infinity. Learn more about MAX_VALUE.
    • Integers greater than the JavaScript constant Number.MAX_SAFE_INTEGER might be rounded or otherwise displayed incorrectly. Learn more about MAX_SAFE_INTEGER.
  • Numbers without significant fractional values are displayed as integers. For example: 10.00 is displayed as 10.