Analyze pipelines and infrastructure

Pages in the Monitor Analyze group include:

  • Asset catalog: Metadata for all operational pipelines. Visible to everyone by default; Environment admins can restrict visibility to Environment admins only.
  • Insights: An overview of environment activity which includes among other statistics, the number of users, active pipelines, and documents processed. The summary updates daily.
  • Pipeline executions: A table of running and completed pipelines with a summary count of their status. Access pipeline details, including Snap statistics and logs.
  • Infrastructure: Resource usage for Snaplexes and their nodes.
  • Metrics: Charts of key usage metrics for a Snaplex node over time.
  • Snap usage: Lists every Snap Pack in your environment with its type and the number of pipelines that use each Snap.

The status of integrations and the infrastructure on which they run determines the health of your SnapLogic environment. For those new to the SnapLogic Platform, this page introduces integration and execution environment terms that are necessary to understand the data and troubleshoot issues. For a more in-depth explanation refer to Platform components and Pipeline execution flow.

Integrations

The SnapLogic Platform integrates and transforms data by running pipelines. At deployment time, tasks invoke pipelines:
  • In Designer, a developer creates a task to invoke a pipeline:
    • Scheduled Tasks run periodically.
    • Triggered Tasks are invoked by an API call from external systems or apps.
    • Ultra Tasks are always on to accept streaming data.
  • AutoSync creates a task automatically when users schedule synchronization for a data pipeline.
  • In APIM, developers create APIs to run pipelines.
Users can also run Designer pipelines and AutoSync data pipelines on demand from the development environment. The SnapLogic Platform creates an execution record when an integration runs, regardless of how it starts. The Monitor Pipeline executions page shows execution records for Ultra Tasks and for running, failed, and completed integrations.

Environment admins can view all executions in the environment. Non-admin users can only see the records for integrations they created or have permission to access. For pipelines created in Designer, this means permission to access the pipeline project. For AutoSync data pipelines, the owner or an Environment admin grants access to others by sharing it.

Execution environment

Integrations run on a Snaplex that consists of one or more services deployed on physical hosts or virtual machines. The Monitor Infrastructure and Metric pages report Snaplex resource usage and health. Snaplexes can be one of the following types:
  • Cloudplex—Managed by SnapLogic, Cloudplexes offer secure connectivity to cloud data endpoints.
  • Groundplex—Managed by your organization and run on your network, Groundplexes offer secure connectivity to on-premises endpoints behind the firewall. Groundplexes can run integrations created in Designer, in AutoSync, or invoked with an API.
  • AutoSync—Provisioned by SnapLogic for AutoSync users, the Autosync plex offers secure connectivity to cloud data endpoints. AutoSync data pipelines can also run on a Groundplex to connect to on-premises endpoints.