Third-party Observability
SnapLogic Third-party Observability works with monitoring tools that support OpenTelemetry (OTel).
SnapLogic Monitor provides visibility into pipeline execution and infrastructure health. The Third-party observability feature enables you to integrate Groundplex node execution logs and metrics with third-party observability tools.
Observability tools:
-
Consolidate the monitoring of many applications in one interface to reduce the total cost of ownership (TCO).
- Simplify issue mitigation with early detection.
- Retain historical data for audits.
Third-party Observability is available by subscription and works with tools that support the OpenTelemetry (OTel) format. SnapLogic currently certifies support for Datadog and New Relic. Contact your CSM for more information.
Integration architecture
In environments subscribed to Third-party Observability, Groundplex JCC services use the OpenTelemetry API and SDK to instrument metrics and logs in OpenTelemetry Protocol (OTLP) format. To use the service, you configure and deploy an OpenTelemetry Collector for each node. The Collector retrieves data from the logs and routes them to a third-party tool.
Three components comprise the OpenTelemetry Collector:
- Receiver: Defines how the logs are sent to the OpenTelemetry Collector.
- Processor: Defines the method of log retrieval.
- Exporter: Specifies the third-party tool.
The following diagram illustrates how the SnapLogic Platform implements the OpenTelemetry service.
OTel workflow
To set up Groundplex monitoring for an OTel-compatible third-party tool:
- Configure an OpenTelemetry collector.
- Configure Groundplex nodes.
- Deploy the OTel collector and restart the Groundplex nodes.
- Run some pipelines to verify the configuration.
The specific procedures depend on how the Groundplex is deployed and the observability tool you want to use. Snaplogic certifies that the Third-party Observability feature works with Datadog and New Relic.
The documentation provides specific instructions for:
- Datadog with a Groundplex deployed on Kubernetes, where the OpenTelemetry collector runs as a DaemonSet.
- New Relic with a Groundplex deployed on Docker.