Kubernetes deployment

You can monitor a Groundplex deployed on Kubernetes (K8s) with Datadog, or any observablity tool that supports OpenTelemetry (OTEL). This requires deployment of an OTEL collector to harvest the metrics and the logs that Groundplex nodes generate.

The OTEL collection daemons should run in the same pods as the Groundplex nodes. You can achieve this by deploying the OTEL collector as a K8s Daemonset. For more details, refer to the OTEL documentation: Important Components for Kubernetes.

Prerequisites:

  • A working K8s cluster

  • Your Datadog API key

  • The configmap.yaml, service.yaml, roles.yaml, serviceaccount.yaml and opentelemetry.yaml files from the open-telemetry-collector-contrib repository (available in an attached zip file for your convenience)

  • A SnapLogic Groundplex Kubernetes configuration

  • A few pipelines to run on the Groundplex to view events in Datadog

The GitHub open-telemetry-collector-contrib repository provides resources for deploying an OTEL collector in Kubernetes. The following topics provide the necessary configuration files and instructions for deploying an OTEL collector as a DaemonSet to use with Datadog:

  1. Configure the DaemonSet
  2. Configure the Groundplex nodes
  3. Observe in Datadog