Scheduled Lineage for Ultra Tasks

Opt-in feature that publishes Ultra Task lineage data in scheduled batches.

The Scheduled Lineage for Ultra Tasks is a platform-based opt-in feature set at the environment (Org) level that provides lineage reporting capabilities for Ultra Tasks. Lineage data is automatically captured, appended, and pushed at each scheduled interval, enabling governance, impact analysis, and auditability for Ultra workloads. This data is delivered in scheduled batches and not pushed in real time.

This feature supports the following Ultra Tasks:

Prerequisites

  • Lineage subscription (Contact your CSM for subscription)
  • Set the feature flag to control the push interval of lineage data. This needs to be set internally by your Environment Admin.
  • JCC version 4.44.1 or later

Benefits

Scheduled lineage reporting is useful when:

  • Running low-latency, always-on integrations such as real-time APIs, Kafka/JMS event processing, or Salesforce streaming integrations

  • Supporting compliance, impact analysis, regulatory audits, or integrations with external governance tools such as Collibra or DataHub

  • Capturing lineage data without disrupting running Ultra Tasks

Feature Enablement

The Ultra Tasks Lineage scheduling requires setting an Environment-level feature flag.

com.snaplogic.cc.snap.adm.AdmUltraLineagePublisher.ULTRA_PUSH_INTERVAL

For example, com.snaplogic.cc.snap.adm.AdmUltraLineagePublisher.ULTRA_PUSH_INTERVAL=3600

Note:

We recommend that you enable this feature flag in your development environments before production environments. Consult your CSM about enabling the feature for your Environment (Org).

Usage Guidelines

  • We recommend you set a large push interval, for example, 86400 seconds (1 day), but not smaller than 3600 seconds. We do not recommend values below 3600 seconds (1 hour) because it may affect system stability.
  • To disable scheduled lineage reporting, set the value to 0 or unset the flag.