Skip to main content

Collector health

0readings
0conditions
0themes fed
Livestatus

Per-collector health for the shipper the agent runs.

Topic id: collector_health.

Full inventory every 2 hours. Supported changes are reported when the agent observes them.

Fields​

Collection status and activity for each collector.

FieldTypeUnitMeaning
sparklogs.data.collector_health.topicstringWhich state topic this row reports on.
sparklogs.data.collector_health.healthstringThe debounced health verdict: on collector_health, fresh, stale (also a topic that has not reported at all within three of its intervals), stalled, frozen, waiting_prereq or unknown (the topic has ticked this process but produced no valid generation yet); on feed_health, onboarding, onboarding_stuck, current, behind, stuck, blocked or unknown. Until the topic or module reports in this process the row carries the verdict it last reported; absent when it has never reported one.
sparklogs.data.collector_health.reasonstringWhy health is not the healthy value, from a closed vocabulary specific to the topic (for example capture_failed, not_declared, or missing_required_channel). Absent when health needs no explanation.
sparklogs.data.collector_health.sincestringtimestampWhen the current health verdict began. Carried from the last report until the topic or module reports in this process, then reset, because the debounce that tracks it is in-memory.
sparklogs.data.collector_health.last_success_tsstringtimestampThe last time this topic's collector produced a valid generation. Survives an agent restart, unlike since.
sparklogs.data.collector_health.capturestringWhich capture loop this topic's collector reads from.
sparklogs.data.collector_health.delta_rate_limitedbooltrue while this row's transitions are capped by the daily rate limit: its reported health is held at the last one reported until the window drains. false otherwise. Engaging and releasing the cap are each reported once. Absent only on a row with no verdict yet this process, which carries the last reported value.

This topic reports what the host looks like rather than scoring a condition on it. The values it carries are queryable on their own.

Example​

Inventory (every 2 hours)

3 collectors, 2 fresh, 1 frozen 0h00m (capture_failed) "vss_writers".

sparklogs.data.collector_health.topic: vss_writers
sparklogs.data.collector_health.delta_rate_limited: false
sparklogs.data.collector_health.health: frozen
sparklogs.data.collector_health.reason: capture_failed

SparkLogs: CONTEXT, Info, collector_health: INVENTORY: 3 collectors, 2 fresh, 1 frozen 0h00m (capture_failed) "vss_writers".