Add paused Prometheus metric

[Wouter0100]

Would there be any interest for a "paused" metric? This way we're able to exclude paused healthchecks in alerts and make it visible in dashboards.

[cuu508]

Can you describe it a little more – how would it look in the metrics endpoint's output, and how would it be used?

[Wouter0100]

Sure thing, I was thinking of 2 options:

• Introduce a third state (2) for the hc_check_up field, which shows it being "paused". That would result in:

# HELP hc_check_up Whether the check is currently up (1 for yes, 0 for no, 2 for paused).
# TYPE hc_check_up gauge
hc_check_up{name="Cloud storage backup", tags="", unique_key="hash"} 2

• Introduce a new hc_check_paused line, e.g.:

# HELP hc_check_paused Whether the check is currently paused (1 for yes, 0 for no).
# TYPE hc_check_paused gauge
hc_check_paused{name="Cloud storage backup", tags="", unique_key="hash"} 1

Especially as hc_check_started was also introduced in a MR, I'd say the last option. We should be able to use this on Grafana dashboards to indicate that the job is paused.