Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[IMPROVED] Health repair #4116

Merged
merged 8 commits into from Apr 30, 2023
Merged

[IMPROVED] Health repair #4116

merged 8 commits into from Apr 30, 2023

Conversation

derekcollison
Copy link
Member

Under certain scenarios we have witnessed healthz() that will never return healthy due to a stream or consumer being missing or stopped. This will now allow the healthz() call to attempt to restart those assets.

We will also periodically call this in clustered mode from the monitorCluster routine.

Signed-off-by: Derek Collison derek@nats.io

… healthy due to a stream or consumer being missing or stopped.

This will now allow the healthy call to attempt to restart those assets.

Signed-off-by: Derek Collison <derek@nats.io>
Signed-off-by: Derek Collison <derek@nats.io>
Signed-off-by: Derek Collison <derek@nats.io>
@derekcollison derekcollison requested a review from a team as a code owner April 29, 2023 01:02
Do not return healthy if the node is closed, and wait a bit longer for forward progress.

Signed-off-by: Derek Collison <derek@nats.io>
… in meta layer and to shutdown the consumer if created but we encountered an error.

Signed-off-by: Derek Collison <derek@nats.io>
Also do health checks in separate go routine.

Signed-off-by: Derek Collison <derek@nats.io>
…hen removing a stream.

Signed-off-by: Derek Collison <derek@nats.io>
Add in a helper method.

Signed-off-by: Derek Collison <derek@nats.io>
Copy link
Member

@wallyqs wallyqs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@derekcollison derekcollison merged commit 91607d8 into main Apr 30, 2023
2 checks passed
@derekcollison derekcollison deleted the healthz-repair branch April 30, 2023 01:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants