Load balance webhook events across multiple workers? #1824
Unanswered
atinylittleshell
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Let's say I have an app installed by 100,000 repositories each sending events every minute, and my workload is heavy, how can I distribute the load to a cluster of workers?
I can't find any documentation that describes how smee.io and probot handles this. Is it assumed that at any given time, there is only one instance subscribing to all webhook events that are sent to my app? That seems difficult to scale and ensure high availability - what if this single instance goes down? We'll then just miss some events? Or are there mechanisms in place that can deal with load balancing and guaranteed at least once/exactly once delivery?
Beta Was this translation helpful? Give feedback.
All reactions