[馃挕 FEATURE REQUEST]: Multiple pool support #1679
Labels
C-feature-request
Category: feature requested, but need to be discussed
help-needed-hard
Call for participation: Experience needed to fix: Hard / a lot
P-jobs
Plugin: Jobs
Plugin
JOBS
I have an idea!
We in the company actively use JOBS plugin and process a lot of tasks.
Our monolithic application has very different queue handlers with:
In the current JOBS implementation, all tasks added into one queue and processed by one pool of workers. Different queue handlers can greatly interfere with others. Problem handlers can take too many workers, requeue tasks too often, and take too long to process.
As a result, the JOBS-cluster performance is unstable and low.
I would like to be able to configure individual pools and assign them individual settings:
The new feature proposes:
Here is an example config for solving these problems:
The result can be a mechanism for managing many pools in a each plugin. This mechanism can be reused in the future plugins.
Comrades, what do you think of this?
The text was updated successfully, but these errors were encountered: