Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Support for Kafka and Elasticsearch database application on Rook clusters #14184

Open
parth-gr opened this issue May 9, 2024 · 2 comments
Labels

Comments

@parth-gr
Copy link
Member

parth-gr commented May 9, 2024

Is this a bug report or feature request?

  • Feature Request

Supporting such database would require replica-1 topological based provisioning + Ceph's localpool functionality

Currently we have a support for replica-1 pools which will be documented soon,
So this feature request is to explore more on ceph local pools(https://docs.ceph.com/en/latest/mgr/localpool/)

What should the feature do:

Do topological provisioning on local pools

What is use case behind this feature:

Support Kafka and Elasticsearch into Rook clusters

Environment:

@parth-gr parth-gr self-assigned this May 9, 2024
@parth-gr parth-gr changed the title Support Kafka and Elasticsearch into Rook clusters Add Support for Kafka and Elasticsearch database application on Rook clusters May 9, 2024
@parth-gr
Copy link
Member Author

parth-gr commented May 9, 2024

@travisn localpool looks like, distributing the data across the cluster,

This can be useful for deployments where it is desirable to distribute some data locally and other data globally across the cluster

But for replica1 we need individual pools specific for a failure domain, not think if the idea will be suited,
Any comments what do you think on this?

@parth-gr parth-gr removed their assignment May 9, 2024
@travisn
Copy link
Member

travisn commented May 9, 2024

From the doc:

For example, by default, it will create a pool for each distinct rack in the cluster. This can be useful for deployments where it is desirable to distribute some data locally

I'm still not clear if it's useful for our scenario, but it does indicate that pools can be created within failure domains.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants