RFC: Support dynamic reconfiguration of "buckets"

[mattmoor]

/area API
/kind feature

I mentioned this in slack, but given that we already support being promoted to and demoted from "leader" dynamically, could we support dynamically changing the bucket count by:

1. Demoting all the current buckets,
2. Promoting new buckets as we gain ownership of them.

I haven't looked deeply into what this would entail at a code level yet, but I wanted to float the idea for broader discussion.

[github-actions]

This issue is stale because it has been open for 90 days with no
activity. It will automatically close after 30 more days of
inactivity. Reopen the issue with /reopen. Mark the issue as
fresh by adding the comment /remove-lifecycle stale.

[vdemeester]

@mattmoor @dprotaso could we re-open that issue ? I think it's still a valid thing to work on 👼🏼

[github-actions]

This issue is stale because it has been open for 90 days with no
activity. It will automatically close after 30 more days of
inactivity. Reopen the issue with /reopen. Mark the issue as
fresh by adding the comment /remove-lifecycle stale.