Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Host collection for the Pinger #19

Merged
merged 10 commits into from
Jun 1, 2023
Merged

Improve Host collection for the Pinger #19

merged 10 commits into from
Jun 1, 2023

Conversation

cortze
Copy link
Owner

@cortze cortze commented Jun 1, 2023

Motivation

Due to the lack of multiple concurrent calls to a single host by the dht internal messenger (#805) and the large range of CID that we aim to track using the CID hoarder, the only way to reduce the impact of the time measurements that I came up with was to scale horizontally the number of hosts that make the +10k request.

Description

This PR presents the upgrade of the Pinger logic to:

  1. Simplify it
  2. implement a "smart" enough pool of hosts that will balance the pinging workload of a Continuous Study
    • Prioritized "idle" hosts
    • or host that is currently pinging the farthest CIDs (XOR distance) among the closest ones of the host pool
  3. Fix proper routine closure
  4. Fix debugging of DB batching
  5. format code
  6. add conf option for OP (experimental)

@cortze cortze merged commit a3dd52c into master Jun 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant