Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Infinite compaction loop? #60

Open
Tudmotu opened this issue Jan 25, 2023 · 0 comments
Open

Infinite compaction loop? #60

Tudmotu opened this issue Jan 25, 2023 · 0 comments
Labels
help wanted Extra attention is needed question Support or open question(s)

Comments

@Tudmotu
Copy link

Tudmotu commented Jan 25, 2023

I'm trying to access an Ethereum DB which about 1TB in size.

Immediately on calling open(), the leveldb LOG file starts printing the following lines over and over again:

2023/01/25-19:00:25.972517 7f512de5e700 Compacting 1@2 + 8@3 files
2023/01/25-19:00:25.983790 7f512de5e700 Generated table #13798933@2: 1426 keys, 524408 bytes
2023/01/25-19:00:25.989548 7f512de5e700 Generated table #13798934@2: 1335 keys, 484178 bytes
2023/01/25-19:00:25.994915 7f512de5e700 Generated table #13798935@2: 1443 keys, 534255 bytes
2023/01/25-19:00:26.000565 7f512de5e700 Generated table #13798936@2: 1405 keys, 507921 bytes
2023/01/25-19:00:26.007436 7f512de5e700 Generated table #13798937@2: 1484 keys, 527112 bytes
2023/01/25-19:00:26.012568 7f512de5e700 Generated table #13798938@2: 1535 keys, 559004 bytes
2023/01/25-19:00:26.019553 7f512de5e700 Generated table #13798939@2: 2506 keys, 548458 bytes
2023/01/25-19:00:26.024701 7f512de5e700 Generated table #13798940@2: 2276 keys, 361713 bytes
2023/01/25-19:00:26.024714 7f512de5e700 Compacted 1@2 + 8@3 files => 4047049 bytes
2023/01/25-19:00:26.056418 7f512de5e700 compacted to: files[ 0 66 842 7135 65110 406111 105772 ]
2023/01/25-19:00:26.312935 7f512de5e700 Delete type=2 #13798056
2023/01/25-19:00:26.319244 7f512de5e700 Delete type=2 #13798932
2023/01/25-19:00:26.454692 7f512de5e700 Delete type=2 #13740731
2023/01/25-19:00:26.454883 7f512de5e700 Delete type=2 #13740732
2023/01/25-19:00:26.454990 7f512de5e700 Delete type=2 #13740733
2023/01/25-19:00:26.455085 7f512de5e700 Delete type=2 #13740734
2023/01/25-19:00:26.455182 7f512de5e700 Delete type=2 #13740735
2023/01/25-19:00:26.455278 7f512de5e700 Delete type=2 #13740736
2023/01/25-19:00:26.455373 7f512de5e700 Delete type=2 #13740737

Trying to read from the DB seems to take longer than usual, and the more I wait the slower the read speed becomes.

Any pointers at what to look at?
Can I somehow disable compaction when opening a DB?

Thanks!

@vweevers vweevers added help wanted Extra attention is needed question Support or open question(s) labels Jan 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed question Support or open question(s)
Projects
Status: Backlog
Development

No branches or pull requests

2 participants