v2.60.0 The Last of Erigon 2

WARNING

Erigon 3 has been under R&D for a long time and is getting closer to release. We plan this release, v2.60.0, to be the last significant release based on Erigon 2. There might be patch v2.60.x releases for critical issues, but by and large, we intend all future development to be based on Erigon 3. The code of Erigon 3 now lives in branch main, which is our default branch now. We advise all forks of Erigon to either switch their development to Erigon 3 or use branch release/2.60 if they choose to stay on Erigon 2.
You can read more about Erigon 3 at https://erigon.tech/merging-erigon-3-and-erigon-4-and-possibly-caplin.

Drop support of golang 1.20

Fixes pruning of logs issue introduced in 2.59.x:

For users using prune=hrtc flag or any prune flags with non-zero prune.r.older value following must be performed when upgrading from 2.59.x

• Stop the node, upgrade to v2.60.0
• Then,

integration stage_log_index --reset --datadir=<your_datadir> --chain=<chain_name>

• Then restart and let it sync to the tip.

(Optional) Database compaction: Stop the node at chain-tip (after syncing is finished) Then

integration mdbx_to_mdbx --chaindata=<your_datadir>/chaindata --chaindata.to=<your_datadir>/chaindata2 --datadir=<any_random_location_for_temp_files>
mv chaindata chaindataOld
mv chaindata2 chaindata

Then restart. The new chaindata may be up to 1/3 of the size of the old (Bonus!). If all goes well, you can delete chaindataOld

rm -rf chaindataOld

Tip: To do the integration commands with docker image, you can always do

docker run -it -v <your_datadir>:/data --entrypoint sh thorax/erigon:devel

Then the value of datadir for integration and mdbx commands is /data on the docker shell, where you can run the above.

N.B. Also, just a reminder, 2.58 originally synced node cannot see much benefit on upgrading (it was also in the release notes of 2.59) The above suggestion would work when upgrading from 2.59.x

by @somnathb1 in #10019 #9968 #9932 #9733

Caplin:

• Caplin: beacon committee subscription api by @domiwei in #9721
• Caplin: tweaks to make staking more stable. by @Giulio2002 in #10097
• Caplin: Fixed not calling FCU due to faulty blob handling by @Giulio2002 in #9779
• Caplin: process new attesting indicies before block comes in to avoid occasiona Reorg by @Giulio2002 in #10085

Silkworm:

• Fix arm64 Silkworm build (#9299) by @battlmonstr in #9914
• Add support for customising Silkworm RpcDaemon settings in Erigon++ by @canepat in #10002

Otterscan:

• Fixed rewards and fees calculation in Otterscan APIs: #10038 #10070
• Added support for return values in ots_traceTransaction traces: #10014"

New:

• Grafana: configurable datasource by @AskAlexSharov in #10073
• Enabled diagnostics by default to collect data by @dmytro Vovk in #10083
• Added command to verify remote manifests from webseeds by @awskii in #9762
• Add aditional types for handling bor waypoint persistnce and refactor snapshot management code to improve extensibility. #10027 #10051 #9793 #10132 #10147
• RPC: Receipts LRU cache by @AskAlexSharov in #10112

Bugfixes:

• Fix default gas values in debug_ RPCs by @shohamc1 in #9922
• Fixed p2p/sentry: StatusDataProvider ReadCurrentHeader error by @battlmonstr in #9890
• Fixed Engine API: NewPayload fails with a "context canceled" error when calling CurrentHeader/GetHeader (#9786) by @battlmonstr in #9894
• Fix abigen regression which generated non-compilable code with unused imports and duplicate struct definitions by @taratorio in #10091
• Release decompressor mmap on errors by @awskii in #9917
• Web Torrent related fixes to improve downloader reliability. For newly released snapshot files downloading is
  primarily via webseeds. This has become unreliable recently due to issues with web firewall quotas and internal
  torrent library http handling. These changes fix several identified issues in this area which should improve downlaod reliability.#9904 #9962 #10008 #10036 #10183 #10149

Full Changelog: v2.59.3...v2.60.0

v2.59.3 Napoli on Amoy

This release sets the Napoli hard fork on the Amoy test net at block #5423600.

What's Changed

• Napoli block for Amoy network by @anshalshukla in #9840

Full Changelog: v2.59.2...v2.59.3

v2.59.2

This patch release fixes an MDBX size/performance regression introduced in v2.58.0.

Changelog

• a013ec2 Revert "updateForkChoice: support --sync.loop.block.limit (#9315)" (#9833)

v2.59.1 Prep for block production in Caplin

What's Changed

• Caplin: Fixed not calling FCU due to faulty blob handling by @Giulio2002 in #9818
• fixed downloading of unnecessary blocks when --caplin.backfilling=f… by @Giulio2002 in #9820
• Proper Caplin's subscription listen by @Giulio2002 in #9821
• Added basic block production to Caplin by @Giulio2002 in #9822
• downloader: when torrent added to lib and metadata resolved - already… by @AskAlexSharov in #9823

Full Changelog: v2.59.0...v2.59.1

v2.59.0 Post-Dencun Fixes

Attention Caplin Users

1. Upgrade your erigon node, let it run for about a minute, then stop it.
2. Reset the headers & snapshots stages:

rm -rf <datadir>/caplin <datadir>/snapshots <datadir>/downloader
make integration
./build/bin/integration stage_headers --reset --datadir=<datadir>
./build/bin/integration stage_snapshots --reset --datadir=<datadir> 

3. Start your erigon node.

More Aggressive Log/Receipt Pruning

PR #9123 introduces more aggressive pruning of logs & receipts (for nodes with r in their pruning flag, e.g. --prune=hrtc), resulting in a 2x smaller disk footprint.
This feature is only enabled for new nodes. To enable it for an existing node, you have to re-sync it from scratch.

Optional reduce IO for getTxnByHash operation

Transaction lookup by hash did touch too much places in snapshots. It caused high IO and PageCache evictions.
If you have much RPC requests - it will greatly help for this use-case.
To get it: rm datdir/snapshots/*.idx and restart erigon.
By #9506

Release Highlights

• Caplin: blob storage by @bayram98 in #9310
• txpool: Respect updates to block gas limit by @jyellick in #9363
• seg compress: fix LCP initialization by @battlmonstr in #9460
• Filter deposit contract logs before pruning by @somnathb1 in #9123
• metrics: Add memory usage statistics to Prometheus by @shohamc1 in #9465
• "integration warmup": open db in asccede mode - to allow run it without erigon shutdown by @AskAlexSharov in #9558
• debug_traceBlockByHash: reject non-canonical hash by @AskAlexSharov in #9616
• rpc: trace_transaction return error if block is non-canonical by @AskAlexSharov in #9641
• Fix txpool_content for pending blob tx by @somnathb1 in #9668
• Fixed gnosis DA on Caplin by @Giulio2002 in #9682
• support --sync.loop.block.limit in newHeads notification by @AskAlexSharov in #9684
• Allow safe/finalized for eth_getLogs by @adytzu2007 in #9686
• silkworm: proper external/internal txn handling in stage Execution by @canepat in #9594
• Caplin: Added preparation for validator block building by @Giulio2002 in #9709
• evm transaction context not correct when txn is type 3 (EIP-4844) by @indanielo in #9722
• Fix ExcessBlobGas wiring in callMany/debug_traceCallMany by @yperbasis in #9723
• RPC: close tx.Prefix iterator for early release memory by @AskAlexSharov in #9759

New Contributors

• @sjb933 made their first contribution in #9432
• @bloxster made their first contribution in #9459
• @bodhi-crypo made their first contribution in #9492
• @alecalve made their first contribution in #9595
• @adytzu2007 made their first contribution in #9686
• @pavedroad made their first contribution in #9685
• @indanielo made their first contribution in #9722
• @AdventureSeeker987 made their first contribution in #9664
• @domiwei made their first contribution in #9735

Full Changelog: v2.58.2...v2.59.0

v2.58.2 Napoli

Polygon mainnet users: You must upgrade to this release or later before the Napoli hard fork (March 20th, 2024)

What's Changed

• Finalize cancun/napoli HF block number for polygon mainnet by @manav2401 in #9674

Full Changelog: v2.58.1...v2.58.2

v2.58.1

This patch release fixes syncing mainnet from scratch and also Issue #9472.

What's Changed

• mainnet: remove beacon after 8M by @AskAlexSharov in #9480
• snapshots: fix filesByRange by @battlmonstr in #9489

Full Changelog: v2.58.0...v2.58.1

v2.58.0 Dencun

You must upgrade to this release or later before Dencun on Gnosis Chain (11 Mar) and Ethereum mainnet (13 Mar).

Release Highlights

• Added Holesky network to Caplin by @Giulio2002 in #9272
• Caplin: Fixed EL<->CL communication for Deneb by @Giulio2002 in #9257
• turbo/jsonrpc: add support for bor state sync event tx tracing in debug API by @taratorio in #9267
• silkworm: recreate tx batch and disable read-ahead in block execution by @canepat in #9293
• Fix mapmutation size update by @canepat in #9309
• Mapmutation.Flush to use less ram and close collectors earlier by @AskAlexSharov in #9320
• updateForkChoice: support --sync.loop.block.limit by @AskAlexSharov in #9315
• Bor waypoints by @mh0lt in #9342
• Added Full Lightclient Server support by @Giulio2002 in #9354
• Schedule Dencun on mainnet by @yperbasis in #9409
• Add totalBlobPoolLimit flag by @somnathb1 in #9406
• Fixed Caplin archive past deneb by @Giulio2002 in #9416
• Schedule Dencun for Gnosis by @somnathb1 in #9437

New Contributors

• @lyfsn made their first contribution in #9371
• @krauspt made their first contribution in #9415

Full Changelog: v2.57.3...v2.58.0

v2.57.3 Napoli on Mumbai

This release schedules the Napoli hard fork on the Mumbai test net at block 45648608 (Feb 7th, 2024 around 8 AM UTC). Mumbai operators must upgrade beforehand.

What's Changed

• Mumbai: add Napoli block by @temaniarpit27 in #9346

Full Changelog: v2.57.2...v2.57.3

v2.57.2

What's Changed

• (FIX) RpcDaemon doesn't see recently retired blocks by @AskAlexSharov in #9336

Full Changelog: v2.57.1...v2.57.2