v6.3 Error with provider.getLogs(): invalid value for value.removed

[PhrackNZ]

Just upgraded to v6.3 from 5.7 and suddenly getting this problem when trying to use getLogs. Not sure if it is something I missed in the changes or an ethers issue.

const provider = new ethers.JsonRpcProvider('https://eth-rpc-api.thetatoken.org/rpc');
const logs = await provider.getLogs({
      fromBlock: 20412500,
      toBlock: 20412600,
      topics: [ethers.id('Transfer(address,address,uint256)')],
    });

Error: invalid value for value.removed (invalid boolean; undefined (argument="value", value=null, code=INVALID_ARGUMENT, version=6.3.0))

 code: 'BAD_DATA',
  value: {
    logIndex: '0x1',
    transactionIndex: '0x1',
    transactionHash: '0xc60616c2d6f2210fe4c851554c51868530170f21db9deca6d5bd4cb7ccffc347',
    blockHash: '0xd42e2a8a9d62f532d2ae3ec17dbb537a16689e51034464e091728d0766883b63',
    blockNumber: '0x1377859',
    address: '0xc98c4cf17156d022fcc908779f360c86fe086753',
    data: '0x',
    topics: [
      '0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef',
      '0x000000000000000000000000bb5f35d40132a0478f6aa91e79962e9f752167ea',
      '0x000000000000000000000000062b5f7e7fa827783abb946915a8109ae82dda40',
      '0x00000000000000000000000000000000000000000000000000000000000010b1'
    ],
    type: 'mined'
  }
}

[bartvdbraak]

Hi @PhrackNZ

It seems that you've encountered an issue after upgrading from version 5.7 to version 6.3 of ether.js library. The error you're experiencing is related to the getLogs method when using a JsonRpcProvider instance.

The error message indicates that there is an "invalid value for value.removed" and it specifically mentions that the value is null. This error is raised because the value.removed property is expected to be a boolean, but it received null instead.

To resolve this issue, you can try explicitly setting the removed property to null or false when calling the getLogs method. Here's an example:

const logs = await provider.getLogs({
  fromBlock: 20412500,
  toBlock: 20412600,
  topics: [ethers.utils.id('Transfer(address,address,uint256)')],
  removed: false // Add this line to explicitly set the 'removed' property
});

By explicitly setting removed to false, you should be able to avoid the error you're encountering.

If the issue persists or if you need further assistance, please provide additional details. This information will help in diagnosing the issue more accurately.

Hope this helps! Let me know if you have any other questions.

Best regards,

[bartvdbraak]

Actually, disregard my previous answer. I can reproduce the error on my end and had misunderstood your error.

It has been referenced here: #3959

This will be fixed by this commit: 4e478e6

[bartvdbraak]

I temporarily fixed it by replacing line 86 in node_modules/ethers/lib.esm/providers/format.js to:

    removed: allowNull(formatBoolean, false),

As you can see by the following successful execution:

❯ node server.js
[
  Log {
    provider: JsonRpcProvider {},
    transactionHash: '0xc60616c2d6f2210fe4c851554c51868530170f21db9deca6d5bd4cb7ccffc347',
    blockHash: '0xd42e2a8a9d62f532d2ae3ec17dbb537a16689e51034464e091728d0766883b63',
    blockNumber: 20412505,
    removed: false,
    address: '0xC98C4Cf17156D022FcC908779F360c86fE086753',
    data: '0x',
    topics: [
      '0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef',
      '0x000000000000000000000000bb5f35d40132a0478f6aa91e79962e9f752167ea',
      '0x000000000000000000000000062b5f7e7fa827783abb946915a8109ae82dda40',
      '0x00000000000000000000000000000000000000000000000000000000000010b1'
    ],
    index: 1,
    transactionIndex: 1
  },
  Log {
    provider: JsonRpcProvider {},
    transactionHash: '0xe75daca403e568d76c917fd4d417026293c25993cb2be490edca7bfb0a8f9783',
    blockHash: '0x92e447074d9d49a469abeaad1e2973c6764091a8db0745b6d6e69376b028dc70',
    blockNumber: 20412515,
    removed: false,
    address: '0x14Ca082C412bf5530AAdB07d54aAA64b6e205A74',
    data: '0x000000000000000000000000000000000000000000000001158e460913d00000',
    topics: [
      '0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef',
      '0x00000000000000000000000008f02ac1ece6f601b7547655dff7fd6223cdef3d',
      '0x0000000000000000000000005d5937910021024aa26d14655335746317ef4250'
    ],
    index: 0,
    transactionIndex: 1
  },
  Log {
    provider: JsonRpcProvider {},
    transactionHash: '0x3125a9eb1ec68101ef70cc0a102d476d586c3f4c8db43c524c30772a15c60924',
    blockHash: '0x474816e7df22eaf534155b9d5ee8b10c8ee42988554814fe8e7a78f5c7e62fb1',
    blockNumber: 20412538,
    removed: false,
    address: '0x20C58042766cEa34E9D9A97F8f56597E7fdDe355',
    data: '0x',
    topics: [
      '0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef',
      '0x0000000000000000000000000000000000000000000000000000000000000000',
      '0x0000000000000000000000007ee90f778c22dd5e8747c381a7cc354f90754717',
      '0x00000000000000000000000000000000000000000000000000000000000005f2'
    ],
    index: 0,
    transactionIndex: 1
  },
  Log {
    provider: JsonRpcProvider {},
    transactionHash: '0x6edac7a0a6ebb071a384217839c993ce28ec0d0af18f449f907a2e747ef36783',
    blockHash: '0xcac2c8ec3ab8c834ff8419561c0678730b4e3875e41dfd6dc2493cc91f1e0375',
    blockNumber: 20412542,
    removed: false,
    address: '0xC98C4Cf17156D022FcC908779F360c86fE086753',
    data: '0x',
    topics: [
      '0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef',
      '0x000000000000000000000000bb5f35d40132a0478f6aa91e79962e9f752167ea',
      '0x000000000000000000000000062b5f7e7fa827783abb946915a8109ae82dda40',
      '0x0000000000000000000000000000000000000000000000000000000000001b67'
    ],
    index: 1,
    transactionIndex: 1
  },
  Log {
    provider: JsonRpcProvider {},
    transactionHash: '0xd1214689425a61b31436b18c3950a18dbeaaf8030263f76049ed69e58157e986',
    blockHash: '0x656f72bcf8d654cc448697fd179eab881ecfdc364aae15d1e0e1d6f0e3b190eb',
    blockNumber: 20412553,
    removed: false,
    address: '0x6175f5f3F61C56Edd56cbfA3Fa78605E4b68F16d',
    data: '0x',
    topics: [
      '0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef',
      '0x0000000000000000000000000000000000000000000000000000000000000000',
      '0x00000000000000000000000097e434e07a93feeff7a28f3da0b6783d756fee4e',
      '0x0000000000000000000000000000000000000000000000000000000000000002'
    ],
    index: 0,
    transactionIndex: 1
  },
  Log {
    provider: JsonRpcProvider {},
    transactionHash: '0x3b8648f244b5cb8b6500f5595ba3763dc141b2325a5d08116c938dfbf16abc06',
    blockHash: '0xae1422877284f6417eb224968846fcc401b0811e806b180b34b4c9cb28f1cd68',
    blockNumber: 20412583,
    removed: false,
    address: '0xaCdcB15077de355f8A9265f87f2F3fF35FBa14A1',
    data: '0x',
    topics: [
      '0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef',
      '0x0000000000000000000000000000000000000000000000000000000000000000',
      '0x00000000000000000000000008f02ac1ece6f601b7547655dff7fd6223cdef3d',
      '0x00000000000000000000000000000000000000000000000000000000000000a5'
    ],
    index: 0,
    transactionIndex: 1
  },
  Log {
    provider: JsonRpcProvider {},
    transactionHash: '0x55167d03d909aa7a75c26f33972d4ec7827ce345f5f1c1583446c9769422e9a6',
    blockHash: '0xf2270bb7fa26107be6178eef127275cf88e559810f5a7a0ba8b48e8c2fd1520a',
    blockNumber: 20412586,
    removed: false,
    address: '0x1336739B05C7Ab8a526D40DCC0d04a826b5f8B03',
    data: '0x00000000000000000000000000000000000000000000000d480e6f0042a3c401',
    topics: [
      '0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef',
      '0x0000000000000000000000000000000000000000000000000000000000000000',
      '0x000000000000000000000000ac918f7a4c7f1228b8612b6cabc15cfc0702e6f5'
    ],
    index: 1,
    transactionIndex: 1
  },
  Log {
    provider: JsonRpcProvider {},
    transactionHash: '0x55167d03d909aa7a75c26f33972d4ec7827ce345f5f1c1583446c9769422e9a6',
    blockHash: '0xf2270bb7fa26107be6178eef127275cf88e559810f5a7a0ba8b48e8c2fd1520a',
    blockNumber: 20412586,
    removed: false,
    address: '0xaCdcB15077de355f8A9265f87f2F3fF35FBa14A1',
    data: '0x',
    topics: [
      '0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef',
      '0x00000000000000000000000008f02ac1ece6f601b7547655dff7fd6223cdef3d',
      '0x000000000000000000000000ac918f7a4c7f1228b8612b6cabc15cfc0702e6f5',
      '0x00000000000000000000000000000000000000000000000000000000000000a5'
    ],
    index: 5,
    transactionIndex: 1
  }
]

[sahfd4eiugf]

I'm still having a similar issue with v6.9.2.
Tried with and without filters, still no way to get any logs.
This is from hardhat console on localhost:

eth_getLogs

Errors encountered in param 0: Invalid value "0x01210bdc" supplied to : RpcFilterRequest/fromBlock: (QUANTITY | "earliest" | "latest" | "pending" | "safe" | "finalized") | undefined/0: QUANTITY, Invalid value "0x01210bdc" supplied to : RpcFilterRequest/fromBlock: (QUANTITY | "earliest" | "latest" | "pending" | "safe" | "finalized") | undefined/1: "earliest" | "latest" | "pending" | "safe" | "finalized"

[bodrovis]

In fact, I'm observing a similar thing with the latest Ethers. I've tried connecting to the contract via Typechain's factory or directly via new ethers.Contract and then using contract.on. Unfortunately, it results in the following error:

eth_getLogs

  Errors encountered in param 0: Invalid value "0x03" supplied to : RpcFilterRequest/fromBlock: (QUANTITY | "earliest" | "latest" | "pending" | "safe" | "finalized") | undefined/0: QUANTITY, Invalid value "0x03" supplied to : RpcFilterRequest/fromBlock: (QUANTITY | "earliest" | "latest" | "pending" | "safe" | "finalized") | undefined/1: "earliest" | "latest" | "pending" | "safe" | "finalized"

It does not matter if I pass a filter or just an event's name. Not sure what's going on but this error does not happen when running this code inside the Hardhat console (still, it happens when running tests on the local Hardhat node).

[ejsqhdl337]

You should check your Hardhat version. I have checked and this issue does not occur in Hardhat 2.23.3
I execute the “npx hardhat node” command and send an HTTP request using the curl command.

Here is the request and response:

// Request: 
curl -H "Content-Type: application/json" -X POST --data '{"jsonrpc":"2.0","method":"eth_getLogs","params":[{
      "fromBlock": "0x0233",
      "toBlock": "0x0234"
    }],"id":67}' 127.0.0.1:8545
// Response: 
{"jsonrpc":"2.0","id":67,"result":[]}

However, this issue does occur in Hardhat 2.20.1 (which is used for Hardhat-trace). Here is the request and response:

// Request:
curl -H "Content-Type: application/json" -X POST --data '{"jsonrpc":"2.0","method":"eth_getLogs","params":[{
      "fromBlock": "0x0233",
      "toBlock": "0x0234"
    }],"id":67}' 127.0.0.1:8545
// Response:
{"jsonrpc":"2.0","id":67,"error":{"code":-32602,"message":"Errors encountered in param 0: Invalid value \"0x0233\" supplied to : RpcFilterRequest/fromBlock: (QUANTITY | \"earliest\" | \"latest\" | \"pending\" | \"safe\" | \"finalized\") | undefined/0: QUANTITY, Invalid value \"0x0233\" supplied to : RpcFilterRequest/fromBlock: ...

I believe the additional zero in front of the hexadecimal value is the problem. It works fine with Hardhat 2.20.1 when the zero is removed. Here is the request and response:

// Request: 
curl -H "Content-Type: application/json" -X POST --data '{"jsonrpc":"2.0","method":"eth_getLogs","params":[{
      "fromBlock": "0x233", 
      "toBlock": "0x234" 
    }],"id":67}' 127.0.0.1:8545
// Response: 
{"jsonrpc":"2.0","id":67,"result":[]}

[ricmoo]

A leading 0 is definitely an error. The ethers function toQuantity will correct this.

[ejsqhdl337]

@ricmoo
Firstly, thank you for your prompt response. However, I recently encountered an issue while using contract.on. It appears that there is no way to access the toQuantity function in this scenario, as PollingEventSubscriber calls getLogs internally. Could you propose any alternative solutions? For your reference, I am currently using Hardhat 2.23.3 for frontend development and 2.20.1 for contract development due to this issue.