Getting tcp-line-server scheduling disconnect during ingestion

[Sumit1697]

To reproduce

Try to connect to a websocket it will have around 10000-12000 data per seconds with different segments and token
Use QuestDb.ingress to insert into the db

QuestDB version:

7.3.10

OS, in case of Docker specify Docker and the Host OS:

Windows 10

File System, in case of Docker specify Host File System:

null

Full Name:

Sumit Santra

Affiliation:

Withheld

Have you followed Linux, MacOs kernel configuration steps to increase Maximum open files and Maximum virtual memory areas limit?

• Yes, I have

Additional context

Hi i'm trying to insert data using python ILP but at random times it gives me this error tcp-line-server scheduling disconnect here are the schedule disconnection and auto connect logs:

2024-04-05T09:37:45.142224Z I i.q.c.p.WriterPool << [table=`tickdata~5`, thread=35]
2024-04-05T09:37:45.635152Z I i.q.c.w.WalWriter committed data block [wal=d:\qdbroot\db\tickdata~5\wal13799\10, segmentTxn=96, seqTxn=2632316, rowLo=120504, roHi=122857, minTimestamp=2024-04-05T15:07:48.000000Z, maxTimestamp=2024-04-05T15:07:49.000000Z]
2024-04-05T09:37:45.640654Z I i.q.c.p.WriterPool >> [table=`tickdata~5`, thread=35]
2024-04-05T09:37:45.641080Z I i.q.c.TableWriter processing WAL [path=d:\qdbroot\db\tickdata~5\wal13799\10, roLo=120504, roHi=122857, seqTxn=2632316, tsMin=2024-04-05T15:07:48.000000Z, tsMax=2024-04-05T15:07:49.000000Z, commitToTimestamp=294247-01-10T04:00:54.775807Z]
2024-04-05T09:37:45.641394Z I i.q.c.TableWriter o3 partition task [table=tickdata, partitionIsReadOnly=false, srcOooBatchRowSize=2353, srcOooLo=120504, srcOooHi=122856, srcOooMax=122857, o3RowCount=2353, o3LagRowCount=0, srcDataMax=25867, o3TimestampMin=2024-04-05T15:07:48.000000Z, o3Timestamp=2024-04-05T15:07:48.000000Z, o3TimestampMax=2024-04-05T15:07:49.000000Z, partitionTimestamp=2024-04-05T15:07:32.000001Z, partitionIndex=100, newPartitionSize=28220, maxTimestamp=2024-04-05T15:07:48.000000Z, last=true, append=true, pCount=1, flattenTimestamp=false, memUsed=16381454402]
2024-04-05T09:37:45.641902Z I i.q.c.w.ApplyWal2TableJob job finished [table=tickdata~5, seqTxn=2632316, transactions=1, rows=2353, time=0ms, rate=2552060rows/s, physicalWrittenRowsMultiplier=1.0]
2024-04-05T09:37:45.641952Z I i.q.c.p.WriterPool << [table=`tickdata~5`, thread=35]
2024-04-05T09:37:46.334966Z I i.q.c.w.WalWriter committed data block [wal=d:\qdbroot\db\tickdata~5\wal13799\10, segmentTxn=97, seqTxn=2632317, rowLo=122857, roHi=123107, minTimestamp=2024-04-05T15:07:49.000000Z, maxTimestamp=2024-04-05T15:07:49.000000Z]
2024-04-05T09:37:46.335028Z I i.q.c.l.t.TableUpdateDetails closing table writer [tableName=tickdata]
2024-04-05T09:37:46.335034Z I i.q.c.l.t.TableUpdateDetails closing table parsers [tableName=tickdata]
2024-04-05T09:37:46.335497Z I i.q.c.p.WriterPool >> [table=`tickdata~5`, thread=34]
2024-04-05T09:37:46.336377Z I i.q.c.TableWriter processing WAL [path=d:\qdbroot\db\tickdata~5\wal13799\10, roLo=122857, roHi=123107, seqTxn=2632317, tsMin=2024-04-05T15:07:49.000000Z, tsMax=2024-04-05T15:07:49.000000Z, commitToTimestamp=294247-01-10T04:00:54.775807Z]
2024-04-05T09:37:46.337098Z I i.q.c.TableWriter o3 partition task [table=tickdata, partitionIsReadOnly=false, srcOooBatchRowSize=250, srcOooLo=122857, srcOooHi=123106, srcOooMax=123107, o3RowCount=250, o3LagRowCount=0, srcDataMax=28220, o3TimestampMin=2024-04-05T15:07:49.000000Z, o3Timestamp=2024-04-05T15:07:49.000000Z, o3TimestampMax=2024-04-05T15:07:49.000000Z, partitionTimestamp=2024-04-05T15:07:32.000001Z, partitionIndex=100, newPartitionSize=28470, maxTimestamp=2024-04-05T15:07:49.000000Z, last=true, append=true, pCount=1, flattenTimestamp=false, memUsed=16381476514]
2024-04-05T09:37:46.337719Z I i.q.c.w.ApplyWal2TableJob job finished [table=tickdata~5, seqTxn=2632317, transactions=1, rows=250, time=1ms, rate=160771rows/s, physicalWrittenRowsMultiplier=1.0]
2024-04-05T09:37:46.337791Z I i.q.c.p.WriterPool << [table=`tickdata~5`, thread=34]
2024-04-05T09:37:46.414767Z I tcp-line-server scheduling disconnect [fd=3276, reason=0]
2024-04-05T09:37:46.414795Z I tcp-line-server disconnected [ip=127.0.0.1, fd=3276, src=queue]
2024-04-05T09:37:46.414876Z I i.q.c.l.t.TableUpdateDetails closing table writer [tableName=tickdata]
2024-04-05T09:37:46.414881Z I i.q.c.l.t.TableUpdateDetails closing table parsers [tableName=tickdata]
2024-04-05T09:37:46.415685Z I i.q.c.w.WalWriter committed data block [wal=d:\qdbroot\db\tickdata~5\wal13799\10, segmentTxn=98, seqTxn=2632318, rowLo=123107, roHi=123232, minTimestamp=2024-04-05T15:07:49.000000Z, maxTimestamp=2024-04-05T15:07:49.000000Z]
2024-04-05T09:37:46.417714Z I i.q.c.p.WriterPool >> [table=`tickdata~5`, thread=33]
2024-04-05T09:37:46.418145Z I i.q.c.TableWriter processing WAL [path=d:\qdbroot\db\tickdata~5\wal13799\10, roLo=123107, roHi=123232, seqTxn=2632318, tsMin=2024-04-05T15:07:49.000000Z, tsMax=2024-04-05T15:07:49.000000Z, commitToTimestamp=294247-01-10T04:00:54.775807Z]
2024-04-05T09:37:46.418446Z I i.q.c.TableWriter o3 partition task [table=tickdata, partitionIsReadOnly=false, srcOooBatchRowSize=125, srcOooLo=123107, srcOooHi=123231, srcOooMax=123232, o3RowCount=125, o3LagRowCount=0, srcDataMax=28470, o3TimestampMin=2024-04-05T15:07:49.000000Z, o3Timestamp=2024-04-05T15:07:49.000000Z, o3TimestampMax=2024-04-05T15:07:49.000000Z, partitionTimestamp=2024-04-05T15:07:32.000001Z, partitionIndex=100, newPartitionSize=28595, maxTimestamp=2024-04-05T15:07:49.000000Z, last=true, append=true, pCount=1, flattenTimestamp=false, memUsed=16380864778]
2024-04-05T09:37:46.418785Z I i.q.c.w.ApplyWal2TableJob job finished [table=tickdata~5, seqTxn=2632318, transactions=1, rows=125, time=0ms, rate=170068rows/s, physicalWrittenRowsMultiplier=1.0]
2024-04-05T09:37:46.418847Z I i.q.c.p.WriterPool << [table=`tickdata~5`, thread=33]
2024-04-05T09:37:47.570748Z I tcp-line-server connected [ip=127.0.0.1, fd=3884]
2024-04-05T09:37:48.425960Z I i.q.c.w.WalWriter committed data block [wal=d:\qdbroot\db\tickdata~5\wal13799\10, segmentTxn=99, seqTxn=2632319, rowLo=123232, roHi=125382, minTimestamp=2024-04-05T15:07:51.000000Z, maxTimestamp=2024-04-05T15:07:51.000000Z]
2024-04-05T09:37:48.426281Z I i.q.c.p.WriterPool >> [table=`tickdata~5`, thread=34]
2024-04-05T09:37:48.427362Z I i.q.c.TableWriter processing WAL [path=d:\qdbroot\db\tickdata~5\wal13799\10, roLo=123232, roHi=125382, seqTxn=2632319, tsMin=2024-04-05T15:07:51.000000Z, tsMax=2024-04-05T15:07:51.000000Z, commitToTimestamp=294247-01-10T04:00:54.775807Z]
2024-04-05T09:37:48.428275Z I i.q.c.TableWriter o3 partition task [table=tickdata, partitionIsReadOnly=false, srcOooBatchRowSize=2150, srcOooLo=123232, srcOooHi=125381, srcOooMax=125382, o3RowCount=2150, o3LagRowCount=0, srcDataMax=28595, o3TimestampMin=2024-04-05T15:07:51.000000Z, o3Timestamp=2024-04-05T15:07:51.000000Z, o3TimestampMax=2024-04-05T15:07:51.000000Z, partitionTimestamp=2024-04-05T15:07:32.000001Z, partitionIndex=100, newPartitionSize=30745, maxTimestamp=2024-04-05T15:07:49.000000Z, last=true, append=true, pCount=1, flattenTimestamp=false, memUsed=16381087114]
2024-04-05T09:37:48.429530Z I i.q.c.w.ApplyWal2TableJob job finished [table=tickdata~5, seqTxn=2632319, transactions=1, rows=2150, time=2ms, rate=879345rows/s, physicalWrittenRowsMultiplier=1.0]
2024-04-05T09:37:48.429664Z I i.q.c.p.WriterPool << [table=`tickdata~5`, thread=34]
2024-04-05T09:37:48.846276Z I i.q.c.w.WalWriter committed data block [wal=d:\qdbroot\db\tickdata~5\wal13799\10, segmentTxn=100, seqTxn=2632320, rowLo=125382, roHi=126861, minTimestamp=2024-04-05T15:07:51.000000Z, maxTimestamp=2024-04-05T15:07:52.000000Z]
2024-04-05T09:37:48.848302Z I i.q.c.p.WriterPool >> [table=`tickdata~5`, thread=35]
2024-04-05T09:37:48.848789Z I i.q.c.TableWriter processing WAL [path=d:\qdbroot\db\tickdata~5\wal13799\10, roLo=125382, roHi=126861, seqTxn=2632320, tsMin=2024-04-05T15:07:51.000000Z, tsMax=2024-04-05T15:07:52.000000Z, commitToTimestamp=294247-01-10T04:00:54.775807Z]
2024-04-05T09:37:48.849100Z I i.q.c.TableWriter o3 partition task [table=tickdata, partitionIsReadOnly=false, srcOooBatchRowSize=1479, srcOooLo=125382, srcOooHi=126860, srcOooMax=126861, o3RowCount=1479, o3LagRowCount=0, srcDataMax=30745, o3TimestampMin=2024-04-05T15:07:51.000000Z, o3Timestamp=2024-04-05T15:07:51.000000Z, o3TimestampMax=2024-04-05T15:07:52.000000Z, partitionTimestamp=2024-04-05T15:07:32.000001Z, partitionIndex=100, newPartitionSize=32224, maxTimestamp=2024-04-05T15:07:51.000000Z, last=true, append=true, pCount=1, flattenTimestamp=false, memUsed=16381217378]
2024-04-05T09:37:48.849588Z I i.q.c.w.ApplyWal2TableJob job finished [table=tickdata~5, seqTxn=2632320, transactions=1, rows=1479, time=0ms, rate=1646993rows/s, physicalWrittenRowsMultiplier=1.0]
2024-04-05T09:37:48.849638Z I i.q.c.p.WriterPool << [table=`tickdata~5`, thread=35]

tried to check the data as well as symbol but everything is looking fine

[ideoma]

I'd recommend get latest version and try using ILP with HTTP it will send a meaningful error back to the writing client

[Sumit1697]

Hi,

I've tried using HTTP, but I'm not receiving any meaningful errors. In fact, there are no errors; the connection is simply getting disconnected at random intervals.

[nwoolmer]

Hi @Sumit1697 ,

reason=0 can mean that the Sender was disposed without close() being called.

It should reconnect and send more data when prompted. If all your data is going in okay, then it should be fine.