Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ksqldb on Confluent Cloud seems to inherit the upstream behavior for TS extraction (even if it should not) resulting in Null Pointer Exception #10124

Open
geogmg opened this issue Nov 22, 2023 · 0 comments

Comments

@geogmg
Copy link

geogmg commented Nov 22, 2023

Describe the bug
We are using ksqldb session windows for some use cases. We've noticed that any select * from table_name emit changes; query on cloud console was throwing a lot of null pointer exceptions in the processing log topic/stream.

{
  "LOGGER": "processing.transient_public_table_2_5927611079956313424.KsqlTopic.Source",
  "LEVEL": "ERROR",
  "TIME": 1700151893065,
  "MESSAGE": {
    "TYPE": 1,
    "DESERIALIZATIONERROR": null,
    "RECORDPROCESSINGERROR": {
      "ERRORMESSAGE": "Failed to extract timestamp from row",
      "RECORD": "key:[['6638392.2023-11-13T17:25:00.000+13:00']@1700151783904/1700151783904], value:null",
      "CAUSE": [
        "java.lang.NullPointerException"
      ]
    },
    "PRODUCTIONERROR": null,
    "SERIALIZATIONERROR": null,
    "KAFKASTREAMSTHREADERROR": null
  }
}

We've noticed that the mesage key corresponds to the null messages in the output topic, which are potentially populated by ksqldb to delete older/smaller sessions when two sessions are merged.

It seems to inherit the upstream behavior (even if it should not) to extract timestamp from a message attribute

To Reproduce
Steps to reproduce the behavior, include:

  1. Use Confluent Cloud.
  2. Create session windows which could create null messages in output topic to merge older/smaller sessions
  3. Execute select * from table_name emit changes; and observe processing logs

Expected behavior
No error logs in processing log topic/stream

Actual behaviour
RecordProcessingError > Null pointer exception in processing log topic/stream

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant