Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

supervisor endpoint not respecting frontCoded indexSpec formatVersion #16257

Open
ColeAtCharter opened this issue Apr 10, 2024 · 0 comments
Open

Comments

@ColeAtCharter
Copy link

ColeAtCharter commented Apr 10, 2024

Affected Version

29.0.1

Description

The druid/indexer/v1/supervisor endpoint is not respecting the frontCoded indexSpec formatVersion for a kafka tuningConfig.

Affected value in kafka ingest spec: $.spec.tuningConfig.indexSpec.stringDictionaryEncoding.formatVersion

Steps to reproduce:

  1. update the supervisor spec by calling druid/indexer/v1/supervisor on the router with a valid kafka index spec which has an indexSpec like the following example:
{
          "bitmap": {
            "type": "roaring"
          },
          "dimensionCompression": "lz4",
          "metricCompression": "none",
          "longEncoding": "auto",
          "stringDictionaryEncoding": {
            "type": "frontCoded",
            "formatVersion": 1,
            "bucketSize": 8
          },
          "jsonCompression": "lz4"
}
  1. Validate the running supervisor spec. Use the unified console to navigate to the supervisors page, and retrieve the kafka index spec that was sent in the prior step. The expected value should have the indexSpec specified in the prior step. The actual, observed behavior is that the indexSpec may not match. For example, the stringDictionaryEncoding formatVersion may be 0 instead of 1.

References

@ColeAtCharter ColeAtCharter changed the title supervisor endpoint not respecting frontCoded indexSpec version supervisor endpoint not respecting frontCoded indexSpec formatVersion Apr 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant