Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Zstd compression for gRPC #5092

Merged
merged 5 commits into from
Jan 12, 2023
Merged

Conversation

ssesha
Copy link
Contributor

@ssesha ssesha commented Jan 11, 2023

What this PR does:
Add zstd compression for grpc
Below output with zstd level BetterCompression as here

Screenshot 2023-01-11 at 3 08 20 PM

We see

Which issue(s) this PR fixes:
Fixes #5091

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

Signed-off-by: Sesha Sendhil <seshasendhil@gmail.com>
Signed-off-by: Sesha Sendhil <seshasendhil@gmail.com>
Signed-off-by: Sesha Sendhil <seshasendhil@gmail.com>
alanprot
alanprot previously approved these changes Jan 12, 2023
@alanprot alanprot dismissed their stale review January 12, 2023 01:13

Update Changelog

@alanprot
Copy link
Member

This looks good!

Can you update the changelog?

Signed-off-by: Sesha Sendhil <seshasendhil@gmail.com>
@ssesha ssesha requested a review from alanprot January 12, 2023 03:53
@ssesha
Copy link
Contributor Author

ssesha commented Jan 12, 2023

Thanks @alanprot . Have updated the changelog

@alanprot
Copy link
Member

LGTM

Copy link
Collaborator

@yeya24 yeya24 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the contribution!

CHANGELOG.md Outdated
@@ -11,6 +11,7 @@
* [ENHANCEMENT] Query Frontend: Log Vertical sharding information when `query_stats_enabled` is enabled. #5037
* [ENHANCEMENT] Ingester: The metadata APIs should honour `querier.query-ingesters-within` when `querier.query-store-for-labels-enabled` is true. #5027
* [ENHANCEMENT] Query Frontend: Skip instant query roundtripper if sharding is not applicable. #5062
* [ENHANCEMENT] Added zstd as an option for grpc compression #5092
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's call it FEATURE instead?

Copy link
Contributor Author

@ssesha ssesha Jan 12, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done @yeya24

Signed-off-by: Sesha Sendhil <seshasendhil@gmail.com>
@alanprot alanprot merged commit a684a3d into cortexproject:master Jan 12, 2023
@ssesha ssesha deleted the grpc_zstd branch January 12, 2023 08:24
alexqyle pushed a commit to alexqyle/cortex that referenced this pull request May 2, 2023
* add zstd compression to grpcclient

Signed-off-by: Sesha Sendhil <seshasendhil@gmail.com>

* fix use of deprecated ioutil pkg

Signed-off-by: Sesha Sendhil <seshasendhil@gmail.com>

* update docs

Signed-off-by: Sesha Sendhil <seshasendhil@gmail.com>

* update CHANGELOG

Signed-off-by: Sesha Sendhil <seshasendhil@gmail.com>

* mark as feature

Signed-off-by: Sesha Sendhil <seshasendhil@gmail.com>

Signed-off-by: Sesha Sendhil <seshasendhil@gmail.com>
Signed-off-by: Alex Le <leqiyue@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

support zstd compressor for grpc
3 participants