Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix pubsub metadata conflict #7421

Merged
merged 5 commits into from Jan 22, 2024

Conversation

artursouza
Copy link
Member

Description

Fix issue where pubsub event metadata can conflict with gRPC metadata and make the message undeliverable.

Issue reference

Please reference the issue this PR will close: #7413

Checklist

Please make sure you've completed the relevant tasks for this PR, out of the following list:

@artursouza artursouza requested review from a team as code owners January 20, 2024 21:28
@artursouza artursouza marked this pull request as draft January 20, 2024 21:29
@artursouza
Copy link
Member Author

This run proves that the E2E test changes repro the issue (using a custom contrib version that has Redis handling metadata): https://github.com/dapr/dapr/actions/runs/7596929989/job/20691187869

Signed-off-by: Artur Souza <asouza.pro@gmail.com>
Signed-off-by: Artur Souza <asouza.pro@gmail.com>
Signed-off-by: Artur Souza <asouza.pro@gmail.com>
Signed-off-by: Artur Souza <asouza.pro@gmail.com>
This reverts commit 20b60a0.

Signed-off-by: Artur Souza <asouza.pro@gmail.com>
@artursouza artursouza marked this pull request as ready for review January 22, 2024 15:49
@artursouza
Copy link
Member Author

PR is ready for review WITHOUT the Redis change. It means the E2E test will always pass, regardless of the bug being present or not because Redis just drops the metadata.

@artursouza
Copy link
Member Author

Once Redis has this feature in 1.14, the E2E test will do its intended purpose. I tested this with an override pointing to my contrib fork. So, the E2E test is confirmed to repro the issue once Redis handles metadata.

Copy link

codecov bot commented Jan 22, 2024

Codecov Report

Attention: 2 lines in your changes are missing coverage. Please review.

Comparison is base (53454d0) 62.34% compared to head (dba7cc7) 62.35%.

Files Patch % Lines
pkg/messaging/v1/util.go 66.66% 1 Missing and 1 partial ⚠️
Additional details and impacted files
@@           Coverage Diff           @@
##           master    #7421   +/-   ##
=======================================
  Coverage   62.34%   62.35%           
=======================================
  Files         240      240           
  Lines       22053    22058    +5     
=======================================
+ Hits        13750    13755    +5     
- Misses       7160     7161    +1     
+ Partials     1143     1142    -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@yaron2 yaron2 merged commit 3b7bc67 into dapr:master Jan 22, 2024
20 of 22 checks passed
artursouza added a commit to artursouza/dapr that referenced this pull request Feb 9, 2024
* Temporary override to have Redis to handle event metadata.

Signed-off-by: Artur Souza <asouza.pro@gmail.com>

* E2E test change to reproduce HTTP header conflict in pubsub.

Signed-off-by: Artur Souza <asouza.pro@gmail.com>

* E2E test for content-length conflict with gRPC subscriber.

Signed-off-by: Artur Souza <asouza.pro@gmail.com>

* Hotfix to avoid content-length header conflict in HTTP and gRPC.

Signed-off-by: Artur Souza <asouza.pro@gmail.com>

* Revert "Temporary override to have Redis to handle event metadata."

This reverts commit 20b60a0.

Signed-off-by: Artur Souza <asouza.pro@gmail.com>

---------

Signed-off-by: Artur Souza <asouza.pro@gmail.com>
yaron2 pushed a commit that referenced this pull request Feb 10, 2024
* Temporary override to have Redis to handle event metadata.



* E2E test change to reproduce HTTP header conflict in pubsub.



* E2E test for content-length conflict with gRPC subscriber.



* Hotfix to avoid content-length header conflict in HTTP and gRPC.



* Revert "Temporary override to have Redis to handle event metadata."

This reverts commit 20b60a0.



---------

Signed-off-by: Artur Souza <asouza.pro@gmail.com>
@JoshVanL JoshVanL added this to the v1.13 milestone Feb 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Some pubsub components can emit conflicting content-length header
3 participants