Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GCP Pubsub: cache topics #3241

Merged
merged 13 commits into from Dec 6, 2023
Merged

GCP Pubsub: cache topics #3241

merged 13 commits into from Dec 6, 2023

Conversation

sadath-12
Copy link
Contributor

@sadath-12 sadath-12 commented Nov 20, 2023

Description

Please explain the changes you've made

Now we don't call ensureTopic function unnecessarily , we cache it and continue if its called before

Issue reference

We strive to have all PR being opened based on an issue, where the problem or feature have been discussed prior to implementation.

Please reference the issue this PR will close: #2539

Checklist

Please make sure you've completed the relevant tasks for this PR, out of the following list:

  • Code compiles correctly
  • [] Created/updated tests
  • Extended the documentation / Created issue in the https://github.com/dapr/docs/ repo: dapr/docs#[issue number]

Signed-off-by: sadath-12 <sadathsadu2002@gmail.com>
@sadath-12 sadath-12 requested review from a team as code owners November 20, 2023 11:29
Signed-off-by: sadath-12 <sadathsadu2002@gmail.com>
common/component/azure/servicebus/client.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
common/component/azure/servicebus/client.go Outdated Show resolved Hide resolved
common/component/azure/servicebus/client.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
Signed-off-by: sadath-12 <sadathsadu2002@gmail.com>
@sadath-12
Copy link
Contributor Author

@ItalyPaleAle , Does the structure I used now fine ? supporting cache invalidation

Signed-off-by: sadath-12 <sadathsadu2002@gmail.com>
Copy link
Contributor

@JoshVanL JoshVanL left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add tests for this change.

pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
Signed-off-by: sadath-12 <sadathsadu2002@gmail.com>
Signed-off-by: sadath-12 <sadathsadu2002@gmail.com>
Signed-off-by: sadath-12 <sadathsadu2002@gmail.com>
pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Show resolved Hide resolved
common/component/azure/servicebus/client.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub_test.go Outdated Show resolved Hide resolved
sadath-12 and others added 3 commits November 29, 2023 18:01
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: syedsadath-17 <90619459+sadath-12@users.noreply.github.com>
Signed-off-by: sadath-12 <sadathsadu2002@gmail.com>
@berndverst
Copy link
Member

/ok-to-test

@dapr-bot
Copy link
Collaborator

Complete Build Matrix

The build status is currently not updated here. Please visit the action run below directly.

🔗 Link to Action run

Commit ref: 0faf8da

@dapr-bot

This comment was marked as outdated.

@dapr-bot

This comment was marked as outdated.

@ItalyPaleAle
Copy link
Contributor

/ok-to-test

@dapr-bot
Copy link
Collaborator

dapr-bot commented Dec 6, 2023

Complete Build Matrix

The build status is currently not updated here. Please visit the action run below directly.

🔗 Link to Action run

Commit ref: 8fb335c

@dapr-bot
Copy link
Collaborator

dapr-bot commented Dec 6, 2023

Components certification test

🔗 Link to Action run

Commit ref: 8fb335c

❌ Some certification tests failed

These tests failed:

  • pubsub.mqtt3

@dapr-bot
Copy link
Collaborator

dapr-bot commented Dec 6, 2023

Components conformance test

🔗 Link to Action run

Commit ref: 8fb335c

✅ All conformance tests passed

All tests have reported a successful status

Copy link
Contributor

@ItalyPaleAle ItalyPaleAle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just some nits

pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
pubsub/gcp/pubsub/pubsub.go Outdated Show resolved Hide resolved
@ItalyPaleAle ItalyPaleAle added this to the v1.13 milestone Dec 6, 2023
@ItalyPaleAle ItalyPaleAle changed the title perf: cache topic GCP Pubsub: cache topics Dec 6, 2023
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
ItalyPaleAle
ItalyPaleAle previously approved these changes Dec 6, 2023
@ItalyPaleAle
Copy link
Contributor

Thank you @sadath-12 !

Signed-off-by: sadath-12 <sadathsadu2002@gmail.com>
auto-merge was automatically disabled December 6, 2023 18:13

Head branch was pushed to by a user without write access

@ItalyPaleAle ItalyPaleAle merged commit 8dfa4b6 into dapr:main Dec 6, 2023
168 of 169 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

GCP PubSub resulting in excessive "Administrator operations per minute" on publish
5 participants