Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor(bigquery/storage/managedwriter): add custom client options #7490

Merged
merged 3 commits into from
Feb 27, 2023

Conversation

shollyman
Copy link
Contributor

@shollyman shollyman commented Feb 23, 2023

This PR revisits the expected behavior for config knobs in the client. Previously, all configuration was done when instantiating a writer (aka a ManagedStream). There are some chicken-and-egg problems related to multiplex settings, as connection options are decoupled from individual writers.

This PR adds the following unexported custom client options (but does not yet use them for anything):

  • enableMultiplex
  • defaultInflightRequests
  • defaultInflightBytes
  • defaultAppendRowsCallOption

This PR also removes the still-unexported enableMultiplex from the set of defined WriterOption options which can be passed when instantiating individual writes.

Additionally, this refactor includes a correctness fix for the traceID option that was causing the traceID to duplicate the initial token.

Towards: #7103

This PR revisits the expected behavior for config knobs in the client.
Previously, all configuration was done when instantiating a writer (aka
a ManagedStream).  There are some chicken-and-egg problems related to
multiplex settings, as connection options are decoupled from individual
writers.

This PR adds the following unexported custom client options (but does
not yet use them for anything):

* enableMultiplex
* defaultInflightRequests
* defaultInflightBytes
* defaultAppendRowsCallOption

This PR also removes the still-unexported enableMultiplex from
the set of defined WriterOption options which can be passed when
instantiating individual writes.

Towards: googleapis#7103
@shollyman shollyman requested a review from a team February 23, 2023 23:22
@shollyman shollyman requested a review from a team as a code owner February 23, 2023 23:22
@product-auto-label product-auto-label bot added size: m Pull request size is medium. api: bigquery Issues related to the BigQuery API. labels Feb 23, 2023
@shollyman shollyman requested review from alvarowolfx and codyoss and removed request for chalmerlowe February 23, 2023 23:22
@shollyman
Copy link
Contributor Author

build failure is unrelated, something about documentai samples appears be having issues?

@shollyman shollyman added the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Feb 24, 2023
@kokoro-team kokoro-team removed the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Feb 24, 2023
@shollyman shollyman merged commit f425a60 into googleapis:main Feb 27, 2023
@shollyman shollyman deleted the custom-clientoption branch February 27, 2023 17:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the BigQuery API. size: m Pull request size is medium.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants