Skip to content

Commit

Permalink
feat: Add multiprocessing and chunked downloading to transfer manager (
Browse files Browse the repository at this point in the history
…#1002)

* multiprocessing intitial commit

* added multiprocessing, fixed tests; tests for multiprocessing chunks pending

* unit tests for multiprocessing

* add system tests, fix off-by-one error detected by system tests

* lint

* exclude subprocess mocks from coverage

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* add deadline to system tests

* ban broken grpcio version

* Clarify docstring for threads param

* fix coverage issues and catch warning

* respond to feedback

* more feedback

---------

Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>
  • Loading branch information
andrewsg and gcf-owl-bot[bot] committed Mar 21, 2023
1 parent 085b3f8 commit e65316b
Show file tree
Hide file tree
Showing 5 changed files with 1,239 additions and 328 deletions.
5 changes: 5 additions & 0 deletions google/cloud/storage/client.py
Original file line number Diff line number Diff line change
Expand Up @@ -130,6 +130,11 @@ def __init__(
if project is _marker:
project = None

# Save the initial value of client_info and client_options before they
# are passed along, for use in __reduce__ defined elsewhere.
self._initial_client_info = client_info
self._initial_client_options = client_options

kw_args = {"client_info": client_info}

# `api_endpoint` should be only set by the user via `client_options`,
Expand Down

0 comments on commit e65316b

Please sign in to comment.