Is there currently any support for handling custom retries?

[jsungg]

Hi there. I tried looking in the docs to see if there was any support for explicitly setting number of retries for the Google Storage Client when writing to a cloud bucket using a CloudPath object. Specifically for my use case I am trying to read/write to a GCS bucket many times but I sometimes get a 503 PUT error from GCS, and our infra wants to retry more frequently than the default retry rate for gcs.

Seems like this problem happened before in this issue: #267

[pjbull]

It looks like the GCS retry functionality is per-method (rather than being set at a client level). We just took a PR with a similar structure for chunked downloads, so I could see implementing something like that. We could accept a ConditionalRetryPolicy object as a retry_policy kwarg for the GSClient and then use it to override the default if it is set.

The other option would be to implement it in your code using a library like tenacity wherever you have methods that use CloudPaths to do reading/writing.