Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Girder client always redownloads? #3334

Open
Erotemic opened this issue Feb 17, 2021 · 1 comment
Open

Girder client always redownloads? #3334

Erotemic opened this issue Feb 17, 2021 · 1 comment

Comments

@Erotemic
Copy link

Erotemic commented Feb 17, 2021

I just tested this following usage of girder-client:

girder-client --api-url https://data.kitware.com/api/v1 download 602586be2fa25629b9635f39
girder-client --api-url https://data.kitware.com/api/v1 download 602586be2fa25629b9635f39
girder-client --api-url https://data.kitware.com/api/v1 download 602586be2fa25629b9635f39

Each time it seemed to re-download the file.

It would be useful if there was an option to have it skip downloading the contents of any file path that already existed.

This is related to the use case where I'm managing data via DVC, which moves any managed files into a shared cache directory and then replaces the original files with symlinks and write protects them. The folder I'm managing was updated on girder and I want to download all the new files. However, its erroring because its trying to overwrite existing symlinks that DVC has write protected.

EDIT:
I would have made a PR to fix this, but there seems to be some magic happening with a cache, and I wanted to get feedback from core devs before I did anything. I might be asking a silly question.

@zachmullen
Copy link
Member

FYI @danlamanna

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants