[CLI] Command line to delete files on a repo

[Wauplin]

At the moment it's not possible to delete remote files from the command line except using the huggingface-cli upload (...) --delete="*" command. But this one requires to upload while deleting.

Other feature request: CLI command to move files inside a repo.

We have everything needed in HfApi, it's just a matter of implementing the CLI.

Requested by @ArthurZucker "feature request for clumsy people" 😄

[OlivierKessler01]

Hi @Wauplin :)

Is that something I could take as a first contribution ?

I see we have two related functions in the HfApi, namely delete_file and delete_folder. Should we rather have a single or two commands ? In the former, should we use a similar API to upload --delete="*" and use a glob-type parameter ?

[Wauplin]

Hi @OlivierKessler01, thanks for proposing your help on this issue :)

Agree with you it makes sense to create a single command. I would maybe call it huggingface-cli repo-files delete <repo_id> <file> (and after that huggingface-cli repo-files move). Something like this:

# delete all
huggingface-cli repo-files <repo_id> delete *

# delete single file
huggingface-cli repo-files <repo_id> delete file.txt

# delete single folder
huggingface-cli repo-files <repo_id> delete folder/

# delete multiple
huggingface-cli repo-files <repo_id> delete file.txt folder/ file2.txt

# delete multiple patterns
huggingface-cli repo-files <repo_id> delete file.txt *.json folder/*.parquet

# delete from different revision / repo-type
huggingface-cli repo-files <repo_id> delete file.txt --revision=... --repo-type=dataset

What do you think?

EDIT: updated the snippet above with new format based on offline discussion with @julien-c

[OlivierKessler01]

Hi @Wauplin thank you for the thorough answer :)

I'll be working on this next week.

[Wauplin]

Thanks! Let me know if you have any question 🤗

[OlivierKessler01]

Hi @Wauplin I don't know how you set-up your notifications, if mentionning the issue in a PR suffices or not, but check this out :) #2280