Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUG: unable to upload a large amount of files through the UI #3403

Open
stchris opened this issue Oct 10, 2023 · 3 comments
Open

BUG: unable to upload a large amount of files through the UI #3403

stchris opened this issue Oct 10, 2023 · 3 comments
Labels
bug Things that should work, but don’t Moderate Issue that may require attention

Comments

@stchris
Copy link
Contributor

stchris commented Oct 10, 2023

Describe the bug
Uploading a large amount of files through the UI can make an Aleph installation freeze and stop processing.

To Reproduce
Steps to reproduce the behavior:

  1. Go to an investigation
  2. Click on 'Upload documents'
  3. Select a large amount of files (thousands)
  4. Aleph will choke and stop processing them.

Expected behavior
Aleph is either able to show and enforce a limit to the number of files being uploaded or it is able to queue the files so that they are processed correctly.

Aleph version
3.15.1

Screenshots

Additional context
The current workaround is to use alephclient

@stchris stchris added bug Things that should work, but don’t triage These issues need to be reviewed by the Aleph team labels Oct 10, 2023
@andresmrm
Copy link

Thanks for helping us with this issue, Chris!
Extra context can be found in #3383 .
"Uploading a folder with 8K files worked, but not another with 300K files"

@Rosencrantz Rosencrantz added Moderate Issue that may require attention and removed triage These issues need to be reviewed by the Aleph team labels Oct 24, 2023
@Rosencrantz
Copy link
Contributor

Options here:

  1. Document a limit (1,000 - 5,000?) files max, possibly size could have an impact.
  2. Try to fix the UI to handle larger file sets (harder, more time consuming).
  3. Limit uploads to single files at a time

@andresmrm
Copy link

andresmrm commented Oct 24, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Things that should work, but don’t Moderate Issue that may require attention
Projects
None yet
Development

No branches or pull requests

3 participants