Skip to content

Issues: huggingface/accelerate

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

114 Open 1,280 Closed
114 Open 1,280 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

GPU Memory Imbalance and OOM Errors During Training
#2789 opened May 17, 2024 by DONGRYEOLLEE1
2 of 4 tasks
3
[DeepSpeed] Asking for feedback when training with zero2 with accelerate and diffusers
#2787 opened May 16, 2024 by sayakpaul
2
AcceleratorState object has no attribute distributed_type.
#2786 opened May 16, 2024 by evelinamorim
2 of 4 tasks
2
Script hangs on .gather_for_metrics()
#2785 opened May 15, 2024 by priyammaz
2 of 4 tasks
4
Unable to launch DeepSpeed multinode training with a heterogenous mix of # devices per node.
#2780 opened May 14, 2024 by iantbutler01
2 of 4 tasks
4
Unable to load mistralai/Mixtral-8x7B-Instruct-v0.1 using mps
#2778 opened May 14, 2024 by chimezie
2 of 4 tasks
5
Error while trying to fine-tune using FSDP on a TPU
#2775 opened May 14, 2024 by tengomucho
4 tasks
1
accelerate test does not work when using 3 GPUs
#2769 opened May 13, 2024 by Trojaner
2 of 4 tasks
Accelerate FSDP RuntimeError: Tensors of the same index must be on the same device and the same dtype
#2764 opened May 10, 2024 by yaswanthchittepu
Accelerate 0.30.0 Breaks FSDP QLora
#2761 opened May 10, 2024 by mallorbc
2 of 4 tasks
5
Cuda Out of memory while loading PEFT weights using accelerate on multi gpu
#2760 opened May 10, 2024 by sidtandon2014
2 of 4 tasks
How to specify the backend of Trainer
#2759 opened May 10, 2024 by Orion-Zheng
2 of 4 tasks
Performance on single GPU is much better than on Multi-GPUs
#2754 opened May 8, 2024 by baicenxiao
3 of 4 tasks
3
Duplicate elements in split_between_processes
#2750 opened May 7, 2024 by hkunzhe
4 tasks
1
4
PicklingError: Can't pickle <function Embedding.forward at XXXXXXX> it's not the same object as torch.nn.modules.sparse.Embedding.forward
#2749 opened May 7, 2024 by arpit2665
1 of 4 tasks
5
Does Accelerate support tensor parallelism?
#2746 opened May 6, 2024 by Saigut
4-bit quantization cannot load weights to meta device for bias terms of the linear layer: NotImplementedError: Cannot copy out of meta tensor; no data!
#2742 opened May 5, 2024 by MuhammedHasan
2 of 4 tasks
1
Multiple processes on CPUs
#2741 opened May 4, 2024 by lamthuy
Is it possible to checkpoint scalar value?
#2738 opened May 3, 2024 by Wongboo
Potential Bug with split_between_processes
#2736 opened May 2, 2024 by Vincent-Li-9701
1 of 4 tasks
[Feature Request] Allows registering custom trackers to internal tracker type registry enhancement New feature or request feature request Request for a new feature to be added to Accelerate
#2734 opened May 2, 2024 by luowyang
2
Loading the trained model for inference is very slow
#2727 opened Apr 30, 2024 by YamingZhang
You are trying to offload the whole model to the disk. Please use the disk_offload function instead.
#2726 opened Apr 30, 2024 by Moazzamnamal
2 of 4 tasks
3
Training with PEFT + Accelerate randomly gets stuck with DeepSpeed after the first epoch
#2724 opened Apr 29, 2024 by vikram71198
2
SIGKILL on save steps
#2722 opened Apr 29, 2024 by emillykkejensen
4 tasks
2
ProTip! Exclude everything labeled bug with -label:bug.