Skip to content

Issues: huggingface/accelerate

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

103 Open 1,300 Closed
103 Open 1,300 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

save_state removes shared weights but load_state cannot load properly
#2807 opened May 27, 2024 by MiladInk
2 of 4 tasks
2
pdb like breakpoint Multiprocess Debugging with Accelerator
#2803 opened May 26, 2024 by ermu2001
1
Accelerateor .prepare() doubles vRAM usage
#2802 opened May 25, 2024 by marvingabler
2 of 4 tasks
5
Error with Deepspeed and dataloader_drop_last=True when batch size doesn't divide evenly
#2801 opened May 25, 2024 by mrbesher
2 of 4 tasks
RuntimeError: Expected is_sm80 || is_sm90 to be true, but got false.
#2799 opened May 23, 2024 by mostafamdy
4 tasks
7
Saving deepspeed ZERO-3 finetuned model fails sometimes.
#2797 opened May 23, 2024 by xuanyaoming
2 of 4 tasks
2
Loading the model with a higher context length
#2793 opened May 21, 2024 by Mugariya
1
replacing torch.utils.checkpoint with deepspeed.runtime.activation_checkpointing.checkpointing does not work
#2792 opened May 20, 2024 by vkaul11
2 of 4 tasks
2
GPU Memory Imbalance and OOM Errors During Training
#2789 opened May 17, 2024 by DONGRYEOLLEE1
2 of 4 tasks
10
[DeepSpeed] Asking for feedback when training with zero2 with accelerate and diffusers
#2787 opened May 16, 2024 by sayakpaul
2
AcceleratorState object has no attribute distributed_type.
#2786 opened May 16, 2024 by evelinamorim
2 of 4 tasks
2
Script hangs on .gather_for_metrics()
#2785 opened May 15, 2024 by priyammaz
2 of 4 tasks
4
Unable to launch DeepSpeed multinode training with a heterogenous mix of # devices per node.
#2780 opened May 14, 2024 by iantbutler01
2 of 4 tasks
5
Unable to load mistralai/Mixtral-8x7B-Instruct-v0.1 using mps
#2778 opened May 14, 2024 by chimezie
2 of 4 tasks
5
accelerate test does not work when using 3 GPUs
#2769 opened May 13, 2024 by Trojaner
2 of 4 tasks
Accelerate FSDP RuntimeError: Tensors of the same index must be on the same device and the same dtype
#2764 opened May 10, 2024 by yaswanthchittepu
Accelerate 0.30.0 Breaks FSDP QLora
#2761 opened May 10, 2024 by mallorbc
2 of 4 tasks
5
Cuda Out of memory while loading PEFT weights using accelerate on multi gpu
#2760 opened May 10, 2024 by sidtandon2014
2 of 4 tasks
How to specify the backend of Trainer
#2759 opened May 10, 2024 by Orion-Zheng
2 of 4 tasks
Performance on single GPU is much better than on Multi-GPUs
#2754 opened May 8, 2024 by baicenxiao
3 of 4 tasks
3
PicklingError: Can't pickle <function Embedding.forward at XXXXXXX> it's not the same object as torch.nn.modules.sparse.Embedding.forward
#2749 opened May 7, 2024 by arpit2665
1 of 4 tasks
5
Does Accelerate support tensor parallelism?
#2746 opened May 6, 2024 by Saigut
4-bit quantization cannot load weights to meta device for bias terms of the linear layer: NotImplementedError: Cannot copy out of meta tensor; no data!
#2742 opened May 5, 2024 by MuhammedHasan
2 of 4 tasks
2
Multiple processes on CPUs
#2741 opened May 4, 2024 by lamthuy
Is it possible to checkpoint scalar value?
#2738 opened May 3, 2024 by Wongboo
ProTip! Exclude everything labeled bug with -label:bug.