Skip to content

Issues: TimDettmers/bitsandbytes

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

142 Open 810 Closed
142 Open 810 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

"You have a version of bitsandbytes that is not compatible with 4bit inference and training"
#1246 opened Jun 7, 2024 by entzyeung
6
ROCm and 8-bit quantization
#1245 opened Jun 6, 2024 by DavideRossi
NotImplementedError: igemmlt not available (probably built with NO_CUBLASLT)
#1242 opened Jun 5, 2024 by stevenmanton
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument mat2 in method wrapper_CUDA_mm)
#1237 opened Jun 3, 2024 by kevalshah90
2
load_in_8bit hangs on ROCm
#1236 opened Jun 1, 2024 by DavideRossi
3
out kwarg in matmul_4bit() is not working
#1235 opened Jun 1, 2024 by chenqianfzh
2
OSError: libcusparse.so.11: cannot open shared object file: No such file or directory CUDA Setup failed despite CUDA being available.
#1234 opened May 31, 2024 by Aashi779
Is it possible to enable fused op F.gemv_4bit in F.gemv_4bit backward?
#1233 opened May 31, 2024 by jiqing-feng
1
"Only Tensors of floating point and complex dtype can require gradients", on FSDP, Accelerate, quatization
#1232 opened May 30, 2024 by artkpv
1
8bit CAME optimizer
#1229 opened May 29, 2024 by betterftr
Request for AdamW8bit support on CPU (would help TorchTune) cross-platform INTEL integration
#1226 opened May 28, 2024 by sanchitintel
@Titus-von-Koeller
5
Error invalid device ordinal at line 359 in file /opt/bitsandbytes/csrc/pythonInterface.c
#1225 opened May 28, 2024 by shahizat
Exact version match required between the system and PyTorch CUDA libraries for the compilation to succeed
#1221 opened May 25, 2024 by mirekphd
1
please provide python whel package in nvidia jetson agx orin (aarch64 + cuda)
#1218 opened May 24, 2024 by WangFengtu1996
1
Error in Windows
#1217 opened May 22, 2024 by jeetendraabvv
2
RuntimeError: Something when wrong when trying to find file. Maybe you do not have a linux system?
#1214 opened May 20, 2024 by fantasy-fish
1
ImportError: Using bitsandbytes 8-bit quantization requires Accelerate: pip install accelerate and the latest version of bitsandbytes: pip install -i https://pypi.org/simple/ bitsandbytes
#1213 opened May 18, 2024 by AnandUgale
AttributeError: 'NoneType' object has no attribute 'cquantize_blockwise_fp16_nf4'
#1210 opened May 13, 2024 by wissamee
5
AnimateDiff SDXL won't run
#1209 opened May 13, 2024 by idesign2018
undefined symbol: cdequantize_blockwise_fp32
#1208 opened May 12, 2024 by Littleiii
1
problem with loading my finetuned Llama2 model - type object 'Params4bit' has no attribute 'from_prequantized'
#1205 opened May 9, 2024 by lujain89
3
RuntimeError: CUDA Setup failed despite GPU being available. Please run the following command to get more information:
#1204 opened May 9, 2024 by Worromots
3
Mistral-v0.1 nf4 is not quantized into 4bit
#1203 opened May 9, 2024 by LameloBally
1
AttributeError: 'NoneType' object has no attribute 'split' CUDA Setup failed despite CUDA being available.
#1202 opened May 7, 2024 by GoDJr
PicklingError: Can't pickle <function Embedding.forward at XXXXXXX> it's not the same object as torch.nn.modules.sparse.Embedding.forward
#1201 opened May 7, 2024 by arpit2665
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.