TimDettmers/bitsandbytes issues and pull requests

#1152 - Not work for CUDA Version: 12.4

Issue - State: closed - Opened by Jebati 8 months ago - 7 comments

#1151 - NVIDIA TX2+jetpack 5+Ubuntu20.4：No matching distribution found for bitsandbytes==0.43.0

Issue - State: closed - Opened by qxpBlog 8 months ago - 3 comments

#1150 - Win10 + WSL2 + Ubuntu 20.04 + miniconda ：CUDA SETUP: CUDA detection failed!

Issue - State: closed - Opened by donaldjohn 8 months ago - 4 comments

#1149 - [docs] Install from source

Pull Request - State: closed - Opened by stevhliu 8 months ago - 4 comments

#1148 - [docs] FSDP-QLoRA

Pull Request - State: closed - Opened by stevhliu 8 months ago - 2 comments

#1147 - Tests: improve memory usage

Pull Request - State: closed - Opened by matthewdouglas 8 months ago - 2 comments

#1146 - Bump the minor-patch group with 4 updates

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#1145 - Bump the major group with 3 updates

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#1144 - CUDA Setup failed despite GPU being available. Please run the following command to get more information: python -m bitsandbytes

Issue - State: open - Opened by tejarao1156 8 months ago - 3 comments

#1143 - bitsandbytes library not getting installed and imported

Issue - State: open - Opened by dishhaa03 8 months ago

#1142 - Dequantizing int8 models to fp16

Issue - State: closed - Opened by raunaks13 8 months ago - 3 comments

#1141 - Quantized 4-bit models use more memory than 16-bit models

Issue - State: closed - Opened by LechengKong 8 months ago - 2 comments

#1140 - bitsandbytes searching cudaso only in /usr/local and does not support other paths

Issue - State: open - Opened by Parvez-Khan-1 8 months ago - 4 comments

#1139 - libstdc++.so.6 error

Issue - State: open - Opened by a-turcu 8 months ago - 10 comments

#1138 - Typo? I think you mean getitem()

Issue - State: open - Opened by BruceDai003 8 months ago

#1137 - Initial kernel changes to support GaLore

Pull Request - State: open - Opened by matthewdouglas 8 months ago - 3 comments

#1136 - Add CUDA 12.4 to docs/install helper

Pull Request - State: closed - Opened by matthewdouglas 8 months ago - 2 comments

#1135 - Update type annotations

Pull Request - State: open - Opened by matthewdouglas 8 months ago - 2 comments

#1134 - Fix diagnostics error within vscode on windows

Pull Request - State: closed - Opened by matthewdouglas 8 months ago - 1 comment

#1133 - Bump the minor-patch group with 4 updates

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 2 comments
Labels: dependencies

#1132 - Bump the major group with 3 updates

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 2 comments
Labels: dependencies

#1131 - Catch-all issue for WINDOWS installation problems (post your feedback on BNB v0.43.0 Windows support here)

Issue - State: open - Opened by Titus-von-Koeller 8 months ago - 5 comments
Labels: Windows

#1129 - BnB a disk space hog

Issue - State: closed - Opened by poedator 8 months ago - 9 comments

#1128 - Minor type/doc fixes

Pull Request - State: closed - Opened by akx 8 months ago - 6 comments

#1127 - Update .git-blame-ignore-revs

Pull Request - State: closed - Opened by akx 8 months ago - 1 comment

#1126 - Linux binaries should ship with appropriate RPATH

Issue - State: open - Opened by matthewdouglas 8 months ago

#1125 - [docs] Optimizer and integrations

Pull Request - State: closed - Opened by stevhliu 8 months ago - 1 comment

#1124 - A bit of confusion about the function kdequant_mm_int32_fp16().

Issue - State: open - Opened by ahqzy 8 months ago - 1 comment

#1123 - Loading directly 4bit quantized model

Issue - State: closed - Opened by ByungKwanLee 8 months ago - 1 comment

#1122 - Bump the minor-patch group with 4 updates

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 2 comments
Labels: dependencies

#1121 - Bump the major group with 3 updates

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 2 comments
Labels: dependencies

#1120 - Starting Lora SDXL training crashing vast.ai server with latest version.

Issue - State: closed - Opened by a-l-e-x-d-s-9 8 months ago - 1 comment

#1119 - Pytorch XLA/PJRT TPU support

Issue - State: open - Opened by opooladz 8 months ago

#1118 - LAMB missing in str2optimizer32bit?

Issue - State: closed - Opened by Xynonners 8 months ago - 2 comments

#1117 - ESM models quantization broken in current BNB

Issue - State: closed - Opened by ddofer 8 months ago - 1 comment

#1116 - Polish GitHub workflows

Pull Request - State: closed - Opened by akx 8 months ago - 2 comments

#1114 - add audit wheel to CI/CD for visibility of many_linux conformance

Pull Request - State: closed - Opened by Titus-von-Koeller 8 months ago - 2 comments

#1113 - Don't use std::thread on Linux

Pull Request - State: closed - Opened by akx 8 months ago - 4 comments

#1112 - bitsandbytes can't handle multiple path locations in LD_LIBRARY_PATH

Issue - State: open - Opened by GuardMoony 9 months ago - 2 comments

#1111 - Build: Expand CUDA Toolkit Matrix

Pull Request - State: closed - Opened by matthewdouglas 9 months ago - 2 comments

#1110 - Security concerns - Possibly unsafe repositories and libraries.

Issue - State: open - Opened by StavrosD 9 months ago - 1 comment

#1109 - fix typo on the script installation file

Pull Request - State: closed - Opened by mohammad-albarham 9 months ago - 3 comments

#1108 - fix an issue in the installtion, the file name should be install_cuda.sh

Issue - State: closed - Opened by mohammad-albarham 9 months ago - 1 comment

#1107 - Deduplicate helpers & fix lint issues from #1099

Pull Request - State: closed - Opened by akx 9 months ago - 3 comments

#1106 - Bitsandbytes cannot find CUDA libraries

Issue - State: closed - Opened by kevin-guimard-ext 9 months ago - 8 comments

#1104 - !python -m bitsandbytes returning CUDA Setup failed despite GPU being available.

Issue - State: closed - Opened by MustfainTariq 9 months ago - 5 comments

#1103 - Remove separate NO_CUBLASLT build.

Pull Request - State: open - Opened by matthewdouglas 9 months ago - 6 comments

#1102 - Bump the minor-patch group with 5 updates

Pull Request - State: closed - Opened by dependabot[bot] 9 months ago - 2 comments
Labels: dependencies

#1101 - Bump the major group with 2 updates

Pull Request - State: closed - Opened by dependabot[bot] 9 months ago - 2 comments
Labels: dependencies

#1100 - ImportError: Using `bitsandbytes` 8-bit quantization requires Accelerate: `pip install accelerate` and the latest version of bitsandbytes: `pip install -i https://pypi.org/simple/ bitsandbytes`

Issue - State: open - Opened by hrmgxuni 9 months ago - 15 comments

#1099 - adding whole Linear8bitLt/Linear4bit module save/load serialization

Pull Request - State: closed - Opened by rdyro 9 months ago - 5 comments

#1098 - Quantization load_in_8bit fails even though I have CUDA installed

Issue - State: closed - Opened by ShadowConYT 9 months ago

#1097 - 8 bit quantization and finetuning with lora is not working - receiving runtime error

Issue - State: open - Opened by solomonmanuelraj 9 months ago - 4 comments

#1096 - (ci) update apt repo before aarch64 build tools are installed

Pull Request - State: closed - Opened by matthewdouglas 9 months ago - 2 comments

#1093 - RuntimeError: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):

Issue - State: open - Opened by SumaiyaSultan2002 9 months ago - 5 comments

#1067 - [bug]: I've raised this in the LangChain repo, but their bot suggests it's an issue with the BitsAndBytes library. ' AssertionError Traceback (most recent call last)'

Issue - State: closed - Opened by KaifAhmad1 9 months ago - 1 comment

#1054 - Compiled BNB from source with cuda 11.8. 'Python -m bitsandbytes' says OK, Running any LLM emits spurious errors stating bnb/no cuda/GPU.

Issue - State: closed - Opened by whitesscott 9 months ago - 1 comment

GitHub / TimDettmers/bitsandbytes issues and pull requests