Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / lyogavin/airllm issues and pull requests

#201 - how to add support for bolt.new-any-llm

Issue - State: open - Opened by rahulmr 1 day ago

#200 - No module named 'sentencepiece' when following install instructions

Issue - State: open - Opened by drdozer 6 days ago - 1 comment

#199 - Integration with ollama server

Issue - State: open - Opened by drdozer 6 days ago

#198 - unsloth/Llama-3.1-Nemotron-70B-Instruct-bnb-4bit

Issue - State: open - Opened by werruww 7 days ago

#196 - support for https://huggingface.co/nvidia/Nemotron-4-340B-Instruct ?

Issue - State: open - Opened by mahald 13 days ago - 2 comments

#195 - Update README.md

Pull Request - State: open - Opened by moresearch 14 days ago

#194 - Is there any practical usecase of this project ?

Issue - State: open - Opened by Greatz08 15 days ago - 2 comments

#193 - Are multi-gpu supported?

Issue - State: open - Opened by wedobetter 16 days ago

#192 - it is run

Issue - State: open - Opened by werruww 16 days ago - 11 comments

#191 - errors

Issue - State: open - Opened by werruww 16 days ago - 1 comment

#190 - No supported model list

Issue - State: open - Opened by rudiservo 20 days ago

#188 - Support for Vision and Language models

Issue - State: open - Opened by versae about 1 month ago

#187 - airllm/utils.py:302 list index out of range

Issue - State: open - Opened by fvisconti about 1 month ago - 1 comment

#186 - taking about 40 minutes to generate one sentence，Is this speed normal?

Issue - State: open - Opened by kingdoom1 about 1 month ago - 2 comments

#184 - docs: update README.md

Pull Request - State: closed - Opened by eltociear about 2 months ago

#183 - How to alther the default saved path of downloaded LLM?

Issue - State: open - Opened by fengnex about 2 months ago - 1 comment

#182 - B70 need

Issue - State: open - Opened by ayttop about 2 months ago

#181 - How to set system prompt

Issue - State: open - Opened by OKHand-Zy 2 months ago - 1 comment

#180 - unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Issue - State: open - Opened by kendiyang 2 months ago - 2 comments

#179 - delete_original

Issue - State: open - Opened by ayttop 2 months ago - 4 comments

#177 - Compression does not work with MLX / Apple Silicon

Issue - State: open - Opened by sammcj 2 months ago

#176 - Fix pip not found when install in Jupyter

Pull Request - State: closed - Opened by chinkan 3 months ago

#175 - CUDA Out of memory RTX 4060TI 16G

Issue - State: open - Opened by 1272870698 3 months ago

#174 - Fixing mlx model load

Pull Request - State: closed - Opened by Razikus 3 months ago - 1 comment

#173 - added delete_original support for single modelfiles

Pull Request - State: closed - Opened by NavodPeiris 3 months ago

#168 - mlx Linear weight arrays were loaded with a dict of arrays

Issue - State: closed - Opened by shiwanlin 3 months ago - 2 comments

#166 - how to increase speed of inference

Issue - State: open - Opened by Tdrinker 3 months ago - 1 comment

#165 - Position Embedding with Seq > 512

Issue - State: open - Opened by Codys12 3 months ago - 1 comment

#164 - Data Parallel across multiple GPUs?

Issue - State: open - Opened by Codys12 3 months ago

#163 - name 'dynamically_import_QuantLinear' is not defined

Issue - State: open - Opened by gyyixr 3 months ago - 1 comment
Labels: enhancement, future work

#162 - layer_name 在使用前没有被定义

Issue - State: open - Opened by yjleo17 3 months ago - 4 comments

#158 - can not run llama 3.1 405B

Issue - State: open - Opened by taozhiyuai 3 months ago - 2 comments

#157 - docs: add Japanese README

Pull Request - State: closed - Opened by eltociear 4 months ago

#155 - Ramdisk

Issue - State: open - Opened by HennethAnnun 4 months ago

#154 - how to use Qwen2-72B-instuct

Issue - State: open - Opened by shenhai-ran 4 months ago - 2 comments

#153 - AssertionError: Torch not compiled with CUDA enabled

Issue - State: open - Opened by smartdawg 4 months ago - 1 comment

#152 - Some grammar suggested fixes in README.md

Pull Request - State: closed - Opened by TheTechOddBug 5 months ago

#151 - No english readme for rlhf

Issue - State: open - Opened by drawnwren 5 months ago

#150 - How?

Issue - State: closed - Opened by nonetrix 5 months ago - 1 comment

#146 - Add support for Mistral model inference

Issue - State: open - Opened by kunling-cxk 5 months ago

#143 - WeChat QR Code out of date

Issue - State: open - Opened by zixianwang2022 6 months ago

#142 - air_llm: README fix MacOS typo

Pull Request - State: closed - Opened by hiemal 6 months ago

#136 - Insuficient disk space

Issue - State: open - Opened by ulisesbussi 6 months ago - 3 comments

#135 - CPU ram offload

Issue - State: open - Opened by NicolasMejiaPetit 6 months ago

#134 - error in apple mac m3

Issue - State: open - Opened by mustangs0786 6 months ago - 5 comments

#133 - Does airllm support quantized gguf/gptq/awq models ?

Issue - State: open - Opened by robik72 7 months ago

#132 - COMPILED_WITH_CUDA error requires libcuda.so

Issue - State: open - Opened by nickums 7 months ago

#130 - 跑不通chatglm3，请大佬指教。

Issue - State: open - Opened by ZiQiangXie 7 months ago - 2 comments

#129 - segmentation fault python3 airllm2.py

Issue - State: open - Opened by taozhiyuai 7 months ago - 3 comments

#128 - to run llama3-70b,but fail to import. why?

Issue - State: closed - Opened by taozhiyuai 7 months ago

#127 - Any CoreML implementation plans?

Issue - State: open - Opened by Proryanator 7 months ago

#126 - Mac 'str' object has no attribute 'sequences

Issue - State: open - Opened by gr3enarr0w 7 months ago

#125 - "src" directory name is conflicted

Issue - State: open - Opened by Rambo55555 7 months ago

#123 - Running on Mac get traceback error

Issue - State: closed - Opened by gr3enarr0w 7 months ago - 3 comments

#122 - 通过Ollama下载了的模型，如何在airllm中直接使用呢

Issue - State: open - Opened by w1005444804 7 months ago - 2 comments

#121 - 请求支持llama3

Issue - State: closed - Opened by CrazyBoyM 7 months ago - 2 comments
Labels: enhancement

#119 - compression parameter on mac.dosent work.

Issue - State: open - Opened by dnvs 8 months ago

#118 - Support for OPT Architecture

Issue - State: open - Opened by varunlmxd 8 months ago

#117 - Is it possible to use AirLLM with a quantized input model?

Issue - State: open - Opened by Verdagon 8 months ago - 3 comments
Labels: enhancement

#115 - 似乎只能产生很少的字符

Issue - State: closed - Opened by andeyeluguo 9 months ago - 2 comments

#112 - Which 70B model does macOS support?

Issue - State: open - Opened by ruifengma 9 months ago

#111 - Generation takes forever

Issue - State: closed - Opened by Kira-Pgr 9 months ago - 4 comments

#109 - Optimize for consumer GPU, eg 11GB or 16GB

Issue - State: open - Opened by profintegra 9 months ago

#108 - AirLLM: Support for DirectML

Issue - State: open - Opened by vegax87 9 months ago - 1 comment

#107 - attn impl to sdpa...

Issue - State: open - Opened by saa1028 10 months ago - 4 comments

#106 - AMD gpu support

Issue - State: open - Opened by hanq-moreh 10 months ago - 2 comments

#105 - For me this model is extremely underperforming

Issue - State: open - Opened by SadafShafi 10 months ago - 1 comment

#104 - Macbook "Torch not compiled with CUDA enabled" Error

Issue - State: closed - Opened by LanLanBoom 10 months ago - 2 comments

#103 - 用airllm运行Yi-34B-chat模型，分层之后报这个错误

Issue - State: open - Opened by peiyanyang 10 months ago - 1 comment

#100 - AirLLMLlamaMlx fails to load model with mlx==0.0.7

Issue - State: open - Opened by jakule 10 months ago
Labels: bug

#99 - 关于对话模型是否能使用airllm

Issue - State: open - Opened by wzz981 10 months ago - 1 comment
Labels: question

#98 - how to infer on multiple gpus?

Issue - State: closed - Opened by yuxx0218 10 months ago - 1 comment
Labels: wontfix

#97 - Fix TYPO

Pull Request - State: closed - Opened by Naozumi520 10 months ago

#96 - Finetune 70B on 24GB 4090?

Issue - State: open - Opened by Naozumi520 10 months ago - 1 comment
Labels: future work

#95 - microsoft-phi2:max() arg is an empty sequence

Issue - State: open - Opened by zazaji 11 months ago - 1 comment
Labels: future work

#94 - ImportError: cannot import name AutoMode

Issue - State: closed - Opened by zazaji 11 months ago - 1 comment