Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / turboderp/exllamav2 issues and pull requests

#23 - Add copilot server example

Pull Request - State: open - Opened by chenhunghan over 1 year ago - 9 comments

#22 - Fix Compiling with HIP on Older Pytorch Version

Pull Request - State: closed - Opened by leonxia1018 over 1 year ago - 6 comments

#22 - Fix Compiling with HIP on Older Pytorch Version

Pull Request - State: closed - Opened by leonxia1018 over 1 year ago - 6 comments

#21 - nvcc fatal : Unknown option '-generate-dependencies-with-compile'

Issue - State: closed - Opened by Hashflower over 1 year ago - 1 comment

#20 - convert.py - RuntimeError: CUDA error: invalid configuration argument

Issue - State: closed - Opened by Thireus over 1 year ago - 22 comments

#18 - Support cfg sampler?

Issue - State: closed - Opened by win10ogod over 1 year ago - 1 comment

#17 - Fix typo in README.md

Pull Request - State: closed - Opened by eltociear over 1 year ago - 1 comment

#16 - Support Baichuan2?

Issue - State: closed - Opened by lx0126z over 1 year ago - 2 comments

#15 - Gibbish Output from 4bit EXL2 quantization

Issue - State: closed - Opened by fgdfgfthgr-fox over 1 year ago - 9 comments

#14 - Big difference in output between exllama1_hf and exllama2_hf

Issue - State: closed - Opened by BadisG over 1 year ago - 12 comments

#12 - aws gpu compatibility

Issue - State: closed - Opened by gtkafka over 1 year ago - 1 comment

#11 - OOM while trying to convert a 70B model to 4.75/4.25 bits on a 4090

Issue - State: closed - Opened by Panchovix over 1 year ago - 4 comments

#9 - Generation never stops

Issue - State: closed - Opened by ortegaalfredo over 1 year ago - 21 comments

#8 - Compile fail on P100.

Issue - State: closed - Opened by SlimeSli over 1 year ago - 1 comment

#7 - Can we run a 34B model with just 12gb Vram

Issue - State: closed - Opened by Gyro0o over 1 year ago - 3 comments

#6 - Convert script fails

Issue - State: closed - Opened by epicfilemcnulty over 1 year ago - 10 comments

#5 - Fix compiling and running on ROCm HIP

Pull Request - State: closed - Opened by ardfork over 1 year ago - 3 comments

#4 - Cannot split from textgen?

Issue - State: closed - Opened by Ph0rk0z over 1 year ago - 3 comments

#3 - It's using 19gb of vram for a 2.65bit 13b model

Issue - State: closed - Opened by BadisG over 1 year ago - 4 comments

#2 - Lower bits per weight

Issue - State: closed - Opened by IgnacioFDM over 1 year ago - 17 comments

#1 - What do you think of omniquant?

Issue - State: closed - Opened by Ph0rk0z over 1 year ago - 1 comment