Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / SqueezeAILab/KVQuant issues and pull requests

#15 - Problems when reproducing the method on Qwen2-7b-instruct

Issue - State: open - Opened by jiangshimiao 2 months ago - 2 comments

#14 - How to reproduce the table 19 (kvquant vs kivi)

Issue - State: open - Opened by condy0919 3 months ago

#13 - Remove deprecated use of `ModelFilter`

Pull Request - State: open - Opened by Wauplin 3 months ago

#12 - Coupled Channel-wise Quantization

Issue - State: open - Opened by naston 5 months ago

#9 - CUDA error: an illegal memory access was encountered

Issue - State: open - Opened by CUHKSZzxy 7 months ago - 2 comments

#8 - Question about storage

Issue - State: open - Opened by mlxht990720 7 months ago

#5 - problem when reproduce experiment

Issue - State: closed - Opened by cat538 8 months ago - 1 comment

#4 - AttributeError: 'LlamaModel' object has no attribute 'split_gpus'

Issue - State: open - Opened by seeyourcell 9 months ago - 1 comment

#3 - Can this be done for other transformer based models?

Issue - State: closed - Opened by caroljoyv 9 months ago - 1 comment

#2 - reproduce the ablation results in Figure 1

Issue - State: closed - Opened by SherrySwift 9 months ago - 1 comment

#1 - PRE-ROPE quantization during inference

Issue - State: closed - Opened by minghaoBD 9 months ago - 1 comment