Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / modeltc/llmc issues and pull requests

#180 - support custom data eval

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#179 - update vlm

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#178 - update discord link

Pull Request - State: closed - Opened by Harahan 3 months ago

#177 - update discord link

Pull Request - State: closed - Opened by Harahan 3 months ago

#176 - Discord link brroken

Issue - State: closed - Opened by TweedBeetle 3 months ago - 1 comment

#175 - How to Quantize with SpinQuant and Export to VLLM

Issue - State: closed - Opened by TweedBeetle 3 months ago - 6 comments

#174 - Support deepseek attn qunatization and recon auto clip

Pull Request - State: closed - Opened by gushiqiao 3 months ago

#173 - Fix bug

Pull Request - State: closed - Opened by llmc-reviewer 3 months ago

#172 - mistral model support quarot

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#171 - Fix bugs

Pull Request - State: closed - Opened by gushiqiao 3 months ago

#169 - support Mllama(llama3.2) and update vit

Pull Request - State: closed - Opened by SmudgedWings 3 months ago

#168 - support Mllama(llama3.2) and update vit

Pull Request - State: closed - Opened by SmudgedWings 3 months ago

#167 - update

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#166 - chatglm series model support.

Issue - State: closed - Opened by simplew2011 3 months ago - 1 comment

#165 - update readme

Pull Request - State: closed - Opened by Harahan 3 months ago

#164 - Update quant.py

Pull Request - State: closed - Opened by gushiqiao 3 months ago

#163 - Mixed-precision configuration not working with RTN?

Issue - State: closed - Opened by sasha-hailo 3 months ago - 6 comments

#162 - Update quant.py

Pull Request - State: closed - Opened by yhhhli 3 months ago - 1 comment

#161 - PPL results for AWQ is not correct?

Issue - State: closed - Opened by yc2367 3 months ago - 2 comments

#160 - Add Tessreaq method

Pull Request - State: closed - Opened by gushiqiao 3 months ago

#159 - update dockerfile

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#158 - fail to run awq on qwen2-7B

Issue - State: closed - Opened by Muuut 3 months ago - 2 comments

#157 - Add dockerfile

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#156 - fix collect_first_block_input

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#155 - support auto get padding side

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#154 - add try except for InternVL2

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#153 - update

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#152 - support padding mask when calib bs >= 1

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#151 - change some info to warning

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#150 - fix preprocess bug

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#149 - support padding mask for vlm

Pull Request - State: closed - Opened by helloyongyang 3 months ago

#148 - KV cache / post-RoPE rotation & quantization in QuaRot

Issue - State: closed - Opened by sasha-hailo 3 months ago - 5 comments

#147 - Dev spinquant

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#146 - Dev spinquant

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#145 - support padding mask for auto clip

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#144 - Fix vit calib data bug

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#143 - add config

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#142 - Dev2

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#141 - support padding mask

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#140 - Update mse quant

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#139 - fix bugs for rotary_emb

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#138 - Update float-quant settings

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#137 - update for mask preproc

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#136 - llmc可以支持smoothqaunt的w8a8在trt-llm后端推理吗？

Issue - State: closed - Opened by GuangyanZhang 4 months ago - 2 comments

#135 - Refine Float-quant

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#134 - add deepseekv2

Pull Request - State: closed - Opened by MercuryB1 4 months ago

#133 - vit support awq

Pull Request - State: closed - Opened by SmudgedWings 4 months ago

#132 - add qwen2 moe

Pull Request - State: closed - Opened by MercuryB1 4 months ago

#131 - aw

Pull Request - State: closed - Opened by SmudgedWings 4 months ago

#130 - add qwen2moe

Pull Request - State: closed - Opened by MercuryB1 4 months ago

#129 - Swap

Pull Request - State: closed - Opened by SmudgedWings 4 months ago

#128 - update readme

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#127 - update requirements

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#126 - remove assert in Quarot

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#125 - update for _TRANSFORMERS_LN_TYPES_

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#124 - moe mixtral

Pull Request - State: closed - Opened by MercuryB1 4 months ago

#123 - 可以用于部署在高通芯片吗?

Issue - State: closed - Opened by xieyi4650 4 months ago - 1 comment

#122 - vit naive quant

Pull Request - State: closed - Opened by SmudgedWings 4 months ago

#121 - fix bug for BaseDataset without init processor

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#119 - update

Pull Request - State: closed - Opened by SmudgedWings 4 months ago

#118 - update docker images

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#117 - update docker images

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#116 - Is awq_w_only.yml & awq_w4a16.yml use the same source code?

Issue - State: closed - Opened by LiMa-cas 4 months ago - 2 comments

#115 - Inference per layer mode has no support for Llama model

Issue - State: closed - Opened by ZeusXuan 4 months ago - 2 comments

#114 - Fix asym quant bug

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#113 - Fix fp-quant bug

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#112 - Update export_vllm.py

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#111 - Update __main__.py

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#110 - Fix utils.py

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#109 - Fix utils.py bug

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#108 - Update config files

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#107 - Support FP8 quant for vllm and sglang

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#106 - llava support img_txt datasets

Pull Request - State: closed - Opened by SmudgedWings 4 months ago

#105 - Update README.md

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#104 - add llama31-405b-quant to readme

Pull Request - State: closed - Opened by zhiwei-dong 4 months ago

#103 - Support Sglang

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#102 - Add docker

Pull Request - State: closed - Opened by helloyongyang 4 months ago

#101 - Fix doc bug

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#100 - Support MLC-LLM

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#99 - Support AutoAWQ

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#98 - Support AutoAWQ

Pull Request - State: closed - Opened by gushiqiao 4 months ago

#97 - failed to save quantizationed model

Issue - State: closed - Opened by LiMa-cas 4 months ago - 17 comments

#96 - remove benchmark

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#95 - update

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#94 - where is run_awq_llama.sh

Issue - State: closed - Opened by LiMa-cas 5 months ago - 1 comment

#93 - Sparsity update

Pull Request - State: closed - Opened by guanchenl 5 months ago - 2 comments

#92 - Possible Bug in QuaRot Implementation with remove_mean_from_embed()

Issue - State: closed - Opened by A-suozhang 5 months ago - 4 comments

#91 - Update README_zh.md

Pull Request - State: closed - Opened by Harahan 5 months ago

#90 - fix README

Pull Request - State: closed - Opened by Harahan 5 months ago

#89 - fix readme

Pull Request - State: closed - Opened by Harahan 5 months ago

#88 - Update README_ja.md

Pull Request - State: closed - Opened by Harahan 5 months ago

#87 - Update README_zh.md

Pull Request - State: closed - Opened by Harahan 5 months ago

#86 - Update README.md

Pull Request - State: closed - Opened by Harahan 5 months ago

#85 - Update README_zh.md

Pull Request - State: closed - Opened by Harahan 5 months ago

#84 - fix README

Pull Request - State: closed - Opened by Harahan 5 months ago

#83 - Update doc

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#82 - Update doc

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#81 - Fix doc bug

Pull Request - State: closed - Opened by gushiqiao 5 months ago