Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / modeltc/llmc issues and pull requests

#80 - Fix doc bug

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#79 - Fix doc bug

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#78 - Fix doc bug

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#77 - Update vllm.md

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#76 - Fix doc bug

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#75 - Update doc

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#74 - Update backend/best practice docs

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#73 - Wanda OOM to be fixed

Issue - State: closed - Opened by guanchenl 5 months ago - 2 comments

#72 - Update step_1_awq.yml

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#71 - Update step_1_awq.yml

Pull Request - State: closed - Opened by llmc-reviewer 5 months ago

#70 - Format config and add vllm backend

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#69 - support max_num_workers in opencompass

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#68 - Update module_utils.py

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#67 - Roll back tp

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#66 - fix tp bug

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#65 - lightllm部署推理问题

Issue - State: closed - Opened by lzd19981105 5 months ago - 1 comment

#64 - update doc and readme

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#63 - Yongyang

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#62 - update doc

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#61 - update docs

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#60 - Dev

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#59 - support opencompass eval

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#58 - awq_llama supports simulated TP

Pull Request - State: closed - Opened by SmudgedWings 5 months ago

#57 - fail to run awq+omniquart on qwen2-7b

Issue - State: closed - Opened by gloritygithub11 5 months ago - 5 comments

#56 - fail to start awq quantized model with lightllm on qwen2-7b-instruct

Issue - State: closed - Opened by gloritygithub11 5 months ago - 10 comments

#55 - fail to run awq on qwen2-7b-instruct

Issue - State: closed - Opened by gloritygithub11 5 months ago - 2 comments

#54 - fix tokenizer in lm-eval

Pull Request - State: closed - Opened by Harahan 5 months ago

#53 - Fix bugs for pass ci

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#52 - Update cpu.txt

Pull Request - State: closed - Opened by llmc-reviewer 5 months ago

#51 - support InternOmni for audio-vision-language model

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#50 - Fix GPTQ bugs and Add eval/vis feature

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#49 - fix ln_fc fuse && support 128g for abitrary shape

Pull Request - State: closed - Opened by Harahan 5 months ago

#48 - Fix real_quant zp bug

Pull Request - State: closed - Opened by gushiqiao 5 months ago

#47 - add some vlm models

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#46 - fix random port generation

Pull Request - State: closed - Opened by helloyongyang 5 months ago

#45 - save_fix_json

Pull Request - State: closed - Opened by Harahan 5 months ago

#44 - fix json save

Pull Request - State: closed - Opened by Harahan 5 months ago

#43 - Update requirements

Pull Request - State: closed - Opened by Harahan 5 months ago

#42 - update requirements

Pull Request - State: closed - Opened by Harahan 5 months ago

#40 - fail to run awq on Qwen2-7B-Instruct

Issue - State: closed - Opened by gloritygithub11 5 months ago - 3 comments

#39 - fail to run smoothquant on llama3-8b

Issue - State: closed - Opened by gloritygithub11 5 months ago - 3 comments

#38 - remove redundant code

Pull Request - State: closed - Opened by Harahan 5 months ago

#37 - remove redundant code

Pull Request - State: closed - Opened by Harahan 5 months ago

#36 - fix wanda

Pull Request - State: closed - Opened by Harahan 5 months ago

#35 - wanda bug

Issue - State: closed - Opened by guanchenl 5 months ago - 2 comments

#34 - add down stream evaluation

Pull Request - State: closed - Opened by Harahan 5 months ago

#32 - Update quarot.py

Pull Request - State: closed - Opened by llmc-reviewer 6 months ago

#31 - Support QuaRot for Qwen2

Pull Request - State: closed - Opened by Harahan 6 months ago

#29 - fix save

Pull Request - State: closed - Opened by Harahan 6 months ago

#27 - ci_update

Pull Request - State: closed - Opened by SmudgedWings 6 months ago

#26 - support ddp

Pull Request - State: closed - Opened by helloyongyang 6 months ago

#25 - llama3.1-70b awq_w4a4 error

Issue - State: closed - Opened by lihongqiang 6 months ago - 2 comments

#24 - add print_important_package_version log

Pull Request - State: closed - Opened by helloyongyang 6 months ago

#23 - add print_important_package_version log

Pull Request - State: closed - Opened by helloyongyang 6 months ago

#22 - Mixtral 8x7b failed on compile with tensorrt-llm

Issue - State: closed - Opened by gloritygithub11 6 months ago - 2 comments

#21 - LLama3-8B-Instruct fail for TensorRT-LLM

Issue - State: closed - Opened by gloritygithub11 6 months ago - 2 comments

#20 - add ShortGPT

Pull Request - State: closed - Opened by MercuryB1 6 months ago

#19 - ci更新且规范了llmc大部分代码格式

Pull Request - State: closed - Opened by SmudgedWings 6 months ago

#18 - 'ci_check'

Pull Request - State: closed - Opened by SmudgedWings 6 months ago

#17 - Fix download ptb warning

Pull Request - State: closed - Opened by shutcode 6 months ago - 2 comments

#16 - Main test

Pull Request - State: closed - Opened by SmudgedWings 6 months ago

#15 - fix fp search bug

Pull Request - State: closed - Opened by chengtao-lv 6 months ago

#14 - fix quarot bug and add config

Pull Request - State: closed - Opened by chengtao-lv 6 months ago

#13 - fix fp bug

Pull Request - State: closed - Opened by chengtao-lv 7 months ago

#12 - docs: add Japanese README

Pull Request - State: closed - Opened by eltociear 7 months ago

#11 - add fp

Pull Request - State: closed - Opened by chengtao-lv 7 months ago

#10 - add sparse and wanda docs

Pull Request - State: closed - Opened by MercuryB1 7 months ago

#9 - support mix bit

Pull Request - State: closed - Opened by helloyongyang 7 months ago

#8 - add wanda

Pull Request - State: closed - Opened by MercuryB1 7 months ago

#5 - How to use Tensorrt-LLM as backend

Issue - State: closed - Opened by Worromots 9 months ago - 4 comments

#4 - Update best practice and fix bugs

Pull Request - State: closed - Opened by gushiqiao 10 months ago

#3 - support tokenizer_mode & support copy_tokenizer

Pull Request - State: closed - Opened by anonymous-emnlp123 10 months ago

#2 - Shift dev

Pull Request - State: closed - Opened by ZhangYunchenY 11 months ago

#1 - Can I use this library for model quantization with only Pytorch+CPU？

Issue - State: closed - Opened by lemon-little 11 months ago - 3 comments