Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / InternLM/lmdeploy issues and pull requests

#2315 - question about implements LRU policy

Issue - State: closed - Opened by xiaoxiangshusheng 3 months ago

#2314 - [Bug] 一张卡上部署多个模型

Issue - State: closed - Opened by jiangix-paper 3 months ago - 3 comments
Labels: awaiting response

#2313 - Add stream options to control usage

Pull Request - State: closed - Opened by AllentDan 3 months ago
Labels: improvement

#2312 - handle invalid images

Pull Request - State: closed - Opened by irexyc 3 months ago - 2 comments
Labels: improvement

#2311 - [Bug] lmdeploy部署报错API call is not supported in the installed CUDA driver

Issue - State: closed - Opened by 2013303386 3 months ago - 5 comments
Labels: awaiting response

#2309 - [Docs] llava-llama3的图片预处理和前向推理过程

Issue - State: open - Opened by Jason8Kang 3 months ago - 4 comments

#2308 - [Feature] Support vision module w8a8 inference

Pull Request - State: open - Opened by AllentDan 3 months ago - 2 comments
Labels: improvement

#2307 - fix: follow up #2303

Pull Request - State: closed - Opened by zhyncs 3 months ago - 3 comments

#2306 - CPU offload when InternVL2-40B inference using lmdeploy.pipeline

Issue - State: closed - Opened by ftgreat 3 months ago - 1 comment

#2305 - [Feature] Add `logits_processor` to `GenerationConfig`

Issue - State: open - Opened by Dan-wanna-M 3 months ago - 3 comments

#2304 - smooth 量化后推理性能没有提升

Issue - State: open - Opened by zxy1119 3 months ago - 1 comment

#2304 - smooth 量化后推理性能没有提升

Issue - State: open - Opened by zxy1119 3 months ago

#2303 - fix Windows compile error

Pull Request - State: closed - Opened by zhyncs 3 months ago - 1 comment

#2302 - [Bug] lmdeploy卡住，不能接收任何请求

Issue - State: open - Opened by thesby 3 months ago - 5 comments

#2302 - [Bug] lmdeploy卡住，不能接收任何请求

Issue - State: open - Opened by thesby 3 months ago - 3 comments

#2300 - [Feature] multi-node training

Issue - State: closed - Opened by taliq 3 months ago - 2 comments

#2300 - [Feature] multi-node training

Issue - State: open - Opened by taliq 3 months ago

#2299 - [Bug] Lmdeploy LLM Llama3在4090单卡和双卡上的推理结果不一致

Issue - State: closed - Opened by chenchenzeng 3 months ago - 6 comments
Labels: awaiting response, Stale

#2295 - i want to run profile_throughput.py using the smooth_quant model. Why did an error occur?

Issue - State: closed - Opened by zxy1119 3 months ago - 5 comments
Labels: awaiting response, Stale

#2295 - i want to run profile_throughput.py using the smooth_quant model. Why did an error occur?

Issue - State: open - Opened by zxy1119 3 months ago - 3 comments
Labels: awaiting response

#2294 - Remove QoS serving

Pull Request - State: closed - Opened by AllentDan 3 months ago
Labels: improvement

#2294 - Remove QoS serving

Pull Request - State: closed - Opened by AllentDan 3 months ago
Labels: improvement

#2293 - [Bug] deepseek-vl模型推理时结果差异

Issue - State: open - Opened by zheng-zf 3 months ago

#2293 - [Bug] deepseek-vl模型推理时结果差异

Issue - State: closed - Opened by zheng-zf 3 months ago - 1 comment

#2292 - Fix internvl2 template and update docs

Pull Request - State: closed - Opened by irexyc 3 months ago - 1 comment
Labels: Bug:P1

#2291 - 支持gptq，awq吗？

Issue - State: closed - Opened by ccp123456789 3 months ago - 1 comment

#2291 - 支持gptq，awq吗？

Issue - State: closed - Opened by ccp123456789 3 months ago - 1 comment

#2290 - Update python support version

Pull Request - State: closed - Opened by wuhongsheng 3 months ago - 1 comment

#2289 - better formatted table of 'lmdeploy list'

Pull Request - State: open - Opened by lvhan028 3 months ago
Labels: WIP, improvement

#2288 - 什么时候能适配python 3.12

Issue - State: closed - Opened by wuhongsheng 3 months ago - 1 comment

#2288 - 什么时候能适配python 3.12

Issue - State: closed - Opened by wuhongsheng 3 months ago - 1 comment

#2287 - [Feature] Support for decoding method that reduce Hallucinations

Issue - State: open - Opened by zhly0 3 months ago - 1 comment

#2286 - [Bug] Not able to install lmdeploy

Issue - State: closed - Opened by Pavun-KumarCH 3 months ago - 1 comment

#2286 - [Bug] Not able to install lmdeploy

Issue - State: closed - Opened by Pavun-KumarCH 3 months ago - 1 comment

#2285 - remove eviction param

Pull Request - State: closed - Opened by grimoire 3 months ago
Labels: improvement

#2283 - 有关输入拆分计算的问题

Issue - State: closed - Opened by SeibertronSS 3 months ago

#2283 - 有关输入拆分计算的问题

Issue - State: closed - Opened by SeibertronSS 3 months ago

#2282 - [Bug] LoRA Finetuned model is not generating any text.

Issue - State: open - Opened by shiva-vardhineedi 3 months ago - 4 comments

#2281 - [Bug] glm4量化之后，吐字异常重复的问题

Issue - State: open - Opened by maxin9966 3 months ago - 6 comments

#2280 - [Bug] OOM errors while loading awq quatized Mixtral 7X8b instruct model

Issue - State: closed - Opened by ab6995 3 months ago - 2 comments

#2279 - 请问一下国产显卡Ascend 910 and Hygon DCU Z100L等如何安装？

Issue - State: closed - Opened by cgq0816 3 months ago - 1 comment

#2278 - build(ascend): add Dockerfile for ascend aarch64 910B

Pull Request - State: closed - Opened by CyCle1024 3 months ago - 14 comments
Labels: enhancement

#2277 - [WIP] Support cogvlm model

Pull Request - State: closed - Opened by pdx1989 3 months ago

#2275 - fix side-effect: failed to update tm model config with tm engine config

Pull Request - State: closed - Opened by lvhan028 3 months ago - 2 comments
Labels: Bug:P1

#2274 - [Feature] support qqq(w4a8) for lmdeploy

Pull Request - State: open - Opened by HandH1998 3 months ago - 14 comments

#2273 - [Bug] internvl2-4B 在v100上推理异常，输出text均为空

Issue - State: closed - Opened by qism 3 months ago - 7 comments
Labels: awaiting response, Stale

#2272 - batch_infer疑似死锁卡住[Bug]

Issue - State: open - Opened by hitzhu 3 months ago - 9 comments

#2271 - lmdeploy pipe 部署internvl2-40B batch_infer出错[Bug]

Issue - State: open - Opened by hitzhu 3 months ago - 4 comments

#2270 - [Bug]

Issue - State: closed - Opened by hitzhu 3 months ago - 3 comments

#2269 - [Bug] Qwen/Qwen2-1.5B error: floating point exception

Issue - State: closed - Opened by lpf6 3 months ago - 16 comments
Labels: awaiting response, Stale

#2268 - Qwen-VL 推理返回空文本

Issue - State: closed - Opened by Liufeiran123 3 months ago - 4 comments

#2267 - minicpmv2.5部署报错

Issue - State: closed - Opened by lyc728 3 months ago - 5 comments

#2266 - 单卡A10用swift加载微调后的glm-4v, 报OOM错误

Issue - State: closed - Opened by demoninpiano 3 months ago - 2 comments

#2265 - [Bug] 使用lmdeploy推理internvl2-40B出错

Issue - State: open - Opened by hitzhu 3 months ago - 9 comments

#2264 - [Bug] lmdeploy 在加载auto_awq 之后的 llava 模型之后显示没有 output.weight

Issue - State: closed - Opened by Skyseaee 3 months ago - 4 comments
Labels: awaiting response

#2263 - [Bug] InternVL2 超过2图就报错

Issue - State: closed - Opened by JixiangGao 3 months ago - 6 comments

#2262 - [Bug] internvl2-2B awq w4a16量化后掉点严重，应该如何排查？

Issue - State: closed - Opened by Howe-Young 3 months ago - 4 comments
Labels: awaiting response, Stale

#2259 - internvl2-8b 推理结果没有特殊token

Issue - State: closed - Opened by lyc728 3 months ago - 14 comments
Labels: awaiting response, Stale

#2258 - [Bug] Intel MKL FATAL ERROR /torch/lib/libtorch_cpu.so

Issue - State: closed - Opened by maxin9966 3 months ago - 2 comments

#2257 - [Bug] 0.5.3版本运行InternVL2-26B-AWQ报错

Issue - State: closed - Opened by bltcn 3 months ago - 4 comments

#2256 - enable run vlm with pytorch engine in gradio

Pull Request - State: closed - Opened by RunningLeon 3 months ago - 3 comments
Labels: Bug:P1

#2255 - [Bug] qwen272b- lmDeploy hanged after 900 requests

Issue - State: closed - Opened by ChunyiY 3 months ago - 4 comments
Labels: awaiting response, Stale

#2253 - [Bug] mac pip 提示找不到匹配信息

Issue - State: closed - Opened by fuckqqcom 3 months ago - 1 comment

#2252 - Split token_embs and lm_head weights

Pull Request - State: closed - Opened by irexyc 3 months ago - 5 comments
Labels: improvement

#2251 - debug

Pull Request - State: closed - Opened by RunningLeon 3 months ago

#2250 - [Bug] internv2系列模型使用pipeline报错

Issue - State: open - Opened by wssywh 3 months ago - 10 comments

#2249 - [Bug] AssertionError: tp should be 2^n

Issue - State: closed - Opened by colorfulandcjy0806 3 months ago - 3 comments

#2247 - [Bug] ImportError: cannot import name 'VLAsyncEngine'

Issue - State: closed - Opened by LSC527 3 months ago - 2 comments

#2246 - cancel support baichuan2 7b awq in pytorch engine

Pull Request - State: closed - Opened by grimoire 3 months ago
Labels: documentation

#2245 - support vlm custom image process parameters in openai input format

Pull Request - State: closed - Opened by irexyc 3 months ago - 1 comment
Labels: enhancement

#2244 - [Bug] interenvl2 auto_awq quant failed

Issue - State: closed - Opened by janelu9 3 months ago - 2 comments

#2243 - [Bug] lmdeploy lite auto_awq量化错误

Issue - State: open - Opened by ZanePoe 3 months ago - 9 comments

#2242 - bump version to v0.5.3

Pull Request - State: closed - Opened by lvhan028 3 months ago

#2241 - [Feature] Minicpm-2.6 support

Issue - State: closed - Opened by AnyangAngus 3 months ago - 3 comments

#2240 - fix the issue missing dependencies in the Dockerfile and pip

Pull Request - State: closed - Opened by ColorfulDick 3 months ago - 4 comments
Labels: Bug:P1

#2239 - [Bug] Infering InternVL2-8B model with Lmdepoly in trouble

Issue - State: closed - Opened by PancakeAwesome 3 months ago - 3 comments
Labels: awaiting response, Stale

#2238 - lmdeploy在windows上的支持问题

Issue - State: closed - Opened by humphreyde 3 months ago - 8 comments

#2237 - docs: add Japanese README

Pull Request - State: closed - Opened by eltociear 3 months ago - 1 comment
Labels: documentation

#2235 - Lmdeploy turbomind backend support rope_scaling?

Issue - State: closed - Opened by Lzhang-hub 3 months ago - 7 comments
Labels: awaiting response, Stale

#2233 - Fix typos in profile_generation.py

Pull Request - State: closed - Opened by jiajie-yang 3 months ago - 1 comment

#2231 - 当连续请求200多次后，出现突然卡住的情况

Issue - State: open - Opened by lai-serena 3 months ago - 11 comments

#2230 - terminate called after throwing an instance of 'std::runtime_error'

Issue - State: closed - Opened by lyc728 3 months ago - 21 comments
Labels: awaiting response

#2226 - 多卡推理，无法生成结果

Issue - State: closed - Opened by deepslee 3 months ago - 12 comments

#2221 - [Bug] IntrenVL2-1B awq量化后推理异常问题

Issue - State: closed - Opened by Jeremy-J-J 3 months ago - 9 comments
Labels: awaiting response, Stale

#2218 - Add peer-access-enabled allocator

Pull Request - State: closed - Opened by lzhangzz 3 months ago
Labels: Bug:P1