Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / wangzhaode/mnn-llm issues and pull requests

#223 - Feature/add docs

Pull Request - State: closed - Opened by ddbbcc about 1 month ago

#222 - mnn-llm 使用cuda 后端执行时，每次结果都是不一样的。

Issue - State: open - Opened by BaofengZan about 1 month ago - 3 comments

#221 - lmm.weight和lmm.json如何生成呢？

Issue - State: closed - Opened by BaofengZan about 1 month ago

#220 - [feat] add docs.

Pull Request - State: closed - Opened by wangzhaode about 1 month ago

#219 - 在Android 上加载Gamma2 2B的时候Demo App 闪退

Issue - State: open - Opened by chenminjun-web about 1 month ago

#218 - 在 Android 上用 OpenCL 跑 Qwen-VL 报空指针

Issue - State: open - Opened by GJYWorld about 2 months ago

#216 - LLM sample with temperature parameters

Pull Request - State: open - Opened by Ma-Dan 2 months ago

#215 - 安卓14 编译完成后 ，运行demo 报错

Issue - State: closed - Opened by ddbbcc 2 months ago - 1 comment
Labels: stale

#213 - Android App Crashed -“std::out_of_range: unordered_map::at: key not found”

Issue - State: closed - Opened by FranzKafkaYu 2 months ago - 1 comment
Labels: stale

#212 - Qwen1.5-1.8B模型转换问题

Issue - State: closed - Opened by robben225 4 months ago - 3 comments

#210 - cli_demo android test failed

Issue - State: closed - Opened by WenguoLi 4 months ago - 1 comment

#209 - qwen2-1.5B get wront results on windows

Issue - State: closed - Opened by ddbbcc 4 months ago - 1 comment
Labels: stale

#207 - android端推理crash

Issue - State: closed - Opened by robben225 4 months ago - 1 comment

#206 - config.json中的字段是否修改过，android工程无法运行

Issue - State: closed - Opened by LHB116 4 months ago - 1 comment

#205 - 请问whisper、paraformer等语音识别模型能用mnn-llm跑吗？

Issue - State: closed - Opened by niusmall 5 months ago - 1 comment

#204 - Android arm平台 Llama-2-7b-chat-MNN输出乱码

Issue - State: closed - Opened by xiaoxiaoyuwen 5 months ago - 2 comments
Labels: stale

#203 - [feat] add ios ci.

Pull Request - State: closed - Opened by wangzhaode 5 months ago

#202 - [refactor] refact ios project.

Pull Request - State: closed - Opened by wangzhaode 5 months ago

#201 - [feat] add python ci.

Pull Request - State: closed - Opened by wangzhaode 5 months ago

#200 - qwen2-1.5B get wront results on x86 and macos

Issue - State: closed - Opened by xingjinglu 5 months ago - 9 comments

#199 - 2024.6.12 master分支Android构建报错

Issue - State: closed - Opened by bulletProofCat 5 months ago - 1 comment

#198 - [refactor] refactor build script and ci.

Pull Request - State: closed - Opened by wangzhaode 5 months ago

#197 - Refactor tokenizer, add config.json.

Pull Request - State: closed - Opened by wangzhaode 5 months ago

#196 - iOS运行闪退

Issue - State: closed - Opened by hadesh 6 months ago - 1 comment
Labels: stale

#195 - "Killed" when loading a model.

Issue - State: closed - Opened by GrantLau1226 6 months ago

#193 - iphone上运行闪退

Issue - State: closed - Opened by hadesh 6 months ago - 1 comment
Labels: stale

#192 - llama2-7b回复错误与重复

Issue - State: closed - Opened by QIANXUNZDL123 6 months ago - 10 comments
Labels: stale

#191 - It's very good! But...

Issue - State: closed - Opened by GrantLau1226 6 months ago - 3 comments
Labels: question

#190 - 解决amr windows下一些文件编译失败的错误

Pull Request - State: closed - Opened by dignfei 6 months ago - 1 comment
Labels: stale

#189 - llama3 model can not answer

Issue - State: closed - Opened by hyperbolic-c 6 months ago - 2 comments
Labels: stale

#188 - 修改Llama2_7b参数，导出mnn模型后在android设备上咯啊的、

Issue - State: closed - Opened by CarryFun 6 months ago - 2 comments
Labels: stale

#187 - [Feature]支持MiniCPM

Issue - State: closed - Opened by zkh2016 6 months ago - 1 comment
Labels: stale

#185 - [1] 46941 segmentation fault ./cli_demo ../qwen-1.8b ../resource/prompt.txt

Issue - State: closed - Opened by CoderXXLee 7 months ago - 1 comment
Labels: stale

#184 - Support MPI distribute computation over machine cluster

Issue - State: closed - Opened by hyperbolic-c 7 months ago - 1 comment
Labels: stale

#183 - Missing a file for the llama3-8b-instruct-mnn model

Issue - State: closed - Opened by ghost 7 months ago - 3 comments
Labels: stale

#182 - DeepSeek-coder Model Support

Issue - State: closed - Opened by hyperbolic-c 7 months ago - 1 comment
Labels: stale

#181 - Support for Lora adapter layers for LLM inference

Issue - State: closed - Opened by TejasRavichandran1995 7 months ago - 3 comments
Labels: stale

#180 - 生成参数

Issue - State: closed - Opened by Vincent131499 7 months ago - 1 comment
Labels: stale

#178 - How to Install and Use "Python Wrapper"? 如何安装使用Python版本？

Issue - State: closed - Opened by nlceyes 7 months ago - 1 comment
Labels: stale

#177 - memory budget reduction

Pull Request - State: closed - Opened by huangzhengxiang 8 months ago - 1 comment
Labels: stale

#176 - update by some optim

Pull Request - State: closed - Opened by triple-Mu 8 months ago - 2 comments
Labels: stale

#175 - android手机对话时点发送闪退

Issue - State: closed - Opened by darengking 8 months ago - 1 comment
Labels: stale

#174 - support python wrapper

Pull Request - State: closed - Opened by wangzhaode 8 months ago

#173 - 服务

Issue - State: closed - Opened by Vincent131499 8 months ago - 7 comments
Labels: stale

#172 - 英伟达T4上使用opencl报错

Issue - State: closed - Opened by tzhang2014 8 months ago - 3 comments
Labels: stale

#171 - [Request]: Expose KV Cache Reset functionality.

Issue - State: closed - Opened by Nick-infinity 8 months ago - 1 comment
Labels: stale

#169 - Error: No encoding found for the sequence starting at position 0

Issue - State: closed - Opened by OliverQueen1466 8 months ago - 5 comments

#167 - TinyLlama-1.1B 能正常运行，但是“胡说八道”

Issue - State: closed - Opened by BUG1989 8 months ago - 2 comments
Labels: stale

#166 - Ubuntu20.04 x86-64，TinyLlama Segmentation fault

Issue - State: closed - Opened by BUG1989 8 months ago - 2 comments

#165 - iOS demo cannot work ,becasue of memory limit

Issue - State: closed - Opened by Fengur 8 months ago - 1 comment
Labels: stale

#164 - Build failure on Linux: missing headers in tokenizer.cpp

Issue - State: closed - Opened by skmkt 8 months ago - 1 comment

#163 - 在linux的cpu下测试的效率对不上

Issue - State: closed - Opened by tzhang2014 9 months ago - 1 comment
Labels: stale

#162 - 编译MNN需要有什么改动

Issue - State: closed - Opened by MuYu-zhi 9 months ago - 1 comment
Labels: stale

#161 - google gemma 也开源了

Issue - State: closed - Opened by kekxv 9 months ago - 1 comment
Labels: stale

#160 - 增加對qwen1.5 1.8b的支持

Issue - State: closed - Opened by CRGBS 9 months ago - 3 comments
Labels: stale

#159 - 修正README文本错误

Pull Request - State: closed - Opened by FiveHair 9 months ago

#158 - Segmentation Fault in PC Linux

Issue - State: closed - Opened by iamfaith 9 months ago - 2 comments
Labels: stale

#157 - iOS demo 内存泄漏

Issue - State: closed - Opened by LionWY 9 months ago - 1 comment
Labels: stale

#156 - 下载完qwen-1.8b-mnn-int8，加载完还是无法到聊天页面

Issue - State: closed - Opened by do-one-thing-to-well 10 months ago - 4 comments
Labels: stale

#147 - 自己编译的apk运行速度很慢

Issue - State: closed - Opened by litao1991 10 months ago - 4 comments
Labels: stale

#146 - Llama2-7B模型在MNN-LLM框架下的性能明显优于MLC-LLM吗

Issue - State: closed - Opened by ZW-BOY1126 10 months ago - 3 comments
Labels: stale

#145 - 手机加载完Phi2模型后，聊天界面提问会出现闪退到加载模型界面。

Issue - State: closed - Opened by ZW-BOY1126 10 months ago - 1 comment
Labels: stale

#142 - 关于Qwen-VL 的支持

Issue - State: closed - Opened by JennieGao-njust 10 months ago - 1 comment
Labels: stale

#138 - HELP! 安卓端版mnn-llm.apk加载chatglm3-6b-mnn无法操作

Issue - State: closed - Opened by forhonourlx 10 months ago - 5 comments
Labels: bug, stale

#136 - Plans for android GPU suppport for qwen 1.8B

Issue - State: closed - Opened by Nick-infinity 10 months ago - 7 comments
Labels: enhancement, stale

#135 - qwen-1.8b-apk 使用时程序崩溃

Issue - State: closed - Opened by MeetUo 11 months ago - 6 comments
Labels: bug, stale

#101 - int4和int8量化模型用的是mnn的量化工具还是直接使用了ChatGLM官方的量化后的模型？

Issue - State: closed - Opened by fcability over 1 year ago - 2 comments
Labels: help wanted

#100 - 安卓端崩溃

Issue - State: closed - Opened by cvv-student over 1 year ago - 7 comments
Labels: bug

#99 - 是否未來有打算支援ChatGLM2呢?

Issue - State: closed - Opened by CRGBS over 1 year ago - 1 comment
Labels: enhancement

#98 - OpenCL进行推理，第二次提问，出现segmentfault(coredump)

Issue - State: closed - Opened by orange-island over 1 year ago - 3 comments
Labels: stale

#97 - 编译报错： CUDA_TOOLKIT_ROOT_DIR not found or specified

Issue - State: closed - Opened by PIKACHUIM over 1 year ago - 1 comment
Labels: stale

#96 - Sementation fault

Issue - State: closed - Opened by kevin945a over 1 year ago - 24 comments
Labels: stale

#95 - fp16 embedding问题

Issue - State: closed - Opened by zhiyaotl over 1 year ago - 2 comments
Labels: question

#94 - CMake Error at CMakeLists.txt:20 (project):

Issue - State: closed - Opened by Crisfw over 1 year ago - 3 comments
Labels: question

#93 - Missing file

Issue - State: closed - Opened by kevin945a over 1 year ago - 2 comments
Labels: question

#92 - linux上运行int4模型失败---Segmentation fault

Issue - State: closed - Opened by zhufuwengang over 1 year ago - 17 comments
Labels: stale

#91 - linux上运行int4模型失败

Issue - State: closed - Opened by I0me0I over 1 year ago - 2 comments
Labels: stale

#89 - GPU显存占用上去，运算并没有使用GPU，推理速度30s/字

Issue - State: closed - Opened by xu-mengnan over 1 year ago - 4 comments
Labels: stale

#88 - Segmentation fault when inference with int4/int8

Issue - State: closed - Opened by Lqlsoftware over 1 year ago - 6 comments
Labels: stale

#87 - ONNX导出失败

Issue - State: closed - Opened by Palazor over 1 year ago - 1 comment
Labels: stale

#86 - 提问时崩溃 如何调试呢

Issue - State: closed - Opened by HJT9328 over 1 year ago - 8 comments
Labels: stale

#85 - MNN编译时候报错 Please update cuda version to 10.2 or higher!

Issue - State: closed - Opened by wangxunA over 1 year ago - 1 comment
Labels: stale

#84 - ChatGLM-MNN推理速度慢，是需要开启什么配置么？

Issue - State: closed - Opened by oncealong over 1 year ago - 3 comments
Labels: stale

#83 - 在16G的无gpu机器上运行Int 4量化模型，16G内存都跑不起来

Issue - State: closed - Opened by kungrainbow over 1 year ago - 2 comments
Labels: stale

#82 - Can't Find type=2 backend, use 3 instead

Issue - State: closed - Opened by liao0028 over 1 year ago - 11 comments
Labels: stale

#81 - 采用P-tuning v2微调的模型怎么转化成onnx文件呢？

Issue - State: closed - Opened by jackizhang over 1 year ago - 1 comment
Labels: stale

#80 - 编译成功，执行时出错，C++库已全部安装，仍报错

Issue - State: closed - Opened by HaviZou over 1 year ago - 3 comments
Labels: stale

#79 - windows cpu最后一步没有可执行文件 报错

Issue - State: closed - Opened by HaviZou over 1 year ago - 6 comments

#78 - MNN/build/express下没有*.so文件，请问一下这个模型支持AMD的GPU嘛

Issue - State: closed - Opened by Luohui1028 over 1 year ago - 8 comments
Labels: stale

#77 - License

Issue - State: closed - Opened by vra over 1 year ago - 1 comment