Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / wangzhaode/mnn-llm issues and pull requests

#76 - int8模式下生成连续的<sop><sop>

Issue - State: closed - Opened by xunbing over 1 year ago - 1 comment

#75 - docker.io/ubuntu:22.04 not found

Issue - State: closed - Opened by qiucichen over 1 year ago - 1 comment
Labels: stale

#74 - 运行时没有正确使用GPU

Issue - State: closed - Opened by yuyi2439 over 1 year ago - 2 comments
Labels: stale

#73 - all answers are nonsence and dead loop

Issue - State: closed - Opened by chienlungcheung over 1 year ago - 3 comments

#72 - 运行cli_demo -d int4时出现空文件指针

Issue - State: closed - Opened by yuyi2439 over 1 year ago - 6 comments

#71 - 部署完成后如何单机多GPU同时调用做推理任务

Issue - State: closed - Opened by mayurou over 1 year ago - 2 comments
Labels: stale

#69 - windows全部使用CPU部署加载模型时出错

Issue - State: closed - Opened by WalkeR-ZG over 1 year ago - 4 comments
Labels: stale

#68 - 大佬，麻烦问下支持ios手机部署吗

Issue - State: closed - Opened by StevensPrime over 1 year ago - 1 comment

#67 - 速度感觉不行，没有python版本快

Issue - State: closed - Opened by lhray over 1 year ago - 1 comment

#66 - 咨询：请问怎么将微调后的模型进行部署？

Issue - State: closed - Opened by YueWen1024 over 1 year ago - 2 comments
Labels: stale

#65 - 有编译好的apk吗

Issue - State: closed - Opened by yeluoo over 1 year ago - 2 comments

#64 - windows 平台 "cmake --build . -- /m:8" 编译 mnn 时报错

Issue - State: closed - Opened by Zaaachary over 1 year ago - 6 comments

#63 - v0.4 release的onnx模型缺失第8和第9个block

Issue - State: closed - Opened by wZuck over 1 year ago - 2 comments
Labels: stale

#62 - ChatGLM-MNN/libs/libMNN.so is incompatible with aarch64linux

Issue - State: closed - Opened by winnerahao over 1 year ago - 2 comments
Labels: stale

#61 - 有没有考虑把 GLM-6B中的 tokenizer 改写成 C++ 呢 ？

Issue - State: closed - Opened by sgxu over 1 year ago - 3 comments
Labels: enhancement, stale

#60 - 咨询：关于lm.mnn导出的问题

Issue - State: closed - Opened by Truoji over 1 year ago - 3 comments
Labels: documentation

#59 - 考虑支持bazel或者blade编译吗

Issue - State: closed - Opened by OceannTwT over 1 year ago - 2 comments
Labels: question, stale

#58 - vs2022 编译报错。

Issue - State: closed - Opened by lanybass over 1 year ago - 6 comments
Labels: bug, stale

#57 - Support Windows Compile with CPU

Pull Request - State: closed - Opened by Tlntin over 1 year ago

#56 - 若干修复，增加更多docker打包方案

Pull Request - State: closed - Opened by Tlntin over 1 year ago

#55 - 安卓端编译，无法使用filesystem

Issue - State: closed - Opened by xiaoguoer over 1 year ago - 5 comments

#54 - 微信群，最新信息更新

Issue - State: open - Opened by wangzhaode over 1 year ago - 63 comments

#53 - An issue of C++ standard when compiling on Windows

Issue - State: closed - Opened by noteas over 1 year ago - 1 comment
Labels: bug

#52 - 没有MNN/build/libMNN.so

Issue - State: closed - Opened by ruoyunbai over 1 year ago - 8 comments
Labels: question, stale

#51 - 修复若干问题，添加docker打包方案

Pull Request - State: closed - Opened by Tlntin over 1 year ago

#50 - Fix description in zh readme of resource/models/download_models.sh

Pull Request - State: closed - Opened by hamkido over 1 year ago - 1 comment

#49 - 尝试修复 modeling_chatglm.py 的 bug

Issue - State: closed - Opened by sgxu over 1 year ago - 2 comments
Labels: enhancement, stale

#48 - 请问回答问题时的停止条件是什么

Issue - State: closed - Opened by irasin over 1 year ago - 1 comment
Labels: question

#47 - make -j8的时候报错

Issue - State: closed - Opened by reddhu over 1 year ago - 6 comments
Labels: question, stale

#46 - Mac上编译web_demo.cpp报错

Issue - State: closed - Opened by justin8736 over 1 year ago - 1 comment
Labels: question

#45 - onnx 文件在 onnxruntime 中无法运行

Issue - State: closed - Opened by sgxu over 1 year ago - 6 comments
Labels: question, stale

#43 - 导出模型失败

Issue - State: closed - Opened by Wanger-SJTU over 1 year ago - 1 comment
Labels: question

#42 - 和LLMA.cpp相比，为什么性能会差这么多？

Issue - State: closed - Opened by yhyu13 over 1 year ago - 4 comments
Labels: question, stale

#41 - English translation of readme

Pull Request - State: closed - Opened by hussainwali74 over 1 year ago
Labels: documentation

#40 - to onnx problems

Issue - State: closed - Opened by frankzhao112 over 1 year ago - 2 comments

#39 - 运行 crash

Issue - State: closed - Opened by sgxu over 1 year ago - 9 comments
Labels: question, stale

#38 - run the cli_demo which layer is loaded in cuda, with error

Issue - State: closed - Opened by deepfind over 1 year ago - 7 comments
Labels: question, stale

#37 - 如何调节多核优化？

Issue - State: closed - Opened by IlysvlVEizbr over 1 year ago - 7 comments
Labels: question, stale

#36 - convert glm block to onnx but get error

Issue - State: closed - Opened by zhaohb over 1 year ago - 2 comments
Labels: question

#35 - 请问是否可以添加METAL的支持？便于在mac上加速

Issue - State: closed - Opened by Min9X1n over 1 year ago - 2 comments

#34 - 从源码编译MNN时出现错误

Issue - State: closed - Opened by okatu-loli over 1 year ago - 6 comments
Labels: stale

#33 - lm cuda支持

Issue - State: closed - Opened by kywen1119 over 1 year ago - 6 comments
Labels: bug, stale

#32 - 出现段错误

Issue - State: closed - Opened by wildkid1024 over 1 year ago - 11 comments

#31 - 提问后崩溃，这是什么原因？

Issue - State: closed - Opened by wjjc1017 over 1 year ago - 1 comment

#30 - 如何通过这生成api接口，用python可以调用？

Issue - State: closed - Opened by wjjc1017 over 1 year ago - 1 comment
Labels: question

#29 - 是否非常依赖pcie 带宽呢？

Issue - State: closed - Opened by yichengming over 1 year ago - 1 comment
Labels: question

#28 - Very slow - is this expected on a CPU only use case

Issue - State: closed - Opened by hishamhaniffa over 1 year ago - 1 comment
Labels: question

#27 - 问到第三个问题的时候直接崩溃

Issue - State: closed - Opened by starfire-lzd over 1 year ago - 6 comments
Labels: stale

#26 - 咨询一下Pytorch导出ONNX的方法

Issue - State: closed - Opened by maoxx241 over 1 year ago - 3 comments

#25 - 16G + 3060 6G Laptop, out of memory.

Issue - State: closed - Opened by tangpingzhou over 1 year ago - 6 comments
Labels: stale

#24 - 修复网页一直发送请求占用太多资源问题

Pull Request - State: closed - Opened by kekxv over 1 year ago

#23 - 貌似不支持上下文？

Issue - State: closed - Opened by xx12138123 over 1 year ago - 2 comments

#21 - where is the "slim_lm.bin"

Issue - State: closed - Opened by wayoungofustc over 1 year ago - 3 comments

#19 - add cmd parser & classify model dir

Pull Request - State: closed - Opened by WhisperChi over 1 year ago - 2 comments

#18 - 要不要建个QQ群交流一下？qq群：935105641

Issue - State: closed - Opened by xtuyaowu over 1 year ago - 3 comments
Labels: stale

#17 - 有Android编译好的动态库吗

Issue - State: closed - Opened by nickming over 1 year ago - 2 comments
Labels: stale

#16 - 只有CPU没有GPU可以微调推理吗？

Issue - State: closed - Opened by sxk000 over 1 year ago - 2 comments

#14 - 这个怎么部署

Issue - State: closed - Opened by yuanjie-ai over 1 year ago - 2 comments
Labels: stale

#12 - ONNX模型推理

Issue - State: closed - Opened by Hap-Zhang over 1 year ago - 2 comments
Labels: stale

#11 - 咨询: onnx 模型

Issue - State: closed - Opened by haolongzhangm over 1 year ago - 13 comments
Labels: stale

#10 - 下载脚本建议加入wget断点续传参数

Issue - State: closed - Opened by WhisperChi over 1 year ago - 2 comments

#9 - add option BUILD_MINI_MEM_MODE

Pull Request - State: closed - Opened by kekxv over 1 year ago

#8 - MNN构建，README有一处需要补充下~

Issue - State: closed - Opened by WhisperChi over 1 year ago - 2 comments

#7 - 推断速度比较慢

Issue - State: closed - Opened by dayu1979 over 1 year ago - 8 comments
Labels: stale

#6 - 有没有预构建二进制文件

Issue - State: closed - Opened by YIZXIY over 1 year ago - 4 comments
Labels: stale

#5 - How to enable fp16？

Issue - State: closed - Opened by duzx16 over 1 year ago - 13 comments
Labels: stale

#4 - MNN编译不了

Issue - State: closed - Opened by ystyle over 1 year ago - 9 comments
Labels: question

#3 - Use sentencepiece tokenizer

Pull Request - State: closed - Opened by duzx16 over 1 year ago - 4 comments

#2 - Fix compilation instructions in README

Pull Request - State: closed - Opened by duzx16 over 1 year ago - 1 comment
Labels: good first issue

#1 - GPU内存大小是硬编码的

Issue - State: closed - Opened by duzx16 over 1 year ago - 1 comment
Labels: question