Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / megengine/inferllm issues and pull requests

#85 - SG2042 服务器 make 出错

Issue - State: open - Opened by JocelynPanPan about 2 months ago - 1 comment

#84 - 无法加载模型bin或者guff模型

Issue - State: open - Opened by velonica0 4 months ago

#83 - 有打算支持qwen吗

Issue - State: open - Opened by Gooddz1 6 months ago

#82 - 在树莓派3b+上部署，出现无法打开模型的问题

Issue - State: open - Opened by Dominic23331 6 months ago - 4 comments

#81 - feat(chatglm3-6B): support chatglm3-6B

Pull Request - State: closed - Opened by xyc0123456789 8 months ago - 2 comments

#80 - 这个有windows的部署教程吗

Issue - State: open - Opened by ASHLEYDX 8 months ago

#79 - [CI] Create CI Flow

Pull Request - State: closed - Opened by QingChuanWS 8 months ago - 1 comment

#78 - How to build wasm file?

Issue - State: closed - Opened by njalan 8 months ago

#77 - 在运行llama2-13b的时候出现以下问题

Issue - State: open - Opened by Wowoho 9 months ago

#76 - 移植问题

Issue - State: open - Opened by yinghuo302 11 months ago

#75 - 请问可以在不支持V扩展的RISC-V CPU上运行吗

Issue - State: open - Opened by TheKiteRunner24 12 months ago - 1 comment

#74 - 可以在RV64指令集的CPU上运行吗

Issue - State: closed - Opened by TheKiteRunner24 12 months ago

#73 - I got the error on centos 7: failed to tokenize string!

Issue - State: open - Opened by Mignet 12 months ago - 2 comments

#72 - chatglm3有计划支持吗？

Issue - State: open - Opened by sunzhe09 about 1 year ago - 3 comments

#71 - arm 平台输出乱码

Issue - State: open - Opened by tanjatang about 1 year ago - 3 comments

#70 - mac os Big Sur 11.7.4 Linking Error , Undefined symbols

Issue - State: closed - Opened by junlong about 1 year ago - 1 comment

#69 - 请问是否有计划支持Whisper？

Issue - State: closed - Opened by nxprxf about 1 year ago - 1 comment

#68 - Corrected small typo in ReadMe

Pull Request - State: closed - Opened by TusharAMD about 1 year ago - 2 comments

#67 - chatglm2 GPU版本的int4、int8量化模型预测结果异常

Issue - State: closed - Opened by itfish1990 over 1 year ago - 1 comment

#66 - ChatGLM2 效果异常

Issue - State: closed - Opened by adf1178 over 1 year ago - 1 comment

#65 - 能否改为GPU辅助计算

Issue - State: open - Opened by bzy-080408 over 1 year ago - 6 comments

#64 - quantizer: refine and support q8

Pull Request - State: closed - Opened by xhebox over 1 year ago - 1 comment

#63 - 【new feature】通义千问有没有计划支持

Issue - State: open - Opened by guangyuanyu over 1 year ago - 2 comments

#62 - new thread worker test

Pull Request - State: closed - Opened by xhebox over 1 year ago - 7 comments

#61 - Thread wakening may be bottom neck for large core systems

Issue - State: open - Opened by xhebox over 1 year ago - 8 comments

#60 - O3 optimization are slower on SG2042

Issue - State: open - Opened by xhebox over 1 year ago - 3 comments

#59 - Please support RWKV for refs and compare.

Issue - State: open - Opened by xiaol over 1 year ago

#58 - unsupported relocation 37 on musl libc

Issue - State: closed - Opened by xhebox over 1 year ago - 3 comments

#57 - feat: int8 support

Pull Request - State: closed - Opened by xhebox over 1 year ago - 4 comments

#56 - 请问一下，这个是不是比python的性能更好？

Issue - State: open - Opened by wuent over 1 year ago - 1 comment

#55 - chore: do not set C(XX)FLAGS for rvv

Pull Request - State: closed - Opened by xhebox over 1 year ago - 3 comments

#54 - make error

Issue - State: open - Opened by forwiat over 1 year ago - 13 comments

#52 - chore: add rvv to README

Pull Request - State: closed - Opened by xhebox over 1 year ago - 1 comment

#50 - 目前不支持gpu跑吗？我看代码中有添加对gpu的支持啊

Issue - State: open - Opened by sf9218 over 1 year ago - 2 comments

#49 - feat: rvv support

Pull Request - State: closed - Opened by xhebox over 1 year ago - 2 comments

#48 - feat: rvv support

Pull Request - State: closed - Opened by xhebox over 1 year ago

#47 - 希望可以封装openai兼容API

Issue - State: open - Opened by nexx5 over 1 year ago

#46 - feat: general backend

Pull Request - State: closed - Opened by xhebox over 1 year ago - 8 comments

#45 - some minor improvement

Pull Request - State: closed - Opened by xhebox over 1 year ago - 3 comments

#42 - ChatGLM 2已经出了，什么时候可以支持一下啊

Issue - State: open - Opened by kungrainbow over 1 year ago - 10 comments

#41 - chatglm-6b下的模型格式不正确

Issue - State: closed - Opened by wildkid1024 over 1 year ago - 1 comment

#40 - feat: support baichuan model

Pull Request - State: closed - Opened by chenqy4933 over 1 year ago

#39 - fix: fix typo

Pull Request - State: closed - Opened by rejoicesyc over 1 year ago - 1 comment

#38 - 没有支持最新的llama.cpp的格式吗

Issue - State: open - Opened by AceyKubbo over 1 year ago

#37 - Fixed an undefined variable in a optimized_x86.h file

Pull Request - State: closed - Opened by IanVzs over 1 year ago - 1 comment

#36 - docs(project): add alpaca and chatglm profiling

Pull Request - State: closed - Opened by tpoisonooo over 1 year ago - 1 comment

#35 - asserts 那个目录，建议改成 assets

Issue - State: closed - Opened by csukuangfj over 1 year ago - 1 comment

#34 - 在线程数>1时，会占满cpu核心

Issue - State: open - Opened by Yricky over 1 year ago - 3 comments

#32 - make报错

Issue - State: open - Opened by hoyin2013 over 1 year ago - 3 comments

#32 - make报错

Issue - State: open - Opened by hoyin2013 over 1 year ago - 3 comments

#31 - decode & decode_iter 多线程会不会有问题

Issue - State: open - Opened by guangyuanyu over 1 year ago

#29 - Update README.md

Pull Request - State: closed - Opened by tpoisonooo over 1 year ago

#28 - Linux 运行时报以下错误

Issue - State: closed - Opened by guangyuanyu over 1 year ago - 12 comments

#28 - Linux 运行时报以下错误

Issue - State: closed - Opened by guangyuanyu over 1 year ago - 12 comments

#27 - 目前完成的GPU部分

Pull Request - State: closed - Opened by SuperCB over 1 year ago - 4 comments

#26 - 请问如何实现的量化？

Issue - State: closed - Opened by lwo2002 over 1 year ago - 2 comments

#25 - feat(openllama): support openllama-3B

Pull Request - State: open - Opened by xingchensong over 1 year ago - 1 comment

#24 - isnan报错

Issue - State: open - Opened by AugF over 1 year ago - 1 comment

#23 - Support input prompt like llama.cpp

Issue - State: open - Opened by donge over 1 year ago

#22 - fix(avx): workaround for missing _mm256_set_m128i in GCC

Pull Request - State: closed - Opened by xingchensong over 1 year ago - 3 comments

#21 - 有实现思维树方式么

Issue - State: open - Opened by cery999 over 1 year ago

#20 - 准备添加GPU的初步设计

Pull Request - State: closed - Opened by SuperCB over 1 year ago - 2 comments

#19 - tokenizer 在哪里下载

Issue - State: closed - Opened by ljiuyuan1987 over 1 year ago - 2 comments
Labels: question

#18 - 更新的太慢了，求加速

Issue - State: open - Opened by wfan1203 over 1 year ago - 2 comments

#17 - windows下面编译失败

Issue - State: open - Opened by kavern1128 over 1 year ago - 8 comments

#16 - 希望能编译成so文件

Issue - State: closed - Opened by realcarlos over 1 year ago - 3 comments

#15 - 感觉回答有些错乱，用的是macbook pro 推理chinese-alpaca-7b-q4

Issue - State: open - Opened by realcarlos over 1 year ago - 5 comments

#14 - 是否有计划优化GPU上的推理加速

Issue - State: open - Opened by 77h2l over 1 year ago - 3 comments

#13 - 超参的理解是否是正确的？

Issue - State: open - Opened by WangFengtu1996 over 1 year ago - 2 comments

#12 - python API support

Issue - State: open - Opened by lucasjinreal over 1 year ago - 4 comments

#11 - Arm support Compute with fp16

Issue - State: open - Opened by chenqy4933 over 1 year ago

#10 - Optimize Arm Kernel

Issue - State: open - Opened by chenqy4933 over 1 year ago

#9 - Support more Model

Issue - State: open - Opened by chenqy4933 over 1 year ago - 5 comments

#8 - fix: add asan memory check

Pull Request - State: closed - Opened by chenqy4933 over 1 year ago

#7 - Fix linux build

Pull Request - State: closed - Opened by zchrissirhcz over 1 year ago - 1 comment

#6 - refact: refactor the graph load

Pull Request - State: closed - Opened by chenqy4933 over 1 year ago

#5 - fix: fix copyright

Pull Request - State: closed - Opened by chenqy4933 over 1 year ago

#4 - feat: add doc

Pull Request - State: closed - Opened by chenqy4933 over 1 year ago

#3 - Dev

Pull Request - State: closed - Opened by chenqy4933 over 1 year ago

#2 - feat: update the readme and delete some unused code

Pull Request - State: closed - Opened by chenqy4933 over 1 year ago

#1 - feat: init

Pull Request - State: closed - Opened by chenqy4933 over 1 year ago