Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / ztxz16/fastllm issues and pull requests

#490 - 增加embed python api接口，bert模型增加normalize

Pull Request - State: closed - Opened by jiewlmrh 1 day ago

#488 - pytorch模型转flm模型Killedt

Issue - State: closed - Opened by scutzhe 2 days ago - 1 comment

#485 - chatglm 失去 function calling 能力

Issue - State: open - Opened by NingRiCheng about 1 month ago

#484 - 编译完之后运行模型时报错

Issue - State: closed - Opened by supercj92 about 1 month ago - 1 comment

#483 - C++支持直接读取Deepseek Coder V1系列HF模型

Pull Request - State: closed - Opened by TylunasLi about 2 months ago

#482 - 请问一下国产显卡Ascend 910 and Hygon DCU如何安装fastllm？

Issue - State: open - Opened by cgq0816 about 2 months ago - 1 comment

#481 - GLM4-V-9B什么时候会出部署代码呢？

Issue - State: open - Opened by GalSang17 about 2 months ago

#480 - 如何多卡部署

Issue - State: open - Opened by longcheng183 2 months ago - 1 comment

#479 - C++支持直接加载DeepSeek V2 Lite系列的HF模型

Pull Request - State: closed - Opened by TylunasLi 2 months ago

#478 - 完善“支持的模型”文档

Pull Request - State: closed - Opened by TylunasLi 2 months ago

#477 - 修改install.sh

Pull Request - State: closed - Opened by 255-1 2 months ago

#476 - 修复Windows上MSVC无法成功编译的Bug。

Pull Request - State: closed - Opened by fluxlinkage 2 months ago

#475 - 可以在CMake中主动指定CUDA计算能力

Pull Request - State: closed - Opened by fluxlinkage 2 months ago - 2 comments

#474 - 支持将直接读取safetrensors得到的模型存为flm格式，并加载推理

Pull Request - State: closed - Opened by TylunasLi 3 months ago - 1 comment

#473 - 对于int4g模型，增加对fp16输入的支持

Pull Request - State: closed - Opened by jiewlmrh 3 months ago

#472 - 对于int8模型，增加对fp16输入的支持

Pull Request - State: closed - Opened by jiewlmrh 3 months ago

#470 - Meta-Llama-3-70B-Instruct

Issue - State: open - Opened by longcheng183 3 months ago - 5 comments

#468 - 修复__restrict__导致的restrict is not allowed错误

Pull Request - State: closed - Opened by ColorfulDick 3 months ago - 1 comment

#467 - 支持转换glm4-9b-chat模型

Pull Request - State: closed - Opened by TylunasLi 3 months ago

#467 - 支持转换glm4-9b-chat模型

Pull Request - State: closed - Opened by TylunasLi 3 months ago

#465 - GLM-4-6B-Chat转换成flm格式后不能加载

Issue - State: closed - Opened by HofNature 3 months ago - 5 comments

#464 - 修复Windows下的编译

Pull Request - State: closed - Opened by TylunasLi 3 months ago

#464 - 修复Windows下的编译

Pull Request - State: closed - Opened by TylunasLi 3 months ago

#463 - H800 docker 编译, half类型转换 编译报错

Issue - State: closed - Opened by ShadowTeamCN 4 months ago - 1 comment

#463 - H800 docker 编译, half类型转换 编译报错

Issue - State: closed - Opened by ShadowTeamCN 4 months ago - 1 comment

#462 - 请问什么时候支持GLM-4 ？

Issue - State: closed - Opened by Stupid-Ai 4 months ago - 4 comments

#460 - Added English Translation of Readme

Pull Request - State: closed - Opened by Wheylop 4 months ago

#460 - Added English Translation of Readme

Pull Request - State: closed - Opened by Wheylop 4 months ago

#459 - make -j过程中报错

Issue - State: open - Opened by AIlaowong 4 months ago - 3 comments

#458 - 添加add_special_tokens选项，默认true，支持chatglm

Pull Request - State: closed - Opened by levinxo 4 months ago - 1 comment

#458 - 添加add_special_tokens选项，默认true，支持chatglm

Pull Request - State: closed - Opened by levinxo 4 months ago - 1 comment

#457 - 请问现在支持deepseekv2量化吗

Issue - State: closed - Opened by fw2325 4 months ago - 1 comment

#457 - 请问现在支持deepseekv2量化吗

Issue - State: closed - Opened by fw2325 4 months ago - 1 comment

#455 - 解决，arm64 windows下编译报错

Pull Request - State: closed - Opened by dignfei 4 months ago

#453 - 提供一个兼容OpenAI 接口的http server

Pull Request - State: closed - Opened by MistSun-Chen 5 months ago - 1 comment

#452 - 结果返回一直是<unk>

Issue - State: open - Opened by VincentLore 5 months ago - 3 comments

#451 - 添加add_special_tokens选项，默认true，支持chatglm模型

Pull Request - State: closed - Opened by levinxo 5 months ago - 1 comment

#451 - 添加add_special_tokens选项，默认true，支持chatglm模型

Pull Request - State: closed - Opened by levinxo 5 months ago - 1 comment

#450 - chatglm3 相同提示词生成结果一致

Issue - State: open - Opened by ttaop 5 months ago

#449 - 采用向量化访存优化旧架构GPU性能

Pull Request - State: closed - Opened by TylunasLi 5 months ago

#449 - 采用向量化访存优化旧架构GPU性能

Pull Request - State: closed - Opened by TylunasLi 5 months ago

#448 - Do you have a plan to implement the CudaCatOp?

Issue - State: open - Opened by dp-aixball 5 months ago

#448 - Do you have a plan to implement the CudaCatOp?

Issue - State: open - Opened by dp-aixball 5 months ago

#447 - 中文输入无法识别；webui打开的地址无法访问。

Issue - State: closed - Opened by Mihubaba 5 months ago - 1 comment

#447 - 中文输入无法识别；webui打开的地址无法访问。

Issue - State: closed - Opened by Mihubaba 5 months ago - 1 comment

#446 - 千问qwen1.5-14B-chat解码错误

Issue - State: open - Opened by yiguanxian 5 months ago - 2 comments

#446 - 千问qwen1.5-14B-chat解码错误

Issue - State: open - Opened by yiguanxian 5 months ago - 2 comments

#445 - cmake -j报错

Issue - State: open - Opened by gggdroa 5 months ago - 2 comments

#445 - cmake -j报错

Issue - State: open - Opened by gggdroa 5 months ago - 2 comments

#443 - 无法安装fastllm_pytools

Issue - State: open - Opened by bailingchun 5 months ago - 1 comment

#443 - 无法安装fastllm_pytools

Issue - State: open - Opened by bailingchun 5 months ago - 1 comment

#442 - Llama支持分组查询注意力，支持书生2模型

Pull Request - State: closed - Opened by TylunasLi 6 months ago

#442 - Llama支持分组查询注意力，支持书生2模型

Pull Request - State: closed - Opened by TylunasLi 6 months ago

#441 - 添加QT界面Qui到example

Pull Request - State: closed - Opened by jacques-chen 6 months ago

#440 - 流式输出中断问题

Issue - State: open - Opened by lwinhong 6 months ago

#439 - 修复Windows下编译的几个问题

Pull Request - State: closed - Opened by TylunasLi 6 months ago

#439 - 修复Windows下编译的几个问题

Pull Request - State: closed - Opened by TylunasLi 6 months ago

#438 - 修复Win32Demo CPU构建错误

Pull Request - State: closed - Opened by TylunasLi 6 months ago - 1 comment

#437 - 模型转换的时候是不是不能用量化过的模型

Issue - State: open - Opened by shum-elli 6 months ago - 1 comment

#437 - 模型转换的时候是不是不能用量化过的模型

Issue - State: open - Opened by shum-elli 6 months ago - 1 comment

#436 - 是否支持qwen1.5的滑动窗口的方式

Issue - State: open - Opened by aofengdaxia 6 months ago

#436 - 是否支持qwen1.5的滑动窗口的方式

Issue - State: open - Opened by aofengdaxia 6 months ago

#433 - Error: cublas error during MatMul in Attention operator.

Issue - State: closed - Opened by pingyuan2016 6 months ago - 3 comments

#431 - 添加python Tensor级api

Pull Request - State: closed - Opened by wildkid1024 7 months ago

#431 - 添加python Tensor级api

Pull Request - State: closed - Opened by wildkid1024 7 months ago

#430 - fix docker build error, update cmake version and base image

Pull Request - State: closed - Opened by peter4431 7 months ago

#430 - fix docker build error, update cmake version and base image

Pull Request - State: closed - Opened by peter4431 7 months ago

#429 - ResponseBatch 返回结果不正确

Issue - State: open - Opened by Liufeiran123 7 months ago - 5 comments

#429 - ResponseBatch 返回结果不正确

Issue - State: open - Opened by Liufeiran123 7 months ago - 5 comments

#428 - MiniCPM模型Win32Demo工程编译、GPU执行问题修复

Pull Request - State: closed - Opened by TylunasLi 7 months ago

#428 - MiniCPM模型Win32Demo工程编译、GPU执行问题修复

Pull Request - State: closed - Opened by TylunasLi 7 months ago

#427 - batch padding mask 处理的相关代码

Issue - State: closed - Opened by Liufeiran123 7 months ago

#427 - batch padding mask 处理的相关代码

Issue - State: closed - Opened by Liufeiran123 7 months ago

#426 - support export minicpm-2b-float16.flm

Pull Request - State: closed - Opened by hadoop2xu 7 months ago

#426 - support export minicpm-2b-float16.flm

Pull Request - State: closed - Opened by hadoop2xu 7 months ago

#424 - fix minicpm

Pull Request - State: closed - Opened by hadoop2xu 7 months ago

#424 - fix minicpm

Pull Request - State: closed - Opened by hadoop2xu 7 months ago

#423 - support OpenBMB/MiniCPM

Pull Request - State: closed - Opened by hadoop2xu 7 months ago

#423 - support OpenBMB/MiniCPM

Pull Request - State: closed - Opened by hadoop2xu 7 months ago

#422 - 如何贡献代码 ？

Issue - State: closed - Opened by hadoop2xu 7 months ago

#422 - 如何贡献代码 ？

Issue - State: closed - Opened by hadoop2xu 7 months ago