Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / infinitensor/infinilm issues and pull requests

#29 - feat(gpt2):实现gpt2模型cuda版本单机推理

Pull Request - State: open - Opened by onenewcode 20 days ago

#28 - refactor(gpt2): 重构mlp和修改部分读取参数的方法

Pull Request - State: closed - Opened by onenewcode about 2 months ago

#27 - feat(gpt2): 添加对gpt2 cpu推理的支持

Pull Request - State: closed - Opened by onenewcode about 2 months ago

#26 - refactor: 优化gpu滚动推理

Pull Request - State: closed - Opened by pwhMass 3 months ago

#25 - enhancement(llama): 添加gpu滚动加载

Pull Request - State: closed - Opened by pwhMass 3 months ago

#24 - enhancement: cpu反量化推理，目前支持q8_0量化类型

Pull Request - State: closed - Opened by pwhMass 4 months ago

#22 - 支持glm4、Qwen2.5、bge-large-zh等模型

Issue - State: closed - Opened by xydz 5 months ago - 1 comment

#21 - Dev

Pull Request - State: closed - Opened by YdrMaster 6 months ago
Labels: enhancement, in progress

#20 - 添加 android generate

Pull Request - State: closed - Opened by ma-hang 6 months ago - 2 comments
Labels: enhancement

#19 - 添加 android crate

Pull Request - State: closed - Opened by YdrMaster 6 months ago
Labels: enhancement

#18 - Add Android interface for generate

Pull Request - State: closed - Opened by ma-hang 6 months ago

#17 - 抽取 Tokenizer

Pull Request - State: closed - Opened by YdrMaster 6 months ago
Labels: enhancement

#16 - 重构 chat-template 和 tokenizer

Pull Request - State: closed - Opened by YdrMaster 6 months ago
Labels: enhancement

#14 - fix typo

Pull Request - State: closed - Opened by syheliel 7 months ago

#14 - fix typo

Pull Request - State: closed - Opened by syheliel 7 months ago

#13 - move random search to operators-rs

Pull Request - State: closed - Opened by YdrMaster 7 months ago
Labels: documentation, enhancement

#12 - fix(service): 输入超长截取时会保留一段起始的部分

Pull Request - State: closed - Opened by pwhMass 7 months ago
Labels: enhancement

#11 - move session manager to service

Pull Request - State: closed - Opened by qinyiqun 7 months ago
Labels: enhancement

#10 - Session manager

Pull Request - State: closed - Opened by qinyiqun 7 months ago

#9 - Move the session management into middleware from web_api

Pull Request - State: closed - Opened by qinyiqun 8 months ago
Labels: enhancement

#8 - 接入 c 算子库

Pull Request - State: closed - Opened by kilinchange 8 months ago

#6 - 本项目的底层支撑是什么

Issue - State: closed - Opened by ShangwenWang 8 months ago - 2 comments
Labels: question

#5 - fix: xtask service中的匿名session现在也会限制数量

Pull Request - State: closed - Opened by pwhMass 9 months ago

#4 - feat (models): 支持mixtral (moe)模型cpu推理

Pull Request - State: closed - Opened by PanZezhong1725 9 months ago

#3 - (WIP) add paged_attention

Pull Request - State: closed - Opened by kilinchange 10 months ago

#2 - 网络推理服务API

Pull Request - State: closed - Opened by PanZezhong1725 11 months ago
Labels: in progress

#1 - feat (demo): 单机多轮会话demo

Pull Request - State: closed - Opened by PanZezhong1725 11 months ago