Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / opencsgs/llm-inference issues and pull requests

#50 - fix output issue 4 ui

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#50 - fix output issue 4 ui

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#49 - fix max-token conflict w/ DS

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#49 - fix max-token conflict w/ DS

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#47 - enable deepspeed inference

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#47 - enable deepspeed inference

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#46 - add parameter for timeout

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#46 - add parameter for timeout

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#45 - Inference throw timeout sometime

Issue - State: closed - Opened by SeanHH86 8 months ago - 1 comment

#45 - Inference throw timeout sometime

Issue - State: closed - Opened by SeanHH86 8 months ago - 1 comment

#44 - Add Qwen1.5-72B-chat

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#44 - Add Qwen1.5-72B-chat

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#43 - Update deepseek yaml file

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#43 - Update deepseek yaml file

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#42 - Update config.py for new model

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#42 - Update config.py for new model

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#41 - fix issue caused by huggingface pipeline with text-generation

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#41 - fix issue caused by huggingface pipeline with text-generation

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#40 - remove some abandoned implements

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#40 - remove some abandoned implements

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#39 - fix broken yamls

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#39 - fix broken yamls

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#38 - add opencsg-deepseek-coder-1.3b

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#38 - add opencsg-deepseek-coder-1.3b

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#35 - refine config for model: deepseek-coder-1.3b

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#35 - refine config for model: deepseek-coder-1.3b

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#33 - Device map not work with macos

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#33 - Device map not work with macos

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#32 - fix bug for set pad_token

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#32 - fix bug for set pad_token

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#31 - Break non text generation model by warmup

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#31 - Break non text generation model by warmup

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#30 - Enable warmup for defaulttransformers

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#30 - Enable warmup for defaulttransformers

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#29 - Output pipeline format not work

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#28 - Fix issue from_pretrain has no parameter device

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#28 - Fix issue from_pretrain has no parameter device

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#27 - Warmup mechanism

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#27 - Warmup mechanism

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#26 - Remove initializer: transformerpipeline

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#26 - Remove initializer: transformerpipeline

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#25 - Push image to opencsg registry

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#25 - Push image to opencsg registry

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#23 - Upgrade ray to 2.9.3

Issue - State: closed - Opened by SeanHH86 8 months ago - 1 comment

#23 - Upgrade ray to 2.9.3

Issue - State: closed - Opened by SeanHH86 8 months ago - 1 comment

#22 - Update document for download model from OpenCSG model hub

Pull Request - State: closed - Opened by SeanHH86 8 months ago - 1 comment

#22 - Update document for download model from OpenCSG model hub

Pull Request - State: closed - Opened by SeanHH86 8 months ago - 1 comment

#21 - Remove default creation of ddp, since have no idea if it's a case for…

Pull Request - State: closed - Opened by depenglee1707 8 months ago - 2 comments

#21 - Remove default creation of ddp, since have no idea if it's a case for…

Pull Request - State: closed - Opened by depenglee1707 8 months ago - 2 comments

#20 - Support Quantized Model

Issue - State: open - Opened by SeanHH86 8 months ago - 1 comment

#20 - Support Quantized Model

Issue - State: open - Opened by SeanHH86 8 months ago - 1 comment

#19 - Enable multiple workers cooperated on batch prompt

Pull Request - State: closed - Opened by depenglee1707 8 months ago

#18 - add model opencsg-deepseek-coder-1.3b-v0.1

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#18 - add model opencsg-deepseek-coder-1.3b-v0.1

Pull Request - State: closed - Opened by SeanHH86 8 months ago

#17 - Fix default pipeline output problem

Pull Request - State: closed - Opened by jasonhe258 8 months ago - 2 comments

#17 - Fix default pipeline output problem

Pull Request - State: closed - Opened by jasonhe258 8 months ago - 2 comments

#16 - [BUG] Get error when try "translation" downstream model

Issue - State: closed - Opened by depenglee1707 8 months ago - 1 comment

#16 - [BUG] Get error when try "translation" downstream model

Issue - State: closed - Opened by depenglee1707 8 months ago - 1 comment

#15 - Change model default download address

Issue - State: closed - Opened by SeanHH86 8 months ago - 2 comments

#15 - Change model default download address

Issue - State: closed - Opened by SeanHH86 8 months ago - 2 comments

#14 - Better to implement streaming output feature

Issue - State: closed - Opened by jasonhe258 8 months ago - 1 comment

#14 - Better to implement streaming output feature

Issue - State: closed - Opened by jasonhe258 8 months ago - 1 comment

#13 - Remove useless code about fine tuning

Pull Request - State: closed - Opened by jasonhe258 8 months ago - 1 comment

#13 - Remove useless code about fine tuning

Pull Request - State: closed - Opened by jasonhe258 8 months ago - 1 comment

#12 - format python code using autopep8 and add pylint

Pull Request - State: closed - Opened by jasonhe258 8 months ago - 5 comments

#12 - format python code using autopep8 and add pylint

Pull Request - State: closed - Opened by jasonhe258 8 months ago - 5 comments

#11 - update project url in readme

Pull Request - State: closed - Opened by jasonhe258 8 months ago

#10 - Add Developer Guide

Pull Request - State: closed - Opened by jasonhe258 8 months ago - 1 comment

#10 - Add Developer Guide

Pull Request - State: closed - Opened by jasonhe258 8 months ago - 1 comment

#9 - Fix README_cn.md translation

Pull Request - State: closed - Opened by pulltheflower 8 months ago - 1 comment

#8 - 速度和sglang相比哪个快？

Issue - State: open - Opened by njhouse365 8 months ago - 1 comment

#8 - 速度和sglang相比哪个快？

Issue - State: open - Opened by njhouse365 8 months ago - 1 comment

#7 - Add cn readme and license

Pull Request - State: closed - Opened by jasonhe258 8 months ago

#7 - Add cn readme and license

Pull Request - State: closed - Opened by jasonhe258 8 months ago

#6 - Fix output issue for default transformers pipeline

Pull Request - State: closed - Opened by jasonhe258 9 months ago - 2 comments

#5 - Fix loading issue for non text-generation models

Pull Request - State: closed - Opened by depenglee1707 9 months ago

#4 - enhance model if for cli

Pull Request - State: closed - Opened by jasonhe258 9 months ago

#3 - Wrong model id when there are -- in model id for do predict

Issue - State: closed - Opened by SeanHH86 9 months ago - 1 comment

#2 - replace / to -- in model id

Pull Request - State: closed - Opened by SeanHH86 9 months ago

#1 - Set min replica to 1 for opt-125m

Pull Request - State: closed - Opened by SeanHH86 9 months ago - 1 comment