Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / serverlessllm/serverlessllm issues and pull requests

#100 - feat(serve): deploy hardware information collector for worker nodes

Pull Request - State: closed - Opened by JustinTong0323 4 months ago - 2 comments
Labels: ready-for-gpu-testing

#99 - Fy/enhanced ci

Pull Request - State: closed - Opened by future-xy 4 months ago - 1 comment

#98 - [test] change the trigger of cli_test

Pull Request - State: closed - Opened by JustinTong0323 4 months ago

#97 - New Feature: Supporting Embedding API for transformers backend

Pull Request - State: closed - Opened by SecretSettler 4 months ago
Labels: ready-for-gpu-testing

#96 - [Fix] Fix gpu unavailable report

Pull Request - State: closed - Opened by SecretSettler 4 months ago

#95 - docs: Add Activate Worker Env before Apply vLLM Patch

Pull Request - State: closed - Opened by SiyangShao 4 months ago

#94 - Fix/update net address

Pull Request - State: closed - Opened by future-xy 4 months ago
Labels: ready-for-gpu-testing

#92 - [BUG] An ActorDiedError occurs when using transformers as the backend inference model

Issue - State: closed - Opened by Ltryxcy 5 months ago - 12 comments
Labels: Bug, Priority 0

#91 - [URGENT] docs: update sllm_store to dev4

Pull Request - State: closed - Opened by future-xy 5 months ago

#90 - [BUG] unable to convert the HuggingFace model to the ServerlessLLM format based on the documentation

Issue - State: closed - Opened by bwj1993 5 months ago - 14 comments
Labels: Bug, Documentation, Priority 0

#89 - fix: patch file and script

Pull Request - State: closed - Opened by SiyangShao 5 months ago
Labels: ready-for-gpu-testing

#88 - Lrq/publish workflow

Pull Request - State: closed - Opened by lrq619 5 months ago

#87 - fix: add script to apply patch

Pull Request - State: closed - Opened by SiyangShao 5 months ago

#86 - docs: add tips for usage with vllm

Pull Request - State: closed - Opened by SiyangShao 5 months ago

#85 - [test] Gpu workflow

Pull Request - State: closed - Opened by future-xy 5 months ago - 2 comments
Labels: ready-for-gpu-testing

#84 - Verify and add example for State Space Model (SSM) support in ServerlessLLM

Issue - State: open - Opened by andrei3131 5 months ago - 3 comments
Labels: Good first issue, Priority 2

#83 - Add support for quantization methods in ServerlessLLM Store

Issue - State: open - Opened by andrei3131 5 months ago - 1 comment
Labels: Priority 1, New feature

#82 - Fy/unified model path

Pull Request - State: closed - Opened by future-xy 5 months ago - 2 comments
Labels: ready-for-gpu-testing

#81 - Benchmark code for cluster evaluation

Issue - State: open - Opened by YuMJie 5 months ago - 1 comment
Labels: Question

#80 - Issue and PR templates

Pull Request - State: closed - Opened by andrei3131 5 months ago

#79 - Update test_sllm_store.yaml

Pull Request - State: closed - Opened by future-xy 5 months ago

#78 - Qwen model register usuccess but get a bug when requesting

Issue - State: open - Opened by Liucd0520 5 months ago - 3 comments
Labels: Bug

#77 - fix: mark model as registered only if model is registered successfully

Pull Request - State: closed - Opened by anyin233 5 months ago - 4 comments

#75 - I have a question about the implementation of the live-migration scheduling policy.

Issue - State: open - Opened by lxnlxnlxnlxnlxn 6 months ago - 1 comment
Labels: Question

#74 - Miss-spellings and Dead links correction

Issue - State: closed - Opened by lrq619 6 months ago

#73 - add linter CI

Pull Request - State: closed - Opened by lrq619 6 months ago - 2 comments

#72 - Bump transformers

Pull Request - State: closed - Opened by ccchow 6 months ago

#71 - Fix: Add formatting for commits

Pull Request - State: closed - Opened by drunkcoding 6 months ago
Labels: ready-for-gpu-testing

#70 - Revert "Update issue and PR templates"

Pull Request - State: closed - Opened by future-xy 6 months ago

#69 - fix: backend workflow changes

Pull Request - State: closed - Opened by SiyangShao 6 months ago

#68 - Update .gitignore

Pull Request - State: closed - Opened by future-xy 6 months ago

#67 - How is the model offloaded from the GPU to the host memory?

Issue - State: open - Opened by ToviHe 6 months ago - 3 comments
Labels: Question

#66 - chore: fix document assets position

Pull Request - State: closed - Opened by Chivier 6 months ago

#65 - [Tests] Add Unit Tests for CLI Commands in sllm-cli

Pull Request - State: closed - Opened by JustinTong0323 6 months ago - 1 comment

#64 - chore: fix intro in docs

Pull Request - State: closed - Opened by Chivier 6 months ago - 1 comment

#63 - ServerlessLLM community

Issue - State: closed - Opened by ustiugov 6 months ago

#62 - CPU support

Issue - State: closed - Opened by YuMJie 6 months ago - 1 comment
Labels: New feature

#61 - feat: vLLM integration

Pull Request - State: closed - Opened by SiyangShao 6 months ago

#59 - The development of serverless-llm-store code

Issue - State: closed - Opened by YuMJie 6 months ago - 1 comment
Labels: Documentation, Question

#58 - feat: ServerlessLLM Store c++ unit tests (CPU)

Pull Request - State: closed - Opened by future-xy 6 months ago - 2 comments

#57 - Does ServerlessLLM needs to modify the vLLM to support fast checkpoint loading?

Issue - State: closed - Opened by ConstantineRoot 6 months ago - 4 comments
Labels: Question

#56 - docs: update README.md

Pull Request - State: closed - Opened by eltociear 6 months ago

#55 - feat: backend unit tests

Pull Request - State: closed - Opened by SiyangShao 6 months ago - 3 comments

#54 - Is there a way to keep model in GPU after a completion request?

Issue - State: open - Opened by ccchow 6 months ago - 1 comment
Labels: Question, New feature

#53 - fix: vllm model downloader's GPU usage

Pull Request - State: closed - Opened by SiyangShao 6 months ago

#52 - Update issue and PR templates

Pull Request - State: closed - Opened by andrei3131 6 months ago
Labels: Project health

#51 - docs: minor improvements

Pull Request - State: closed - Opened by JustinTong0323 6 months ago - 1 comment
Labels: Documentation

#50 - docs: update documents

Pull Request - State: closed - Opened by future-xy 6 months ago
Labels: Documentation

#49 - Create LICENSE

Pull Request - State: closed - Opened by future-xy 6 months ago

#48 - Docs: suggestions for minor improvements

Issue - State: closed - Opened by andrei3131 6 months ago - 11 comments
Labels: Documentation

#47 - Docs: Improve onboarding for users by providing a diagram and an FAQ

Issue - State: open - Opened by andrei3131 6 months ago - 1 comment
Labels: Documentation

#46 - [Feat] Enhance deploy command to support partial configurations

Pull Request - State: closed - Opened by JustinTong0323 6 months ago - 1 comment

#45 - fix(cli): display model name when deploy using config

Pull Request - State: closed - Opened by JustinTong0323 6 months ago

#43 - [Doc] Update CONTRIBUTING.md

Pull Request - State: closed - Opened by Chivier 6 months ago

#42 - [Docs] Minor fix doc

Pull Request - State: closed - Opened by JustinTong0323 6 months ago - 5 comments

#41 - [Doc] Remove empty pages and update introduction

Pull Request - State: closed - Opened by future-xy 6 months ago - 1 comment

#40 - Some advice on the quickstart guide

Issue - State: closed - Opened by JasonZhang517 6 months ago - 3 comments

#39 - Update contributing guide

Issue - State: closed - Opened by future-xy 6 months ago - 1 comment

#38 - Add unit test for `sllm-serve` controller, model downloader

Issue - State: open - Opened by future-xy 6 months ago
Labels: Unit tests

#37 - Add unit test for `sllm-serve` backends

Issue - State: closed - Opened by future-xy 6 months ago
Labels: Unit tests

#36 - Add unit test for `sllm-cli`

Issue - State: closed - Opened by future-xy 6 months ago - 1 comment
Labels: Unit tests

#35 - Add unit test for `sllm-store`

Issue - State: closed - Opened by future-xy 6 months ago
Labels: Unit tests

#34 - Remove empty docs

Issue - State: closed - Opened by future-xy 6 months ago

#33 - feat: ROCm Support

Pull Request - State: closed - Opened by SiyangShao 6 months ago - 5 comments
Labels: New feature

#32 - [Feat] Enhance deploy functionality to allow overriding default configuration

Pull Request - State: closed - Opened by JustinTong0323 6 months ago - 1 comment

#31 - Add save/load interface for vLLM

Pull Request - State: closed - Opened by drunkcoding 6 months ago

#30 - [Docs] Add Multi-Machine setup guide

Pull Request - State: closed - Opened by JustinTong0323 6 months ago

#29 - docs: build sllm-store from source

Pull Request - State: closed - Opened by SiyangShao 6 months ago

#28 - Add essential format and ignore hints

Pull Request - State: closed - Opened by future-xy 6 months ago - 1 comment

#27 - feat: change save model path with backend name

Pull Request - State: closed - Opened by SiyangShao 7 months ago - 7 comments

#26 - 模型加载器的 vllm 实现 (model loader implementation for vllm)

Issue - State: closed - Opened by pipul 7 months ago - 5 comments
Labels: New feature

#24 - [BUG] `sllm-cli` reports successful deployment despite failure

Issue - State: closed - Opened by JustinTong0323 7 months ago - 2 comments
Labels: Bug

#23 - [Feature] Enhance `sllm-cli`

Issue - State: closed - Opened by future-xy 7 months ago

#22 - feat: storage aware scheduler

Pull Request - State: closed - Opened by future-xy 7 months ago - 2 comments

#21 - feat: add support for update autoscaling config

Pull Request - State: closed - Opened by SiyangShao 7 months ago

#20 - docker build error due to examples folder not found

Issue - State: closed - Opened by ccchow 7 months ago - 2 comments

#18 - fix: re-add examples folder

Pull Request - State: closed - Opened by JustinTong0323 7 months ago

#17 - [Docs] Delete model deployment after testing.

Issue - State: closed - Opened by future-xy 7 months ago - 1 comment

#16 - How to run sllm on two nodes?

Issue - State: closed - Opened by YuMJie 7 months ago - 6 comments

#15 - docs: update readme and fix docs (#14)

Pull Request - State: closed - Opened by future-xy 7 months ago

#14 - How to reproduce the results of loading 70B LLMs within 300-700ms?

Issue - State: open - Opened by duanzhaol 7 months ago - 3 comments
Labels: Question

#13 - docs: add sllm-store guide

Pull Request - State: closed - Opened by future-xy 7 months ago

#12 - [BUG] `sllm-store` loads `embed_tokens` and `embed_weight` to two devices.

Issue - State: open - Opened by future-xy 7 months ago
Labels: Bug, Priority 2

#11 - v0.1.0 Release Checklist for ServerlessLLM

Issue - State: closed - Opened by future-xy 7 months ago

#10 - Add contributors.

Pull Request - State: closed - Opened by luomai 7 months ago

#9 - Update README.md

Pull Request - State: closed - Opened by luomai 7 months ago

#8 - Initial release

Pull Request - State: closed - Opened by future-xy 7 months ago - 1 comment

#7 - A Question about the Eexperiment

Issue - State: closed - Opened by chenhongyu2048 11 months ago - 1 comment

#6 - When will the source code be released?

Issue - State: closed - Opened by lt2000 11 months ago - 5 comments

#5 - Where's the code?

Issue - State: closed - Opened by edi-bice 11 months ago

#4 - Live migration API proposal

Issue - State: closed - Opened by future-xy about 1 year ago - 6 comments

#3 - LLM Serve API proposal

Issue - State: closed - Opened by future-xy about 1 year ago - 1 comment

#2 - FasterCkpt (Faster Checkpoint) API proposal

Issue - State: closed - Opened by future-xy about 1 year ago - 2 comments

#1 - add README

Pull Request - State: closed - Opened by future-xy about 1 year ago