Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / ModelTC/lightllm issues and pull requests

#603 - update lightllm version to 3.0.0

Pull Request - State: closed - Opened by hiworldwzj 9 days ago

#602 - [docs] Update docs.

Pull Request - State: closed - Opened by sufubao 9 days ago

#601 - 如果不想要进行batch推理的话应该怎么办？

Issue - State: closed - Opened by Chen8566 10 days ago - 2 comments
Labels: bug

#600 - [docs] Update docs.

Pull Request - State: closed - Opened by sufubao 11 days ago

#599 - add first_token_constraint_mode

Pull Request - State: closed - Opened by hiworldwzj 11 days ago

#598 - Allowed token ids

Pull Request - State: closed - Opened by hiworldwzj 11 days ago

#597 - [docs] Update docs.

Pull Request - State: closed - Opened by sufubao 11 days ago

#596 - refact quantization, support torchao quant and vllm w8a8

Pull Request - State: open - Opened by shihaobai 12 days ago

#595 - [BugFix] Fix reward model support

Pull Request - State: closed - Opened by sufubao 13 days ago

#594 - code clean.

Pull Request - State: closed - Opened by hiworldwzj 13 days ago

#593 - [BugFix] Fix reward model backend

Pull Request - State: closed - Opened by sufubao 13 days ago

#592 - Vit parallel

Pull Request - State: closed - Opened by SangChengC 13 days ago

#591 - [misc] add import vllm

Pull Request - State: closed - Opened by WANDY666 13 days ago

#590 - Vit parallel

Pull Request - State: closed - Opened by SangChengC 13 days ago

#587 - fix bug for deepseekv2 moe cache tensor manager

Pull Request - State: closed - Opened by hiworldwzj 15 days ago

#586 - [model] Use cache memory manager

Pull Request - State: closed - Opened by sufubao 16 days ago

#585 - Vit parallel

Pull Request - State: closed - Opened by SangChengC 16 days ago

#584 - Vit parallel

Pull Request - State: closed - Opened by SangChengC 16 days ago

#583 - [misc] Use fastapi lifespan

Pull Request - State: closed - Opened by sufubao 16 days ago

#582 - [misc] Use fastapi lifespan

Pull Request - State: closed - Opened by sufubao 16 days ago

#581 - Vit parallel

Pull Request - State: closed - Opened by SangChengC 16 days ago

#580 - add vllm moe configs

Pull Request - State: closed - Opened by WANDY666 16 days ago

#579 - Vit parallel

Pull Request - State: closed - Opened by SangChengC 16 days ago

#578 - add max len prefill infer check

Pull Request - State: closed - Opened by hiworldwzj 17 days ago

#577 - Vit parallel

Pull Request - State: closed - Opened by SangChengC 17 days ago

#576 - add lightllm_vllm_kernel

Pull Request - State: closed - Opened by WANDY666 18 days ago

#575 - [BUG] Unable to install with pip because PyO3 cannot be installed under Python 3.13

Issue - State: closed - Opened by yookoala 19 days ago - 6 comments
Labels: bug

#574 - add profile max_total_token_nums

Pull Request - State: closed - Opened by shihaobai 20 days ago

#573 - 支持encoder-only模型

Issue - State: open - Opened by EvanSong77 21 days ago - 1 comment
Labels: bug

#572 - Vit parallel

Pull Request - State: closed - Opened by SangChengC 23 days ago

#571 - Vit parallel

Pull Request - State: closed - Opened by SangChengC 23 days ago

#570 - Vit parallel

Pull Request - State: closed - Opened by SangChengC 23 days ago

#569 - support to read eos_id from config.json

Pull Request - State: closed - Opened by hiworldwzj 23 days ago

#568 - release local tensors alloc during cudagraph warmup

Pull Request - State: closed - Opened by shihaobai 24 days ago

#567 - [op] Modify embedding

Pull Request - State: closed - Opened by sufubao 26 days ago

#566 - attention decode use self.alloc_tensor interface.

Pull Request - State: closed - Opened by hiworldwzj 26 days ago

#565 - [misc] In-place add for embedding

Pull Request - State: closed - Opened by sufubao 26 days ago

#564 - [misc] modify flash decoding function

Pull Request - State: closed - Opened by sufubao 27 days ago

#563 - CPU Inference

Issue - State: open - Opened by JocelynPanPan 28 days ago - 1 comment

#562 - W4a16 fix

Pull Request - State: closed - Opened by shihaobai 30 days ago

#561 - New embedding

Pull Request - State: closed - Opened by sufubao about 1 month ago - 1 comment

#560 - New embedding

Pull Request - State: closed - Opened by sufubao about 1 month ago

#559 - Update README.md

Pull Request - State: closed - Opened by hiworldwzj about 1 month ago

#558 - slim dockerfile

Pull Request - State: closed - Opened by shihaobai about 1 month ago

#557 - fix llama3 prelayer weight load.

Pull Request - State: closed - Opened by hiworldwzj about 1 month ago

#556 - fix llama3 pre_layer_weight loading

Pull Request - State: closed - Opened by shihaobai about 1 month ago

#555 - add docker clean

Pull Request - State: closed - Opened by shihaobai about 1 month ago

#554 - fix cudagraph warmup for multimodal

Pull Request - State: closed - Opened by shihaobai about 1 month ago

#553 - 【bug】 fix alloc_tensor for torch.__version__ < 2.1.0

Pull Request - State: closed - Opened by hiworldwzj about 1 month ago

#552 - Function Calling support

Issue - State: closed - Opened by floschne about 1 month ago - 2 comments

#551 - add cudagraph warmup

Pull Request - State: closed - Opened by shihaobai about 1 month ago

#550 - Visual rpc scm

Pull Request - State: closed - Opened by SangChengC about 1 month ago

#549 - upgrade cuda graph mem manager

Pull Request - State: closed - Opened by hiworldwzj about 1 month ago

#548 - fix cuda graph

Pull Request - State: closed - Opened by hiworldwzj about 1 month ago

#547 - fix context_flashattention_nopad.py

Pull Request - State: closed - Opened by hiworldwzj about 1 month ago

#546 - fix bug for format out

Pull Request - State: closed - Opened by hiworldwzj about 1 month ago

#544 - add cudagraph for lightllm

Pull Request - State: closed - Opened by shihaobai about 1 month ago

#543 - New prefill op

Pull Request - State: closed - Opened by sufubao about 1 month ago

#542 - New prefill op

Pull Request - State: closed - Opened by fubaosu about 2 months ago

#541 - fix health_monitor bug

Pull Request - State: closed - Opened by hiworldwzj about 2 months ago

#540 - Improve mixtral

Pull Request - State: closed - Opened by flyinglandlord about 2 months ago

#539 - Update Dockerfile

Pull Request - State: closed - Opened by hiworldwzj about 2 months ago

#538 - Update Dockerfile

Pull Request - State: closed - Opened by hiworldwzj about 2 months ago

#537 - add get_model_name interface to get model name in server

Pull Request - State: closed - Opened by hiworldwzj about 2 months ago

#536 - update torch version to 2.4.0 and update gqa flash decoding kernel

Pull Request - State: closed - Opened by hiworldwzj about 2 months ago

#535 - fix push interrupt

Pull Request - State: closed - Opened by shihaobai 2 months ago

#534 - Add md qwen2 vl

Pull Request - State: closed - Opened by SangChengC 2 months ago

#533 - add_readme_qwen2vl

Pull Request - State: closed - Opened by SangChengC 2 months ago

#532 - Add qwen2 vl readme

Pull Request - State: closed - Opened by SangChengC 2 months ago

#531 - Add qwen2 vl readme

Pull Request - State: closed - Opened by SangChengC 2 months ago

#530 - Add qwen2 vl readme

Pull Request - State: closed - Opened by SangChengC 2 months ago

#529 - Update requirements.txt

Pull Request - State: closed - Opened by hiworldwzj 2 months ago

#528 - support_qwen2_vl

Pull Request - State: closed - Opened by SangChengC 2 months ago

#527 - update log

Pull Request - State: closed - Opened by shihaobai 2 months ago

#526 - fix

Pull Request - State: closed - Opened by hiworldwzj 2 months ago

#525 - qabot demo.

Pull Request - State: closed - Opened by hiworldwzj 2 months ago

#524 - Revert "Revert "edit docs ""

Pull Request - State: closed - Opened by fubaosu 2 months ago

#523 - add docs README.md

Pull Request - State: closed - Opened by fubaosu 2 months ago

#522 - Revert "ADD CN and EN docs"

Pull Request - State: closed - Opened by fubaosu 2 months ago

#521 - Update requirements.txt

Pull Request - State: closed - Opened by hiworldwzj 2 months ago

#520 - Update requirements.txt

Pull Request - State: closed - Opened by hiworldwzj 2 months ago

#519 - Update Dockerfile to fix package conficts

Pull Request - State: closed - Opened by hiworldwzj 2 months ago

#518 - Revert "edit docs "

Pull Request - State: closed - Opened by fubaosu 2 months ago

#517 - add push mertics log.

Pull Request - State: closed - Opened by hiworldwzj 2 months ago

#516 - [Feature] Token healing + regular format out.

Pull Request - State: closed - Opened by hiworldwzj 2 months ago

#515 - update to torch 2.1.0

Pull Request - State: closed - Opened by WANDY666 2 months ago

#514 - Add dispatcher support

Pull Request - State: closed - Opened by fubaosu 3 months ago

#513 - Assist

Pull Request - State: closed - Opened by fubaosu 3 months ago

#512 - [Feature] add gpu tensor cache feature.

Pull Request - State: closed - Opened by hiworldwzj 3 months ago

#511 - Data Parallelism for vision model

Pull Request - State: closed - Opened by SangChengC 3 months ago

#510 - Add dispatch support

Pull Request - State: closed - Opened by fubaosu 3 months ago

#509 - Add dispatch support

Pull Request - State: closed - Opened by fubaosu 3 months ago

#508 - add req input log.

Pull Request - State: closed - Opened by hiworldwzj 3 months ago

#507 - fix qwen2 for 1.8B 128k

Pull Request - State: closed - Opened by shihaobai 3 months ago

#506 - fix group pause

Pull Request - State: open - Opened by shihaobai 3 months ago

#504 - fix(router): fix pause_reqs() in InferBatch

Pull Request - State: closed - Opened by WuSiYu 3 months ago