Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / bentoml/bentotrtllm issues and pull requests

#9 - Batching for service

Issue - State: open - Opened by jackNhat 2 months ago

#8 - Update README.md

Pull Request - State: closed - Opened by rickzx 5 months ago - 1 comment

#7 - Update TRT-LLM to v0.10.0. Modify trtllm-build flags

Pull Request - State: closed - Opened by rickzx 5 months ago - 1 comment

#6 - Update README.md

Pull Request - State: closed - Opened by rickzx 6 months ago - 1 comment

#5 - docs: Update readme

Pull Request - State: closed - Opened by Sherlock113 6 months ago
Labels: documentation

#4 - Add 70B code and instructions

Pull Request - State: closed - Opened by rickzx 6 months ago

#3 - Update README to reflect kv_reuse feature

Pull Request - State: closed - Opened by rickzx 6 months ago

#2 - Enable asynchronous I/O

Pull Request - State: closed - Opened by rickzx 6 months ago

#1 - Support output streaming

Pull Request - State: closed - Opened by rickzx 6 months ago