Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / bentoml/llm-bench issues and pull requests
#13 - Iterating Data Chunks Logical Issue
Issue -
State: open - Opened by zhanggzh 26 days ago
#12 - llm perf logs to ML repo
Pull Request -
State: closed - Opened by kunwar31 about 1 month ago
#11 - Base_URL based problem
Issue -
State: open - Opened by Amber-Believe 3 months ago
- 1 comment
#10 - feat: allow multiple system prompts usage
Pull Request -
State: open - Opened by larme 4 months ago
#9 - feat: customize max tokens and system prompt with env var
Pull Request -
State: closed - Opened by larme 5 months ago
#8 - Incorrect benchmarks
Issue -
State: open - Opened by AIvashov 5 months ago
#7 - Time To First Token measurement
Issue -
State: open - Opened by huangh12 5 months ago
#6 - 咨询一下关于 使用 4 位 AWQ 量化后,在单个 A100-80G 实例上加载模型权重需要大约 37 GB 的 RAM 的问题
Issue -
State: closed - Opened by akaihaoshuai 5 months ago
#5 - fix: ttft calculation bug
Pull Request -
State: closed - Opened by larme 6 months ago
#4 - add median/95th/99th stats
Pull Request -
State: closed - Opened by larme 6 months ago
#3 - Update benchmark script and README
Pull Request -
State: closed - Opened by rickzx 6 months ago
#2 - Add report_final to report aggregated metrics over the benchmark run
Pull Request -
State: closed - Opened by rickzx 6 months ago
#1 - Tgi benchmarking
Pull Request -
State: closed - Opened by XunchaoZ about 1 year ago