Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / microsoft/sarathi-serve issues and pull requests

#43 - Unable to run offline_inference.py

Issue - State: closed - Opened by amansahu278 19 days ago - 2 comments

#42 - cannot assign GPU

Issue - State: closed - Opened by Sunt-ing 20 days ago - 5 comments

#41 - pipeline parallel fails at high load

Issue - State: open - Opened by yunoJ 26 days ago - 1 comment

#40 - A parameter error occurred when running the script.

Issue - State: open - Opened by Jaxcong 26 days ago - 1 comment

#39 - Use flashinfer kernel for autoregressive sampling

Pull Request - State: closed - Opened by kasohrab 27 days ago - 6 comments

#38 - missing data files

Issue - State: closed - Opened by Sunt-ing about 1 month ago - 8 comments

#37 - mismatch figures in osdi-sarathi-serve

Issue - State: closed - Opened by Sunt-ing about 2 months ago - 6 comments

#36 - How to determine token budget

Issue - State: closed - Opened by deciding about 2 months ago - 1 comment

#35 - Add paper link in readme

Pull Request - State: closed - Opened by AgrawalAmey about 2 months ago

#34 - how to simply reproduce the paper

Issue - State: closed - Opened by Sunt-ing about 2 months ago - 1 comment

#33 - Add benchmark configuration settings

Pull Request - State: closed - Opened by alvi75 about 2 months ago

#32 - [Core] Attention Refactoring

Pull Request - State: closed - Opened by kompy99 2 months ago - 1 comment

#31 - Merged PR 1916: Port Mixtral support from vLLM

Pull Request - State: closed - Opened by AgrawalAmey 2 months ago

#30 - Add zmq based communication

Pull Request - State: closed - Opened by AgrawalAmey 2 months ago

#29 - Peak memory profiling

Issue - State: closed - Opened by Mrxiangli 2 months ago - 4 comments

#27 - what is the relationship between SARATHI and sarathi-serve

Issue - State: closed - Opened by irasin 2 months ago - 2 comments

#26 - Minor: Fix formatting

Pull Request - State: closed - Opened by AgrawalAmey 2 months ago

#25 - Minor: Fix formatting issues

Pull Request - State: closed - Opened by AgrawalAmey 2 months ago

#24 - Add help strings for config args

Pull Request - State: closed - Opened by AgrawalAmey 2 months ago

#23 - Fix minor bug in token append logic

Pull Request - State: closed - Opened by AgrawalAmey 3 months ago

#22 - Output of prefill phase

Issue - State: closed - Opened by azamikram 3 months ago - 1 comment

#21 - which version of vllm your code is built on

Issue - State: closed - Opened by Albert-Zhao-2020 3 months ago - 1 comment

#19 - [CI/Build] Create codeql.yml

Pull Request - State: closed - Opened by nitinkedia7 3 months ago - 1 comment

#18 - Merged PR 1865: Critical bug fixes related to sampling

Pull Request - State: closed - Opened by AgrawalAmey 3 months ago

#16 - Port PR 1857: Add OpenAI Server

Pull Request - State: closed - Opened by AgrawalAmey 3 months ago

#15 - Use pythonic config management

Pull Request - State: closed - Opened by AgrawalAmey 3 months ago

#14 - Didn't find the trace files

Issue - State: closed - Opened by zhypku 3 months ago - 2 comments

#12 - Add OSDI Experiment Folder

Pull Request - State: closed - Opened by nitinkedia7 4 months ago

#11 - "https://flashinfer.ai/whl/cu121/torch2.3/ " there is no files.

Issue - State: closed - Opened by JuiceLemonLemon 4 months ago - 2 comments

#10 - Port of PR 1813: Replace yapf with black

Pull Request - State: closed - Opened by AgrawalAmey 4 months ago

#9 - Port of PR 1810: Fixes from OSDI cam ready runs

Pull Request - State: closed - Opened by AgrawalAmey 4 months ago

#8 - Port of PR 1798: Add flashinfer unpaged attention

Pull Request - State: closed - Opened by AgrawalAmey 4 months ago

#6 - Minor tweaks to ease profiling for `Vidur` Simulator

Pull Request - State: closed - Opened by nitinkedia7 5 months ago

#5 - Prepare for open-source release

Pull Request - State: closed - Opened by nitinkedia7 5 months ago

#2 - Fix pylint workflow issues

Pull Request - State: closed - Opened by apanwariisc 11 months ago

#1 - Initial commit

Pull Request - State: closed - Opened by AgrawalAmey 11 months ago