Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / microsoft/sarathi-serve issues and pull requests
#43 - Unable to run offline_inference.py
Issue -
State: closed - Opened by amansahu278 19 days ago
- 2 comments
#42 - cannot assign GPU
Issue -
State: closed - Opened by Sunt-ing 20 days ago
- 5 comments
#41 - pipeline parallel fails at high load
Issue -
State: open - Opened by yunoJ 26 days ago
- 1 comment
#40 - A parameter error occurred when running the script.
Issue -
State: open - Opened by Jaxcong 26 days ago
- 1 comment
#39 - Use flashinfer kernel for autoregressive sampling
Pull Request -
State: closed - Opened by kasohrab 27 days ago
- 6 comments
#38 - missing data files
Issue -
State: closed - Opened by Sunt-ing about 1 month ago
- 8 comments
#37 - mismatch figures in osdi-sarathi-serve
Issue -
State: closed - Opened by Sunt-ing about 2 months ago
- 6 comments
#36 - How to determine token budget
Issue -
State: closed - Opened by deciding about 2 months ago
- 1 comment
#35 - Add paper link in readme
Pull Request -
State: closed - Opened by AgrawalAmey about 2 months ago
#34 - how to simply reproduce the paper
Issue -
State: closed - Opened by Sunt-ing about 2 months ago
- 1 comment
#33 - Add benchmark configuration settings
Pull Request -
State: closed - Opened by alvi75 about 2 months ago
#32 - [Core] Attention Refactoring
Pull Request -
State: closed - Opened by kompy99 2 months ago
- 1 comment
#31 - Merged PR 1916: Port Mixtral support from vLLM
Pull Request -
State: closed - Opened by AgrawalAmey 2 months ago
#30 - Add zmq based communication
Pull Request -
State: closed - Opened by AgrawalAmey 2 months ago
#29 - Peak memory profiling
Issue -
State: closed - Opened by Mrxiangli 2 months ago
- 4 comments
#28 - Merged PR 1908: Fix performance regression in pipeline parallel benchmark
Pull Request -
State: closed - Opened by AgrawalAmey 2 months ago
#27 - what is the relationship between SARATHI and sarathi-serve
Issue -
State: closed - Opened by irasin 2 months ago
- 2 comments
#26 - Minor: Fix formatting
Pull Request -
State: closed - Opened by AgrawalAmey 2 months ago
#25 - Minor: Fix formatting issues
Pull Request -
State: closed - Opened by AgrawalAmey 2 months ago
#24 - Add help strings for config args
Pull Request -
State: closed - Opened by AgrawalAmey 2 months ago
#23 - Fix minor bug in token append logic
Pull Request -
State: closed - Opened by AgrawalAmey 3 months ago
#22 - Output of prefill phase
Issue -
State: closed - Opened by azamikram 3 months ago
- 1 comment
#21 - which version of vllm your code is built on
Issue -
State: closed - Opened by Albert-Zhao-2020 3 months ago
- 1 comment
#20 - Merged PR 1874: Fix bug in async llm engine with pipeline parallel
Pull Request -
State: closed - Opened by AgrawalAmey 3 months ago
#19 - [CI/Build] Create codeql.yml
Pull Request -
State: closed - Opened by nitinkedia7 3 months ago
- 1 comment
#18 - Merged PR 1865: Critical bug fixes related to sampling
Pull Request -
State: closed - Opened by AgrawalAmey 3 months ago
#17 - Port of PR 1863: Remove flashinfer-unpaged and flashattention backends
Pull Request -
State: closed - Opened by AgrawalAmey 3 months ago
#16 - Port PR 1857: Add OpenAI Server
Pull Request -
State: closed - Opened by AgrawalAmey 3 months ago
#15 - Use pythonic config management
Pull Request -
State: closed - Opened by AgrawalAmey 3 months ago
#14 - Didn't find the trace files
Issue -
State: closed - Opened by zhypku 3 months ago
- 2 comments
#13 - Can't git clone https://[email protected]/msri/AI-Infrastructure/_git/llm-batching
Issue -
State: closed - Opened by lambda7xx 4 months ago
- 1 comment
#12 - Add OSDI Experiment Folder
Pull Request -
State: closed - Opened by nitinkedia7 4 months ago
#11 - "https://flashinfer.ai/whl/cu121/torch2.3/ " there is no files.
Issue -
State: closed - Opened by JuiceLemonLemon 4 months ago
- 2 comments
#10 - Port of PR 1813: Replace yapf with black
Pull Request -
State: closed - Opened by AgrawalAmey 4 months ago
#9 - Port of PR 1810: Fixes from OSDI cam ready runs
Pull Request -
State: closed - Opened by AgrawalAmey 4 months ago
#8 - Port of PR 1798: Add flashinfer unpaged attention
Pull Request -
State: closed - Opened by AgrawalAmey 4 months ago
#7 - Port of PR 1797: Pipeline parallel fix for PP>2 and other edge cases
Pull Request -
State: closed - Opened by AgrawalAmey 4 months ago
#6 - Minor tweaks to ease profiling for `Vidur` Simulator
Pull Request -
State: closed - Opened by nitinkedia7 5 months ago
#5 - Prepare for open-source release
Pull Request -
State: closed - Opened by nitinkedia7 5 months ago
#4 - Action required: self-attest your goal for this repository
Issue -
State: closed - Opened by microsoft-github-policy-service[bot] 5 months ago
- 3 comments
#3 - Action required: migrate or opt-out of migration to GitHub inside Microsoft
Issue -
State: closed - Opened by microsoft-github-policy-service[bot] 10 months ago
- 3 comments
#2 - Fix pylint workflow issues
Pull Request -
State: closed - Opened by apanwariisc 11 months ago
#1 - Initial commit
Pull Request -
State: closed - Opened by AgrawalAmey 11 months ago