Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / ray-project/llmperf issues and pull requests

#79 - error

Pull Request - State: closed - Opened by TomerG711 13 days ago

#79 - error

Pull Request - State: closed - Opened by TomerG711 13 days ago

#78 - Support other scenarios

Issue - State: open - Opened by yw-furiosa 21 days ago

#78 - Support other scenarios

Issue - State: open - Opened by yw-furiosa 21 days ago

#77 - how to test vllm interface

Issue - State: open - Opened by ZTurboX 24 days ago

#77 - how to test vllm interface

Issue - State: open - Opened by ZTurboX 24 days ago

#76 - Using `max_concurrency` or AsyncActor?

Issue - State: open - Opened by chiragjn 28 days ago

#76 - Using `max_concurrency` or AsyncActor?

Issue - State: open - Opened by chiragjn 28 days ago

#75 - Wrong generated prompt length

Issue - State: open - Opened by PietroFerr about 1 month ago

#75 - Wrong generated prompt length

Issue - State: open - Opened by PietroFerr about 1 month ago

#74 - Refactor to use `yarl` package for safe URL manipulation

Pull Request - State: open - Opened by rapsealk about 1 month ago - 1 comment

#74 - Refactor to use `yarl` package for safe URL manipulation

Pull Request - State: open - Opened by rapsealk about 1 month ago - 1 comment

#73 - Feat/trust remote code

Pull Request - State: open - Opened by jouDance about 1 month ago

#73 - Feat/trust remote code

Pull Request - State: open - Opened by jouDance about 1 month ago

#72 - Adjust chat completion request message order

Pull Request - State: closed - Opened by ohm314 about 2 months ago - 1 comment

#72 - Adjust chat completion request message order

Pull Request - State: closed - Opened by ohm314 about 2 months ago - 1 comment

#71 - Raise exception when errors

Pull Request - State: closed - Opened by markVaykhansky about 2 months ago

#71 - Raise exception when errors

Pull Request - State: closed - Opened by markVaykhansky about 2 months ago

#70 - Error while using pip

Issue - State: open - Opened by avi7611 2 months ago - 1 comment

#70 - Error while using pip

Issue - State: open - Opened by avi7611 2 months ago - 1 comment

#69 - Contributions guidelines

Issue - State: open - Opened by miloszwatroba 2 months ago

#69 - Contributions guidelines

Issue - State: open - Opened by miloszwatroba 2 months ago

#68 - Use appropriate tokenizer

Pull Request - State: closed - Opened by markVaykhansky 2 months ago

#68 - Use appropriate tokenizer

Pull Request - State: closed - Opened by markVaykhansky 2 months ago

#67 - Azure OpenAi Endpoint Support

Issue - State: open - Opened by gujju62 3 months ago

#67 - Azure OpenAi Endpoint Support

Issue - State: open - Opened by gujju62 3 months ago

#66 - Add local triton client

Pull Request - State: closed - Opened by protagohhz 3 months ago

#66 - Add local triton client

Pull Request - State: closed - Opened by protagohhz 3 months ago

#65 - Update openai_chat_completions_client.py

Pull Request - State: closed - Opened by jmhessel 3 months ago

#64 - fix issue #63

Pull Request - State: open - Opened by huangdi614 3 months ago

#62 - fix typo

Pull Request - State: open - Opened by zhimin-z 3 months ago

#62 - fix typo

Pull Request - State: open - Opened by zhimin-z 3 months ago

#61 - Fixes `Divide by zero` error

Pull Request - State: open - Opened by e3oroush 3 months ago

#61 - Fixes `Divide by zero` error

Pull Request - State: open - Opened by e3oroush 3 months ago

#60 - Update README from LLMPerf to BeFOri

Pull Request - State: closed - Opened by ori-cfowler 4 months ago

#60 - Update README from LLMPerf to BeFOri

Pull Request - State: closed - Opened by ori-cfowler 4 months ago

#58 - How to use llmperf to test ollama performance (TTFT, etc)

Issue - State: open - Opened by alexhegit 5 months ago - 1 comment

#58 - How to use llmperf to test ollama performance (TTFT, etc)

Issue - State: open - Opened by alexhegit 5 months ago - 1 comment

#54 - Improve benchmark tput by moving prompt preparation outside of loop

Pull Request - State: closed - Opened by gracehonv 5 months ago - 1 comment

#54 - Improve benchmark tput by moving prompt preparation outside of loop

Pull Request - State: closed - Opened by gracehonv 5 months ago - 1 comment

#53 - Sagemaker client issue

Issue - State: open - Opened by SuchethaChintha 5 months ago

#53 - Sagemaker client issue

Issue - State: open - Opened by SuchethaChintha 5 months ago

#52 - Benchmark

Pull Request - State: closed - Opened by philschmid 6 months ago

#51 - Fix typo in README

Pull Request - State: closed - Opened by sparsh2 6 months ago - 1 comment

#51 - Fix typo in README

Pull Request - State: closed - Opened by sparsh2 6 months ago - 1 comment

#50 - DOC: add location to sonnet.txt and fix typo

Pull Request - State: open - Opened by tuhinsharma121 6 months ago - 1 comment

#49 - error in request_metrics dictionary implementation

Issue - State: open - Opened by Durga2Dash 6 months ago

#49 - error in request_metrics dictionary implementation

Issue - State: open - Opened by Durga2Dash 6 months ago

#48 - Vertex AI API needs to be updated.

Issue - State: open - Opened by Durga2Dash 6 months ago

#48 - Vertex AI API needs to be updated.

Issue - State: open - Opened by Durga2Dash 6 months ago

#45 - Fix decoding throughput computation

Pull Request - State: closed - Opened by comaniac 8 months ago

#45 - Fix decoding throughput computation

Pull Request - State: closed - Opened by comaniac 8 months ago

#44 - unable to get the benchmark result

Issue - State: open - Opened by dipshirajput 8 months ago - 1 comment

#44 - unable to get the benchmark result

Issue - State: open - Opened by dipshirajput 8 months ago - 1 comment

#43 - Blocking on pending requests despite block == false

Issue - State: open - Opened by dacorvo 8 months ago - 1 comment

#43 - Blocking on pending requests despite block == false

Issue - State: open - Opened by dacorvo 8 months ago - 1 comment

#42 - Add Hugging face client

Pull Request - State: open - Opened by philschmid 8 months ago - 2 comments

#42 - Add Hugging face client

Pull Request - State: open - Opened by philschmid 8 months ago - 2 comments

#41 - Added Azure OpenAI endpoint support

Pull Request - State: open - Opened by datlife 8 months ago - 1 comment

#40 - feat: Client Added for Predibase

Pull Request - State: open - Opened by bhaba-ranjan 8 months ago

#39 - minor typo fix

Pull Request - State: open - Opened by jimburtoft 8 months ago

#38 - HUGGINGFACE set

Issue - State: open - Opened by capyun 8 months ago

#37 - Update README.md

Pull Request - State: open - Opened by xieus 9 months ago

#37 - Update README.md

Pull Request - State: open - Opened by xieus 9 months ago

#36 - Added azureai client

Pull Request - State: open - Opened by VindyaKonjarla 9 months ago - 3 comments

#36 - Added azureai client

Pull Request - State: open - Opened by VindyaKonjarla 9 months ago - 3 comments

#35 - bug of counting output tokens

Issue - State: open - Opened by irasin 9 months ago

#35 - bug of counting output tokens

Issue - State: open - Opened by irasin 9 months ago

#34 - llmperf not working for concurrent users

Issue - State: open - Opened by nkanike07 9 months ago

#34 - llmperf not working for concurrent users

Issue - State: open - Opened by nkanike07 9 months ago

#33 - Bug: Hugging Face TGI not working

Issue - State: open - Opened by ptrmayer 9 months ago

#33 - Bug: Hugging Face TGI not working

Issue - State: open - Opened by ptrmayer 9 months ago

#32 - Concurrency level is not handled properly

Issue - State: open - Opened by alexeykudinkin 10 months ago

#32 - Concurrency level is not handled properly

Issue - State: open - Opened by alexeykudinkin 10 months ago

#31 - Add memory bandwidth utilization metric

Issue - State: open - Opened by mmcclean-aws 10 months ago

#31 - Add memory bandwidth utilization metric

Issue - State: open - Opened by mmcclean-aws 10 months ago

#29 - usage for local models .

Issue - State: open - Opened by Akash08naik 10 months ago

#29 - usage for local models .

Issue - State: open - Opened by Akash08naik 10 months ago

#28 - [Feature] Add Triton Inference Server support

Pull Request - State: closed - Opened by mo-hai 11 months ago - 1 comment

#28 - [Feature] Add Triton Inference Server support

Pull Request - State: closed - Opened by mo-hai 11 months ago - 1 comment

#27 - Fix typos and add caveats

Pull Request - State: closed - Opened by rickyyx 11 months ago

#27 - Fix typos and add caveats

Pull Request - State: closed - Opened by rickyyx 11 months ago

#26 - Fix Installation instructions in README.md

Pull Request - State: closed - Opened by mgoin 11 months ago

#26 - Fix Installation instructions in README.md

Pull Request - State: closed - Opened by mgoin 11 months ago

#25 - Fixed URL by adding version V1 prefix to OpenAI LLMPerf client

Pull Request - State: open - Opened by drelu 11 months ago