Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / ray-project/llmperf issues and pull requests

#83 - Fix typo

Pull Request - State: open - Opened by strickvl 10 days ago

#81 - Add an option to use the relevant tokenizer

Pull Request - State: open - Opened by pinak-p about 1 month ago

#80 - Benchmarking Gimlet Models using LLMPerf

Pull Request - State: closed - Opened by TarasPriadka about 1 month ago

#79 - error

Pull Request - State: closed - Opened by TomerG711 4 months ago

#79 - error

Pull Request - State: closed - Opened by TomerG711 4 months ago

#78 - Support other scenarios

Issue - State: open - Opened by yw-furiosa 4 months ago

#78 - Support other scenarios

Issue - State: open - Opened by yw-furiosa 4 months ago

#77 - how to test vllm interface

Issue - State: open - Opened by ZTurboX 4 months ago

#77 - how to test vllm interface

Issue - State: open - Opened by ZTurboX 4 months ago

#76 - Using `max_concurrency` or AsyncActor?

Issue - State: open - Opened by chiragjn 4 months ago

#76 - Using `max_concurrency` or AsyncActor?

Issue - State: open - Opened by chiragjn 4 months ago

#75 - Wrong generated prompt length

Issue - State: open - Opened by PietroFerr 4 months ago

#75 - Wrong generated prompt length

Issue - State: open - Opened by PietroFerr 4 months ago

#74 - Refactor to use `yarl` package for safe URL manipulation

Pull Request - State: open - Opened by rapsealk 4 months ago - 1 comment

#74 - Refactor to use `yarl` package for safe URL manipulation

Pull Request - State: open - Opened by rapsealk 4 months ago - 1 comment

#73 - Feat/trust remote code

Pull Request - State: open - Opened by jouDance 5 months ago

#73 - Feat/trust remote code

Pull Request - State: open - Opened by jouDance 5 months ago

#72 - Adjust chat completion request message order

Pull Request - State: closed - Opened by ohm314 5 months ago - 1 comment

#72 - Adjust chat completion request message order

Pull Request - State: closed - Opened by ohm314 5 months ago - 1 comment

#71 - Raise exception when errors

Pull Request - State: closed - Opened by markVaykhansky 5 months ago

#71 - Raise exception when errors

Pull Request - State: closed - Opened by markVaykhansky 5 months ago

#70 - Error while using pip

Issue - State: open - Opened by avi7611 5 months ago - 1 comment

#70 - Error while using pip

Issue - State: open - Opened by avi7611 5 months ago - 1 comment

#69 - Contributions guidelines

Issue - State: open - Opened by miloszwatroba 5 months ago

#69 - Contributions guidelines

Issue - State: open - Opened by miloszwatroba 5 months ago

#68 - Use appropriate tokenizer

Pull Request - State: closed - Opened by markVaykhansky 5 months ago

#68 - Use appropriate tokenizer

Pull Request - State: closed - Opened by markVaykhansky 5 months ago

#67 - Azure OpenAi Endpoint Support

Issue - State: open - Opened by gujju62 6 months ago

#67 - Azure OpenAi Endpoint Support

Issue - State: open - Opened by gujju62 6 months ago

#66 - Add local triton client

Pull Request - State: closed - Opened by protagohhz 6 months ago

#66 - Add local triton client

Pull Request - State: closed - Opened by protagohhz 6 months ago

#65 - Update openai_chat_completions_client.py

Pull Request - State: closed - Opened by jmhessel 6 months ago

#64 - fix issue #63

Pull Request - State: open - Opened by huangdi614 7 months ago

#62 - fix typo

Pull Request - State: open - Opened by zhimin-z 7 months ago

#62 - fix typo

Pull Request - State: open - Opened by zhimin-z 7 months ago

#61 - Fixes `Divide by zero` error

Pull Request - State: open - Opened by e3oroush 7 months ago

#61 - Fixes `Divide by zero` error

Pull Request - State: open - Opened by e3oroush 7 months ago

#60 - Update README from LLMPerf to BeFOri

Pull Request - State: closed - Opened by ori-cfowler 8 months ago

#60 - Update README from LLMPerf to BeFOri

Pull Request - State: closed - Opened by ori-cfowler 8 months ago

#58 - How to use llmperf to test ollama performance (TTFT, etc)

Issue - State: open - Opened by alexhegit 8 months ago - 1 comment

#58 - How to use llmperf to test ollama performance (TTFT, etc)

Issue - State: open - Opened by alexhegit 8 months ago - 1 comment

#54 - Improve benchmark tput by moving prompt preparation outside of loop

Pull Request - State: closed - Opened by gracehonv 8 months ago - 1 comment

#54 - Improve benchmark tput by moving prompt preparation outside of loop

Pull Request - State: closed - Opened by gracehonv 8 months ago - 1 comment

#53 - Sagemaker client issue

Issue - State: open - Opened by SuchethaChintha 9 months ago - 2 comments

#53 - Sagemaker client issue

Issue - State: open - Opened by SuchethaChintha 9 months ago - 3 comments

#52 - Benchmark

Pull Request - State: closed - Opened by philschmid 9 months ago

#51 - Fix typo in README

Pull Request - State: closed - Opened by sparsh2 9 months ago - 1 comment

#51 - Fix typo in README

Pull Request - State: closed - Opened by sparsh2 9 months ago - 1 comment

#50 - DOC: add location to sonnet.txt and fix typo

Pull Request - State: open - Opened by tuhinsharma121 9 months ago - 1 comment

#49 - error in request_metrics dictionary implementation

Issue - State: open - Opened by Durga2Dash 9 months ago

#49 - error in request_metrics dictionary implementation

Issue - State: open - Opened by Durga2Dash 9 months ago

#48 - Vertex AI API needs to be updated.

Issue - State: open - Opened by Durga2Dash 9 months ago

#48 - Vertex AI API needs to be updated.

Issue - State: open - Opened by Durga2Dash 9 months ago

#45 - Fix decoding throughput computation

Pull Request - State: closed - Opened by comaniac 11 months ago

#45 - Fix decoding throughput computation

Pull Request - State: closed - Opened by comaniac 11 months ago

#44 - unable to get the benchmark result

Issue - State: open - Opened by dipshirajput 11 months ago - 1 comment

#44 - unable to get the benchmark result

Issue - State: open - Opened by dipshirajput 11 months ago - 1 comment

#43 - Blocking on pending requests despite block == false

Issue - State: open - Opened by dacorvo 11 months ago - 1 comment

#43 - Blocking on pending requests despite block == false

Issue - State: open - Opened by dacorvo 11 months ago - 1 comment

#42 - Add Hugging face client

Pull Request - State: open - Opened by philschmid 11 months ago - 2 comments

#42 - Add Hugging face client

Pull Request - State: open - Opened by philschmid 11 months ago - 2 comments

#41 - Added Azure OpenAI endpoint support

Pull Request - State: open - Opened by datlife 11 months ago - 1 comment

#40 - feat: Client Added for Predibase

Pull Request - State: open - Opened by bhaba-ranjan 11 months ago

#39 - minor typo fix

Pull Request - State: open - Opened by jimburtoft 11 months ago

#38 - HUGGINGFACE set

Issue - State: open - Opened by capyun 12 months ago

#37 - Update README.md

Pull Request - State: open - Opened by xieus 12 months ago

#37 - Update README.md

Pull Request - State: open - Opened by xieus 12 months ago

#36 - Added azureai client

Pull Request - State: open - Opened by VindyaKonjarla almost 1 year ago - 3 comments

#36 - Added azureai client

Pull Request - State: open - Opened by VindyaKonjarla almost 1 year ago - 3 comments

#35 - bug of counting output tokens

Issue - State: open - Opened by irasin almost 1 year ago

#35 - bug of counting output tokens

Issue - State: open - Opened by irasin almost 1 year ago

#34 - llmperf not working for concurrent users

Issue - State: open - Opened by nkanike07 about 1 year ago

#34 - llmperf not working for concurrent users

Issue - State: open - Opened by nkanike07 about 1 year ago

#33 - Bug: Hugging Face TGI not working

Issue - State: open - Opened by ptrmayer about 1 year ago

#33 - Bug: Hugging Face TGI not working

Issue - State: open - Opened by ptrmayer about 1 year ago

#32 - Concurrency level is not handled properly

Issue - State: open - Opened by alexeykudinkin about 1 year ago

#32 - Concurrency level is not handled properly

Issue - State: open - Opened by alexeykudinkin about 1 year ago

#31 - Add memory bandwidth utilization metric

Issue - State: open - Opened by mmcclean-aws about 1 year ago

#31 - Add memory bandwidth utilization metric

Issue - State: open - Opened by mmcclean-aws about 1 year ago

#30 - Handling custom codes arguments like trust_remote_code

Issue - State: open - Opened by Akash08naik about 1 year ago

#30 - Handling custom codes arguments like trust_remote_code

Issue - State: open - Opened by Akash08naik about 1 year ago

#29 - usage for local models .

Issue - State: open - Opened by Akash08naik about 1 year ago

#29 - usage for local models .

Issue - State: open - Opened by Akash08naik about 1 year ago

#28 - [Feature] Add Triton Inference Server support

Pull Request - State: closed - Opened by mo-hai about 1 year ago - 1 comment

#28 - [Feature] Add Triton Inference Server support

Pull Request - State: closed - Opened by mo-hai about 1 year ago - 1 comment

#27 - Fix typos and add caveats

Pull Request - State: closed - Opened by rickyyx about 1 year ago