Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / guidance-ai/llgtrt issues and pull requests

#7 - [question] First try to start llgtrt

Issue - State: open - Opened by thehumit 15 days ago - 1 comment

#6 - AppError should return 500

Pull Request - State: closed - Opened by datdo-msft 24 days ago

#5 - update TensorRT-LLM to 0.14.0

Pull Request - State: closed - Opened by mmoskal 29 days ago

#4 - Min P support

Issue - State: open - Opened by user-0a about 1 month ago - 3 comments

#3 - Add min_tokens param to openai frontend and through to trt backend.

Pull Request - State: closed - Opened by tot0 about 1 month ago

#2 - Ensure worker executors don't try and process request results.

Pull Request - State: closed - Opened by tot0 about 2 months ago - 2 comments

#1 - implement logprobs=1

Pull Request - State: closed - Opened by mmoskal about 2 months ago - 1 comment