Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / lightning-ai/litserve issues and pull requests

#360 - Update media type and JSON handling in OpenAISpec

Pull Request - State: closed - Opened by fabigr8 4 days ago - 1 comment

#359 - bug: OpenAI-Spec should send text/event-stream

Issue - State: closed - Opened by fabigr8 5 days ago - 6 comments
Labels: bug, help wanted

#358 - make @borda global code owner

Pull Request - State: closed - Opened by aniketmaurya 7 days ago - 1 comment

#357 - Development release 0.2.5.dev0

Pull Request - State: closed - Opened by aniketmaurya 7 days ago - 1 comment

#356 - Fail fast when LitAPI.setup has error

Pull Request - State: closed - Opened by aniketmaurya 8 days ago - 1 comment
Labels: enhancement

#355 - GET Request

Issue - State: closed - Opened by gururaser 9 days ago - 5 comments
Labels: enhancement

#354 - Default Input-Output schema

Issue - State: open - Opened by aniketmaurya 9 days ago
Labels: enhancement

#353 - [pre-commit.ci] pre-commit suggestions

Pull Request - State: closed - Opened by pre-commit-ci[bot] 10 days ago - 2 comments

#352 - How to route /docs path in litserve behind a proxy?

Issue - State: closed - Opened by Mayurji 11 days ago - 6 comments
Labels: bug, help wanted

#351 - Release 0.2.4

Pull Request - State: closed - Opened by aniketmaurya 15 days ago - 1 comment

#350 - Can't start the demo example without bug

Issue - State: closed - Opened by anonym-ai 16 days ago - 3 comments
Labels: bug, help wanted

#349 - stream tool calling

Pull Request - State: closed - Opened by whisper-bye 16 days ago - 3 comments
Labels: bug

#348 - Support for async requests or webhooks

Issue - State: closed - Opened by brian316 17 days ago - 3 comments
Labels: enhancement

#347 - LitServe server doesn't crash when there is a failure in setup

Issue - State: closed - Opened by tchaton 18 days ago - 3 comments
Labels: enhancement, help wanted

#346 - Add dockerization to feature list

Pull Request - State: closed - Opened by aniketmaurya 21 days ago - 1 comment
Labels: documentation

#345 - Add dockerize example in the README

Issue - State: closed - Opened by tchaton 21 days ago - 2 comments
Labels: enhancement

#344 - Improve the debugging experience of LitServe

Issue - State: open - Opened by tchaton 21 days ago - 1 comment
Labels: enhancement

#343 - Litserve entrypoint wasn't properly registered on first install in Studios

Issue - State: closed - Opened by tchaton 21 days ago - 1 comment
Labels: bug, help wanted

#342 - Add custom healthcheck path

Pull Request - State: open - Opened by akuma12 22 days ago - 1 comment

#341 - Add custom path option for healthcheck

Issue - State: open - Opened by akuma12 22 days ago - 2 comments
Labels: enhancement

#339 - Prometheus logger is not pickable + monitoring metrics set via self.log are not tracked

Issue - State: closed - Opened by miguelalba96 24 days ago - 5 comments
Labels: bug, help wanted

#338 - Fix Docker Argument Handling

Pull Request - State: closed - Opened by aniketmaurya 24 days ago - 1 comment

#337 - improve error handling from inference worker processes

Pull Request - State: closed - Opened by aniketmaurya 24 days ago - 1 comment

#336 - Test multiple Python version compatibility

Pull Request - State: open - Opened by aniketmaurya 24 days ago - 1 comment

#335 - Host param

Pull Request - State: closed - Opened by grumpyp 27 days ago - 1 comment

#334 - Avoiding counting active requests in /health and /metrics

Pull Request - State: closed - Opened by vrdn-23 about 1 month ago - 3 comments

#333 - Add support for selecting Python version in Dockerfile

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment

#332 - update(lint): prune config

Pull Request - State: closed - Opened by Borda about 1 month ago - 1 comment

#331 - lint: emergency `docformatter` bump

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment

#330 - Docs: Replaced the broken Discord link

Pull Request - State: closed - Opened by oksanaphmn about 1 month ago - 1 comment

#329 - How to load models from S3

Issue - State: closed - Opened by AbhishekBose about 1 month ago - 6 comments
Labels: enhancement, question

#328 - aggregate requests across uvicorn processes

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment

#327 - enable isort

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment
Labels: ci / tests

#326 - move middlewares to a module

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment

#325 - Feat: track number of active requests

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment
Labels: enhancement

#324 - avoid client generation if already exist

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment
Labels: bug

#323 - Benchmarking gRPC with LitServe – Surprising Results

Issue - State: closed - Opened by deependujha about 1 month ago - 1 comment
Labels: enhancement

#322 - test generate client file

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 3 comments
Labels: ci / tests

#321 - CUDA Multiprocessing Issue

Issue - State: closed - Opened by floschne about 1 month ago - 2 comments
Labels: bug, help wanted

#320 - Websocket Support for Streaming Input and Output

Issue - State: open - Opened by ChenghaoMou about 1 month ago - 4 comments
Labels: enhancement, question

#319 - fix(Logger): handle unpickleable Logger

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment
Labels: bug

#318 - fix dockerize CLI test

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment
Labels: bug, ci / tests

#317 - Release 0.2.3

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment

#316 - Add request queue to callbacks

Pull Request - State: closed - Opened by vrdn-23 about 1 month ago - 11 comments

#315 - format example usage for `dockerize` CLI

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment

#314 - Pyright linting fixes

Pull Request - State: closed - Opened by grumpyp about 1 month ago - 2 comments

#313 - add Ethan as codeowner

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment

#312 - update `dockerize` CLI success msg copy

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 1 comment
Labels: enhancement

#311 - Enable gpu docker image generation

Pull Request - State: closed - Opened by aniketmaurya about 1 month ago - 2 comments
Labels: enhancement

#310 - Pyright issues [Name mismatches]

Issue - State: closed - Opened by grumpyp about 1 month ago - 2 comments
Labels: bug, help wanted

#309 - switch to `argparse` for CLI

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 3 comments

#308 - add codeowners for requirements

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment

#307 - Dynamically grab port number

Pull Request - State: closed - Opened by grantgasser about 2 months ago - 4 comments

#306 - add jsonargparse in requirements

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment
Labels: bug

#305 - Embedding model support with openai spec

Issue - State: open - Opened by riyajatar37003 about 2 months ago - 15 comments
Labels: enhancement, help wanted, question

#304 - Add Keep-Alive Functionality for GPU Resource Optimization in LitServe

Issue - State: open - Opened by skyking363 about 2 months ago - 12 comments
Labels: enhancement

#303 - fix vLLM capitalization

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment
Labels: documentation

#302 - fix custom HTTPException with argument names

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment
Labels: bug

#301 - Custom HTTPException Not Working as Expected

Issue - State: closed - Opened by randydl about 2 months ago - 3 comments
Labels: bug, help wanted

#300 - Add warning for unexpected model output in batched prediction

Pull Request - State: closed - Opened by grumpyp about 2 months ago - 1 comment
Labels: good first issue

#299 - update ask a question link to reddit

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment

#298 - generate Dockerfile with CLI

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 7 comments
Labels: enhancement

#297 - update PR template with hiding instructions

Pull Request - State: closed - Opened by Borda about 2 months ago - 1 comment
Labels: enhancement

#296 - add links to forum and reduce opening issues for docs

Pull Request - State: closed - Opened by Borda about 2 months ago - 1 comment
Labels: enhancement

#295 - docs: update feat template / readability

Pull Request - State: closed - Opened by Borda about 2 months ago - 1 comment

#294 - unexpected output for HF model with matching

Issue - State: closed - Opened by Borda about 2 months ago - 5 comments
Labels: bug, good first issue, help wanted

#293 - dry run after server started

Issue - State: open - Opened by Borda about 2 months ago - 1 comment
Labels: enhancement

#292 - terminate early if accelerator is missing

Issue - State: open - Opened by Borda about 2 months ago
Labels: enhancement

#291 - monitor and restart Logger process

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 2 comments
Labels: enhancement

#290 - Feat: decode request in threadpool

Pull Request - State: closed - Opened by deependujha about 2 months ago - 6 comments
Labels: enhancement

#289 - Handle case when Logger.process is stuck

Issue - State: open - Opened by aniketmaurya about 2 months ago
Labels: enhancement

#288 - fix flaky Logger test

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment
Labels: ci / tests

#287 - handle exceptions for logger processing

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment

#286 - Example in documentation on how to setup an OpenAI-spec API with LlamaIndex-RAG

Issue - State: closed - Opened by PierreMesure about 2 months ago - 4 comments
Labels: enhancement, help wanted

#285 - fix: callbacks EventType typo

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment

#284 - [Feat]: add Logger API

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 6 comments
Labels: enhancement

#283 - add streaming no-batch speed test

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment
Labels: ci / tests

#282 - More complex model management (multiple models, model reloading etc...)

Issue - State: closed - Opened by bsergean about 2 months ago - 2 comments
Labels: enhancement, help wanted

#281 - [Chore] rename setup_server to register_endpoints

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment

#280 - add Pixtral multi-modal example

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment
Labels: documentation

#279 - minor LitServer code clean up

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 1 comment

#278 - Callback system v0

Pull Request - State: closed - Opened by aniketmaurya about 2 months ago - 2 comments
Labels: enhancement

#277 - chore: adds Parler TTS Studio example

Pull Request - State: closed - Opened by bhimrazy 2 months ago - 1 comment

#276 - Feat: multiple endpoints using a list of LitServer

Pull Request - State: open - Opened by bhimrazy 2 months ago - 6 comments
Labels: enhancement

#275 - Add Support to Huggingface Diffusers!

Issue - State: closed - Opened by KaifAhmad1 2 months ago - 2 comments
Labels: enhancement, help wanted

#274 - install uvloop with uvcorn

Pull Request - State: closed - Opened by aniketmaurya 2 months ago - 1 comment

#273 - Can't appear to load the server

Issue - State: closed - Opened by B-M-S-West 2 months ago - 2 comments
Labels: bug, help wanted

#272 - Supporting query params alongside file upload

Issue - State: closed - Opened by energydrink9 2 months ago - 4 comments
Labels: enhancement, help wanted

#271 - Is it possible to support multiple endpoints for one server?

Issue - State: open - Opened by arkohut 2 months ago - 15 comments
Labels: enhancement, help wanted, question

#270 - Feature Request: Customize FastAPI Metadata

Issue - State: open - Opened by bhimrazy 2 months ago - 5 comments
Labels: enhancement, help wanted

#263 - Setup step is not awaited

Issue - State: closed - Opened by andreieuganox 2 months ago - 2 comments
Labels: bug, help wanted

#262 - First attempt at monitoring metrics using prometheus_client

Pull Request - State: open - Opened by AdolfoVillalobos 2 months ago - 15 comments
Labels: enhancement

#258 - Heterogeneous parallel processing to avoid CPU & GPU Idle time

Pull Request - State: open - Opened by Usama3059 3 months ago - 14 comments

#239 - Placeholder storage has not been allocated on MPS device

Issue - State: closed - Opened by candlep 3 months ago - 6 comments
Labels: bug, help wanted

#236 - May I ask if it is possible to deploy complex pipelines such as ControlNet and IP Adapter in Stable Diffusion? Do you have any examples

Issue - State: closed - Opened by libai-lab 3 months ago - 5 comments
Labels: enhancement, help wanted, question

#233 - load_and_raise change

Pull Request - State: closed - Opened by Aceer121 3 months ago - 4 comments

#223 - Feat/evict req on client disconnect streaming case

Pull Request - State: open - Opened by bhimrazy 3 months ago - 3 comments

#166 - Map `decode_request` during dynamic batching using a threadpool

Issue - State: open - Opened by aniketmaurya 4 months ago - 1 comment
Labels: enhancement, help wanted

#146 - API monitoring metrics

Issue - State: closed - Opened by aniketmaurya 5 months ago - 5 comments
Labels: enhancement, help wanted