Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / lightning-ai/litserve issues and pull requests
#360 - Update media type and JSON handling in OpenAISpec
Pull Request -
State: closed - Opened by fabigr8 4 days ago
- 1 comment
#359 - bug: OpenAI-Spec should send text/event-stream
Issue -
State: closed - Opened by fabigr8 5 days ago
- 6 comments
Labels: bug, help wanted
#358 - make @borda global code owner
Pull Request -
State: closed - Opened by aniketmaurya 7 days ago
- 1 comment
#357 - Development release 0.2.5.dev0
Pull Request -
State: closed - Opened by aniketmaurya 7 days ago
- 1 comment
#356 - Fail fast when LitAPI.setup has error
Pull Request -
State: closed - Opened by aniketmaurya 8 days ago
- 1 comment
Labels: enhancement
#355 - GET Request
Issue -
State: closed - Opened by gururaser 9 days ago
- 5 comments
Labels: enhancement
#354 - Default Input-Output schema
Issue -
State: open - Opened by aniketmaurya 9 days ago
Labels: enhancement
#353 - [pre-commit.ci] pre-commit suggestions
Pull Request -
State: closed - Opened by pre-commit-ci[bot] 10 days ago
- 2 comments
#352 - How to route /docs path in litserve behind a proxy?
Issue -
State: closed - Opened by Mayurji 11 days ago
- 6 comments
Labels: bug, help wanted
#351 - Release 0.2.4
Pull Request -
State: closed - Opened by aniketmaurya 15 days ago
- 1 comment
#350 - Can't start the demo example without bug
Issue -
State: closed - Opened by anonym-ai 16 days ago
- 3 comments
Labels: bug, help wanted
#349 - stream tool calling
Pull Request -
State: closed - Opened by whisper-bye 16 days ago
- 3 comments
Labels: bug
#348 - Support for async requests or webhooks
Issue -
State: closed - Opened by brian316 17 days ago
- 3 comments
Labels: enhancement
#347 - LitServe server doesn't crash when there is a failure in setup
Issue -
State: closed - Opened by tchaton 18 days ago
- 3 comments
Labels: enhancement, help wanted
#346 - Add dockerization to feature list
Pull Request -
State: closed - Opened by aniketmaurya 21 days ago
- 1 comment
Labels: documentation
#345 - Add dockerize example in the README
Issue -
State: closed - Opened by tchaton 21 days ago
- 2 comments
Labels: enhancement
#344 - Improve the debugging experience of LitServe
Issue -
State: open - Opened by tchaton 21 days ago
- 1 comment
Labels: enhancement
#343 - Litserve entrypoint wasn't properly registered on first install in Studios
Issue -
State: closed - Opened by tchaton 21 days ago
- 1 comment
Labels: bug, help wanted
#342 - Add custom healthcheck path
Pull Request -
State: open - Opened by akuma12 22 days ago
- 1 comment
#341 - Add custom path option for healthcheck
Issue -
State: open - Opened by akuma12 22 days ago
- 2 comments
Labels: enhancement
#340 - Raising HTTPexception on single request from encode_request or decode_request raise same for all request in batch
Issue -
State: open - Opened by bimarshak7 23 days ago
Labels: bug, help wanted
#339 - Prometheus logger is not pickable + monitoring metrics set via self.log are not tracked
Issue -
State: closed - Opened by miguelalba96 24 days ago
- 5 comments
Labels: bug, help wanted
#338 - Fix Docker Argument Handling
Pull Request -
State: closed - Opened by aniketmaurya 24 days ago
- 1 comment
#337 - improve error handling from inference worker processes
Pull Request -
State: closed - Opened by aniketmaurya 24 days ago
- 1 comment
#336 - Test multiple Python version compatibility
Pull Request -
State: open - Opened by aniketmaurya 24 days ago
- 1 comment
#335 - Host param
Pull Request -
State: closed - Opened by grumpyp 27 days ago
- 1 comment
#334 - Avoiding counting active requests in /health and /metrics
Pull Request -
State: closed - Opened by vrdn-23 about 1 month ago
- 3 comments
#333 - Add support for selecting Python version in Dockerfile
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
#332 - update(lint): prune config
Pull Request -
State: closed - Opened by Borda about 1 month ago
- 1 comment
#331 - lint: emergency `docformatter` bump
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
#330 - Docs: Replaced the broken Discord link
Pull Request -
State: closed - Opened by oksanaphmn about 1 month ago
- 1 comment
#329 - How to load models from S3
Issue -
State: closed - Opened by AbhishekBose about 1 month ago
- 6 comments
Labels: enhancement, question
#328 - aggregate requests across uvicorn processes
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
#327 - enable isort
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
Labels: ci / tests
#326 - move middlewares to a module
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
#325 - Feat: track number of active requests
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
Labels: enhancement
#324 - avoid client generation if already exist
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
Labels: bug
#323 - Benchmarking gRPC with LitServe – Surprising Results
Issue -
State: closed - Opened by deependujha about 1 month ago
- 1 comment
Labels: enhancement
#322 - test generate client file
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 3 comments
Labels: ci / tests
#321 - CUDA Multiprocessing Issue
Issue -
State: closed - Opened by floschne about 1 month ago
- 2 comments
Labels: bug, help wanted
#320 - Websocket Support for Streaming Input and Output
Issue -
State: open - Opened by ChenghaoMou about 1 month ago
- 4 comments
Labels: enhancement, question
#319 - fix(Logger): handle unpickleable Logger
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
Labels: bug
#318 - fix dockerize CLI test
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
Labels: bug, ci / tests
#317 - Release 0.2.3
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
#316 - Add request queue to callbacks
Pull Request -
State: closed - Opened by vrdn-23 about 1 month ago
- 11 comments
#315 - format example usage for `dockerize` CLI
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
#314 - Pyright linting fixes
Pull Request -
State: closed - Opened by grumpyp about 1 month ago
- 2 comments
#313 - add Ethan as codeowner
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
#312 - update `dockerize` CLI success msg copy
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 1 comment
Labels: enhancement
#311 - Enable gpu docker image generation
Pull Request -
State: closed - Opened by aniketmaurya about 1 month ago
- 2 comments
Labels: enhancement
#310 - Pyright issues [Name mismatches]
Issue -
State: closed - Opened by grumpyp about 1 month ago
- 2 comments
Labels: bug, help wanted
#309 - switch to `argparse` for CLI
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 3 comments
#308 - add codeowners for requirements
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
#307 - Dynamically grab port number
Pull Request -
State: closed - Opened by grantgasser about 2 months ago
- 4 comments
#306 - add jsonargparse in requirements
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
Labels: bug
#305 - Embedding model support with openai spec
Issue -
State: open - Opened by riyajatar37003 about 2 months ago
- 15 comments
Labels: enhancement, help wanted, question
#304 - Add Keep-Alive Functionality for GPU Resource Optimization in LitServe
Issue -
State: open - Opened by skyking363 about 2 months ago
- 12 comments
Labels: enhancement
#303 - fix vLLM capitalization
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
Labels: documentation
#302 - fix custom HTTPException with argument names
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
Labels: bug
#301 - Custom HTTPException Not Working as Expected
Issue -
State: closed - Opened by randydl about 2 months ago
- 3 comments
Labels: bug, help wanted
#300 - Add warning for unexpected model output in batched prediction
Pull Request -
State: closed - Opened by grumpyp about 2 months ago
- 1 comment
Labels: good first issue
#299 - update ask a question link to reddit
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
#298 - generate Dockerfile with CLI
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 7 comments
Labels: enhancement
#297 - update PR template with hiding instructions
Pull Request -
State: closed - Opened by Borda about 2 months ago
- 1 comment
Labels: enhancement
#296 - add links to forum and reduce opening issues for docs
Pull Request -
State: closed - Opened by Borda about 2 months ago
- 1 comment
Labels: enhancement
#295 - docs: update feat template / readability
Pull Request -
State: closed - Opened by Borda about 2 months ago
- 1 comment
#294 - unexpected output for HF model with matching
Issue -
State: closed - Opened by Borda about 2 months ago
- 5 comments
Labels: bug, good first issue, help wanted
#293 - dry run after server started
Issue -
State: open - Opened by Borda about 2 months ago
- 1 comment
Labels: enhancement
#292 - terminate early if accelerator is missing
Issue -
State: open - Opened by Borda about 2 months ago
Labels: enhancement
#291 - monitor and restart Logger process
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 2 comments
Labels: enhancement
#290 - Feat: decode request in threadpool
Pull Request -
State: closed - Opened by deependujha about 2 months ago
- 6 comments
Labels: enhancement
#289 - Handle case when Logger.process is stuck
Issue -
State: open - Opened by aniketmaurya about 2 months ago
Labels: enhancement
#288 - fix flaky Logger test
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
Labels: ci / tests
#287 - handle exceptions for logger processing
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
#286 - Example in documentation on how to setup an OpenAI-spec API with LlamaIndex-RAG
Issue -
State: closed - Opened by PierreMesure about 2 months ago
- 4 comments
Labels: enhancement, help wanted
#285 - fix: callbacks EventType typo
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
#284 - [Feat]: add Logger API
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 6 comments
Labels: enhancement
#283 - add streaming no-batch speed test
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
Labels: ci / tests
#282 - More complex model management (multiple models, model reloading etc...)
Issue -
State: closed - Opened by bsergean about 2 months ago
- 2 comments
Labels: enhancement, help wanted
#281 - [Chore] rename setup_server to register_endpoints
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
#280 - add Pixtral multi-modal example
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
Labels: documentation
#279 - minor LitServer code clean up
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 1 comment
#278 - Callback system v0
Pull Request -
State: closed - Opened by aniketmaurya about 2 months ago
- 2 comments
Labels: enhancement
#277 - chore: adds Parler TTS Studio example
Pull Request -
State: closed - Opened by bhimrazy 2 months ago
- 1 comment
#276 - Feat: multiple endpoints using a list of LitServer
Pull Request -
State: open - Opened by bhimrazy 2 months ago
- 6 comments
Labels: enhancement
#275 - Add Support to Huggingface Diffusers!
Issue -
State: closed - Opened by KaifAhmad1 2 months ago
- 2 comments
Labels: enhancement, help wanted
#274 - install uvloop with uvcorn
Pull Request -
State: closed - Opened by aniketmaurya 2 months ago
- 1 comment
#273 - Can't appear to load the server
Issue -
State: closed - Opened by B-M-S-West 2 months ago
- 2 comments
Labels: bug, help wanted
#272 - Supporting query params alongside file upload
Issue -
State: closed - Opened by energydrink9 2 months ago
- 4 comments
Labels: enhancement, help wanted
#271 - Is it possible to support multiple endpoints for one server?
Issue -
State: open - Opened by arkohut 2 months ago
- 15 comments
Labels: enhancement, help wanted, question
#270 - Feature Request: Customize FastAPI Metadata
Issue -
State: open - Opened by bhimrazy 2 months ago
- 5 comments
Labels: enhancement, help wanted
#263 - Setup step is not awaited
Issue -
State: closed - Opened by andreieuganox 2 months ago
- 2 comments
Labels: bug, help wanted
#262 - First attempt at monitoring metrics using prometheus_client
Pull Request -
State: open - Opened by AdolfoVillalobos 2 months ago
- 15 comments
Labels: enhancement
#258 - Heterogeneous parallel processing to avoid CPU & GPU Idle time
Pull Request -
State: open - Opened by Usama3059 3 months ago
- 14 comments
#239 - Placeholder storage has not been allocated on MPS device
Issue -
State: closed - Opened by candlep 3 months ago
- 6 comments
Labels: bug, help wanted
#236 - May I ask if it is possible to deploy complex pipelines such as ControlNet and IP Adapter in Stable Diffusion? Do you have any examples
Issue -
State: closed - Opened by libai-lab 3 months ago
- 5 comments
Labels: enhancement, help wanted, question
#233 - load_and_raise change
Pull Request -
State: closed - Opened by Aceer121 3 months ago
- 4 comments
#223 - Feat/evict req on client disconnect streaming case
Pull Request -
State: open - Opened by bhimrazy 3 months ago
- 3 comments
#166 - Map `decode_request` during dynamic batching using a threadpool
Issue -
State: open - Opened by aniketmaurya 4 months ago
- 1 comment
Labels: enhancement, help wanted
#146 - API monitoring metrics
Issue -
State: closed - Opened by aniketmaurya 5 months ago
- 5 comments
Labels: enhancement, help wanted