Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / lightning-ai/litserve issues and pull requests

#100 - Improve docs for OpenAI spec

Pull Request - State: closed - Opened by lantiga 6 months ago - 1 comment

#100 - Improve docs for OpenAI spec

Pull Request - State: closed - Opened by lantiga 6 months ago - 1 comment

#99 - dynamic inference worker

Issue - State: closed - Opened by aniketmaurya 6 months ago
Labels: enhancement

#99 - dynamic inference worker

Issue - State: closed - Opened by aniketmaurya 6 months ago
Labels: enhancement

#98 - add client detail to streaming document

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: documentation

#98 - add client detail to streaming document

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: documentation

#97 - fix summary tag

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: documentation

#97 - fix summary tag

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: documentation

#96 - Exclude markdown files from pre-commit formatter

Pull Request - State: closed - Opened by rasbt 6 months ago - 1 comment

#96 - Exclude markdown files from pre-commit formatter

Pull Request - State: closed - Opened by rasbt 6 months ago - 1 comment

#95 - Add Stream API Example

Pull Request - State: closed - Opened by rasbt 6 months ago - 1 comment
Labels: enhancement

#95 - Add Stream API Example

Pull Request - State: closed - Opened by rasbt 6 months ago - 1 comment
Labels: enhancement

#93 - removes `/stream-predict` endpoint and standardizes to `/predict`

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment

#93 - removes `/stream-predict` endpoint and standardizes to `/predict`

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment

#92 - validate port

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: enhancement

#92 - validate port

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: enhancement

#91 - add custom endpoint path

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 2 comments
Labels: enhancement

#91 - add custom endpoint path

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 2 comments
Labels: enhancement

#90 - enable users to override the default api endpoint path

Issue - State: open - Opened by aniketmaurya 6 months ago - 10 comments
Labels: enhancement, help wanted

#90 - enable users to override the default api endpoint path

Issue - State: open - Opened by aniketmaurya 6 months ago - 10 comments
Labels: enhancement, help wanted

#89 - Update server.py

Pull Request - State: closed - Opened by williamFalcon 6 months ago - 1 comment

#89 - Update server.py

Pull Request - State: closed - Opened by williamFalcon 6 months ago - 1 comment

#88 - Too many files open with 1K requests

Issue - State: closed - Opened by aniketmaurya 6 months ago - 3 comments
Labels: bug, help wanted

#88 - Too many files open with 1K requests

Issue - State: closed - Opened by aniketmaurya 6 months ago - 3 comments
Labels: bug, help wanted

#87 - improve logging

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: enhancement

#87 - improve logging

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: enhancement

#86 - FastAPI background_task cleanup is not executed upon error

Issue - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: bug, good first issue, help wanted

#86 - FastAPI background_task cleanup is not executed upon error

Issue - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: bug, good first issue, help wanted

#85 - format encoded response

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: enhancement

#85 - format encoded response

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 1 comment
Labels: enhancement

#84 - automatically dump dictionary to json in encode_response while Streaming

Issue - State: closed - Opened by aniketmaurya 6 months ago
Labels: enhancement, help wanted

#84 - automatically dump dictionary to json in encode_response while Streaming

Issue - State: closed - Opened by aniketmaurya 6 months ago
Labels: enhancement, help wanted

#83 - Logging error

Issue - State: closed - Opened by williamFalcon 6 months ago - 2 comments
Labels: bug, help wanted

#83 - Logging error

Issue - State: closed - Opened by williamFalcon 6 months ago - 2 comments
Labels: bug, help wanted

#82 - Let the user know when "setup" has completed...

Pull Request - State: closed - Opened by williamFalcon 6 months ago - 3 comments

#82 - Let the user know when "setup" has completed...

Pull Request - State: closed - Opened by williamFalcon 6 months ago - 3 comments

#81 - Print "Setup complete" when setup is complete

Issue - State: closed - Opened by williamFalcon 6 months ago
Labels: enhancement, help wanted

#81 - Print "Setup complete" when setup is complete

Issue - State: closed - Opened by williamFalcon 6 months ago
Labels: enhancement, help wanted

#80 - feat: Support multipart & url-encoded form bodies

Pull Request - State: closed - Opened by andyland 6 months ago - 1 comment

#80 - feat: Support multipart & url-encoded form bodies

Pull Request - State: closed - Opened by andyland 6 months ago - 1 comment

#79 - decouple decode_request from get_batch_from_uid

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 2 comments
Labels: enhancement

#79 - decouple decode_request from get_batch_from_uid

Pull Request - State: closed - Opened by aniketmaurya 6 months ago - 2 comments
Labels: enhancement

#78 - [pre-commit.ci] pre-commit suggestions

Pull Request - State: closed - Opened by pre-commit-ci[bot] 6 months ago - 1 comment

#78 - [pre-commit.ci] pre-commit suggestions

Pull Request - State: closed - Opened by pre-commit-ci[bot] 6 months ago - 1 comment

#77 - fix cuda forking error

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment

#77 - fix cuda forking error

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment

#76 - add openai spec v0

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 9 comments
Labels: enhancement

#76 - add openai spec v0

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 9 comments
Labels: enhancement

#75 - Bump mypy from 1.9.0 to 1.10.0

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago - 1 comment
Labels: ci / tests

#75 - Bump mypy from 1.9.0 to 1.10.0

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago - 1 comment
Labels: ci / tests

#74 - add license info

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment

#74 - add license info

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment

#73 - allow to set mps accelerator explicitly

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment

#73 - allow to set mps accelerator explicitly

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment

#72 - Add OpenAI as a pluggable spec

Issue - State: closed - Opened by lantiga 7 months ago - 1 comment
Labels: enhancement, help wanted

#72 - Add OpenAI as a pluggable spec

Issue - State: closed - Opened by lantiga 7 months ago - 1 comment
Labels: enhancement, help wanted

#71 - test_timeout test is flaky

Issue - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: bug, help wanted

#71 - test_timeout test is flaky

Issue - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: bug, help wanted

#70 - add readme improvements

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: documentation

#70 - add readme improvements

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: documentation

#69 - Add devices auto

Pull Request - State: closed - Opened by lantiga 7 months ago - 1 comment
Labels: enhancement

#69 - Add devices auto

Pull Request - State: closed - Opened by lantiga 7 months ago - 1 comment
Labels: enhancement

#68 - fix: default unbatch always generator

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment
Labels: bug, ci / tests

#68 - fix: default unbatch always generator

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment
Labels: bug, ci / tests

#67 - end-to-end tests

Issue - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: enhancement, good first issue, help wanted, ci / tests

#67 - end-to-end tests

Issue - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: enhancement, good first issue, help wanted, ci / tests

#66 - default unbatch is always a generator

Issue - State: closed - Opened by aniketmaurya 7 months ago - 2 comments
Labels: bug, help wanted

#66 - default unbatch is always a generator

Issue - State: closed - Opened by aniketmaurya 7 months ago - 2 comments
Labels: bug, help wanted

#65 - document batching

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: documentation

#65 - document batching

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: documentation

#64 - document accelerator=auto

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment
Labels: documentation

#64 - document accelerator=auto

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment
Labels: documentation

#63 - allow timeout disable

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: enhancement

#63 - allow timeout disable

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: enhancement

#62 - Fix macos CI

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment
Labels: ci / tests

#62 - Fix macos CI

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment
Labels: ci / tests

#61 - fix: broken pipes caused inference worker to fail

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment
Labels: bug

#61 - fix: broken pipes caused inference worker to fail

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 1 comment
Labels: bug

#60 - NO CHANGE, DON'T MERGE - test mac ci

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 3 comments

#60 - NO CHANGE, DON'T MERGE - test mac ci

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 3 comments

#59 - Add devices="auto"

Issue - State: closed - Opened by lantiga 7 months ago
Labels: enhancement, help wanted

#59 - Add devices="auto"

Issue - State: closed - Opened by lantiga 7 months ago
Labels: enhancement, help wanted

#58 - Running litserve with HTTPS

Issue - State: closed - Opened by BZandi 7 months ago - 3 comments

#58 - Running litserve with HTTPS

Issue - State: closed - Opened by BZandi 7 months ago - 3 comments

#56 - Add a detached mode

Issue - State: open - Opened by rasbt 7 months ago - 4 comments
Labels: enhancement, help wanted

#56 - Add a detached mode

Issue - State: open - Opened by rasbt 7 months ago - 4 comments
Labels: enhancement, help wanted

#55 - batched streaming

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: enhancement

#55 - batched streaming

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 3 comments
Labels: enhancement

#54 - auto accelerator for JAX

Issue - State: open - Opened by aniketmaurya 7 months ago

#54 - auto accelerator for JAX

Issue - State: open - Opened by aniketmaurya 7 months ago

#53 - Bump version to 0.1.0

Pull Request - State: closed - Opened by lantiga 7 months ago - 1 comment

#53 - Bump version to 0.1.0

Pull Request - State: closed - Opened by lantiga 7 months ago - 1 comment

#52 - Disable timeout

Issue - State: closed - Opened by williamFalcon 7 months ago - 3 comments
Labels: bug, help wanted

#52 - Disable timeout

Issue - State: closed - Opened by williamFalcon 7 months ago - 3 comments
Labels: bug, help wanted

#51 - add llama3 example

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 2 comments
Labels: documentation, has conflicts

#51 - add llama3 example

Pull Request - State: closed - Opened by aniketmaurya 7 months ago - 2 comments
Labels: documentation, has conflicts