Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / deepjavalibrary/djl-serving issues and pull requests
#2156 - [lmi] Upgrade lmi dockerfile for 0.29.0 release
Pull Request -
State: closed - Opened by maaquib 3 months ago
#2155 - [python] parse input only when new requests are received
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
#2154 - [python] add max_logprobs vllm configuration to EngineArgs
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
#2153 - [python] fix integration test failures
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
- 1 comment
#2152 - [lmi] remove redundant auto logic from python handler
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2151 - add 0.5.1 supported models
Pull Request -
State: closed - Opened by lanking520 3 months ago
#2150 - [CI] Supports temp repo in execute job
Pull Request -
State: closed - Opened by zachgk 3 months ago
#2149 - [docker] upgrade vllm version to 0.5.1
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
- 1 comment
#2148 - [engine] include lmi recommended entrypoint when model.py exists
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
#2147 - [python] support multimodal models openai api in vllm
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
- 1 comment
#2146 - [python] Fix new logprobs computation in vllm_utils
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
#2145 - [python] refactor input parser to support Request
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
#2144 - [CI] Action for manual pytest runs
Pull Request -
State: closed - Opened by zachgk 3 months ago
#2143 - [3p][python]add metering and error details to 3p outputs
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2142 - [python] log exception stacktrace for exceptions in python, improve r…
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2141 - [ci] Adds formatShell gradle tasks
Pull Request -
State: closed - Opened by frankfliu 3 months ago
#2140 - [docker] Fixes docker -SNAPSHOT version build issue
Pull Request -
State: closed - Opened by frankfliu 3 months ago
#2139 - [docker] Fixes pytorch-gpu docker build script
Pull Request -
State: closed - Opened by frankfliu 3 months ago
#2138 - [docker] Fixes cpu-full docker build script
Pull Request -
State: closed - Opened by frankfliu 3 months ago
#2137 - [onnx] Allows to customize onnxruntime optimization level
Pull Request -
State: closed - Opened by frankfliu 3 months ago
#2136 - [docker] remove tensorflow native from cpu-full image
Pull Request -
State: closed - Opened by frankfliu 3 months ago
#2135 - [awscurl] Fixes missing \"text\" case in jsonlines output
Pull Request -
State: closed - Opened by frankfliu 3 months ago
#2134 - [CI] Add trust remote code option in TRTLLM CI
Pull Request -
State: closed - Opened by ydm-amazon 3 months ago
- 2 comments
#2133 - [cherry-pick] [secure-mode] add per-model configs to allowlist (#2132)
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2132 - [secure-mode] add per-model configs to allowlist
Pull Request -
State: closed - Opened by ethnzhng 3 months ago
#2131 - [ci] remove HF_MODEL_ID env for lmi_dist_1 test
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
#2130 - [secure-mode] Add properties allowlist validation (#2129)
Pull Request -
State: closed - Opened by frankfliu 3 months ago
#2129 - [secure-mode] Add properties allowlist validation
Pull Request -
State: closed - Opened by ethnzhng 3 months ago
- 1 comment
#2128 - [0.28.0-dlc] spec decoding cache dirty fix
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
#2126 - [serving] Fixes snake case pattern (#2123)
Pull Request -
State: closed - Opened by frankfliu 3 months ago
#2125 - Support multi node for lmi-dist
Pull Request -
State: closed - Opened by xyang16 3 months ago
#2124 - [lmi][hf]remove usage of HF Conversational pipeline as it is deprecated
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2122 - [python] add support for 3p use-case
Pull Request -
State: closed - Opened by siddvenk 3 months ago
- 1 comment
#2115 - [Neo] Neo compilation/quantization script bugfixes
Pull Request -
State: closed - Opened by a-ys 3 months ago
#2112 - Fix acceptance history check in speculative telemetry
Pull Request -
State: closed - Opened by zachgk 3 months ago
- 1 comment
#2109 - [CI] Integration tests through pytest
Pull Request -
State: closed - Opened by zachgk 3 months ago
- 1 comment
#2099 - [Draft][Do-not-merge] 0.28.0 multi node initial changes
Pull Request -
State: closed - Opened by nikhil-sk 3 months ago
#2095 - [Neuron] Fix Neuron compilation logging
Pull Request -
State: closed - Opened by a-ys 3 months ago
#2094 - [0.28.0-dlc] Record telemetry including acceptance rate
Pull Request -
State: closed - Opened by zachgk 3 months ago
#2093 - Llama 2 7b chat model output quality is low
Issue -
State: open - Opened by VrushaliJoshi-v37040 3 months ago
Labels: bug
#2092 - [python] move parse input functions to input_parser.py
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
- 2 comments
#2091 - [CI] Inferentia tests through pytest
Pull Request -
State: open - Opened by zachgk 3 months ago
#2090 - [python] refactor rolling batch inference method
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
#2089 - [CI] Fix post autoAwq cleanup
Pull Request -
State: closed - Opened by zachgk 3 months ago
#2088 - Record telemetry including acceptance rate
Pull Request -
State: closed - Opened by zachgk 3 months ago
#2087 - codeql for python
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2086 - [0.28.0 dlc][cherry-pick] AOT fix and pin numpy
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
#2085 - fix pinning of numpy version in docker files by reinstalling specifie…
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2084 - fix pinning of numpy version in docker files by reinstalling specifie…
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2083 - fix pinning of numpy version in docker files by reinstalling specifie…
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2082 - fix pinning of numpy version in docker files by reinstalling specifie…
Pull Request -
State: closed - Opened by siddvenk 3 months ago
- 1 comment
#2081 - [IB] Supports forwarding environment variables
Pull Request -
State: closed - Opened by zachgk 3 months ago
#2080 - [cherry-pick][0.28.0-dlc][aot] Fix aot quantization for weight only quantization (#2079)
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
#2079 - [aot] Fix aot quantization for weight only quantization
Pull Request -
State: closed - Opened by tosterberg 3 months ago
#2078 - [cherry-pick][0.28.0-dlc][Neo] Fix Neo Quantization properties output. Add some additional con…
Pull Request -
State: closed - Opened by sindhuvahinis 3 months ago
#2077 - [Neo] Fix Neo Quantization properties output. Add some additional configuration.
Pull Request -
State: closed - Opened by a-ys 3 months ago
#2076 - pin numpy to <2 in ci/docker (#2071)
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2075 - pin numpy to <2 in ci/docker
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2074 - pin numpy to <2 in ci/docker
Pull Request -
State: closed - Opened by siddvenk 3 months ago
#2073 - [ib] fix docker env file write location
Pull Request -
State: closed - Opened by tosterberg 3 months ago
#2072 - [fix] initialize sequence dictionary for default sequence index to pr…
Pull Request -
State: closed - Opened by siddvenk 4 months ago
- 1 comment
#2071 - pin numpy to <2 in ci/docker
Pull Request -
State: closed - Opened by siddvenk 4 months ago
- 1 comment
#2070 - DJL-TensorRT-LLM : inference no longer working, tokenizer error.
Issue -
State: open - Opened by eduardzl 4 months ago
Labels: bug
#2069 - [cherry-pick][0.28.0-dlc][fix] remove validating quantization in properties_manager.py
Pull Request -
State: closed - Opened by sindhuvahinis 4 months ago
#2068 - [ci][fix] don't use env vars for llm integ test as it causes issues w…
Pull Request -
State: closed - Opened by siddvenk 4 months ago
#2067 - [fix] remove validating quantization in properties_manager.py
Pull Request -
State: closed - Opened by sindhuvahinis 4 months ago
#2066 - [0.28.0-dlc][cherry-pick][secure-mode] Fix entrypoint control name
Pull Request -
State: closed - Opened by ethnzhng 4 months ago
#2065 - [secure-mode] Fix entrypoint control name
Pull Request -
State: closed - Opened by ethnzhng 4 months ago
#2064 - [ci] Adding integration test for AutoAwq
Pull Request -
State: closed - Opened by sindhuvahinis 4 months ago
#2063 - [lmi][docs] update to 0.28.0 in lmi docs
Pull Request -
State: closed - Opened by siddvenk 4 months ago
#2062 - [secure-mode] Refactor secure mode plugin (#2058)
Pull Request -
State: closed - Opened by frankfliu 4 months ago
#2061 - [0.28.0-dlc][cherry-pick] AutoAWQ Integration Script (#2038)
Pull Request -
State: closed - Opened by sindhuvahinis 4 months ago
#2060 - [plugin] Fixes plugin scaning bug
Pull Request -
State: closed - Opened by frankfliu 4 months ago
#2059 - [plugin] Fixes plugin scaning bug
Pull Request -
State: closed - Opened by frankfliu 4 months ago
#2058 - [secure-mode] Refactor secure mode plugin
Pull Request -
State: closed - Opened by frankfliu 4 months ago
#2057 - Stopping short: Very few output tokens returned, even though max tokens set very high.
Issue -
State: closed - Opened by yaronr 4 months ago
- 1 comment
Labels: bug
#2056 - [0.28.0-dlc] IP protection cherry-pick with Kotlin to gradle changes
Pull Request -
State: closed - Opened by sindhuvahinis 4 months ago
#2055 - [cherry-pick] fix bug with duplicate models when HF_MODEL_ID points to model store …
Pull Request -
State: closed - Opened by siddvenk 4 months ago
#2054 - fix bug with duplicate models when HF_MODEL_ID points to model store
Pull Request -
State: closed - Opened by siddvenk 4 months ago
#2053 - [0.28.0 dlc][cherry-pick] cherry-pick all doc updates to 0.28.0-dlc
Pull Request -
State: closed - Opened by sindhuvahinis 4 months ago
#2052 - [test] remove trtllm flan t5 integration test
Pull Request -
State: closed - Opened by sindhuvahinis 4 months ago
#2051 - [vllm, lmi-dist] add support for top_n_tokens
Pull Request -
State: closed - Opened by sindhuvahinis 4 months ago
#2050 - Fix benchmark deb build
Pull Request -
State: closed - Opened by zachgk 4 months ago
#2049 - [0.28.0-dlc][lmi] Update lmi-dist to 10.0.1
Pull Request -
State: closed - Opened by maaquib 4 months ago
- 2 comments
#2048 - [serving] Update default max worker to 1 for GPU
Pull Request -
State: closed - Opened by xyang16 4 months ago
#2047 - [docs] Updates embedding user guide
Pull Request -
State: closed - Opened by frankfliu 4 months ago
#2046 - [IB] support suzuka model
Pull Request -
State: closed - Opened by lanking520 4 months ago
#2045 - [IB] write template into file system
Pull Request -
State: closed - Opened by lanking520 4 months ago
#2044 - [IB] use a file to pass to the output
Pull Request -
State: closed - Opened by lanking520 4 months ago
#2043 - bump up trtllm to 0.10.0
Pull Request -
State: open - Opened by ydm-amazon 4 months ago
#2042 - [Serving] Implement SageMaker Secure Mode & support for multiple data sources
Pull Request -
State: closed - Opened by ethnzhng 4 months ago
#2041 - [doc] SSE jsonline document
Pull Request -
State: closed - Opened by sindhuvahinis 4 months ago
#2040 - [serving] Fail ping if error rate exceed
Pull Request -
State: closed - Opened by frankfliu 4 months ago
#2039 - [metrics] Improve prometheus metric type handling
Pull Request -
State: closed - Opened by frankfliu 4 months ago
#2038 - AutoAWQ Integration Script
Pull Request -
State: closed - Opened by a-ys 4 months ago
- 1 comment
#2037 - [ci] Add back missing publish task in gradle
Pull Request -
State: closed - Opened by frankfliu 4 months ago
#2036 - [docker] Fixes docker build script for version detection
Pull Request -
State: closed - Opened by frankfliu 4 months ago
#2035 - [python] Fixes typing issue with py3.8
Pull Request -
State: closed - Opened by frankfliu 4 months ago
#2034 - [serving] Update python typing to support py38
Pull Request -
State: closed - Opened by tosterberg 4 months ago
#2033 - [test] Fixes java-client test dependency
Pull Request -
State: closed - Opened by frankfliu 4 months ago