Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / deepjavalibrary/djl-serving issues and pull requests

#2156 - [lmi] Upgrade lmi dockerfile for 0.29.0 release

Pull Request - State: closed - Opened by maaquib 3 months ago

#2155 - [python] parse input only when new requests are received

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago

#2154 - [python] add max_logprobs vllm configuration to EngineArgs

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago

#2153 - [python] fix integration test failures

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago - 1 comment

#2152 - [lmi] remove redundant auto logic from python handler

Pull Request - State: closed - Opened by siddvenk 3 months ago

#2151 - add 0.5.1 supported models

Pull Request - State: closed - Opened by lanking520 3 months ago

#2150 - [CI] Supports temp repo in execute job

Pull Request - State: closed - Opened by zachgk 3 months ago

#2149 - [docker] upgrade vllm version to 0.5.1

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago - 1 comment

#2147 - [python] support multimodal models openai api in vllm

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago - 1 comment

#2146 - [python] Fix new logprobs computation in vllm_utils

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago

#2145 - [python] refactor input parser to support Request

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago

#2144 - [CI] Action for manual pytest runs

Pull Request - State: closed - Opened by zachgk 3 months ago

#2143 - [3p][python]add metering and error details to 3p outputs

Pull Request - State: closed - Opened by siddvenk 3 months ago

#2141 - [ci] Adds formatShell gradle tasks

Pull Request - State: closed - Opened by frankfliu 3 months ago

#2140 - [docker] Fixes docker -SNAPSHOT version build issue

Pull Request - State: closed - Opened by frankfliu 3 months ago

#2139 - [docker] Fixes pytorch-gpu docker build script

Pull Request - State: closed - Opened by frankfliu 3 months ago

#2138 - [docker] Fixes cpu-full docker build script

Pull Request - State: closed - Opened by frankfliu 3 months ago

#2137 - [onnx] Allows to customize onnxruntime optimization level

Pull Request - State: closed - Opened by frankfliu 3 months ago

#2136 - [docker] remove tensorflow native from cpu-full image

Pull Request - State: closed - Opened by frankfliu 3 months ago

#2135 - [awscurl] Fixes missing \"text\" case in jsonlines output

Pull Request - State: closed - Opened by frankfliu 3 months ago

#2134 - [CI] Add trust remote code option in TRTLLM CI

Pull Request - State: closed - Opened by ydm-amazon 3 months ago - 2 comments

#2132 - [secure-mode] add per-model configs to allowlist

Pull Request - State: closed - Opened by ethnzhng 3 months ago

#2131 - [ci] remove HF_MODEL_ID env for lmi_dist_1 test

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago

#2130 - [secure-mode] Add properties allowlist validation (#2129)

Pull Request - State: closed - Opened by frankfliu 3 months ago

#2129 - [secure-mode] Add properties allowlist validation

Pull Request - State: closed - Opened by ethnzhng 3 months ago - 1 comment

#2128 - [0.28.0-dlc] spec decoding cache dirty fix

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago

#2126 - [serving] Fixes snake case pattern (#2123)

Pull Request - State: closed - Opened by frankfliu 3 months ago

#2125 - Support multi node for lmi-dist

Pull Request - State: closed - Opened by xyang16 3 months ago

#2122 - [python] add support for 3p use-case

Pull Request - State: closed - Opened by siddvenk 3 months ago - 1 comment

#2115 - [Neo] Neo compilation/quantization script bugfixes

Pull Request - State: closed - Opened by a-ys 3 months ago

#2112 - Fix acceptance history check in speculative telemetry

Pull Request - State: closed - Opened by zachgk 3 months ago - 1 comment

#2109 - [CI] Integration tests through pytest

Pull Request - State: closed - Opened by zachgk 3 months ago - 1 comment

#2099 - [Draft][Do-not-merge] 0.28.0 multi node initial changes

Pull Request - State: closed - Opened by nikhil-sk 3 months ago

#2095 - [Neuron] Fix Neuron compilation logging

Pull Request - State: closed - Opened by a-ys 3 months ago

#2094 - [0.28.0-dlc] Record telemetry including acceptance rate

Pull Request - State: closed - Opened by zachgk 3 months ago

#2093 - Llama 2 7b chat model output quality is low

Issue - State: open - Opened by VrushaliJoshi-v37040 3 months ago
Labels: bug

#2092 - [python] move parse input functions to input_parser.py

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago - 2 comments

#2091 - [CI] Inferentia tests through pytest

Pull Request - State: open - Opened by zachgk 3 months ago

#2090 - [python] refactor rolling batch inference method

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago

#2089 - [CI] Fix post autoAwq cleanup

Pull Request - State: closed - Opened by zachgk 3 months ago

#2088 - Record telemetry including acceptance rate

Pull Request - State: closed - Opened by zachgk 3 months ago

#2087 - codeql for python

Pull Request - State: closed - Opened by siddvenk 3 months ago

#2086 - [0.28.0 dlc][cherry-pick] AOT fix and pin numpy

Pull Request - State: closed - Opened by sindhuvahinis 3 months ago

#2082 - fix pinning of numpy version in docker files by reinstalling specifie…

Pull Request - State: closed - Opened by siddvenk 3 months ago - 1 comment

#2081 - [IB] Supports forwarding environment variables

Pull Request - State: closed - Opened by zachgk 3 months ago

#2079 - [aot] Fix aot quantization for weight only quantization

Pull Request - State: closed - Opened by tosterberg 3 months ago

#2076 - pin numpy to <2 in ci/docker (#2071)

Pull Request - State: closed - Opened by siddvenk 3 months ago

#2075 - pin numpy to <2 in ci/docker

Pull Request - State: closed - Opened by siddvenk 3 months ago

#2074 - pin numpy to <2 in ci/docker

Pull Request - State: closed - Opened by siddvenk 3 months ago

#2073 - [ib] fix docker env file write location

Pull Request - State: closed - Opened by tosterberg 3 months ago

#2072 - [fix] initialize sequence dictionary for default sequence index to pr…

Pull Request - State: closed - Opened by siddvenk 4 months ago - 1 comment

#2071 - pin numpy to <2 in ci/docker

Pull Request - State: closed - Opened by siddvenk 4 months ago - 1 comment

#2070 - DJL-TensorRT-LLM : inference no longer working, tokenizer error.

Issue - State: open - Opened by eduardzl 4 months ago
Labels: bug

#2065 - [secure-mode] Fix entrypoint control name

Pull Request - State: closed - Opened by ethnzhng 4 months ago

#2064 - [ci] Adding integration test for AutoAwq

Pull Request - State: closed - Opened by sindhuvahinis 4 months ago

#2063 - [lmi][docs] update to 0.28.0 in lmi docs

Pull Request - State: closed - Opened by siddvenk 4 months ago

#2062 - [secure-mode] Refactor secure mode plugin (#2058)

Pull Request - State: closed - Opened by frankfliu 4 months ago

#2060 - [plugin] Fixes plugin scaning bug

Pull Request - State: closed - Opened by frankfliu 4 months ago

#2059 - [plugin] Fixes plugin scaning bug

Pull Request - State: closed - Opened by frankfliu 4 months ago

#2058 - [secure-mode] Refactor secure mode plugin

Pull Request - State: closed - Opened by frankfliu 4 months ago

#2057 - Stopping short: Very few output tokens returned, even though max tokens set very high.

Issue - State: closed - Opened by yaronr 4 months ago - 1 comment
Labels: bug

#2052 - [test] remove trtllm flan t5 integration test

Pull Request - State: closed - Opened by sindhuvahinis 4 months ago

#2051 - [vllm, lmi-dist] add support for top_n_tokens

Pull Request - State: closed - Opened by sindhuvahinis 4 months ago

#2050 - Fix benchmark deb build

Pull Request - State: closed - Opened by zachgk 4 months ago

#2049 - [0.28.0-dlc][lmi] Update lmi-dist to 10.0.1

Pull Request - State: closed - Opened by maaquib 4 months ago - 2 comments

#2048 - [serving] Update default max worker to 1 for GPU

Pull Request - State: closed - Opened by xyang16 4 months ago

#2047 - [docs] Updates embedding user guide

Pull Request - State: closed - Opened by frankfliu 4 months ago

#2046 - [IB] support suzuka model

Pull Request - State: closed - Opened by lanking520 4 months ago

#2045 - [IB] write template into file system

Pull Request - State: closed - Opened by lanking520 4 months ago

#2044 - [IB] use a file to pass to the output

Pull Request - State: closed - Opened by lanking520 4 months ago

#2043 - bump up trtllm to 0.10.0

Pull Request - State: open - Opened by ydm-amazon 4 months ago

#2041 - [doc] SSE jsonline document

Pull Request - State: closed - Opened by sindhuvahinis 4 months ago

#2040 - [serving] Fail ping if error rate exceed

Pull Request - State: closed - Opened by frankfliu 4 months ago

#2039 - [metrics] Improve prometheus metric type handling

Pull Request - State: closed - Opened by frankfliu 4 months ago

#2038 - AutoAWQ Integration Script

Pull Request - State: closed - Opened by a-ys 4 months ago - 1 comment

#2037 - [ci] Add back missing publish task in gradle

Pull Request - State: closed - Opened by frankfliu 4 months ago

#2036 - [docker] Fixes docker build script for version detection

Pull Request - State: closed - Opened by frankfliu 4 months ago

#2035 - [python] Fixes typing issue with py3.8

Pull Request - State: closed - Opened by frankfliu 4 months ago

#2034 - [serving] Update python typing to support py38

Pull Request - State: closed - Opened by tosterberg 4 months ago

#2033 - [test] Fixes java-client test dependency

Pull Request - State: closed - Opened by frankfliu 4 months ago