Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / deepjavalibrary/djl-serving issues and pull requests

#2130 - [secure-mode] Add properties allowlist validation (#2129)

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2129 - [secure-mode] Add properties allowlist validation

Pull Request - State: closed - Opened by ethnzhng 5 months ago - 1 comment

#2128 - [0.28.0-dlc] spec decoding cache dirty fix

Pull Request - State: closed - Opened by sindhuvahinis 5 months ago

#2126 - [serving] Fixes snake case pattern (#2123)

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2125 - Support multi node for lmi-dist

Pull Request - State: closed - Opened by xyang16 5 months ago

#2122 - [python] add support for 3p use-case

Pull Request - State: closed - Opened by siddvenk 5 months ago - 1 comment

#2115 - [Neo] Neo compilation/quantization script bugfixes

Pull Request - State: closed - Opened by a-ys 5 months ago

#2112 - Fix acceptance history check in speculative telemetry

Pull Request - State: closed - Opened by zachgk 5 months ago - 1 comment

#2109 - [CI] Integration tests through pytest

Pull Request - State: closed - Opened by zachgk 5 months ago - 1 comment

#2099 - [Draft][Do-not-merge] 0.28.0 multi node initial changes

Pull Request - State: closed - Opened by nikhil-sk 5 months ago

#2095 - [Neuron] Fix Neuron compilation logging

Pull Request - State: closed - Opened by a-ys 5 months ago

#2094 - [0.28.0-dlc] Record telemetry including acceptance rate

Pull Request - State: closed - Opened by zachgk 5 months ago

#2093 - Llama 2 7b chat model output quality is low

Issue - State: open - Opened by VrushaliJoshi-v37040 5 months ago
Labels: bug

#2092 - [python] move parse input functions to input_parser.py

Pull Request - State: closed - Opened by sindhuvahinis 5 months ago - 2 comments

#2091 - [CI] Inferentia tests through pytest

Pull Request - State: open - Opened by zachgk 5 months ago

#2090 - [python] refactor rolling batch inference method

Pull Request - State: closed - Opened by sindhuvahinis 5 months ago

#2089 - [CI] Fix post autoAwq cleanup

Pull Request - State: closed - Opened by zachgk 5 months ago

#2088 - Record telemetry including acceptance rate

Pull Request - State: closed - Opened by zachgk 5 months ago

#2087 - codeql for python

Pull Request - State: closed - Opened by siddvenk 5 months ago

#2086 - [0.28.0 dlc][cherry-pick] AOT fix and pin numpy

Pull Request - State: closed - Opened by sindhuvahinis 5 months ago

#2082 - fix pinning of numpy version in docker files by reinstalling specifie…

Pull Request - State: closed - Opened by siddvenk 5 months ago - 1 comment

#2081 - [IB] Supports forwarding environment variables

Pull Request - State: closed - Opened by zachgk 5 months ago

#2079 - [aot] Fix aot quantization for weight only quantization

Pull Request - State: closed - Opened by tosterberg 5 months ago

#2076 - pin numpy to <2 in ci/docker (#2071)

Pull Request - State: closed - Opened by siddvenk 5 months ago

#2075 - pin numpy to <2 in ci/docker

Pull Request - State: closed - Opened by siddvenk 5 months ago

#2074 - pin numpy to <2 in ci/docker

Pull Request - State: closed - Opened by siddvenk 5 months ago

#2073 - [ib] fix docker env file write location

Pull Request - State: closed - Opened by tosterberg 5 months ago

#2072 - [fix] initialize sequence dictionary for default sequence index to pr…

Pull Request - State: closed - Opened by siddvenk 5 months ago - 1 comment

#2071 - pin numpy to <2 in ci/docker

Pull Request - State: closed - Opened by siddvenk 5 months ago - 1 comment

#2070 - DJL-TensorRT-LLM : inference no longer working, tokenizer error.

Issue - State: open - Opened by eduardzl 5 months ago
Labels: bug

#2065 - [secure-mode] Fix entrypoint control name

Pull Request - State: closed - Opened by ethnzhng 5 months ago

#2064 - [ci] Adding integration test for AutoAwq

Pull Request - State: closed - Opened by sindhuvahinis 5 months ago

#2063 - [lmi][docs] update to 0.28.0 in lmi docs

Pull Request - State: closed - Opened by siddvenk 5 months ago

#2062 - [secure-mode] Refactor secure mode plugin (#2058)

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2060 - [plugin] Fixes plugin scaning bug

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2059 - [plugin] Fixes plugin scaning bug

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2058 - [secure-mode] Refactor secure mode plugin

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2057 - Stopping short: Very few output tokens returned, even though max tokens set very high.

Issue - State: closed - Opened by yaronr 5 months ago - 1 comment
Labels: bug

#2052 - [test] remove trtllm flan t5 integration test

Pull Request - State: closed - Opened by sindhuvahinis 5 months ago

#2051 - [vllm, lmi-dist] add support for top_n_tokens

Pull Request - State: closed - Opened by sindhuvahinis 5 months ago

#2050 - Fix benchmark deb build

Pull Request - State: closed - Opened by zachgk 5 months ago

#2049 - [0.28.0-dlc][lmi] Update lmi-dist to 10.0.1

Pull Request - State: closed - Opened by maaquib 5 months ago - 2 comments

#2048 - [serving] Update default max worker to 1 for GPU

Pull Request - State: closed - Opened by xyang16 5 months ago

#2047 - [docs] Updates embedding user guide

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2046 - [IB] support suzuka model

Pull Request - State: closed - Opened by lanking520 5 months ago

#2045 - [IB] write template into file system

Pull Request - State: closed - Opened by lanking520 5 months ago

#2044 - [IB] use a file to pass to the output

Pull Request - State: closed - Opened by lanking520 5 months ago

#2043 - bump up trtllm to 0.10.0

Pull Request - State: open - Opened by ydm-amazon 5 months ago

#2041 - [doc] SSE jsonline document

Pull Request - State: closed - Opened by sindhuvahinis 5 months ago

#2040 - [serving] Fail ping if error rate exceed

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2039 - [metrics] Improve prometheus metric type handling

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2038 - AutoAWQ Integration Script

Pull Request - State: closed - Opened by a-ys 5 months ago - 1 comment

#2037 - [ci] Add back missing publish task in gradle

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2036 - [docker] Fixes docker build script for version detection

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2035 - [python] Fixes typing issue with py3.8

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2034 - [serving] Update python typing to support py38

Pull Request - State: closed - Opened by tosterberg 5 months ago

#2033 - [test] Fixes java-client test dependency

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2032 - [doc] adding release notes for docs.djl.ai

Pull Request - State: closed - Opened by sindhuvahinis 5 months ago - 1 comment

#2031 - [doc] add tgi_compat and see details

Pull Request - State: closed - Opened by sindhuvahinis 5 months ago

#2030 - [CI] fix a bug in dataset prep

Pull Request - State: closed - Opened by lanking520 5 months ago

#2029 - Updates DJL version to 0.29.0-SNAPSHOT

Pull Request - State: closed - Opened by frankfliu 5 months ago

#2028 - [doc] improve output schema doc

Pull Request - State: closed - Opened by sindhuvahinis 5 months ago

#2027 - Add llama-3 lora test

Pull Request - State: closed - Opened by rohithkrn 5 months ago

#2026 - [docs] Omit response array in text embedding doc

Pull Request - State: closed - Opened by xyang16 6 months ago

#2025 - [docs] Fix broken links in user guide

Pull Request - State: closed - Opened by xyang16 6 months ago

#2024 - [lmi][docs] add deepspeed deprecation notice to lmi docs

Pull Request - State: closed - Opened by siddvenk 6 months ago

#2023 - [CI] LLM Integration Tests through pytest suite

Pull Request - State: closed - Opened by zachgk 6 months ago - 4 comments

#2022 - [doc] Add LMI Text Embedding Inference user guide

Pull Request - State: closed - Opened by xyang16 6 months ago

#2020 - [CI] use split by '\n' to solve the issue

Pull Request - State: closed - Opened by lanking520 6 months ago

#2019 - Add ecr login credentials

Pull Request - State: closed - Opened by vinayburugu 6 months ago

#2018 - [doc] custom output formatter schema

Pull Request - State: closed - Opened by sindhuvahinis 6 months ago

#2017 - [docker] Fixes duplicated onnx jar file issue

Pull Request - State: closed - Opened by frankfliu 6 months ago

#2016 - [docker] Remove onnxruntime cpu jar in lmi docker

Pull Request - State: closed - Opened by xyang16 6 months ago

#2014 - [lmi][docs] fix token format in api schema docs

Pull Request - State: closed - Opened by siddvenk 6 months ago

#2013 - Convert cuda env tgi variables to lmi

Pull Request - State: closed - Opened by sindhuvahinis 6 months ago

#2012 - Update max num tokens workflow, fix multiple bugs

Pull Request - State: closed - Opened by ydm-amazon 6 months ago

#2011 - Refactor lmi_dist and vllm to support best_of with RequestOutput

Pull Request - State: closed - Opened by sindhuvahinis 6 months ago - 2 comments

#2009 - lmi cpu container with vLLM

Pull Request - State: open - Opened by lanking520 6 months ago

#2003 - [docs][lmi] update lmi docs in general for 0.28.0

Pull Request - State: closed - Opened by siddvenk 6 months ago

#1994 - fix typo in finish_reason default.

Pull Request - State: closed - Opened by sindhuvahinis 6 months ago

#1992 - best_of support in output formatter

Pull Request - State: closed - Opened by sindhuvahinis 6 months ago