Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / deepjavalibrary/djl-serving issues and pull requests

#922 - [python] A temporary workaround for rolling batch

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#921 - [ci/cd] Add llama to performance testing

Pull Request - State: closed - Opened by tosterberg over 1 year ago

#920 - Fix do sample type

Pull Request - State: closed - Opened by sindhuvahinis over 1 year ago

#918 - lmi_dist model tests updates

Pull Request - State: closed - Opened by maaquib over 1 year ago

#912 - Assign random seed for lmi dist

Pull Request - State: closed - Opened by sindhuvahinis over 1 year ago

#908 - Fix skip special tokens in lmi-dist

Pull Request - State: closed - Opened by xyang16 over 1 year ago

#904 - Add integration test for lmi-dist AutoModel

Pull Request - State: closed - Opened by xyang16 over 1 year ago

#901 - [python] Use lmi-dist api to get batch class

Pull Request - State: closed - Opened by xyang16 over 1 year ago

#896 - [serving] Update tnx handler for 2.12 supported models

Pull Request - State: closed - Opened by tosterberg over 1 year ago

#881 - Non streaming for rolling batch

Pull Request - State: closed - Opened by sindhuvahinis over 1 year ago

#864 - using paddlepaddle engine and ppocr-v3 model an error occurred

Issue - State: closed - Opened by faquir-sun over 1 year ago - 4 comments
Labels: bug

#862 - Update netty for cve

Pull Request - State: closed - Opened by siddvenk over 1 year ago

#861 - Update netty for cve

Pull Request - State: closed - Opened by siddvenk over 1 year ago

#860 - Update netty for cve

Pull Request - State: closed - Opened by siddvenk over 1 year ago

#858 - Update netty for cve

Pull Request - State: closed - Opened by siddvenk over 1 year ago

#850 - [docker] add protobuf to FT and TNX

Pull Request - State: closed - Opened by tosterberg over 1 year ago

#849 - [docker] add protobuf to FT and TNX

Pull Request - State: closed - Opened by tosterberg over 1 year ago

#838 - [partition] Adding back S3Url for backward compatibility in pysdk

Pull Request - State: closed - Opened by sindhuvahinis over 1 year ago

#836 - [AOT PySDK] Override the key prefix added for output_uri

Issue - State: closed - Opened by sindhuvahinis over 1 year ago - 2 comments
Labels: enhancement

#835 - [AOT] Tokenizer should be optional for AOT

Issue - State: closed - Opened by sindhuvahinis over 1 year ago - 1 comment
Labels: bug

#832 - LLAMA 13B parallel loading processes hanged

Issue - State: closed - Opened by lanking520 over 1 year ago
Labels: bug

#824 - CUDA error when using huggingface streaming

Issue - State: closed - Opened by frankfliu over 1 year ago
Labels: bug

#823 - DeepSpeed streaming, max_length is ignored

Issue - State: closed - Opened by frankfliu over 1 year ago - 2 comments
Labels: bug

#811 - [python] Create model level virtualenv

Pull Request - State: closed - Opened by xyang16 over 1 year ago

#784 - Sharded GPT2 model cannot be loaded with DeepSpeed

Issue - State: closed - Opened by frankfliu over 1 year ago - 1 comment
Labels: bug

#762 - [docker] Pin bitsandbytes version to 0.38.1

Pull Request - State: closed - Opened by xyang16 over 1 year ago

#761 - [docker] Pin bitsandbytes version to 0.38.1

Pull Request - State: closed - Opened by xyang16 over 1 year ago

#760 - [docker] Pin bitsandbytes version to 0.38.1

Pull Request - State: closed - Opened by xyang16 over 1 year ago

#759 - [docker] Pin bitsandbytes version to 0.38.1

Pull Request - State: closed - Opened by xyang16 over 1 year ago

#757 - [TNX] Add partition method to inf2 handler

Pull Request - State: closed - Opened by maaquib over 1 year ago

#754 - [docker] Pin bitsandbytes version to 0.38.1

Pull Request - State: closed - Opened by xyang16 over 1 year ago - 1 comment

#752 - MME model dependency conflict scenario

Issue - State: closed - Opened by lanking520 over 1 year ago - 1 comment
Labels: enhancement

#751 - fix permissions for sm pysdk install script

Pull Request - State: closed - Opened by siddvenk over 1 year ago - 1 comment

#750 - [serving] Improves model loading logging

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#749 - [python] Handle torch.cuda.OutOfMemoryError

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#748 - Flaky Pipeline due to Transformers 4.27.x

Issue - State: open - Opened by tosterberg over 1 year ago
Labels: bug

#747 - update the wheel to have path fixed

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#746 - LMBlock

Pull Request - State: open - Opened by KexinFeng over 1 year ago

#745 - Skeleton structure for sequence batch scheduler

Pull Request - State: closed - Opened by sindhuvahinis over 1 year ago

#744 - [serving] Avoid unit-test hang

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#743 - Iteration-level scheduler with geedy search

Pull Request - State: open - Opened by KexinFeng over 1 year ago

#742 - Adding project diagrams link to architecture.md

Pull Request - State: closed - Opened by alexkarezin over 1 year ago

#741 - [python] Adds text/plain content-type support

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#740 - [python] Fixes typo in fastertransformer handler

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#739 - [ci] Upgrade jacoco to 0.8.8 to support JDK17+

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#738 - [docker] Uses the same convention as tritonserver

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#737 - FT bloom conversion fails with HF model id

Issue - State: closed - Opened by rohithkrn over 1 year ago - 1 comment
Labels: bug

#736 - ft_handler fix

Pull Request - State: closed - Opened by rohithkrn over 1 year ago

#735 - Remove TGI build and test pipeline

Pull Request - State: closed - Opened by xyang16 over 1 year ago

#734 - [FT] change the dependencies so

Pull Request - State: closed - Opened by lanking520 over 1 year ago - 1 comment

#733 - [fix] bump versions for new deepspeed wheel

Pull Request - State: open - Opened by tosterberg over 1 year ago

#732 - tokenizer bug fixes

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#731 - [python] Add --no-index to pip install in offline mode

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#730 - Asynchronous with PublisherBytesSupplier

Pull Request - State: closed - Opened by zachgk over 1 year ago

#729 - [python] Support pip install in offline mode

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#728 - requirement.txt installation lack of mechanism for off-network installation

Issue - State: closed - Opened by lanking520 over 1 year ago
Labels: bug

#727 - adding llama model support

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#726 - GPTNeoX variant model crashes on LMI

Issue - State: closed - Opened by lanking520 over 1 year ago
Labels: bug

#725 - [DeepSpeed][INF2] add vision components

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#724 - Add seq2seq streaming integ test

Pull Request - State: closed - Opened by rohithkrn over 1 year ago

#723 - [test] Update tranformser-neuxornx gpt-j-b mode options

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#722 - update fastertransformers build instruction

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#721 - [test] Refactor client.py

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#720 - [test] Reformat python code

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#719 - Creates S3 Cache Engine

Pull Request - State: closed - Opened by zachgk over 1 year ago

#718 - [serving] Load function from workflow directory

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#717 - Fix no code tests in lmi test suite

Pull Request - State: closed - Opened by siddvenk over 1 year ago

#716 - Add unit test for empty model store initialization

Pull Request - State: closed - Opened by siddvenk over 1 year ago

#715 - Add support for se2seq model loading in HF handler

Pull Request - State: closed - Opened by rohithkrn over 1 year ago

#714 - [workflow] Support load model from workflow directory

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#713 - bump up n positions

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#712 - Refactor logic for supporting HF_MODEL_ID to support MME use case

Pull Request - State: closed - Opened by siddvenk over 1 year ago - 1 comment

#711 - [ci] reconfigure performance test time and machines

Pull Request - State: closed - Opened by tosterberg over 1 year ago

#710 - [INF2] give better room for more tokens

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#709 - fix the start gpu bug

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#708 - LMI container not compatible with Multi-container endpoint of SageMaker

Issue - State: closed - Opened by dhawalkp over 1 year ago - 2 comments
Labels: enhancement

#707 - fix the device mapping issue if visible devices is set

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#706 - add SageMaker MCE support

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#705 - Add SageMaker integration test

Pull Request - State: closed - Opened by siddvenk over 1 year ago - 3 comments

#704 - [ci] Upgrade spotbugs to 5.0.14

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#703 - [serving] Workaround LocalRepository detection issue

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#702 - Add SageMaker integration test

Pull Request - State: closed - Opened by siddvenk over 1 year ago

#701 - [cherry-pick] add bf16 support (#700)

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#700 - [INF2] add bf16 support to SD

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#699 - [plugin] Include djl s3 extension in djl-serving distribution

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#698 - Add support for streaming Seq2Seq models

Pull Request - State: closed - Opened by rohithkrn over 1 year ago

#697 - [Cherry pick] adding clip model support

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#696 - [INF2] adding clip model support

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#695 - [tgi] Add more models to TGI test pipeline

Pull Request - State: closed - Opened by xyang16 over 1 year ago

#694 - add neuronx new feature for generation

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#693 - [console] Fixes log file charset issue

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#692 - [api] Update ChunkedBytesSupplier API

Pull Request - State: closed - Opened by frankfliu over 1 year ago

#691 - Change the bucket for different object

Pull Request - State: closed - Opened by sindhuvahinis over 1 year ago

#690 - [ci] make performance tests run in parallel

Pull Request - State: closed - Opened by tosterberg over 1 year ago

#689 - add stable diffusion support on INF2 (#683)

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#688 - unset omp thread to prevent CLIP model delay

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#687 - [WIP] new set of configurations

Pull Request - State: closed - Opened by lanking520 over 1 year ago

#686 - Update github-slug-action to v4.4.1

Pull Request - State: closed - Opened by xyang16 over 1 year ago