Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / ELS-RD/transformer-deploy issues and pull requests

#184 - build(deps): bump onnx from 1.13.1 to 1.17.0

Pull Request - State: open - Opened by dependabot[bot] about 1 month ago
Labels: dependencies

#180 - Unable To use batching

Issue - State: open - Opened by rahulmate about 1 year ago - 1 comment

#179 - unable to host .onnx model on triton server

Issue - State: open - Opened by riyaj8888 over 1 year ago

#178 - :wolf: fix python tokenizer path

Pull Request - State: open - Opened by Pranjalya over 1 year ago

#177 - GPTModelWrapper' object has no attribute 'can_generate'

Issue - State: open - Opened by jxcomeon over 1 year ago - 1 comment

#176 - unable to do tensorrt inference

Issue - State: open - Opened by riyaj8888 over 1 year ago

#175 - No supported GPU(s) detected to run this container

Issue - State: open - Opened by sinankefeli over 1 year ago

#174 - transformer-deploy on triton server 22.08

Issue - State: closed - Opened by lakshaykc over 1 year ago - 1 comment

#173 - convert_model command not found

Issue - State: open - Opened by pint1022 over 1 year ago - 3 comments

#172 - Failed to load 'transformer_onnx_model'

Issue - State: closed - Opened by rifkybujana over 1 year ago - 4 comments

#171 - Tokenizer path

Issue - State: open - Opened by vishalsrao over 1 year ago

#170 - Llama support

Issue - State: open - Opened by michaelroyzen over 1 year ago - 2 comments

#169 - Torch 2.0

Issue - State: open - Opened by varshith15 over 1 year ago - 3 comments

#168 - Marginal Improvement Between INT8 and FP16

Issue - State: open - Opened by alexriggio over 1 year ago

#165 - sharing the code for the triton models.

Issue - State: open - Opened by espoirMur over 1 year ago

#164 - Can we support facebook/m2m100_418M model?

Issue - State: open - Opened by chi2liu almost 2 years ago

#163 - How to deploy TrCOR

Issue - State: closed - Opened by SShimmyo almost 2 years ago - 2 comments

#162 - ViT serving

Issue - State: open - Opened by VoVoR almost 2 years ago

#160 - VDubbs

Issue - State: closed - Opened by VDubbs86 almost 2 years ago

#160 - VDubbs

Issue - State: closed - Opened by VDubbs86 almost 2 years ago

#159 - Question-Answering example not working for batch_size > 1

Issue - State: open - Opened by lakshaykc almost 2 years ago

#159 - Question-Answering example not working for batch_size > 1

Issue - State: open - Opened by lakshaykc almost 2 years ago

#158 - Support for constrained beam-search in T5

Issue - State: open - Opened by junwang-wish almost 2 years ago

#158 - Support for constrained beam-search in T5

Issue - State: open - Opened by junwang-wish almost 2 years ago

#157 - Attempting to run T5 ORT model in Triton inference server

Issue - State: open - Opened by samiur almost 2 years ago - 1 comment

#156 - Two GPU are slower than one

Issue - State: open - Opened by OleksandrKorovii almost 2 years ago

#156 - Two GPU are slower than one

Issue - State: open - Opened by OleksandrKorovii almost 2 years ago

#155 - Tensorrt engine

Issue - State: open - Opened by imsiddhant07 almost 2 years ago - 1 comment

#155 - Tensorrt engine

Issue - State: open - Opened by imsiddhant07 almost 2 years ago - 1 comment

#154 - Token type ids bug

Pull Request - State: closed - Opened by fursovia about 2 years ago - 3 comments

#153 - Embedding with T5-Encoder

Issue - State: open - Opened by DA-L3 about 2 years ago - 1 comment

#153 - Embedding with T5-Encoder

Issue - State: open - Opened by DA-L3 about 2 years ago - 1 comment

#152 - Bug fix for embedding task

Pull Request - State: closed - Opened by fursovia about 2 years ago - 1 comment

#152 - Bug fix for embedding task

Pull Request - State: closed - Opened by fursovia about 2 years ago - 1 comment

#151 - Auth token bug

Pull Request - State: closed - Opened by fursovia about 2 years ago - 2 comments

#151 - Auth token bug

Pull Request - State: closed - Opened by fursovia about 2 years ago - 2 comments

#150 - Unable to optimize microsoft/deberta-v3-small model

Issue - State: open - Opened by hlkong323 about 2 years ago - 2 comments

#149 - Unable to install transformer-deploy module

Issue - State: closed - Opened by elvinagam about 2 years ago - 4 comments

#149 - Unable to install transformer-deploy module

Issue - State: closed - Opened by elvinagam about 2 years ago - 4 comments

#146 - GPT-J 6B model

Issue - State: closed - Opened by timofeev1995 about 2 years ago - 2 comments
Labels: question

#145 - Zero copy may lead to wrong text generation results

Issue - State: open - Opened by brevity2021 about 2 years ago - 6 comments
Labels: bug

#144 - EncoderDecoderModel wrapper

Pull Request - State: closed - Opened by varshith15 about 2 years ago - 1 comment

#144 - EncoderDecoderModel wrapper

Pull Request - State: closed - Opened by varshith15 about 2 years ago - 1 comment

#143 - OpusMT conversion

Issue - State: open - Opened by Matthieu-Tinycoaching about 2 years ago - 1 comment

#142 - fix: fix tensorrt inference in gpt2 notebook

Pull Request - State: closed - Opened by ayoub-louati about 2 years ago
Labels: bug

#142 - fix: fix tensorrt inference in gpt2 notebook

Pull Request - State: closed - Opened by ayoub-louati about 2 years ago
Labels: bug

#141 - fix: expose load_external_data for large models

Pull Request - State: closed - Opened by ayoub-louati about 2 years ago - 1 comment
Labels: bug

#141 - fix: expose load_external_data for large models

Pull Request - State: closed - Opened by ayoub-louati about 2 years ago - 1 comment
Labels: bug

#139 - encoder_hidden_states in the onnx inputs

Issue - State: closed - Opened by pngmafia about 2 years ago - 3 comments

#138 - [Question] Converting models over 2GB

Issue - State: closed - Opened by wkkautas about 2 years ago - 3 comments

#138 - [Question] Converting models over 2GB

Issue - State: closed - Opened by wkkautas about 2 years ago - 3 comments

#137 - fix: default device checked before device checking

Pull Request - State: closed - Opened by Thytu about 2 years ago

#137 - fix: default device checked before device checking

Pull Request - State: closed - Opened by Thytu about 2 years ago

#136 - TypeError: unhashable type: 'slice'

Issue - State: closed - Opened by pngmafia about 2 years ago - 2 comments
Labels: bug

#136 - TypeError: unhashable type: 'slice'

Issue - State: closed - Opened by pngmafia about 2 years ago - 2 comments
Labels: bug

#135 - Using t5-large in t5 notebook, the translation result is invalid

Issue - State: open - Opened by brevity2021 about 2 years ago - 1 comment

#135 - Using t5-large in t5 notebook, the translation result is invalid

Issue - State: open - Opened by brevity2021 about 2 years ago - 1 comment

#134 - fix: update version with fix for private models

Pull Request - State: closed - Opened by ayoub-louati about 2 years ago

#134 - fix: update version with fix for private models

Pull Request - State: closed - Opened by ayoub-louati about 2 years ago

#133 - fix: fix authentication for private models

Pull Request - State: closed - Opened by ayoub-louati about 2 years ago
Labels: bug

#133 - fix: fix authentication for private models

Pull Request - State: closed - Opened by ayoub-louati about 2 years ago
Labels: bug

#132 - Failed to load private model

Issue - State: closed - Opened by Matthieu-Tinycoaching about 2 years ago - 5 comments

#132 - Failed to load private model

Issue - State: closed - Opened by Matthieu-Tinycoaching about 2 years ago - 5 comments

#131 - Feat/add t5 support

Pull Request - State: closed - Opened by ayoub-louati over 2 years ago - 7 comments
Labels: enhancement

#130 - t5 notebook broken with transformer-deploy 0.5.0

Issue - State: open - Opened by michaelroyzen over 2 years ago - 3 comments

#130 - t5 notebook broken with transformer-deploy 0.5.0

Issue - State: open - Opened by michaelroyzen over 2 years ago - 3 comments

#129 - [Question] Documentation for generative model API and parameters?

Issue - State: open - Opened by tanmayb123 over 2 years ago - 1 comment

#129 - [Question] Documentation for generative model API and parameters?

Issue - State: open - Opened by tanmayb123 over 2 years ago - 1 comment

#128 - [Question] Batch inference for classification models

Issue - State: open - Opened by denisov-vlad over 2 years ago - 3 comments

#128 - [Question] Batch inference for classification models

Issue - State: open - Opened by denisov-vlad over 2 years ago - 3 comments

#127 - Unable to pull docker image

Issue - State: open - Opened by brevity2021 over 2 years ago - 1 comment

#125 - feat: add t5 model support for convert script

Pull Request - State: closed - Opened by ayoub-louati over 2 years ago
Labels: enhancement

#125 - feat: add t5 model support for convert script

Pull Request - State: closed - Opened by ayoub-louati over 2 years ago
Labels: enhancement

#124 - GPU quantization for sentence-transformer: ONNX quantized model

Issue - State: open - Opened by Matthieu-Tinycoaching over 2 years ago - 3 comments

#124 - GPU quantization for sentence-transformer: ONNX quantized model

Issue - State: open - Opened by Matthieu-Tinycoaching over 2 years ago - 3 comments

#123 - Question about generative model notebook

Issue - State: open - Opened by hyunwoongko over 2 years ago - 1 comment

#122 - Support converting T5 model

Issue - State: closed - Opened by ayoub-louati over 2 years ago - 4 comments
Labels: enhancement

#121 - How to Run With Polygraphy Graph Surgeon

Issue - State: open - Opened by sam-h-bean over 2 years ago - 5 comments

#121 - How to Run With Polygraphy Graph Surgeon

Issue - State: open - Opened by sam-h-bean over 2 years ago - 5 comments

#119 - [Question] TensorRT + ONNX Runtime

Issue - State: closed - Opened by MaximilienLeClei over 2 years ago - 2 comments

#119 - [Question] TensorRT + ONNX Runtime

Issue - State: closed - Opened by MaximilienLeClei over 2 years ago - 2 comments

#118 - t5_bf16 notebooks fails with [ONNXRuntimeError] : 10 : INVALID_GRAPH

Issue - State: open - Opened by michaelroyzen over 2 years ago - 4 comments

#118 - t5_bf16 notebooks fails with [ONNXRuntimeError] : 10 : INVALID_GRAPH

Issue - State: open - Opened by michaelroyzen over 2 years ago - 4 comments

#117 - embedding task fails with batch_size > 1 given variable length inputs

Issue - State: closed - Opened by bbartlett-nv over 2 years ago - 4 comments
Labels: bug