Data

Tools

Indexes

Applications

Experiments

Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / triton-inference-server/python_backend issues and pull requests

#400 - refactor: Use safer backend APIs

Pull Request - State: closed - Opened by yinggeh 3 months ago

#399 - fix: Update the SHA256 checksum for boost lib (r22.12)

Pull Request - State: closed - Opened by simonzgx 3 months ago

#397 - Update CMakeLists.txt to avoid check sum error

Pull Request - State: open - Opened by naman223 4 months ago

#395 - feat: Extend response parameters support to BLS in python backend

Pull Request - State: closed - Opened by ziqif-nv 6 months ago - 1 comment
Labels: PR: feat

#394 - feat: Add parameters support to InferResponse

Pull Request - State: closed - Opened by kthui 6 months ago - 1 comment
Labels: PR: feat

#392 - fix: Move from jfrog artifactory to archives.boost.io to fix boost download

Pull Request - State: open - Opened by VikramVuppla 7 months ago - 1 comment

#384 - fix: python backend support for numpy>=2

Pull Request - State: closed - Opened by KrishnanPrash 9 months ago - 3 comments

#379 - perf: vLLM metrics optimization

Pull Request - State: closed - Opened by yinggeh 10 months ago
Labels: enhancement

#359 - Shm related fixes

Pull Request - State: closed - Opened by pziecina-nv about 1 year ago

#345 - Delete TRITONSERVER_Error - #344

Pull Request - State: closed - Opened by pskiran1 over 1 year ago - 1 comment

#339 - Add support for correlation string in BLS calls in python backend

Pull Request - State: closed - Opened by pskiran1 over 1 year ago - 1 comment

#306 - Rmccormick shmleak debug

Pull Request - State: closed - Opened by rmccorm4 almost 2 years ago

#168 - fix inferentia test build

Pull Request - State: closed - Opened by jbkyang-nvi about 3 years ago

#100 - Update documentation to remove beta from BLS

Pull Request - State: closed - Opened by deadeyegoodwin over 3 years ago

#99 - Separate shared memory region by version

Pull Request - State: closed - Opened by GuanLuo over 3 years ago

#98 - Fix changing the stub execute permission

Pull Request - State: closed - Opened by Tabrizian over 3 years ago

#97 - pb_utils.Tensor.from_dlpack() — correct signature in README

Pull Request - State: closed - Opened by okdimok over 3 years ago - 3 comments

#96 - Add testing setup script and some more notes to README

Pull Request - State: closed - Opened by jbkyang-nvi over 3 years ago

#95 - TensorFlow support for inferentia gen script

Pull Request - State: closed - Opened by tanmayv25 over 3 years ago

#94 - Support mulitple triton model instances in Inferentia

Pull Request - State: closed - Opened by tanmayv25 over 3 years ago

#93 - Migrate to Neuron Runtime 2.X in model.py

Pull Request - State: closed - Opened by tanmayv25 over 3 years ago

#91 - Fix GPU tensor bug in BLS (#88)

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#90 - Add script for generating model template and config.pbtxt for inferentia models

Pull Request - State: closed - Opened by tanmayv25 almost 4 years ago - 1 comment

#89 - Add inferentia build script

Pull Request - State: closed - Opened by jbkyang-nvi almost 4 years ago - 1 comment

#88 - Fix GPU tensor bug in BLS

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#87 - Clarify FORCE_CPU_ONLY_INPUT_TENSORS documentation

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#86 - Use local repo dirs for build instead of pointing to github repos

Pull Request - State: closed - Opened by CoderHam almost 4 years ago

#85 - Fix segfault when inference response has an error

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#84 - add resnet50_trt example

Pull Request - State: closed - Opened by jackyh almost 4 years ago - 4 comments

#83 - Improve examples to be verifiable using CI

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#82 - Fix zero length bytes tensor

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago - 1 comment

#81 - Add support for relative paths for execution envs

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago - 3 comments

#80 - Add documentation for DLPack tensor

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#79 - Add support for GPU tensors in BLS

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#78 - Add async BLS documentation

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#77 - Fix destruction of GPU tensors

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago - 2 comments

#76 - Fix default_model_filename

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#75 - Add async BLS execution

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago - 1 comment

#74 - Fix CPU only for GPU tensors

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#73 - Add documentation for BLS

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#72 - Add a note about PYTHONUSERSITE env variable

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#71 - Add BLS sync

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#70 - Add documentation for BLS

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#69 - Fix LD_LIBRARY_PATH for execution environments

Pull Request - State: closed - Opened by Tabrizian almost 4 years ago

#68 - Add BLS sync

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#67 - Add SaveToSharedMemory and LoadFromSharedMemory to InferRequest and InferResponse objects

Pull Request - State: closed - Opened by Tabrizian about 4 years ago - 1 comment

#66 - Update building from source instructions

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#65 - Refactor communication of stub and main process

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#64 - Fix a bug in detecting the health of the stub process

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#63 - Modify backend to be host policy aware

Pull Request - State: closed - Opened by GuanLuo about 4 years ago

#62 - Add support for DLPack Tensors

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#61 - Convert non-contiguous tensors to contiguous tensors

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#60 - Fix minor typo in README

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#59 - Fix stub shutdown and memory leak in Python backend

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#58 - Add automatic restart for Python backend stubs

Pull Request - State: closed - Opened by Tabrizian about 4 years ago - 1 comment

#57 - Add docs for custom execution environments

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#56 - Improve the note on Python packages and conda

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#55 - Add support for custom python environments

Pull Request - State: closed - Opened by Tabrizian about 4 years ago - 1 comment

#54 - Update the note about the Python environments in the README

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#53 - add huggingface t5 translation example

Pull Request - State: closed - Opened by nlpcat about 4 years ago - 2 comments

#52 - Update default timeout value.

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#51 - Fix a concurrency bug when the stub is starting

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#50 - Modify incorrect information in READMD.md

Pull Request - State: closed - Opened by qpakzk about 4 years ago - 1 comment

#49 - Delete redundant source code

Pull Request - State: closed - Opened by qpakzk about 4 years ago - 2 comments

#48 - Use fallocate instead of ftruncate to avoid SIGBUS error

Pull Request - State: closed - Opened by Tabrizian about 4 years ago

#47 - Make sure that the output buffers are in CPU

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#46 - Add docs for new flags in Python backend

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#45 - Add checks for flags values and improve shm growth error handling

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#44 - Set maximum tensor size

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#43 - Modify wrong paths for add_sub model

Pull Request - State: closed - Opened by qpakzk over 4 years ago

#42 - Accelerate Python backend using shared memory

Pull Request - State: closed - Opened by Tabrizian over 4 years ago - 3 comments

#41 - Bug fix: Removed usage of deprecated np.bool

Pull Request - State: closed - Opened by jbkyang-nvi over 4 years ago

#40 - Fix batch size reporting

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#39 - Fix np.object_ encoding when using str

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#38 - Use np.object_ when serializing BYTES type

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#37 - Revert "Fix np.object_ for Python backend"

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#36 - Fix np.object_ for Python backend

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#35 - Fix boolean type

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#34 - Correctly escape angle brackets

Pull Request - State: closed - Opened by deadeyegoodwin over 4 years ago

#33 - Fix name_ and model_instance_state_

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#32 - Fix: ModelInstanceState name_ property should not set #2457

Pull Request - State: closed - Opened by zjjott over 4 years ago - 1 comment

#31 - Fix np.object for TYPE_STRING

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#30 - Add support for copying data from GPU to CPU when input is in GPU

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#29 - support get input buffer from GPU memory to CPU memory

Pull Request - State: closed - Opened by ldengjie over 4 years ago - 1 comment

#28 - Fix np.object_ for TYPE_STRING

Pull Request - State: closed - Opened by francescoclarifai over 4 years ago - 6 comments

#27 - Add triton client installation to README

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#26 - Rename backend to model_instance

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#25 - Fix model imports

Pull Request - State: closed - Opened by Tabrizian over 4 years ago - 1 comment

#24 - Add grpc timeout config to backend config

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#23 - Add PyTorch example

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#22 - Fix examples

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#21 - Add code format configuration

Pull Request - State: closed - Opened by deadeyegoodwin over 4 years ago

#20 - Update README.md

Pull Request - State: closed - Opened by Tabrizian over 4 years ago

#19 - Include instance group kind in initialization logging

Pull Request - State: closed - Opened by deadeyegoodwin over 4 years ago

#18 - Fix large payload for Python backend

Pull Request - State: closed - Opened by Tabrizian over 4 years ago