GitHub / triton-inference-server/backend issues and pull requests
#112 - refactor: Prevent overflow in backend APIs
Pull Request -
State: closed - Opened by yinggeh 3 months ago
#111 - Remove tf from bls backend (#110)
Pull Request -
State: closed - Opened by krishung5 4 months ago
#110 - fix: Remove tf model from bls backend
Pull Request -
State: closed - Opened by krishung5 4 months ago
#109 - Update default branch post 25.01
Pull Request -
State: closed - Opened by mc-nv 6 months ago
#108 - Update the cuda archs in Backend
Pull Request -
State: closed - Opened by pvijayakrish 7 months ago
#107 - Update `main` branch post 24.11
Pull Request -
State: closed - Opened by mc-nv 8 months ago
#106 - Enable support for Ubuntu 24.04
Pull Request -
State: closed - Opened by mc-nv 9 months ago
#105 - Build Updates for Ubuntu24.04
Pull Request -
State: closed - Opened by nv-anants 9 months ago
#104 - Support Windows Long Paths
Pull Request -
State: closed - Opened by fpetrini15 9 months ago
#103 - Windows Long Paths Support
Pull Request -
State: open - Opened by ashishk98 9 months ago
#102 - doc: Add TRT-LLM backend to the doc
Pull Request -
State: closed - Opened by krishung5 11 months ago
#101 - refactor: Refactor string input check
Pull Request -
State: closed - Opened by yinggeh about 1 year ago
Labels: enhancement
#100 - Add kCUDAExecutionAccelerator constant
Pull Request -
State: closed - Opened by krishung5 about 1 year ago
#99 - chore: Use log level ERROR when logging backend errors with LOG_IF_ERROR
Pull Request -
State: closed - Opened by rmccorm4 about 1 year ago
#98 - Remove deprecated use of find_package(CUDA)
Pull Request -
State: closed - Opened by Tabrizian about 1 year ago
#97 - adding json logging macros
Pull Request -
State: open - Opened by nnshah1 about 1 year ago
- 1 comment
#96 - Parameterize git repository
Pull Request -
State: closed - Opened by nv-kmcgill53 over 1 year ago
#95 - BackendMemory::Create must release all errors
Pull Request -
State: closed - Opened by lhrios over 1 year ago
- 7 comments
#94 - Python backend based PyTorch backend documentations
Pull Request -
State: closed - Opened by kthui over 1 year ago
#93 - Fixes for Clang 15 warnings
Pull Request -
State: open - Opened by HennerM over 1 year ago
#92 - Bump min cxx standard to 17
Pull Request -
State: closed - Opened by oandreeva-nv over 1 year ago
#91 - Use compliant preprocessor on windows
Pull Request -
State: closed - Opened by tanmayv25 over 1 year ago
#90 - Clarify decoupled models documentation
Pull Request -
State: closed - Opened by dyastremsky over 1 year ago
#89 - Document vLLM integration as a first class citizen in Triton (#88)
Pull Request -
State: closed - Opened by oandreeva-nv almost 2 years ago
#88 - Document vLLM integration as a first class citizen in Triton
Pull Request -
State: closed - Opened by oandreeva-nv almost 2 years ago
#87 - Add docs on BackendAttributes
Pull Request -
State: closed - Opened by rmccorm4 almost 2 years ago
#86 - Update iSort to use Black style
Pull Request -
State: closed - Opened by dyastremsky about 2 years ago
#85 - Add GitHub action to format and lint code
Pull Request -
State: closed - Opened by dyastremsky about 2 years ago
#84 - Auto-formatting with upgrade to clang-format-15
Pull Request -
State: closed - Opened by dyastremsky about 2 years ago
#83 - Fix typos
Pull Request -
State: closed - Opened by rmccorm4 about 2 years ago
#82 - Add documentation on model config "platform"
Pull Request -
State: closed - Opened by GuanLuo about 2 years ago
#81 - Hide event_ and buffer_ready_event_ variables
Pull Request -
State: closed - Opened by kthui over 2 years ago
- 2 comments
#80 - Add device memory tracker as backend utilties
Pull Request -
State: closed - Opened by GuanLuo over 2 years ago
- 1 comment
#79 - Avoid linking to cudart_static library
Pull Request -
State: closed - Opened by mc-nv over 2 years ago
- 1 comment
#78 - Avoid linking to cudart_static library
Pull Request -
State: closed - Opened by tanmayv25 over 2 years ago
#77 - Rename kernel library to work with library exports
Pull Request -
State: closed - Opened by tanmayv25 over 2 years ago
#76 - Add Cache Function for User-Defined Batching
Pull Request -
State: closed - Opened by dyastremsky over 2 years ago
- 1 comment
#75 - Allow User-Defined Batching Strategies
Pull Request -
State: closed - Opened by dyastremsky over 2 years ago
#74 - Add a note about type bytes not being supported.
Pull Request -
State: closed - Opened by Tabrizian over 2 years ago
#73 - Fix typo
Pull Request -
State: closed - Opened by Tabrizian over 2 years ago
#72 - fix metrics readme
Pull Request -
State: closed - Opened by jbkyang-nvi almost 3 years ago
- 3 comments
#71 - Fixed the casting issue for armv7
Pull Request -
State: closed - Opened by thmca almost 3 years ago
- 2 comments
#70 - Update DALI section in the platform support matrix
Pull Request -
State: closed - Opened by szalpal almost 3 years ago
#69 - Add backend support matrices for different platforms
Pull Request -
State: closed - Opened by tanmayv25 almost 3 years ago
- 1 comment
#68 - Fix error handling for TritonJson APIs
Pull Request -
State: closed - Opened by krishung5 almost 3 years ago
#67 - Clean up TRITONSERVER_Message to prevent memory leak
Pull Request -
State: closed - Opened by krishung5 about 3 years ago
#66 - feat: update readme, with that plattform field is legacy and backend is prefered
Pull Request -
State: closed - Opened by NikeNano about 3 years ago
- 4 comments
#65 - Fix comment typo
Pull Request -
State: closed - Opened by tjsongzw about 3 years ago
- 1 comment
#64 - Parse the updated model configuration after re-normalization by core
Pull Request -
State: closed - Opened by tanmayv25 about 3 years ago
#63 - Move bls documentation
Pull Request -
State: closed - Opened by krishung5 about 3 years ago
#62 - Import sync_queue in backend_input_collector
Pull Request -
State: closed - Opened by rmccorm4 about 3 years ago
#61 - Implement BLS backend
Pull Request -
State: closed - Opened by krishung5 about 3 years ago
- 3 comments
#60 - Prefix Logs with Request ID
Pull Request -
State: closed - Opened by dyastremsky about 3 years ago
- 1 comment
#59 - Add support for GPU tensor in ReadInputTensor
Pull Request -
State: closed - Opened by Tabrizian about 3 years ago
#58 - Improve documentation on decoupled backend API (#57)
Pull Request -
State: closed - Opened by mc-nv about 3 years ago
#57 - Improve documentation on decoupled backend API
Pull Request -
State: closed - Opened by tanmayv25 about 3 years ago
#56 - Validate the batch size before trying to override it in responder
Pull Request -
State: closed - Opened by tanmayv25 about 3 years ago
#55 - Don't override shape for empty tensors
Pull Request -
State: closed - Opened by tanmayv25 over 3 years ago
- 4 comments
#54 - Add TYPE_BF16 scaffolding
Pull Request -
State: closed - Opened by rmccorm4 over 3 years ago
#53 - Update backend lifecycle doc
Pull Request -
State: closed - Opened by deadeyegoodwin over 3 years ago
#52 - Add BATCH_ITEM_SHAPE handling in BackendInputCollector
Pull Request -
State: closed - Opened by GuanLuo over 3 years ago
#51 - Add RESPOND_ALL_AND_SET_TRUE_IF_ERROR macro to handle error correctly
Pull Request -
State: closed - Opened by tanmayv25 over 3 years ago
- 2 comments
#50 - Add recommended backend to tutorial
Pull Request -
State: closed - Opened by deadeyegoodwin over 3 years ago
#49 - Add tutorial on backend creation
Pull Request -
State: closed - Opened by deadeyegoodwin over 3 years ago
#48 - Responder should explicitly use 'first dimension batching'
Pull Request -
State: closed - Opened by deadeyegoodwin over 3 years ago
#47 - Read First Dimension Batching From Model Config
Pull Request -
State: closed - Opened by dyastremsky over 3 years ago
- 1 comment
#46 - Add default optional input handling for BackendModel
Pull Request -
State: closed - Opened by GuanLuo over 3 years ago
#45 - Fix the segfault when using CopyKernel
Pull Request -
State: closed - Opened by tanmayv25 over 3 years ago
#44 - Allow BackendMemory to be created from preallocated buffer
Pull Request -
State: closed - Opened by tanmayv25 almost 4 years ago
#43 - Add state output support to backend output responder
Pull Request -
State: closed - Opened by Tabrizian almost 4 years ago
#42 - Disable request input coalescence by default
Pull Request -
State: closed - Opened by GuanLuo almost 4 years ago
- 1 comment
#41 - [DO NOT MERGE] Test elimination of illegal memory coalescing
Pull Request -
State: closed - Opened by wphicks almost 4 years ago
#40 - Adding stateful backend example to README.md
Pull Request -
State: closed - Opened by efeguney almost 4 years ago
#39 - adding utility functions to parse model config parameters field
Pull Request -
State: closed - Opened by askhade almost 4 years ago
#38 - Add FIL blurb to README
Pull Request -
State: closed - Opened by wphicks almost 4 years ago
#37 - Use local repo dirs for build instead of pointing to github repos
Pull Request -
State: closed - Opened by CoderHam almost 4 years ago
#36 - Fix the parsing of pinned memory optimization
Pull Request -
State: closed - Opened by tanmayv25 almost 4 years ago
- 2 comments
#35 - Update the documentation to point to the TensorRT backend repo
Pull Request -
State: closed - Opened by tanmayv25 almost 4 years ago
- 1 comment
#34 - Extend START, END, READY controls to allow BOOL type
Pull Request -
State: closed - Opened by krishung5 almost 4 years ago
#33 - Add copy on stream and nullify request pointers upon release
Pull Request -
State: closed - Opened by tanmayv25 almost 4 years ago
#32 - Add the support for copy on stream in backend utilities
Pull Request -
State: closed - Opened by tanmayv25 almost 4 years ago
#31 - Document request ownership in case TRITONBACKEND_ModelInstanceExecute…
Pull Request -
State: closed - Opened by tanmayv25 almost 4 years ago
#30 - Updated field requirements for custom TensorFlow backend
Pull Request -
State: closed - Opened by dyastremsky about 4 years ago
- 5 comments
#29 - Modify BackendInputCollector to detect contiguity across requests
Pull Request -
State: closed - Opened by GuanLuo about 4 years ago
- 1 comment
#28 - Modify backend utilities to be host policy aware
Pull Request -
State: closed - Opened by GuanLuo about 4 years ago
#27 - Link backend utilities against static cudart
Pull Request -
State: closed - Opened by deadeyegoodwin about 4 years ago
#26 - Fix the documentation for TensorRT models
Pull Request -
State: closed - Opened by tanmayv25 about 4 years ago
#25 - ARM MALI support
Pull Request -
State: closed - Opened by jishminor about 4 years ago
- 1 comment
#24 - Add -fPIC flag in Triton gather kernel build
Pull Request -
State: closed - Opened by GuanLuo about 4 years ago
#23 - Fix No GPU build
Pull Request -
State: closed - Opened by CoderHam over 4 years ago
- 1 comment
#22 - Update collector with enhancements from server src/core
Pull Request -
State: closed - Opened by tanmayv25 over 4 years ago
#21 - Add batch I/O support as backend common utilities
Pull Request -
State: closed - Opened by GuanLuo over 4 years ago
#20 - Add ProcessTensor() overload that checks input contiguity
Pull Request -
State: closed - Opened by GuanLuo over 4 years ago
- 4 comments
#19 - Add get parameter value utility
Pull Request -
State: closed - Opened by GuanLuo over 4 years ago
#18 - Add OpenVINO documentation
Pull Request -
State: closed - Opened by deadeyegoodwin over 4 years ago
#17 - Additional documentation about installing backends
Pull Request -
State: closed - Opened by deadeyegoodwin over 4 years ago
#16 - Add implementation of ReadBinaryFile
Pull Request -
State: closed - Opened by jishminor over 4 years ago
- 1 comment
#15 - Fix double free of responses when responding with error
Pull Request -
State: closed - Opened by tanmayv25 over 4 years ago
#14 - Correctly escape angle brackets
Pull Request -
State: closed - Opened by deadeyegoodwin over 4 years ago
#13 - Port backend utils to Windows
Pull Request -
State: closed - Opened by GuanLuo over 4 years ago