Xilinx/inference-server issues and pull requests

#224 - Error starting server from Python package

Issue - State: closed - Opened by sitabulaixizawaluduo 9 months ago - 2 comments
Labels: bug

#223 - Add a rocAL worker - CPU backend

Pull Request - State: closed - Opened by hansely 9 months ago - 10 comments

#222 - Add a rocAL worker for adding preprocessing feature on the servers side

Issue - State: closed - Opened by hansely 9 months ago

#221 - Update ONNX download links

Pull Request - State: closed - Opened by varunsh-xilinx 11 months ago - 3 comments

#220 - Update CODEOWNERS

Pull Request - State: closed - Opened by aaronn-xilinx about 1 year ago

#219 - Add roctracer to migraphx package list

Pull Request - State: closed - Opened by bpickrel about 1 year ago - 1 comment

#216 - Allow not pushing batch size in the XModel backend

Pull Request - State: closed - Opened by varunsh-xilinx about 1 year ago - 2 comments

#215 - UIF 1.2 release

Pull Request - State: closed - Opened by varunsh-xilinx about 1 year ago - 5 comments

#214 - Add a test for the VCK5000

Pull Request - State: closed - Opened by varunsh-xilinx about 1 year ago - 1 comment

#213 - Add resize to Python preprocess binding

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#212 - Add a PyTorch worker

Pull Request - State: open - Opened by ZchiPitt over 1 year ago - 4 comments

#211 - Add a PyTorch worker

Issue - State: open - Opened by ZchiPitt over 1 year ago

#210 - Fix quickstart script for 0.3.0

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago

#209 - Quickstart in the README doesn't work

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: bug

#208 - Fix FP16 binding

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#207 - Include tensor name in model metadata for xmodel worker

Pull Request - State: closed - Opened by ZchiPitt over 1 year ago - 8 comments

#206 - Add a python test for vck5000

Pull Request - State: closed - Opened by ZchiPitt over 1 year ago - 8 comments

#205 - Error with resnet50 example on V70

Issue - State: open - Opened by varunsh-xilinx over 1 year ago - 7 comments
Labels: bug

#204 - invalid tensorbuffer input for running tests on vck5000

Issue - State: closed - Opened by ZchiPitt over 1 year ago
Labels: bug

#203 - Add FP16 test in Python

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#202 - Bug fix in migraphx filename mangling

Pull Request - State: closed - Opened by bpickrel over 1 year ago - 7 comments

#201 - FP16 errors in Python

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: bug

#200 - Update documentation

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#199 - Rendering issues with the performance graphs

Issue - State: open - Opened by varunsh-xilinx over 1 year ago
Labels: bug

#198 - Add performance graphs

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#197 - Use MLCommons app for benchmarks

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#196 - Print a message if requested ports are in use

Issue - State: open - Opened by varunsh-xilinx over 1 year ago - 1 comment
Labels: bug

#195 - Fix loading models at startup

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#194 - Allow passing git credentials to Docker build

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#193 - Handle bad requests in each backend

Issue - State: open - Opened by varunsh-xilinx over 1 year ago

#192 - Add ONNXRuntime as a backend

Issue - State: open - Opened by varunsh-xilinx over 1 year ago

#191 - Fix wheel generation

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#190 - Improve KServe compatibility

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 2 comments

#189 - Add FP16 test

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 2 comments

#188 - Use vcpkg for dependencies

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 18 comments

#187 - Replace Jaeger exporter with OTLP

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 4 comments

#186 - Close dynamically opened libraries

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#185 - Replace Jaeger exporter with OTLP exporter

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago

#184 - Update benchmarks

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#183 - Pin python packages

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#182 - Update documentation

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago

#181 - Add ensembles to documentation

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: documentation

#180 - Update downloading test models

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 4 comments

#179 - Update downloading test models

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago

#178 - Support model chaining in modelLoad

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 4 comments

#177 - Support model chaining in modelLoad

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago

#176 - Add model chaining

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 7 comments

#175 - Broken links in docs

Issue - State: closed - Opened by udayh over 1 year ago - 2 comments
Labels: bug

#174 - Add QuickStart for ZenDNN CPU Inference

Pull Request - State: closed - Opened by rradjabi over 1 year ago - 2 comments

#173 - Add model chaining

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#172 - Add C++ worker

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#171 - Update to rt-engine for VAI 3.0 and add new models

Issue - State: open - Opened by varunsh-xilinx over 1 year ago - 1 comment
Labels: enhancement

#170 - Update CMake build

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 4 comments

#169 - Use VAI 3.0 XRT and XRM

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#168 - Enable parallel tests in CI

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#167 - Write a walkthrough for adding a new worker

Issue - State: open - Opened by varunsh-xilinx over 1 year ago
Labels: documentation

#166 - Support using custom classes for memory in the pool

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 3 comments

#165 - Enable parallel tests in CI

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#164 - Resolve requests before the batcher

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#163 - Reorganize 'Interface' class

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#162 - Support using custom classes for memory in the pool

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#161 - Improve compatibility with KServe API

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#160 - On dynamic batching

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#159 - Add performance data to documentation

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: documentation, enhancement

#158 - Increase test coverage

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#157 - Add shared memory support with the C++ API

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#156 - Run MLCommons benchmarks

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#155 - Easily identify what's inside containers

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: documentation

#154 - Add Github actions

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#153 - Python Backend and Ensemble Scheduling

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#152 - Improve benchmarking

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#151 - Add a GUI

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago

#150 - Support building nightly images

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#149 - Use a global memory pool

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment
Labels: enhancement

#148 - Use memory manager for workers

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#147 - Use benchmark library for C++ benchmarks

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment
Labels: enhancement

#146 - Use Google Benchmark for C++ benchmarks

Issue - State: closed - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#145 - Run KServe tests in CI pipeline

Issue - State: open - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#142 - Add a demo inference script

Issue - State: open - Opened by varunsh-xilinx over 1 year ago
Labels: enhancement

#129 - Add MLPerf app

Pull Request - State: closed - Opened by varunsh-xilinx over 1 year ago - 1 comment

#126 - Python Backend and Ensemble Scheduling

Issue - State: open - Opened by dbasbabasi over 1 year ago - 1 comment
Labels: enhancement

#125 - Refactor globals

Pull Request - State: closed - Opened by varunsh-xilinx almost 2 years ago - 2 comments

#124 - Running recommendation models on AMD CPUs

Issue - State: closed - Opened by rishucoding almost 2 years ago - 2 comments
Labels: question

#123 - Add Github actions

Issue - State: open - Opened by varunsh-xilinx almost 2 years ago
Labels: enhancement

#122 - Add standard container functions

Pull Request - State: closed - Opened by varunsh-xilinx almost 2 years ago - 2 comments

#121 - Easily identify what's inside containers

Issue - State: open - Opened by varunsh-xilinx almost 2 years ago
Labels: documentation

#120 - Run MLCommons benchmarks

Issue - State: closed - Opened by varunsh-xilinx almost 2 years ago - 1 comment
Labels: enhancement

#119 - Add shared memory support with the C++ API

Issue - State: open - Opened by varunsh-xilinx almost 2 years ago
Labels: enhancement

#118 - Increase test coverage

Issue - State: open - Opened by varunsh-xilinx almost 2 years ago
Labels: enhancement

#117 - Support processes for workers

Issue - State: open - Opened by varunsh-xilinx almost 2 years ago
Labels: enhancement

#116 - Change memory buffering for requests

Issue - State: closed - Opened by varunsh-xilinx almost 2 years ago
Labels: enhancement

#115 - Add performance data to documentation

Issue - State: open - Opened by varunsh-xilinx almost 2 years ago
Labels: documentation, enhancement

#114 - Improve documentation

Pull Request - State: closed - Opened by varunsh-xilinx almost 2 years ago - 1 comment

#113 - Update for ZenDNN 4.0

Pull Request - State: closed - Opened by varunsh-xilinx almost 2 years ago - 1 comment

#112 - Update to VAI 3.0

Issue - State: closed - Opened by varunsh-xilinx almost 2 years ago
Labels: enhancement

#111 - Use RTLD_DEEPBIND for TF+ZenDNN

Pull Request - State: closed - Opened by varunsh-xilinx almost 2 years ago - 4 comments

#110 - Delete the web GUI

Pull Request - State: closed - Opened by varunsh-xilinx almost 2 years ago - 2 comments

#109 - Fixed CVE-2022-0686: Authorization Bypass Through User-Controlled Key

Pull Request - State: closed - Opened by iot-defcon almost 2 years ago - 2 comments

#108 - Fixed Prototype Pollution in JSON5() via Parse Method

Pull Request - State: closed - Opened by iot-defcon almost 2 years ago - 2 comments

#107 - Support building containers with custom backend versions

Pull Request - State: closed - Opened by varunsh-xilinx almost 2 years ago - 1 comment

GitHub / Xilinx/inference-server issues and pull requests