pytorch/TensorRT issues and pull requests

#2888 - feat: Add dynamic shape support for sub

Pull Request - State: closed - Opened by keehyuna 4 months ago
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo

#2887 - add dynamic shape support for sin/cos/cat

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo

#2886 - Implemented basic pipeline for Refitting

Pull Request - State: closed - Opened by cehongwang 4 months ago - 5 comments
Labels: documentation, component: tests, component: conversion, component: core, component: api [Python], component: runtime, cla signed, component: dynamo

#2885 - Bump transformers version from 4.39 to 4.40

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago - 1 comment
Labels: component: tests, cla signed, ciflow/binaries/all

#2884 - fix: Missing nvinfer.dll in CI for Windows [`release/2.3`]

Pull Request - State: closed - Opened by gs-olive 4 months ago - 1 comment
Labels: component: tests, cla signed, ciflow/binaries/all

#2883 - add dynamic shape support for aten.ops.gt and aten.ops.ge

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo

#2882 - cherry pick pull/2879 to release/2.3 branch

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#2881 - feat: Cudagraphs integration for Torch-TRT + Non-default Stream Utilization

Pull Request - State: closed - Opened by gs-olive 4 months ago
Labels: documentation, component: tests, component: core, component: build system, component: api [Python], component: runtime, cla signed, component: dynamo

#2880 - feat: support aten index_put converter for accumulate=False

Pull Request - State: closed - Opened by chohk88 4 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#2879 - replace itemset due to numpy version 2.0 removed itemset api

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#2878 - feat: dynamic shapes support for neg ops

Pull Request - State: closed - Opened by keehyuna 4 months ago - 1 comment
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo

#2877 - 🐛 [Bug] select_scatter decomposition caused compilation failure

Issue - State: open - Opened by HolyWu 4 months ago
Labels: bug

#2876 - fix: Repair integer inputs in dynamic shape cases

Pull Request - State: closed - Opened by gs-olive 4 months ago - 1 comment
Labels: component: tests, component: api [Python], component: runtime, cla signed, component: dynamo, needs-release-cherrypick

#2875 - chore: Update torch to 2.3.1

Pull Request - State: closed - Opened by peri044 4 months ago - 3 comments
Labels: component: tests, component: build system, component: api [Python], cla signed, ciflow/binaries/all

#2874 - feat: support aten.resize_ converter

Pull Request - State: closed - Opened by chohk88 4 months ago - 3 comments
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#2873 - `aten.diagonal`

Issue - State: closed - Opened by chohk88 4 months ago
Labels: component: converters

#2872 - `aten.resize_`

Issue - State: closed - Opened by chohk88 4 months ago
Labels: component: converters

#2871 - Dynamic support for split

Pull Request - State: closed - Opened by cehongwang 4 months ago - 1 comment
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo

#2870 - chore: cherry pick cudnn dependency removal commit

Pull Request - State: closed - Opened by peri044 4 months ago
Labels: documentation, component: core, component: build system, component: api [Python], cla signed

#2869 - Dynamic support for split

Pull Request - State: closed - Opened by cehongwang 4 months ago
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo

#2868 - manylinux wheel file build update for TensorRT-10.0.1

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago
Labels: component: api [Python], cla signed

#2867 - cherrypick: #2804 to branch `fp8_trt10`

Pull Request - State: closed - Opened by zewenli98 4 months ago - 1 comment
Labels: documentation, component: conversion, component: core, component: converters, component: build system, component: api [Python], component: runtime, cla signed, component: dynamo

#2866 - chore: Minor fix 2.3

Pull Request - State: closed - Opened by peri044 4 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, fx, component: dynamo

#2865 - 🐛 [Bug] `aten.scatter.value` converter error

Issue - State: closed - Opened by HolyWu 4 months ago - 3 comments
Labels: bug

#2864 - readme

Pull Request - State: closed - Opened by laikhtewari 4 months ago
Labels: cla signed

#2863 - updated README.md

Pull Request - State: closed - Opened by laikhtewari 4 months ago
Labels: cla signed

#2862 - chore: upgrade to torch 2.3.1

Pull Request - State: closed - Opened by peri044 4 months ago - 1 comment
Labels: component: tests, component: build system, component: api [Python], cla signed

#2861 - chore: cherry-pick of https://github.com/pytorch/TensorRT/pull/2858

Pull Request - State: closed - Opened by peri044 4 months ago
Labels: component: tests, component: api [Python], cla signed

#2860 - ptq test error correction

Pull Request - State: closed - Opened by apbose 4 months ago
Labels: component: tests, cla signed

#2859 - empty_stride decomposition

Pull Request - State: closed - Opened by apbose 4 months ago
Labels: component: tests, component: lowering, component: api [Python], cla signed, component: dynamo

#2858 - chore: Make from and to methods use the same TRT API

Pull Request - State: closed - Opened by narendasan 4 months ago
Labels: component: tests, component: api [Python], cla signed

#2857 - chore: cherry-pick of DS feature

Pull Request - State: closed - Opened by peri044 4 months ago - 1 comment
Labels: component: tests, component: lowering, component: conversion, component: core, component: converters, component: api [Python], component: runtime, cla signed, component: dynamo, component: torch_compile

#2856 - feat: support aten.diagonal converter

Pull Request - State: closed - Opened by chohk88 4 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#2855 - [WIP] upgrade to public TRT 10.1.0.27

Pull Request - State: closed - Opened by zewenli98 4 months ago - 1 comment
Labels: component: tests, component: core, component: build system, WIP, component: api [Python], cla signed

#2854 - fix user_guide and tutorial docs

Pull Request - State: closed - Opened by yoosful 5 months ago
Labels: documentation, cla signed

#2853 - fix: Handle dynamic shapes in where ops

Pull Request - State: closed - Opened by keehyuna 5 months ago - 2 comments
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#2852 - chore: cherry pick of #2832

Pull Request - State: closed - Opened by zewenli98 5 months ago
Labels: component: conversion, component: api [Python], component: runtime, cla signed, component: dynamo

#2851 - chore: cherry pick of #2805

Pull Request - State: closed - Opened by bowang007 5 months ago
Labels: documentation, cla signed

#2850 - chore: cherry pick of #2709

Pull Request - State: closed - Opened by peri044 5 months ago
Labels: component: core, component: runtime, cla signed

#2849 - feat: Cherry pick of Add validators for dynamic shapes in converter registration

Pull Request - State: closed - Opened by peri044 5 months ago
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo

#2848 - 🐛 [Bug] Unable to freeze tensor of type Int64/Float64 into constant layer

Issue - State: open - Opened by supermeng 5 months ago - 4 comments
Labels: bug

#2847 - scatter_reduce decomposition

Pull Request - State: closed - Opened by apbose 5 months ago
Labels: component: lowering, component: api [Python], cla signed, component: dynamo

#2846 - ↔ [Converter] Add support for aten.diagonal

Issue - State: closed - Opened by apbose 5 months ago
Labels: feature request, component: converters

#2845 - feat(//py/torch_tensorrt/dynamo): Support for BF16 (#2833)

Pull Request - State: closed - Opened by narendasan 5 months ago - 1 comment
Labels: component: tests, component: conversion, component: core, component: api [Python], cla signed, component: dynamo

#2844 - Bf16 cherry pick

Pull Request - State: closed - Opened by narendasan 5 months ago
Labels: documentation, component: tests, component: lowering, component: conversion, component: core, component: converters, component: build system, component: api [Python], component: api [C++], component: evaluators, component: runtime, cla signed, component: fx, component: dynamo, component: torch_compile

#2843 - 🐛 [Bug] torch.export fails to export embedding_bag_aten layer in a standalone test

Issue - State: open - Opened by peri044 5 months ago - 2 comments
Labels: bug

#2842 - 🐛 [Bug] A Segmentation fault occurs when torchtrt::ts::compile using Torch-TensorRT

Issue - State: open - Opened by demuxin 5 months ago - 3 comments
Labels: bug

#2841 - add aten.topk implementation

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#2840 - Lluo/aten topk

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago - 1 comment
Labels: documentation, component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#2839 - Remove `ShapeProp` Pass

Issue - State: closed - Opened by gs-olive 5 months ago
Labels: bug, hf

#2838 - Add support for `torch.ops.aten.full_like.default`

Issue - State: open - Opened by gs-olive 5 months ago - 1 comment
Labels: hf

#2837 - Add support for `torch.ops.aten.baddbmm.default`

Issue - State: open - Opened by gs-olive 5 months ago
Labels: hf

#2836 - 🐛 [Bug] Llama-2-7b on a 4090 GPU

Issue - State: open - Opened by gs-olive 5 months ago
Labels: bug, hf

#2835 - cherry-pick: Add release flag for nightly build tag (#2821)

Pull Request - State: closed - Opened by gs-olive 5 months ago - 1 comment
Labels: component: tests, cla signed, ciflow/binaries/all

#2834 - [doc] Update options documentation for torch.compile

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago - 2 comments
Labels: documentation, cla signed

#2833 - feat(//py/torch_tensorrt/dynamo): Support for BF16

Pull Request - State: closed - Opened by narendasan 5 months ago
Labels: component: tests, component: conversion, component: core, component: api [Python], cla signed, component: dynamo

#2832 - fix: bugs in TRT 10 upgrade

Pull Request - State: closed - Opened by zewenli98 5 months ago - 1 comment
Labels: component: conversion, component: api [Python], component: runtime, cla signed, component: dynamo

#2831 - tool: Opset coverage notebook

Pull Request - State: closed - Opened by narendasan 5 months ago
Labels: component: api [Python], cla signed, component: dynamo

#2830 - ❓ [Question] How to specific aten operators must be run by LibTorch in C++?

Issue - State: open - Opened by demuxin 5 months ago - 7 comments
Labels: question

#2829 - feat: support aten.atan2.out converter

Pull Request - State: closed - Opened by chohk88 5 months ago
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo

#2828 - aten.atan2.out

Issue - State: closed - Opened by chohk88 5 months ago
Labels: component: converters

#2827 - 🐛 [Bug] error: backend='torch_tensorrt' raised: TypeError: pybind11::init(): factory function returned nullptr

Issue - State: open - Opened by geraldstanje 5 months ago - 5 comments
Labels: bug

#2826 - Use environment for docgen

Pull Request - State: closed - Opened by atalman 5 months ago
Labels: cla signed

#2825 - 🐛 [Bug] failed to install torch-tensorrt

Issue - State: open - Opened by geraldstanje 5 months ago - 2 comments
Labels: bug

#2824 - feat: Add support for multi-device safe mode in C++

Pull Request - State: closed - Opened by gs-olive 5 months ago
Labels: component: tests, component: core, component: runtime, cla signed

#2823 - feat: support aten.log1p converter

Pull Request - State: closed - Opened by chohk88 5 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#2822 - ❓ [Question] Model inference is much slower after updating to TensorRT 9.3

Issue - State: open - Opened by demuxin 5 months ago - 1 comment
Labels: question

#2821 - ci: Add release flag for nightly build tag

Pull Request - State: closed - Opened by gs-olive 5 months ago - 2 comments
Labels: cla signed, needs-release-cherrypick

#2820 - 🐛 [Bug] Nightly import fails

Issue - State: closed - Opened by laikhtewari 5 months ago - 2 comments
Labels: bug

#2819 - fix: bug in elementwise base for static inputs

Pull Request - State: closed - Opened by zewenli98 5 months ago - 5 comments
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#2818 - typo fix in doc on saving models

Pull Request - State: closed - Opened by laikhtewari 5 months ago
Labels: documentation, cla signed

#2817 - ✨[Feature] Autogen TRT Plugins

Issue - State: open - Opened by narendasan 5 months ago
Labels: feature request

#2816 - Cherry-pick of #2580 for release/2.3 - rand evaluator

Pull Request - State: closed - Opened by apbose 5 months ago
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo

#2815 - 🐛 [Bug] RuntimeError: [Error thrown at core/util/trt_util.cpp:320] Expected type to be true but got false

Issue - State: closed - Opened by zewenli98 5 months ago - 2 comments
Labels: bug

#2814 - Fix ModuleNotFoundError in ptq

Pull Request - State: closed - Opened by HolyWu 5 months ago
Labels: component: api [Python], cla signed

#2813 - ❓ [Question] How to solve this warning: Detected this engine is being instantitated in a multi-GPU system with multi-device safe mode disabled.

Issue - State: closed - Opened by demuxin 5 months ago - 6 comments
Labels: question

GitHub / pytorch/TensorRT issues and pull requests