pytorch/TensorRT issues and pull requests

#3929 - reenable back thor test

Pull Request - State: closed - Opened by lanluo-nvidia 15 days ago
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo, Force All Tests[L0+L1+L2]

#3853 - Lluo/cherry pick moe

Pull Request - State: closed - Opened by lanluo-nvidia about 2 months ago
Labels: component: tests, component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3851 - move is_thor() is_tegra_platform() from dynamo.utils to utils to avoid circular import

Pull Request - State: closed - Opened by lanluo-nvidia about 2 months ago
Labels: component: tests, component: lowering, component: api [Python], cla signed, component: dynamo, component: torch_compile

#3849 - add capture and replay feature in tensorrt

Pull Request - State: open - Opened by lanluo-nvidia 2 months ago
Labels: component: api [Python], cla signed, component: dynamo

#3845 - Cpu memory optimization

Pull Request - State: open - Opened by cehongwang 2 months ago
Labels: component: tests, component: lowering, component: conversion, component: api [Python], cla signed, component: dynamo

#3831 - Llama distributed example

Pull Request - State: open - Opened by apbose 3 months ago
Labels: component: tests, component: lowering, component: conversion, component: build system, component: api [Python], component: runtime, cla signed, component: dynamo, component: torch_compile

#3830 - Changes to TRT-LLM download tool for multigpu distributed case

Pull Request - State: open - Opened by apbose 3 months ago
Labels: component: tests, component: conversion, component: build system, component: api [Python], cla signed, component: dynamo

#3829 - TRT-LLM installation tool

Pull Request - State: closed - Opened by apbose 3 months ago - 1 comment
Labels: component: tests, component: conversion, component: build system, component: api [Python], cla signed, component: dynamo

#3822 - Same changes as #3812 chore: Add more models for benchmark and polish codes

Pull Request - State: closed - Opened by zewenli98 3 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3813 - cherry pick is_thor from ngc/release/25.09 branch to main

Pull Request - State: closed - Opened by lanluo-nvidia 3 months ago
Labels: component: api [Python], cla signed, component: dynamo

#3812 - chore: Add more models for benchmark and polish codes

Pull Request - State: closed - Opened by zewenli98 3 months ago - 1 comment
Labels: component: api [Python], cla signed, component: dynamo

#3811 - Moe support

Pull Request - State: open - Opened by cehongwang 3 months ago - 2 comments
Labels: component: tests, component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3793 - register sdpa operator with model config

Pull Request - State: closed - Opened by lanluo-nvidia 3 months ago
Labels: component: tests, component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3785 - Distributed llama3 example

Pull Request - State: closed - Opened by apbose 4 months ago - 1 comment
Labels: component: lowering, component: api [Python], component: runtime, cla signed, component: dynamo, component: torch_compile

#3784 - Changes to TRT-LLM download tool for multigpu distributed case

Pull Request - State: closed - Opened by apbose 4 months ago - 1 comment
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo

#3784 - Changes to TRT-LLM download tool for multigpu distributed case

Pull Request - State: closed - Opened by apbose 4 months ago - 1 comment
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo

#3773 - fix the typo

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago
Labels: component: conversion, component: api [Python], cla signed, component: dynamo

#3764 - Fix Jetson FP4 gate issue

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3760 - fix typing extensions dependencies issue

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago
Labels: documentation, component: tests, component: lowering, component: conversion, component: converters, component: build system, component: api [Python], component: runtime, cla signed, component: dynamo, component: torch_compile

#3758 - fix: batch norm issue encountered in RAFT

Pull Request - State: closed - Opened by zewenli98 4 months ago - 1 comment
Labels: component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3753 - Add support for TensorRT-RTX

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago - 1 comment
Labels: documentation, component: tests, component: lowering, component: conversion, component: core, component: converters, component: build system, component: api [Python], component: api [C++], component: evaluators, component: runtime, component: partitioning, cla signed, fx, component: dynamo, ciflow/binaries/all

#3749 - add strong typing fix

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3746 - fix: Inferred dimensions at build time in reshape

Pull Request - State: closed - Opened by keehyuna 4 months ago - 1 comment
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3746 - fix: Inferred dimensions at build time in reshape

Pull Request - State: closed - Opened by keehyuna 4 months ago - 1 comment
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3742 - add sliding window support for Gemma3

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago - 1 comment
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3739 - add test cases for strong typing

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago
Labels: component: tests, component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3737 - fix conv1d/deconv1d bug with stride more than 1

Pull Request - State: closed - Opened by lanluo-nvidia 4 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3734 - Cherrypick #3719 for release/2.8

Pull Request - State: closed - Opened by zewenli98 4 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3727 - Dynamic memory allocation

Pull Request - State: open - Opened by cehongwang 4 months ago
Labels: component: tests, component: core, component: api [Python], component: runtime, cla signed, component: dynamo

#3726 - Dynamic memory allocation

Pull Request - State: closed - Opened by cehongwang 4 months ago
Labels: component: lowering, component: conversion, component: core, component: converters, component: api [Python], component: runtime, cla signed, component: dynamo

#3713 - fix: Remove type casting in matmul and add scalar tensor conversion

Pull Request - State: closed - Opened by keehyuna 5 months ago - 1 comment
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3703 - feat: revert linear converter

Pull Request - State: closed - Opened by zewenli98 5 months ago
Labels: component: tests, component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo, ci-no-td

#3698 - integrated vlm code for benchmark for Eagle2

Pull Request - State: closed - Opened by chohk88 5 months ago - 7 comments
Labels: documentation, component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3688 - cherry pick 3685: disable jetson build in ci

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago
Labels: component: tests, component: lowering, component: conversion, component: converters, component: build system, component: api [Python], component: runtime, cla signed, component: dynamo, component: torch_compile

#3687 - cherry pick 3680: fix refit test bug

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago
Labels: component: tests, component: api [Python], cla signed, component: dynamo

#3667 - chore: cherry pick of KV cache PR (3527)

Pull Request - State: closed - Opened by peri044 5 months ago
Labels: documentation, component: conversion, component: api [Python], component: runtime, cla signed, component: dynamo

#3666 - chore: cherry pick of bf16 cast PR (3643)

Pull Request - State: closed - Opened by peri044 5 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3663 - fix the int8 quantization failure error

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3662 - Cherrypick of PR 3570

Pull Request - State: closed - Opened by apbose 5 months ago
Labels: component: tests, component: lowering, component: conversion, component: api [Python], cla signed, component: dynamo

#3658 - Lluo/cherry pick 3620

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago
Labels: component: tests, component: api [Python], cla signed, component: dynamo, component: torch_compile

#3658 - Lluo/cherry pick 3620

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago
Labels: component: tests, component: api [Python], cla signed, component: dynamo, component: torch_compile

#3657 - Add Flux fp4 support

Pull Request - State: open - Opened by lanluo-nvidia 5 months ago
Labels: component: lowering, component: api [Python], component: runtime, cla signed, component: dynamo

#3656 - Lluo/cherry pick 3629

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3656 - Lluo/cherry pick 3629

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3650 - Upgrade perf_run script to support TRT 10 and fix some issues

Pull Request - State: open - Opened by zewenli98 5 months ago
Labels: component: lowering, component: api [Python], cla signed, component: dynamo

#3650 - Upgrade perf_run script to support TRT 10 and fix some issues

Pull Request - State: closed - Opened by zewenli98 5 months ago
Labels: component: api [Python], component: runtime, cla signed, component: dynamo

#3643 - feat: Add bf16 support to cast converter

Pull Request - State: closed - Opened by peri044 5 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3643 - feat: Add bf16 support to cast converter

Pull Request - State: closed - Opened by peri044 5 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3640 - cherry pick 3636

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago
Labels: component: api [Python], component: runtime, cla signed, component: dynamo

#3636 - Temporary fix to workaround the mutable decomposition error.

Pull Request - State: closed - Opened by lanluo-nvidia 5 months ago - 1 comment
Labels: component: api [Python], component: runtime, cla signed, component: dynamo

#3629 - Closed the perf gap of resnet and enabled refit

Pull Request - State: closed - Opened by cehongwang 5 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3620 - Refit debug patch

Pull Request - State: closed - Opened by cehongwang 6 months ago
Labels: component: tests, component: api [Python], cla signed, component: dynamo, component: torch_compile

#3617 - fix: Fix unbacked sym int not found issue

Pull Request - State: closed - Opened by peri044 6 months ago - 1 comment
Labels: component: tests, component: api [Python], component: runtime, cla signed, component: dynamo

#3617 - fix: Fix unbacked sym int not found issue

Pull Request - State: closed - Opened by peri044 6 months ago - 1 comment
Labels: component: tests, component: api [Python], component: runtime, cla signed, component: dynamo

#3611 - py39 does not like | E TypeError: unsupported operand type(s) for |: 'type' and 'EnumMeta'

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: component: api [Python], component: runtime, cla signed, component: dynamo

#3606 - fix enabled_precisions error in test cases

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: component: tests, component: api [Python], component: runtime, cla signed, component: dynamo

#3606 - fix enabled_precisions error in test cases

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: component: tests, component: api [Python], component: runtime, cla signed, component: dynamo

#3603 - fix: pre-commit issues

Pull Request - State: closed - Opened by zewenli98 6 months ago
Labels: component: api [Python], cla signed, component: dynamo

#3602 - Cpu memory optimization

Pull Request - State: open - Opened by cehongwang 6 months ago
Labels: component: lowering, component: conversion, component: api [Python], component: runtime, cla signed, component: dynamo

#3594 - fix dynamo converter test case failure

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: component: tests, component: api [Python], cla signed, component: dynamo

#3594 - fix dynamo converter test case failure

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: component: tests, component: api [Python], cla signed, component: dynamo

#3590 - fix main test failure bug

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: component: conversion, component: converters, component: build system, component: api [Python], cla signed, component: dynamo

#3590 - fix main test failure bug

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: component: conversion, component: converters, component: build system, component: api [Python], cla signed, component: dynamo

#3574 - Fix: Revert conv/deconv to use get_trt_weights for refit to record weights

Pull Request - State: closed - Opened by peri044 6 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo, ci-no-td

#3573 - Changed weight map to tensor and fix the refit bug

Pull Request - State: closed - Opened by cehongwang 6 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3572 - TorchTensorRTModule Serialization Fix

Pull Request - State: closed - Opened by cehongwang 6 months ago
Labels: component: tests, component: api [Python], cla signed, component: dynamo

#3570 - adding rotary embedding example, with graph rewrite for complex subgraph

Pull Request - State: closed - Opened by apbose 6 months ago - 1 comment
Labels: component: tests, component: lowering, component: conversion, component: api [Python], cla signed, component: dynamo

#3569 - add --no-deps for tests/py/requirements.txt

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: component: tests, component: lowering, component: api [Python], cla signed, component: dynamo

#3568 - fix: Fix a perf regression due to weights being ITensors

Pull Request - State: closed - Opened by peri044 6 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3568 - fix: Fix a perf regression due to weights being ITensors

Pull Request - State: closed - Opened by peri044 6 months ago
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3565 - fix: Fix constant folding failure due to modelopt

Pull Request - State: closed - Opened by peri044 6 months ago
Labels: component: lowering, component: api [Python], cla signed, component: dynamo

#3563 - fix: replace add_identity by add_cast for type cast

Pull Request - State: closed - Opened by junstar92 6 months ago - 5 comments
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: fx, fx, component: dynamo

#3563 - fix: replace add_identity by add_cast for type cast

Pull Request - State: closed - Opened by junstar92 6 months ago - 5 comments
Labels: component: conversion, component: converters, component: api [Python], cla signed, component: fx, fx, component: dynamo

#3562 - Add check if modelopt is imported or not to fix issue 3560

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: component: lowering, component: api [Python], cla signed, component: dynamo

#3555 - Amend Dynamo debugger

Pull Request - State: closed - Opened by cehongwang 6 months ago
Labels: component: conversion, component: api [Python], component: runtime, cla signed, component: dynamo

#3551 - Changed the debug setting

Pull Request - State: closed - Opened by cehongwang 6 months ago - 1 comment
Labels: component: conversion, component: api [Python], component: runtime, cla signed, component: dynamo

#3549 - Mechanisms to register components of the code base that have debugging functionality

Pull Request - State: closed - Opened by narendasan 6 months ago
Labels: component: lowering, component: conversion, component: build system, component: api [Python], cla signed, component: dynamo

#3549 - Mechanisms to register components of the code base that have debugging functionality

Pull Request - State: closed - Opened by narendasan 6 months ago
Labels: component: lowering, component: conversion, component: build system, component: api [Python], cla signed, component: dynamo

#3547 - cherry pick 3505(windows driver upgrade) to release2.6.1

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: documentation, component: lowering, component: conversion, component: core, component: converters, component: build system, component: api [Python], component: api [C++], cla signed, component: fx, fx, component: dynamo, component: torch_compile

#3547 - cherry pick 3505(windows driver upgrade) to release2.6.1

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: documentation, component: lowering, component: conversion, component: core, component: converters, component: build system, component: api [Python], component: api [C++], cla signed, component: fx, fx, component: dynamo, component: torch_compile

#3543 - fix int8/fp8 constant folding issue

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: component: tests, component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3543 - fix int8/fp8 constant folding issue

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: component: tests, component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3542 - fix the build issue for patch2.6.1

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: documentation, component: lowering, component: conversion, component: core, component: converters, component: build system, component: api [Python], component: api [C++], cla signed, component: fx, fx, component: dynamo, component: torch_compile

#3542 - fix the build issue for patch2.6.1

Pull Request - State: closed - Opened by lanluo-nvidia 6 months ago
Labels: documentation, component: lowering, component: conversion, component: core, component: converters, component: build system, component: api [Python], component: api [C++], cla signed, component: fx, fx, component: dynamo, component: torch_compile

GitHub / pytorch/TensorRT issues and pull requests