pytorch/TensorRT issues and pull requests

#3687 - cherry pick 3680

Pull Request - State: open - Opened by lanluo-nvidia 15 days ago

#3686 - upgrade tensorrt from 10.11 to 10.12

Issue - State: open - Opened by lanluo-nvidia 15 days ago

#3685 - disable jetpack build for now

Pull Request - State: closed - Opened by lanluo-nvidia 15 days ago
Labels: component: build system, cla signed

#3684 - fix windows build failure: add /utf-8

Pull Request - State: open - Opened by lanluo-nvidia 15 days ago

#3658 - Lluo/cherry pick 3620

Pull Request - State: closed - Opened by lanluo-nvidia 27 days ago
Labels: component: tests, component: api [Python], cla signed, component: dynamo, component: torch_compile

#3657 - Add Flux fp4 support

Pull Request - State: open - Opened by lanluo-nvidia 27 days ago
Labels: component: lowering, component: api [Python], component: runtime, cla signed, component: dynamo

#3656 - Lluo/cherry pick 3629

Pull Request - State: closed - Opened by lanluo-nvidia 27 days ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3655 - cherry pick 3642

Pull Request - State: closed - Opened by lanluo-nvidia 27 days ago
Labels: cla signed

#3654 - chore: Fix path in FLUX demo

Pull Request - State: open - Opened by peri044 27 days ago
Labels: cla signed

#3653 - 🐛 [Bug] examples/dynamo/torch_compile_gpt2.py run failed

Issue - State: open - Opened by yangxiaorun 27 days ago - 1 comment
Labels: bug

#3652 - [kv_cache] integrated vlm code for benchmark (Stacked on #3527)

Pull Request - State: open - Opened by chohk88 27 days ago
Labels: cla signed

#3651 - 🐛 [Bug] FLUX Accuracy Issue

Issue - State: open - Opened by cehongwang 28 days ago
Labels: bug

#3650 - Upgrade perf_run script to support TRT 10 and fix some issues

Pull Request - State: open - Opened by zewenli98 28 days ago
Labels: component: lowering, component: api [Python], cla signed, component: dynamo

#3649 - 🐛 [Bug] Draw svg for flux model hangs

Issue - State: open - Opened by lanluo-nvidia 29 days ago - 1 comment
Labels: bug

#3648 - 🐛 [Bug] group_norm implementation may slows down SD vae

Issue - State: open - Opened by cehongwang 29 days ago
Labels: bug

#3647 - 🐛 [Bug] index and index_put don't support dynamic shapes

Issue - State: open - Opened by peri044 29 days ago - 2 comments
Labels: bug

#3646 - 🐛 [Bug] Flux does not produce the correct image

Issue - State: open - Opened by lanluo-nvidia 29 days ago
Labels: bug

#3645 - 🐛 [Bug] with torch_tensorrt.dynamo.Debugger on torch_tensorrt.dynamo.compile it failed due to no graphviz installed

Issue - State: open - Opened by lanluo-nvidia 29 days ago - 3 comments
Labels: bug

#3644 - 🐛 [Bug] with torch_tensorrt.dynamo.Debugger is not working with MutableTorchTensorRTModule

Issue - State: open - Opened by lanluo-nvidia 29 days ago
Labels: bug

#3643 - feat: Add bf16 support to cast converter

Pull Request - State: closed - Opened by peri044 29 days ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3642 - Fix dynamo core test failure on Windows

Pull Request - State: closed - Opened by HolyWu 29 days ago - 2 comments
Labels: cla signed

#3641 - Removal of BAZEL build files from python package and changes to make cpp tests work [WIP]

Pull Request - State: open - Opened by apbose 29 days ago
Labels: component: build system, cla signed

#3640 - cherry pick 3636

Pull Request - State: closed - Opened by lanluo-nvidia 30 days ago
Labels: component: api [Python], component: runtime, cla signed, component: dynamo

#3639 - upgrade torch_tensorrt version from 2.8.0.dev to 2.9.0.dev

Pull Request - State: closed - Opened by lanluo-nvidia 30 days ago
Labels: component: build system, component: api [Python], component: api [C++], cla signed

#3638 - release 2.8 branch cut

Pull Request - State: closed - Opened by lanluo-nvidia 30 days ago
Labels: component: tests, component: build system, component: api [Python], cla signed

#3637 - ❓ [Question] Why is `torch.bfloat16` excluded from the `allowed_casts` set ?

Issue - State: closed - Opened by junstar92 about 1 month ago
Labels: question

#3636 - Temporary fix to workaround the mutable decomposition error.

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago - 1 comment
Labels: component: api [Python], component: runtime, cla signed, component: dynamo

#3635 - fix the broken CC0 image link

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: cla signed

#3634 - 🐛 [Bug] Changing input size would affect the TRT engine size, testing on BERT

Issue - State: open - Opened by zewenli98 about 1 month ago - 1 comment
Labels: bug

#3633 - 🐛 [Bug] Dynamo core test failed in linux

Issue - State: closed - Opened by lanluo-nvidia about 1 month ago - 1 comment
Labels: bug

#3632 - disable aoti format in windows

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: component: tests, component: api [Python], cla signed

#3631 - 🐛 [Bug] Windows dynamo core tests failed

Issue - State: closed - Opened by lanluo-nvidia about 1 month ago - 3 comments
Labels: bug

#3630 - 🐛 [Bug] Windows dynamo export serde test failed

Issue - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: bug

#3629 - Closed the perf gap of resnet and enabled refit

Pull Request - State: closed - Opened by cehongwang about 1 month ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo

#3628 - 🐛 [Bug] current BN implementation results in slower performance

Issue - State: closed - Opened by peri044 about 1 month ago - 2 comments
Labels: bug

#3627 - 📖 [Story] Performance improvements/gaps in Torch-TensorRT

Issue - State: open - Opened by peri044 about 1 month ago
Labels: Story

#3626 - 🐛 [Bug] Large Accuracy Issue

Issue - State: open - Opened by patrick-botco about 1 month ago - 3 comments
Labels: bug

#3625 - ✨[Feature] Integrate release pipeline with test pipeline

Issue - State: open - Opened by lanluo-nvidia about 1 month ago
Labels: feature request

#3624 - ✨[Feature] Automate examples verification in the release pipeline

Issue - State: open - Opened by lanluo-nvidia about 1 month ago
Labels: feature request

#3623 - disable test on aarch64 for now

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: cla signed

#3622 - compile the QAT trained model in with TensorRT

Issue - State: open - Opened by pribadihcr about 1 month ago - 1 comment
Labels: bug

#3621 - fix broken CCO image link

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: cla signed

#3620 - Refit debug patch

Pull Request - State: closed - Opened by cehongwang about 1 month ago
Labels: component: tests, component: api [Python], cla signed, component: dynamo, component: torch_compile

#3619 - fix ts fe test error.

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: component: tests, component: build system, cla signed

#3618 - remove debug flag

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: component: tests, cla signed

#3617 - fix: Fix unbacked sym int not found issue

Pull Request - State: closed - Opened by peri044 about 1 month ago - 1 comment
Labels: component: tests, component: api [Python], component: runtime, cla signed, component: dynamo

#3616 - add weekly cron job to upgrade uv lock

Pull Request - State: open - Opened by lanluo-nvidia about 1 month ago
Labels: cla signed

#3615 - Remove Bazel files from wheel

Pull Request - State: open - Opened by mering about 1 month ago - 4 comments
Labels: component: build system, cla signed

#3614 - error in data types

Issue - State: open - Opened by muhammadtarek98 about 1 month ago - 2 comments

#3613 - Debug Windows error(WIP)

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago - 1 comment
Labels: WIP, component: api [Python], cla signed, ciflow/binaries/all

#3612 - a few CI changes

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago - 1 comment
Labels: component: tests, WIP, component: api [Python], cla signed, ciflow/binaries/all

#3611 - py39 does not like | E TypeError: unsupported operand type(s) for |: 'type' and 'EnumMeta'

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: component: api [Python], component: runtime, cla signed, component: dynamo

#3610 - debug flag is deprecated, remove it so that test won't complain

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: component: tests, cla signed

#3609 - fix cross compilation test bug

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: component: tests, component: api [Python], cla signed

#3608 - regex for dllist [WIP]

Pull Request - State: closed - Opened by apbose about 1 month ago - 1 comment
Labels: component: api [Python], cla signed

#3607 - fix: add prefix in hierarchical_partitioner_example

Pull Request - State: closed - Opened by zewenli98 about 1 month ago
Labels: cla signed

#3606 - fix enabled_precisions error in test cases

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: component: tests, component: api [Python], component: runtime, cla signed, component: dynamo

#3605 - skip flashinfer-python for py3.9 due to upstream error

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: cla signed

#3604 - Fix aarch64 build issue(WIP)

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: component: build system, WIP, cla signed

#3603 - fix: pre-commit issues

Pull Request - State: closed - Opened by zewenli98 about 1 month ago
Labels: component: api [Python], cla signed, component: dynamo

#3602 - Cpu memory optimization

Pull Request - State: open - Opened by cehongwang about 1 month ago
Labels: component: lowering, component: conversion, component: api [Python], cla signed, component: dynamo

#3601 - 🐛 [Bug] Flux perf scripts issue

Issue - State: open - Opened by peri044 about 1 month ago
Labels: bug

#3600 - 🐛 [Bug] mypy precommit issues

Issue - State: closed - Opened by peri044 about 1 month ago
Labels: bug

#3599 - test failed but displayed as green

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago - 2 comments
Labels: component: tests, cla signed

#3598 - remove torchvision dependency from build, optional for test

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: component: tests, cla signed

#3597 - feat: working uv pyproject.toml

Pull Request - State: closed - Opened by narendasan about 1 month ago
Labels: component: build system, cla signed

#3596 - 🐛 [Bug] torchtrt.dynamo.compile produces nan values

Issue - State: open - Opened by cehongwang about 1 month ago - 1 comment
Labels: bug

#3595 - Fix: fix aot plugin example docstring issue

Pull Request - State: closed - Opened by bowang007 about 1 month ago
Labels: cla signed

#3594 - fix dynamo converter test case failure

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: component: tests, component: api [Python], cla signed, component: dynamo

#3593 - 🐛 [Bug] Workflow issue: the tests are failed but showing as green in the workflow UI

Issue - State: closed - Opened by lanluo-nvidia about 1 month ago - 1 comment
Labels: bug

#3592 - Import dllist only on linux

Pull Request - State: closed - Opened by HolyWu about 1 month ago
Labels: component: api [Python], cla signed

#3591 - 🐛 [Bug] ModuleNotFoundError: No module named 'dllist'

Issue - State: closed - Opened by HolyWu about 1 month ago
Labels: bug

#3590 - fix main test failure bug

Pull Request - State: closed - Opened by lanluo-nvidia about 1 month ago
Labels: component: conversion, component: converters, component: build system, component: api [Python], cla signed, component: dynamo

#3589 - Verify C++ tests, fix cuda graphs union issue

Pull Request - State: closed - Opened by narendasan about 2 months ago
Labels: component: tests, component: api [Python], cla signed