Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / pytorch/TensorRT issues and pull requests
#3098 - ❓ [Question] When using torch_tensorrt.compile to optimize Mask2Former's multi_scale_deformable_attn layer, an error occurs.
Issue -
State: open - Opened by edition3234 about 1 month ago
- 1 comment
Labels: question
#3097 - Refit bug fix
Pull Request -
State: closed - Opened by cehongwang about 2 months ago
- 1 comment
Labels: component: tests, component: conversion, component: api [Python], component: runtime, cla signed, component: dynamo
#3096 - Fix tests-py-dynamo-cudagraphs in Windows test
Pull Request -
State: closed - Opened by HolyWu about 2 months ago
Labels: cla signed
#3095 - ❓ [Question] Why does the speed (fps) of torch-tensorrt perform so badly in `torch.multiprocessing`?
Issue -
State: open - Opened by zhongqiu1245 about 2 months ago
Labels: question
#3094 - Fix TypeError in MutableTorchTensorRTModule on Python 3.9
Pull Request -
State: closed - Opened by HolyWu about 2 months ago
Labels: component: api [Python], component: runtime, cla signed, component: dynamo
#3093 - Fixing slice scatter and select scatter decomposition
Pull Request -
State: closed - Opened by apbose about 2 months ago
- 1 comment
Labels: component: lowering, component: api [Python], cla signed, component: dynamo
#3092 - ❓ [Question] Is there any way to deploy on a single machine with multi-gpus?
Issue -
State: open - Opened by SZ-ing about 2 months ago
- 1 comment
Labels: question
#3091 - chore: fix group_norm test
Pull Request -
State: closed - Opened by keehyuna about 2 months ago
- 2 comments
Labels: component: tests, cla signed
#3090 - add runtime_platform_compatibility flag
Pull Request -
State: open - Opened by lanluo-nvidia about 2 months ago
- 2 comments
Labels: component: tests, component: conversion, WIP, component: api [Python], component: runtime, cla signed, component: dynamo
#3089 - refactor: Use HF to download the LoRA
Pull Request -
State: closed - Opened by narendasan about 2 months ago
Labels: cla signed
#3088 - fix: Adjust reflection pad test cases to prevent runtime errors
Pull Request -
State: closed - Opened by chohk88 about 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3087 - feat: Adding live progress monitoring to the engine building phase
Pull Request -
State: closed - Opened by narendasan about 2 months ago
Labels: component: conversion, component: build system, component: api [Python], cla signed, component: dynamo
#3086 - fix the libtorch version mismatch issue
Pull Request -
State: closed - Opened by lanluo-nvidia about 2 months ago
- 3 comments
Labels: component: conversion, component: api [Python], cla signed, component: dynamo, ciflow/binaries/all, build-release-artifacts
#3085 - tile dynamic dim
Pull Request -
State: closed - Opened by apbose about 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3084 - 🐛 [Bug] AttributeError: module \'torch_tensorrt\' has no attribute \'set_device\'
Issue -
State: open - Opened by KumoLiu about 2 months ago
- 1 comment
Labels: bug
#3083 - fix converter test error
Pull Request -
State: closed - Opened by lanluo-nvidia about 2 months ago
Labels: component: tests, cla signed
#3082 - 🐛 [Bug] TS test_runtime_thread_safety failed
Issue -
State: closed - Opened by zewenli98 about 2 months ago
- 2 comments
Labels: bug
#3081 - 🐛 [Bug] TS test_compiled_modules failed
Issue -
State: closed - Opened by zewenli98 about 2 months ago
- 3 comments
Labels: bug
#3080 - 🐛 [Bug] TS test_scaled_dot_product_attention failed
Issue -
State: closed - Opened by zewenli98 about 2 months ago
Labels: bug
#3079 - test Only: test windows build on release 2.4
Pull Request -
State: closed - Opened by lanluo-nvidia about 2 months ago
Labels: component: build system, WIP, cla signed
#3078 - Run all model tests
Pull Request -
State: closed - Opened by narendasan about 2 months ago
Labels: cla signed
#3077 - feat: lowering replace aten.full_like with aten.full
Pull Request -
State: closed - Opened by chohk88 about 2 months ago
- 3 comments
Labels: component: tests, component: lowering, component: conversion, component: core, component: converters, component: api [Python], component: runtime, cla signed, component: dynamo
#3076 - remove torchvision as dependency in py/requirements.txt
Pull Request -
State: closed - Opened by lanluo-nvidia about 2 months ago
Labels: component: tests, component: conversion, component: build system, component: api [Python], cla signed, component: dynamo
#3075 - ❓ [Question] failed to run the `examples/dynamo/vgg16_fp8_ptq.y` example
Issue -
State: open - Opened by broken-dream about 2 months ago
- 1 comment
Labels: question
#3074 - 🐛 [Bug] Support ITensor type arguments for Batch Norm
Issue -
State: closed - Opened by zewenli98 about 2 months ago
- 3 comments
Labels: bug
#3073 - ❓ Cannot figure out the following error: AttributeError: module 'torch_tensorrt' has no attribute 'ptq'.
Issue -
State: closed - Opened by ImaanIbrar about 2 months ago
- 2 comments
Labels: question
#3072 - Test Only: Windows Build failure issue
Pull Request -
State: closed - Opened by lanluo-nvidia about 2 months ago
- 2 comments
Labels: component: build system, WIP, component: api [Python], cla signed
#3071 - chore: Bump TRT version to 10.3.0.26
Pull Request -
State: closed - Opened by zewenli98 about 2 months ago
Labels: component: tests, component: conversion, component: core, component: converters, component: build system, component: api [Python], cla signed
#3070 - Fix docker build issue
Pull Request -
State: closed - Opened by lanluo-nvidia about 2 months ago
Labels: component: build system, component: api [Python], cla signed
#3068 - chore: dynamic shape support for pdist ops
Pull Request -
State: closed - Opened by keehyuna about 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3067 - fix: Fix the CUDAGraphs C++ runtime implementation
Pull Request -
State: closed - Opened by narendasan about 2 months ago
Labels: component: tests, component: conversion, component: core, component: converters, component: api [Python], component: runtime, cla signed, component: dynamo
#3066 - Renamed convert_exported_program_to_serialized_trt_engine
Pull Request -
State: closed - Opened by cehongwang about 2 months ago
Labels: component: tests, cla signed
#3065 - chore: bug fixes
Pull Request -
State: open - Opened by peri044 about 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3064 - 🐛 [Bug] select scatter decomposition device handling
Issue -
State: open - Opened by peri044 about 2 months ago
- 1 comment
Labels: bug
#3062 - Fix: Layer norm Torchscript converter
Pull Request -
State: closed - Opened by narendasan about 2 months ago
Labels: component: tests, component: lowering, component: conversion, component: core, component: converters, cla signed
#3061 - fix: Relax thresholds of dynamo converters' tests
Pull Request -
State: closed - Opened by zewenli98 about 2 months ago
- 1 comment
Labels: component: tests, cla signed
#3060 - ❓ [Question] function `torch._ops.aten.aten::_to_copy` not currently supported with dynamic input shape
Issue -
State: open - Opened by broken-dream about 2 months ago
Labels: question
#3059 - 🐛 [Bug] SDv1.5 generate black image with torch_tensorrt compile
Issue -
State: open - Opened by xduzhangjiayu about 2 months ago
- 3 comments
Labels: bug, bug: triaged [not a bug]
#3058 - add int8 quantization support
Pull Request -
State: closed - Opened by lanluo-nvidia about 2 months ago
- 2 comments
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3057 - bugfix: WAR disable BERT TS test
Pull Request -
State: closed - Opened by narendasan 2 months ago
Labels: component: tests, cla signed
#3056 - test only
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
Labels: component: conversion, component: converters, WIP, component: api [Python], component: dynamo
#3055 - chore: fix attn test
Pull Request -
State: closed - Opened by peri044 2 months ago
Labels: component: lowering, component: api [Python], cla signed, component: dynamo
#3054 - chore: bug fix in runtime
Pull Request -
State: closed - Opened by peri044 2 months ago
Labels: component: core, component: runtime, cla signed
#3053 - ✨[Feature] Relax thresholds in tests for TRT 10 upgrade
Issue -
State: closed - Opened by zewenli98 2 months ago
Labels: feature request
#3052 - Dynamic shape chunk
Pull Request -
State: closed - Opened by apbose 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3051 - Add dynamic shape support for cumsum/grid
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3050 - add dynamic shape support for cumsum/grid
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
- 1 comment
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3049 - Is jetpack 6.0 for jetson agx orin supported?
Issue -
State: open - Opened by dhruvmsheth 2 months ago
- 5 comments
Labels: question
#3048 - Notebook failure
Pull Request -
State: closed - Opened by apbose 2 months ago
Labels: cla signed
#3047 - Added tensor_parallelism examples
Pull Request -
State: closed - Opened by cehongwang 2 months ago
- 1 comment
Labels: cla signed
#3046 - chore: dynamic shape support for flip ops
Pull Request -
State: closed - Opened by keehyuna 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3045 - feat: dynamic shape support for pad ops
Pull Request -
State: closed - Opened by chohk88 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3044 - feat: dynamic support for pixel_suffle and pixel_unshuffle
Pull Request -
State: closed - Opened by chohk88 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3043 - feat: Support `aten.dot` dynamo converter
Pull Request -
State: closed - Opened by HolyWu 2 months ago
- 6 comments
Labels: component: tests, component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3042 - Fix the build name issue: cherry pick from 3041 back to main
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
Labels: cla signed
#3041 - fix the artifacts name issue
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
- 2 comments
Labels: cla signed, ciflow/binaries/all, build-release-artifacts
#3040 - Test only...........
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
- 1 comment
Labels: WIP, component: api [Python], cla signed, ciflow/binaries/all, build-release-artifacts
#3039 - Dynamic shape index
Pull Request -
State: closed - Opened by apbose 2 months ago
- 5 comments
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3038 - assertEquals is deprecated in TestCase in Python 3.12
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
Labels: component: tests, cla signed
#3037 - Add the initial benchmark test scripts for hugging face model.
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
- 1 comment
Labels: WIP, cla signed
#3036 - chore: doc fix
Pull Request -
State: closed - Opened by peri044 2 months ago
Labels: documentation, cla signed
#3035 - cherry pick from 3008 to release/2.4
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
Labels: component: tests, component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3034 - chore: Update perf tooling with support for HF models
Pull Request -
State: closed - Opened by peri044 2 months ago
Labels: component: lowering, component: conversion, component: api [Python], cla signed, component: dynamo
#3033 - cherry pick 2740 to release2.4 branch.
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
Labels: component: tests, component: lowering, component: api [Python], cla signed, component: dynamo
#3032 - add dynamic support for embedding_bag/index_select
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo
#3031 - 🐛 [Bug] Undefined symbol when importing `torch_tensorrt`
Issue -
State: closed - Opened by laclouis5 2 months ago
- 2 comments
Labels: bug
#3030 - feat: support dynamic shape for replication and circular pad
Pull Request -
State: closed - Opened by chohk88 2 months ago
- 1 comment
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3029 - Dynamic shape support for aten.constant_pad_nd
Pull Request -
State: closed - Opened by chohk88 2 months ago
- 1 comment
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3028 - feat: dynamic shape support for reflection_pad (aten.reflection_pad1d,2d,3d)
Pull Request -
State: closed - Opened by chohk88 2 months ago
- 1 comment
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3027 - chore: cherrypick of #2855
Pull Request -
State: closed - Opened by zewenli98 2 months ago
Labels: component: tests, component: build system, component: api [Python], cla signed
#3026 - chore: dynamic shape support for any/sort/trunc ops
Pull Request -
State: closed - Opened by keehyuna 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3025 - 🐛 [Bug] Encountered bug : torch._dynamo.exc.InternalTorchDynamoError: 'NoneType' object is not subscriptable
Issue -
State: open - Opened by yyChen233 2 months ago
- 1 comment
Labels: bug
#3024 - ❓ [Question] How to deal with this error: AssertionError: cuda_ext_fp8 could not be imported. E4M3 quantization requires CUDA and cuda_ext_fp8
Issue -
State: closed - Opened by zk1009 2 months ago
- 3 comments
Labels: question
#3023 - Add dynamic support to roll/scaler_tensor
Pull Request -
State: closed - Opened by lanluo-nvidia 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3022 - 🐛 [Bug] Numerical error with dynamic shape support for aten.linear
Issue -
State: closed - Opened by chohk88 2 months ago
Labels: bug
#3021 - feat: dynamic shape support for adaptive_avg_poolNd (partially)
Pull Request -
State: closed - Opened by chohk88 2 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3020 - 🐛 [Bug] ValueError: Trying to flatten user inputs with exported input tree spec
Issue -
State: open - Opened by Hukongtao 3 months ago
- 2 comments
Labels: bug
#3019 - chore: bug fixes for full and expand
Pull Request -
State: closed - Opened by peri044 3 months ago
- 2 comments
Labels: component: tests, component: lowering, component: conversion, component: core, component: converters, component: api [Python], component: runtime, cla signed, component: dynamo
#3018 - ❓ [Question] How do you save a unet model compiled Torch-TensorRT (Stable Diffusion XL)
Issue -
State: open - Opened by dru10 3 months ago
- 2 comments
Labels: question
#3017 - chore: dynamic shape support for upsample_nearest2d/bilinear2d
Pull Request -
State: closed - Opened by keehyuna 3 months ago
- 4 comments
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3016 - 🐛 [Bug] TRT Error when compiling ViT with Dynamic Shape
Issue -
State: closed - Opened by Hukongtao 3 months ago
- 5 comments
Labels: bug
#3015 - 🐛 [Bug] ValueError: Not all inputs provided are torch.tensors. Please provide torch.tensors as inputs
Issue -
State: closed - Opened by Hukongtao 3 months ago
Labels: bug
#3014 - Group norm bug fix
Pull Request -
State: closed - Opened by cehongwang 3 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3013 - add the sym_not / full operator to support dynamic shape
Pull Request -
State: closed - Opened by lanluo-nvidia 3 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3012 - refactor: Upgrade bazel and move to MODULE.bazel
Pull Request -
State: closed - Opened by narendasan 3 months ago
Labels: component: build system, component: api [Python], component: api [C++], cla signed, component: dynamo
#3011 - feat: support dynamic shape for aten.linear
Pull Request -
State: closed - Opened by chohk88 3 months ago
- 1 comment
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo
#3010 - feat: support dynamic shapes for avg poolNd
Pull Request -
State: closed - Opened by chohk88 3 months ago
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3009 - dynamic shape argmax and argmin
Pull Request -
State: closed - Opened by apbose 3 months ago
- 1 comment
Labels: component: tests, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3008 - scatter reduce decomposition
Pull Request -
State: closed - Opened by apbose 3 months ago
- 1 comment
Labels: component: tests, component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3007 - fix: fix exported_program import error
Pull Request -
State: closed - Opened by peri044 3 months ago
Labels: component: api [Python], cla signed
#3005 - 🐛 [Bug] Encountered bug when using Torch-TensorRT: ImportError: cannot import name 'ExportedProgram' from 'torch._export' (/usr/local/lib/python3.10/dist-packages/torch/_export/__init__.py)
Issue -
State: closed - Opened by AIManifest 3 months ago
- 1 comment
Labels: bug
#3003 - 🐛 [Bug] Encountered bug when using Torch-TensorRT - SD1.5 compilation causes incorrect output
Issue -
State: open - Opened by cehongwang 3 months ago
Labels: bug
#3002 - chore: Fixes required for LLM models
Pull Request -
State: closed - Opened by peri044 3 months ago
Labels: component: tests, component: lowering, component: conversion, component: converters, component: api [Python], cla signed, component: dynamo
#3001 - Bump torchvision
Pull Request -
State: closed - Opened by HolyWu 3 months ago
- 2 comments
Labels: component: build system, component: api [Python], cla signed
#3000 - 🐛 [Bug] Encountered bug when using Torch-TensorRT (aten_ops_constant_pad_nd_default)
Issue -
State: open - Opened by minimok7 3 months ago
Labels: bug
#2999 - Enabled python runtime saving
Pull Request -
State: open - Opened by cehongwang 3 months ago
Labels: component: api [Python], component: runtime, cla signed, component: dynamo
#2998 - 🐛 [Bug] AttributeError: '_OpNamespace' 'tensorrt' object has no attribute 'get_cudagraphs_mode'
Issue -
State: open - Opened by zewenli98 3 months ago
Labels: bug
#2997 - feat: Lazy engine initialization
Pull Request -
State: closed - Opened by narendasan 3 months ago
Labels: component: tests, component: conversion, component: api [Python], component: runtime, cla signed, component: dynamo
#2996 - chore: Bump TRT version to 10.2.0.19
Pull Request -
State: closed - Opened by zewenli98 3 months ago
- 5 comments
Labels: component: tests, component: build system, component: api [Python], cla signed
#2995 - feat: engine caching
Pull Request -
State: closed - Opened by zewenli98 3 months ago
- 3 comments
Labels: component: tests, component: conversion, component: api [Python], cla signed, component: dynamo, component: torch_compile