pytorch/pytorch issues and pull requests

#165034 - DTensor Matmul Compile with Unbacked Symint Failure

Issue - State: open - Opened by azahed98 about 1 month ago - 7 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: dynamo, module: dtensor

#164875 - [Fuzzer][Eager/Compile Divergence] The size of tensor a (s67) must match the size of tensor b (u0) at non-singleton dimension 0)

Issue - State: open - Opened by bobrenjc93 about 1 month ago
Labels: module: dynamic shapes, module: dynamo, topic: fuzzer

#164486 - [Fuzzer][Eager/Compile Divergence] torch._inductor.exc.InductorError: ImportError:

Issue - State: closed - Opened by bobrenjc93 about 2 months ago - 2 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, topic: fuzzer

#164385 - FloorDiv generate sympy rational

Issue - State: closed - Opened by laithsakka about 2 months ago
Labels: oncall: pt2, module: dynamic shapes

#163798 - tolist() does not graph when capture_scalar_outputs = False

Issue - State: closed - Opened by laithsakka about 2 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes

#163457 - [Fuzzer][Eager/Compile Divergence] unsupported operand type(s) for divmod(): 'SymInt' and 'int'

Issue - State: closed - Opened by bobrenjc93 about 2 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes, module: dynamo, topic: fuzzer

#162271 - Tensor.fill_diagonal_ doesn't support dynamic shapes

Issue - State: closed - Opened by bdhirsh 2 months ago - 2 comments
Labels: triaged, oncall: pt2, module: dynamic shapes

#159590 - DTensor Compile w/ Dynamic Shapes Autograd - Unhashable SymInt in sharding propagation when inputs have requires_grad=True

Issue - State: closed - Opened by azahed98 4 months ago - 3 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: dynamo, module: dtensor

#158081 - `torch.compile` errors with inductor raised `GuardOnDataDependentSymNode` exception

Issue - State: open - Opened by StrongerXi 4 months ago - 3 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: inductor, module: pt2-dispatcher

#157479 - torch.ops._c10d_functional_autograd.all_to_all_single missing dynamic shapes support

Issue - State: closed - Opened by xmfan 5 months ago
Labels: triaged, module: c10d, oncall: pt2, module: dynamic shapes

#155688 - `torch.compile(..., mode="max-autotune")` fails with `TypeError: Expected a number but got Identity` under `torch.no_grad()`

Issue - State: closed - Opened by tinywisdom 5 months ago - 1 comment
Labels: triaged, oncall: pt2, module: dynamic shapes, module: inductor

#155267 - [inductor] support linear & layer_norm unbacked

Pull Request - State: closed - Opened by ColinPeppler 6 months ago - 5 comments
Labels: Merged, ciflow/trunk, topic: not user facing, module: dynamic shapes, module: inductor, ciflow/inductor, merging

#155205 - torch.compile failure in `all_to_all_single_grad` with dynamic splits

Issue - State: closed - Opened by hann-wang 6 months ago - 2 comments
Labels: oncall: distributed, triaged, module: c10d, oncall: pt2, module: dynamic shapes

#154146 - inductor unbacked codegen results in undefined inputs

Issue - State: open - Opened by bobrenjc93 6 months ago - 3 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: inductor

#153778 - unbacked inputs not being preserved in backwards graph

Issue - State: open - Opened by bobrenjc93 6 months ago
Labels: module: dynamic shapes

#153777 - dynamic shapes infinite loop triage

Issue - State: closed - Opened by bobrenjc93 6 months ago - 1 comment
Labels: triaged, oncall: pt2, module: dynamic shapes

#153174 - export: `tensor.view()` fails with dynamic shapes.

Issue - State: closed - Opened by ysiraichi 6 months ago - 4 comments
Labels: oncall: pt2, module: dynamic shapes, oncall: export

#153108 - Introduce unbacked friendly is_known_contiguous and use it instead of is_contiguous in all locations where there is a general path for not know_contiguous

Issue - State: closed - Opened by laithsakka 7 months ago - 1 comment
Labels: triaged, oncall: pt2, module: dynamic shapes, data dependent error

#152972 - avoid falling back to as_strided for non-contiguous in-place reshape.

Issue - State: closed - Opened by laithsakka 7 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes

#152918 - We should include where specialization happens when we throw a constraint violation error

Issue - State: closed - Opened by bobrenjc93 7 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes

#152473 - [dynamo] Dynamo fails to run torch.cat() with FakeTensors because it can't confirm 's0 + s1*u0' is nonzero

Issue - State: closed - Opened by Adam27X 7 months ago - 2 comments
Labels: triaged, oncall: pt2, module: fakeTensor, module: dynamic shapes, module: dynamo

#151823 - Optimize printing sympy expressions during logging and cache key computation

Issue - State: closed - Opened by laithsakka 7 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes

#151799 - Expanding subset of tensor reads wrong memory

Issue - State: closed - Opened by martenlienen 7 months ago - 8 comments
Labels: triaged, module: correctness (silent), bug, oncall: pt2, module: dynamic shapes

#151480 - Some way to branch on dynamic vs static shapes in user code

Issue - State: closed - Opened by zou3519 7 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes, vllm-compile

#151356 - Improve Error Message for Dynamic Shape Constraint Violation

Issue - State: closed - Opened by drisspg 7 months ago
Labels: oncall: pt2, module: dynamic shapes

#150851 - Cannot export torch.sym_max(x.shape[0], y.shape[0])

Issue - State: closed - Opened by xadupre 7 months ago - 8 comments
Labels: oncall: pt2, module: dynamic shapes, oncall: export

#150842 - Exporting BertModel failed with marking batch as dynamic

Issue - State: closed - Opened by ChuanqiXu9 8 months ago - 3 comments
Labels: oncall: pt2, module: dynamic shapes, oncall: export

#150184 - Backed size oblivious not working as expected

Issue - State: closed - Opened by laithsakka 8 months ago - 2 comments
Labels: triaged, module: dynamic shapes

#150057 - [export] Export fails with multiple dimension indexing

Issue - State: closed - Opened by angelayi 8 months ago - 1 comment
Labels: oncall: pt2, module: dynamic shapes, export-triaged, oncall: export

#149635 - avoid guarding on max() unnecessarily

Issue - State: closed - Opened by bdhirsh 8 months ago - 7 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, vllm-compile

#149406 - Recompils due to Python float object

Issue - State: closed - Opened by efsotr 8 months ago - 4 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: dynamo

#148826 - automatically convert _check(u>=0) to check_is_size(), export should suggest check_is_size() instead of _check(u>=0) when applicable

Issue - State: closed - Opened by laithsakka 9 months ago - 4 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, oncall: export

#148645 - [inductor][torchbench][CI] timm models got obvious performance drop with --ci flag

Issue - State: closed - Opened by LifengWang 9 months ago - 1 comment
Labels: module: ci, triaged, oncall: pt2, module: dynamic shapes

#148564 - [Feature Request] Dynamic shapes API requires spec for all arguments.

Issue - State: open - Opened by tugsbayasgalan 9 months ago
Labels: feature, triaged, oncall: pt2, module: dynamic shapes

#148519 - reshape is decomposed to view setting allow_copy=False making it fail in some case!

Issue - State: closed - Opened by laithsakka 9 months ago - 7 comments
Labels: triaged, module: dynamic shapes, data dependent error

#148479 - export is emitting too many not actionable warnings.

Issue - State: closed - Opened by tugsbayasgalan 9 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes, export-triaged, oncall: export

#148389 - [export] Unable to trace ops like min/pow

Issue - State: open - Opened by angelayi 9 months ago
Labels: module: dynamic shapes, oncall: export

#148332 - DISABLED test_mark_unbacked_strict (main.MiscTests)

Issue - State: closed - Opened by pytorch-bot[bot] 9 months ago - 4 comments
Labels: triaged, module: flaky-tests, skipped, oncall: pt2, module: dynamic shapes

#148311 - DISABLED test_empty_graph_nested_calls_fullgraph_True_dynamic_shapes (main.DynamicShapesReproTests)

Issue - State: closed - Opened by pytorch-bot[bot] 9 months ago - 5 comments
Labels: triaged, module: flaky-tests, skipped, oncall: pt2, module: dynamic shapes

#148040 - [dynamo] torch._dynamo.mark_dynamic hard fails the compile if the dimension is coerced to static

Issue - State: closed - Opened by xmfan 9 months ago - 2 comments
Labels: oncall: pt2, module: dynamic shapes, module: dynamo, module: guards

#147772 - torch._check doesn't work for .item() then select

Issue - State: open - Opened by ydwu4 9 months ago
Labels: module: dynamic shapes

#147402 - [dynamic shapes][export] real-tensor tracing fails, due to bad decomposition path

Issue - State: closed - Opened by pianpwk 9 months ago - 2 comments
Labels: oncall: pt2, module: dynamic shapes, export-triaged, oncall: export

#147261 - `F.interpolate()` + `torch.compile(dynamic=True)` produces wrong shape

Issue - State: closed - Opened by gau-nernst 9 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes

#146932 - Use of @property on in-graph constructed NJT fails Dynamo tracing

Issue - State: closed - Opened by jbschlosser 9 months ago
Labels: triaged, module: nestedtensor, oncall: pt2, module: dynamic shapes, module: dynamo, dynamo-triage-jan2025

#146890 - max(a, b) if a and b else b specialize on both a and b. can we be smarter?

Issue - State: closed - Opened by laithsakka 9 months ago - 1 comment
Labels: oncall: pt2, module: dynamic shapes

#146686 - Unexpected specialization during estimate_runtime

Issue - State: closed - Opened by laithsakka 10 months ago - 3 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: aotdispatch, module: pt2-dispatcher

#146377 - FlexAttention compiled backward gives garbage data in certain stride situations for K.grad

Issue - State: closed - Opened by leijurv 10 months ago - 11 comments
Labels: high priority, triaged, module: correctness (silent), oncall: pt2, module: dynamic shapes, module: inductor, module: flex attention

#146168 - [dynamo] dynamo fails to compile a correct dynamic graph and lead to unexpected recompiles

Issue - State: closed - Opened by yyp0 10 months ago - 5 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: compiled autograd

#145775 - Error instead of silent specializing when an unbacked dimension has a value range cardinality of one

Issue - State: closed - Opened by bobrenjc93 10 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes

#145587 - [dynamo] mark_dynamic not working as intended with input shapes

Issue - State: closed - Opened by shreyansh26 10 months ago - 3 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: aotdispatch

#145500 - `torch._inductor.aoti_compile_and_package` fails when using dynamic shapes (PyTorch 2.6.0 RC)

Issue - State: closed - Opened by dt-synth 10 months ago - 7 comments
Labels: high priority, triaged, oncall: pt2, module: dynamic shapes, oncall: export, module: aotinductor

#144969 - Support something similar to export dynamic dims for torch.compile with fullgraph=True

Issue - State: open - Opened by ezyang 10 months ago
Labels: module: dynamic shapes

#144907 - `torch.export` for Yolo Pose fails

Issue - State: closed - Opened by agunapal 10 months ago - 1 comment
Labels: oncall: pt2, module: dynamic shapes, module: dynamo, oncall: export

#144792 - massive number of runtime asserts can hamper compile times

Issue - State: closed - Opened by bdhirsh 10 months ago - 5 comments
Labels: high priority, triage review, oncall: pt2, module: dynamic shapes

#144607 - broken `torch.compile` with `"meta"` device tensors

Issue - State: closed - Opened by koute 10 months ago - 9 comments
Labels: good first issue, triaged, actionable, oncall: pt2, module: dynamic shapes, module: inductor

#144095 - activation memory budget partitioner can fail with unbacked symints

Issue - State: closed - Opened by bdhirsh 11 months ago - 2 comments
Labels: high priority, triaged, oncall: pt2, module: dynamic shapes, module: aotdispatch, module: pt2-dispatcher

#144075 - [regression] Incorrect symbolic output shape and guards for arange, avg pool and conv ops

Issue - State: closed - Opened by BartlomiejStemborowski 11 months ago - 2 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: dynamo

#143053 - test_custom_scan_op regression

Issue - State: closed - Opened by eellison 11 months ago - 5 comments
Labels: triaged, bug, oncall: pt2, module: dynamic shapes, module: higher order operators, module: pt2-dispatcher

#142816 - [FlexAttention] Fix a few more symbolic shape issues

Pull Request - State: closed - Opened by drisspg 11 months ago - 9 comments
Labels: Merged, ciflow/trunk, topic: not user facing, module: dynamic shapes, module: inductor, ciflow/inductor, merging, ciflow/rocm

#142410 - Testing dynamic sizes in FakeTensor for registering custom ops on CUDA

Issue - State: closed - Opened by tvogels 11 months ago - 3 comments
Labels: triaged, oncall: pt2, module: dynamic shapes

#142379 - fixed fft_r2c incorrect stride calculation when dealing with dynamic …

Pull Request - State: closed - Opened by JulianMu16 11 months ago - 9 comments
Labels: triaged, open source, module: fft, Stale, module: dynamic shapes, release notes: dynamo

#142024 - Compute output strides logic is incompatible with unbacked symints

Issue - State: closed - Opened by xmfan 12 months ago - 4 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: dynamo

#141710 - compiling attention layer with dynamic shapes yields nans

Issue - State: closed - Opened by bdhirsh 12 months ago - 5 comments
Labels: high priority, triaged, oncall: pt2, module: dynamic shapes

#141522 - handle sympy.oo in bitwise_and/or value_ranges

Pull Request - State: closed - Opened by williamwen42 12 months ago - 7 comments
Labels: module: cpu, Merged, ciflow/trunk, release notes: fx, topic: bug fixes, module: dynamic shapes, ciflow/inductor, merging

#141419 - Dedicated function for the "changevar" trick (unbacked symint)

Issue - State: closed - Opened by ezyang 12 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes

#141248 - Need to also assert on replacements

Issue - State: open - Opened by ezyang 12 months ago
Labels: module: dynamic shapes

#141225 - torch.compile recompile when symbolic dim value is 2 and 1

Issue - State: closed - Opened by wbigat 12 months ago - 2 comments
Labels: triaged, oncall: pt2, module: dynamic shapes

#141215 - Rewrite FloorDiv Expands (x + y) // b into x // b + y // b in iterative way

Issue - State: closed - Opened by laithsakka 12 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes

#141120 - Symbolic execution fails when kernel has a fallthrough registration

Pull Request - State: closed - Opened by kundaMwiza 12 months ago - 5 comments
Labels: triaged, oncall: pt2, module: dynamic shapes

#141051 - Faulty symint for input tensor stride

Issue - State: closed - Opened by dvorjackz 12 months ago
Labels: triaged, oncall: pt2, module: dynamic shapes

#140751 - avoid specializing strides with DDPOptimizer + inductor

Pull Request - State: closed - Opened by bdhirsh about 1 year ago - 6 comments
Labels: oncall: distributed, Merged, ciflow/trunk, release notes: fx, fx, module: dynamic shapes, module: inductor, ciflow/inductor, merging

#140625 - [AOTI] AOT Compile NaViT - AttributeError: 'int' object has no attribute 'node'

Issue - State: closed - Opened by yiming0416 about 1 year ago - 6 comments
Labels: high priority, triage review, oncall: pt2, module: dynamic shapes, oncall: export, module: aotinductor, empathy-day

#140421 - torch.export.export of torch.nonzero failed

Issue - State: closed - Opened by mstebelev about 1 year ago - 5 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, oncall: export

#140229 - DDP disables torch.compile dynamic shape behaviour

Issue - State: closed - Opened by alxndrTL about 1 year ago - 4 comments
Labels: oncall: distributed, triaged, module: ddp, oncall: pt2, module: dynamic shapes, pt2d-triage-nov2024

#140011 - `torch.export.export` infers dynamic_shape as constant

Issue - State: closed - Opened by samutamm about 1 year ago - 8 comments
Labels: oncall: pt2, module: dynamic shapes, oncall: export

#139936 - [dynamic][inductor][recompilations] Static guard on tensor dim size

Issue - State: closed - Opened by anijain2305 about 1 year ago - 2 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: inductor

#139868 - [ONNX] Optimizer fails when comparing dynamic shapes

Issue - State: closed - Opened by laan8613 about 1 year ago - 3 comments
Labels: module: onnx, oncall: pt2, module: dynamic shapes, oncall: export

#139798 - [AOTI] SymInt used in torch.cond isn't codegen

Issue - State: closed - Opened by henrylhtsang about 1 year ago - 2 comments
Labels: oncall: pt2, module: dynamic shapes, oncall: export, module: aotinductor

#139610 - Error when exporting the torchaudio Conformer model

Issue - State: closed - Opened by neuropilot-captain about 1 year ago - 1 comment
Labels: oncall: pt2, module: dynamic shapes, oncall: export

#139544 - [flex attention][torch.compile] LoweringException: TypeError: cannot determine truth value of Relational

Issue - State: closed - Opened by JeffSHF about 1 year ago - 2 comments
Labels: triaged, oncall: pt2, module: dynamic shapes, module: higher order operators, module: pt2-dispatcher, module: flex attention

#139474 - Recompilation exausted with `size mismatch at index 2`

Issue - State: closed - Opened by bhack about 1 year ago - 33 comments
Labels: oncall: distributed, triaged, module: ddp, oncall: pt2, module: dynamic shapes, pt2d-triage-nov2024

#139408 - [Export] dynamic shape divisibility problem results in excessive warnings from Ignored guard + stack trace

Issue - State: closed - Opened by henrylhtsang about 1 year ago - 1 comment
Labels: oncall: pt2, module: dynamic shapes, export-triaged, oncall: export

#139316 - Reported code that emitted guard should not reference polyfill

Issue - State: closed - Opened by ezyang about 1 year ago - 1 comment
Labels: triaged, oncall: pt2, module: dynamic shapes

#139111 - `torch.compile` errors when inputs memory overlap.

Issue - State: closed - Opened by ysiraichi about 1 year ago - 3 comments
Labels: triaged, oncall: pt2, module: dynamic shapes

#138813 - Strange recompilations on torch 2.5 + FSDP + UNet

Issue - State: open - Opened by GLivshits about 1 year ago - 9 comments
Labels: oncall: distributed, triaged, oncall: pt2, module: dynamic shapes, module: dynamo

#138777 - [dynamo] add SymNode bitwise and/or

Pull Request - State: open - Opened by williamwen42 about 1 year ago - 13 comments
Labels: module: cpu, Merged, Reverted, ciflow/trunk, release notes: fx, fx, module: dynamic shapes, module: dynamo, ciflow/inductor, ci-no-td

#138777 - [dynamo] add SymNode bitwise and/or

Pull Request - State: closed - Opened by williamwen42 about 1 year ago - 23 comments
Labels: module: cpu, Merged, Reverted, ciflow/trunk, release notes: fx, fx, module: dynamic shapes, module: dynamo, ciflow/inductor, ci-no-td

#138478 - Changes in type annotations break downstream code

Issue - State: closed - Opened by lw about 1 year ago - 6 comments
Labels: module: typing, triaged, oncall: pt2, module: dynamic shapes

#138070 - AttributeError: Can't pickle local object 'make_opaque_unary_fn.<locals>.OpaqueUnaryFn'

Issue - State: closed - Opened by bhack about 1 year ago - 5 comments
Labels: oncall: pt2, module: dynamic shapes, oncall: export

#138069 - failed while executing int_truediv

Issue - State: closed - Opened by bhack about 1 year ago - 19 comments
Labels: triaged, oncall: pt2, module: dynamic shapes

#137747 - check fake/real mismatches during real tensor prop

Pull Request - State: open - Opened by pianpwk about 1 year ago - 17 comments
Labels: fb-exported, ciflow/trunk, module: dynamic shapes, ciflow/inductor, release notes: export

#137747 - check fake/real mismatches during real tensor prop

Pull Request - State: closed - Opened by pianpwk about 1 year ago - 19 comments
Labels: fb-exported, Merged, ciflow/trunk, module: dynamic shapes, ciflow/inductor, merging, release notes: export

#137527 - Report WHY a symbol was created dynamically in symbolic_shapes logs

Issue - State: open - Opened by ezyang about 1 year ago
Labels: module: dynamic shapes

#137520 - Support torch.cond with differing (but same dimensionality) sizes on true/false branches

Issue - State: open - Opened by ezyang about 1 year ago
Labels: module: dynamic shapes

#137220 - Less restrictive guards when using int(log2(sz))

Issue - State: open - Opened by davidberard98 about 1 year ago
Labels: module: dynamic shapes

#137217 - Automagically lift assertions / shape checks into torch._check

Issue - State: open - Opened by zou3519 about 1 year ago
Labels: module: dynamic shapes

#137179 - dynamic shapes: as_strided() on non-size-like int doesn't infer size-like

Issue - State: closed - Opened by bdhirsh about 1 year ago - 9 comments
Labels: good first issue, triaged, actionable, oncall: pt2, module: dynamic shapes

#137159 - Env var to shut up "for more info run with TORCHDYNAMO_EXTENDED_DEBUG_CREATE_SYMBOL"

Issue - State: closed - Opened by ezyang about 1 year ago
Labels: good first issue, triaged, oncall: pt2, module: dynamic shapes

#137100 - Something like mark_unbacked but only does size oblivious

Pull Request - State: closed - Opened by ezyang about 1 year ago - 2 comments
Labels: high priority, triaged, oncall: pt2, module: dynamic shapes

#137096 - Expressions involving Min/Max don't simplify with value ranges information

Issue - State: open - Opened by ezyang about 1 year ago
Labels: module: dynamic shapes

GitHub / pytorch/pytorch issues and pull requests