GitHub / pytorch/torchchat issues and pull requests
#1542 - Push torchtune install deeper in generate._gen_model_input and undo import order change for etmodel
Pull Request -
State: closed - Opened by Jack-Khuu 3 months ago
- 1 comment
Labels: CLA Signed
#1541 - Bump torchao pin to pick up qmv_fast optimization
Pull Request -
State: closed - Opened by manuelcandales 3 months ago
- 2 comments
Labels: CLA Signed
#1540 - Unified tokenizer type onboarding
Pull Request -
State: open - Opened by srikary12 3 months ago
- 4 comments
Labels: CLA Signed
#1539 - Move imports to prepare for making torchtune an optional dependency
Pull Request -
State: closed - Opened by krammnic 3 months ago
- 10 comments
Labels: CLA Signed
#1538 - Bumping ET Pin to pick up PT and tune pin updates: May 9th
Pull Request -
State: closed - Opened by Jack-Khuu 3 months ago
- 2 comments
Labels: CLA Signed
#1537 - Improve Quantization Setup Prompts and Doc
Pull Request -
State: open - Opened by zhenyan-zhang-meta 3 months ago
- 2 comments
Labels: CLA Signed
#1536 - Improve Tokenizer New Type Onboarding
Issue -
State: open - Opened by zhenyan-zhang-meta 3 months ago
- 3 comments
Labels: good first issue, actionable, triaged
#1535 - Simplify `TokenizerArgs.__post_init__` with Enum Tokenizer Type
Pull Request -
State: closed - Opened by zhenyan-zhang-meta 3 months ago
- 1 comment
Labels: CLA Signed
#1534 - Accumulate tokens in generate mode
Pull Request -
State: closed - Opened by manuelcandales 3 months ago
- 1 comment
Labels: CLA Signed
#1533 - move just-in-time compilation time message
Pull Request -
State: closed - Opened by manuelcandales 3 months ago
- 1 comment
Labels: CLA Signed
#1532 - decode_n_tokens clean up
Pull Request -
State: closed - Opened by manuelcandales 3 months ago
- 1 comment
Labels: CLA Signed
#1531 - mps compile: Bump PT pin to April 18th
Pull Request -
State: closed - Opened by manuelcandales 3 months ago
- 1 comment
Labels: CLA Signed
#1530 - mps + compile + quant: introduce mps_op_lib
Pull Request -
State: closed - Opened by manuelcandales 3 months ago
- 1 comment
Labels: CLA Signed
#1529 - Bump PT pins to April 17th
Pull Request -
State: closed - Opened by Jack-Khuu 3 months ago
- 1 comment
Labels: CLA Signed
#1528 - Removing redundant installs from install_requirements.sh
Pull Request -
State: closed - Opened by Jack-Khuu 4 months ago
- 1 comment
Labels: CLA Signed, triaged
#1527 - [PyProject] Spin up an initial pyproject.toml allowing for local pip install
Pull Request -
State: closed - Opened by Jack-Khuu 4 months ago
- 2 comments
Labels: CLA Signed, triaged, Installing
#1526 - metal lowbit kernels: Introduce mps_op_lib
Pull Request -
State: closed - Opened by manuelcandales 4 months ago
- 1 comment
Labels: CLA Signed
#1525 - Enabling EmbeddingQuantizer and SharedEmbeddingQuantizer
Pull Request -
State: open - Opened by dillondesilva 4 months ago
- 12 comments
Labels: CLA Signed
#1524 - Add Initial unit test example: Model_Config
Pull Request -
State: closed - Opened by Jack-Khuu 4 months ago
- 1 comment
Labels: CLA Signed
#1523 - Enable compile on MPS with experimental warning
Pull Request -
State: closed - Opened by manuelcandales 4 months ago
- 3 comments
Labels: CLA Signed
#1522 - Bump ET Pin to 2025-3-5
Pull Request -
State: closed - Opened by Jack-Khuu 4 months ago
- 1 comment
Labels: CLA Signed, ExecuTorch, triaged
#1521 - Add Ascend NPU Support
Pull Request -
State: closed - Opened by xuedinge233 4 months ago
- 5 comments
Labels: CLA Signed
#1520 - Enable torchao.experimental EmbeddingQuantization
Issue -
State: open - Opened by Jack-Khuu 4 months ago
- 6 comments
Labels: Quantization, triaged
#1519 - torchtune as an optional dependency: Lazy Import
Issue -
State: open - Opened by Jack-Khuu 4 months ago
- 2 comments
Labels: good first issue, actionable, triaged, torchtune
#1518 - Simplify TokenizerArgs __post_init__: Unnecessarily verbose
Issue -
State: closed - Opened by Jack-Khuu 4 months ago
- 9 comments
Labels: good first issue, actionable, triaged
#1517 - Restrict CMake < 4.0.0: BC breaking version release
Pull Request -
State: closed - Opened by Jack-Khuu 4 months ago
- 1 comment
Labels: CLA Signed
#1516 - Bump PT/Vision/Tune Pin to 25250327
Pull Request -
State: closed - Opened by Jack-Khuu 4 months ago
- 1 comment
Labels: CLA Signed
#1515 - Update CI Jobs in anticipation for Cuda 12.4 deprecation
Pull Request -
State: closed - Opened by HonestDeng 4 months ago
- 6 comments
Labels: CLA Signed, CI Infra, triaged
#1514 - PT Pinbump to 2025226: Prior to to 12.4 deprecation
Pull Request -
State: closed - Opened by Jack-Khuu 4 months ago
- 2 comments
Labels: CLA Signed, CI Infra, triaged
#1513 - Mini README.md update removing "Update" from banner
Pull Request -
State: closed - Opened by Jack-Khuu 4 months ago
- 1 comment
Labels: CLA Signed
#1512 - Install torchao mps ops by default when running on Apple Silicon
Pull Request -
State: open - Opened by manuelcandales 4 months ago
- 1 comment
Labels: CLA Signed
#1511 - Direct Community to Discord instead of Slack
Pull Request -
State: closed - Opened by Jack-Khuu 5 months ago
- 1 comment
Labels: CLA Signed
#1510 - Move tokenizer info into pte for et
Pull Request -
State: closed - Opened by silverguo 5 months ago
- 1 comment
Labels: CLA Signed
#1509 - Fix install ET without pybind
Pull Request -
State: closed - Opened by silverguo 5 months ago
- 1 comment
Labels: CLA Signed
#1508 - [Experimenting] Bump PT/vision/tune pings to Feb 28 2025
Pull Request -
State: closed - Opened by Jack-Khuu 5 months ago
- 2 comments
Labels: CLA Signed
#1507 - Issue:1506 Add the min, max to embedding 4bit.
Pull Request -
State: closed - Opened by TheBetterSolution 5 months ago
- 4 comments
Labels: CLA Signed
#1506 - export mobile model with 4bit failed, but 8bit was ok.
Issue -
State: closed - Opened by TheBetterSolution 5 months ago
- 4 comments
Labels: ExecuTorch, Quantization, triaged
#1505 - Bump torchao pin closer to nightly: 2/26/2025
Pull Request -
State: closed - Opened by Jack-Khuu 5 months ago
- 1 comment
Labels: CLA Signed, Quantization, triaged
#1504 - Update CI Jobs in anticipation for Cuda 12.4 deprecation
Issue -
State: closed - Opened by Jack-Khuu 5 months ago
- 2 comments
Labels: Cuda, CI Infra, triaged
#1503 - Add XPU support for AOT inductor
Pull Request -
State: closed - Opened by jenniew 5 months ago
- 1 comment
Labels: CLA Signed
#1502 - Perform evaluation test based on evaluation.md
Pull Request -
State: open - Opened by mikekgfb 5 months ago
- 1 comment
Labels: CLA Signed
#1501 - Distributed Inference test
Pull Request -
State: open - Opened by mikekgfb 5 months ago
- 2 comments
Labels: CLA Signed
#1500 - Enable README.md testing
Pull Request -
State: open - Opened by mikekgfb 5 months ago
- 2 comments
Labels: CLA Signed
#1499 - Added support for Multimodal eval
Pull Request -
State: closed - Opened by anirudhs001 5 months ago
- 7 comments
Labels: enhancement, CLA Signed, Evaluation/Benchmarking
#1498 - Added support for Multimodal eval
Pull Request -
State: closed - Opened by anirudhs001 5 months ago
- 3 comments
#1497 - Llama3.2 vision model AOTI integration
Issue -
State: open - Opened by larryliu0820 5 months ago
- 1 comment
Labels: enhancement, Compile / AOTI, triaged
#1495 - Update test-tinystories-executorch: Disable config mobile-32, fix typo
Pull Request -
State: closed - Opened by Jack-Khuu 5 months ago
- 1 comment
Labels: CLA Signed, ExecuTorch, CI Infra, triaged
#1494 - Info Message fix in cli.py
Pull Request -
State: closed - Opened by mikekgfb 5 months ago
- 1 comment
Labels: CLA Signed
#1493 - Bump PT 2025131 and ET pins 20250209
Pull Request -
State: closed - Opened by Jack-Khuu 6 months ago
- 9 comments
Labels: CLA Signed
#1492 - Update README.md
Pull Request -
State: closed - Opened by shoumikhin 6 months ago
- 1 comment
Labels: CLA Signed
#1491 - What's the future plan for torchchat serving
Issue -
State: open - Opened by jenniew 6 months ago
- 3 comments
Labels: enhancement, triaged
#1489 - use template from pull.yml for run-readme-pr.yml since pip3 not available in current environment
Pull Request -
State: closed - Opened by mikekgfb 6 months ago
- 2 comments
Labels: enhancement, CLA Signed, CI Infra, triaged
#1488 - Add DeepSeek R1 Distill 8B
Pull Request -
State: closed - Opened by Jack-Khuu 6 months ago
- 3 comments
Labels: enhancement, CLA Signed, triaged
#1487 - Update check_gibberish
Pull Request -
State: closed - Opened by mikekgfb 6 months ago
- 1 comment
Labels: CLA Signed, CI Infra, triaged
#1486 - Update pull.yml to test snapshot saving and loading
Pull Request -
State: closed - Opened by mikekgfb 6 months ago
- 6 comments
Labels: CLA Signed
#1485 - Update pull.yml
Pull Request -
State: open - Opened by mikekgfb 6 months ago
- 1 comment
Labels: CLA Signed
#1484 - Move tokenizer information into pte to reduce ExecuTorch runner args
Issue -
State: closed - Opened by Jack-Khuu 6 months ago
Labels: enhancement, good first issue, actionable, ExecuTorch, triaged
#1483 - Model execution runs excruciatingly slow/doesn't run at all
Issue -
State: closed - Opened by JakeMalis 6 months ago
- 12 comments
Labels: performance, MPS/Metal, triaged
#1482 - Update ExecuTorch install requirements to new APIs
Issue -
State: closed - Opened by Jack-Khuu 6 months ago
- 2 comments
Labels: good first issue, actionable, ExecuTorch, triaged
#1481 - Bump llama.cpp pin to pick up numpy fix
Pull Request -
State: open - Opened by Jack-Khuu 6 months ago
- 1 comment
Labels: CLA Signed
#1480 - Add attention backend tests to more-tests.yml
Pull Request -
State: open - Opened by mikekgfb 6 months ago
- 3 comments
Labels: CLA Signed
#1479 - Update numpy requirements to no longer upper bound on 2.0
Pull Request -
State: closed - Opened by Jack-Khuu 6 months ago
- 3 comments
Labels: CLA Signed
#1478 - Enable sdpa backends for server export in export.py
Pull Request -
State: closed - Opened by mikekgfb 6 months ago
- 2 comments
Labels: CLA Signed
#1477 - Add SDPA backend tests and refactor generate.py
Pull Request -
State: open - Opened by mikekgfb 6 months ago
- 7 comments
Labels: CLA Signed
#1476 - source instead of exec in run-readme-pr-macos.yml
Pull Request -
State: closed - Opened by mikekgfb 6 months ago
- 19 comments
Labels: CLA Signed, Compile / AOTI, CI Infra, triaged
#1475 - Explicitly turning off pybindings for ExecuTorch install unless requested
Pull Request -
State: closed - Opened by Jack-Khuu 6 months ago
- 3 comments
Labels: CLA Signed, ExecuTorch
#1474 - Decode_n_tokens yield eos/eot token
Pull Request -
State: closed - Opened by nlpfollower 6 months ago
- 2 comments
Labels: CLA Signed
#1473 - Update Android NDK version to r27c
Pull Request -
State: closed - Opened by Jack-Khuu 6 months ago
- 8 comments
Labels: CLA Signed
#1472 - [Easy?] Numpy Version Pin Bump: == 2.0
Issue -
State: closed - Opened by Jack-Khuu 6 months ago
- 4 comments
Labels: good first issue, Known Gaps, actionable, ExecuTorch, triaged
#1471 - Typo: Fix generate signature type hint for attention_backend
Pull Request -
State: closed - Opened by Jack-Khuu 6 months ago
- 1 comment
Labels: CLA Signed
#1470 - Update import of sdpa_with_kv_cache to custom_ops
Pull Request -
State: closed - Opened by Jack-Khuu 6 months ago
- 1 comment
Labels: CLA Signed
#1469 - Update run-readme-pr-linuxaarch64.yml to use correct runner
Pull Request -
State: closed - Opened by Jack-Khuu 6 months ago
- 2 comments
Labels: CLA Signed
#1468 - Add warning in PTEModel when not defined
Pull Request -
State: closed - Opened by Jack-Khuu 6 months ago
- 1 comment
Labels: CLA Signed
#1467 - Update torch/tune/vision pins to 1/19
Pull Request -
State: closed - Opened by Jack-Khuu 6 months ago
- 1 comment
Labels: CLA Signed
#1466 - Add distributed tests to run-readme-pr.yml
Pull Request -
State: closed - Opened by mikekgfb 6 months ago
- 1 comment
Labels: CLA Signed
#1465 - Add `export --output-snapshot-path snap.tc`, and `--snapshot-path snap.tc`
Pull Request -
State: closed - Opened by mikekgfb 6 months ago
- 5 comments
Labels: CLA Signed
#1464 - Replace RMSNorm by nn.RMSNorm
Pull Request -
State: closed - Opened by manuelcandales 6 months ago
- 1 comment
Labels: CLA Signed
#1463 - [KNOWN BUG] ExecuTorch Related CI Failing
Issue -
State: open - Opened by Jack-Khuu 7 months ago
- 1 comment
Labels: ExecuTorch, CI Infra, triaged
#1462 - Increment start_pos by encoded size in generate
Pull Request -
State: closed - Opened by nlpfollower 7 months ago
- 8 comments
Labels: CLA Signed
#1461 - Fix quantize.py typo
Pull Request -
State: closed - Opened by mikekgfb 7 months ago
- 1 comment
Labels: CLA Signed
#1460 - Update run-readme-pr-mps.yml for typo
Pull Request -
State: closed - Opened by mikekgfb 7 months ago
- 2 comments
Labels: CLA Signed
#1459 - Bumping ET Pin to Jan16 2025
Pull Request -
State: closed - Opened by Jack-Khuu 7 months ago
- 3 comments
Labels: CLA Signed, ExecuTorch
#1458 - Update ARM CPU experimental kernels from AO to leverage pip install
Pull Request -
State: open - Opened by metascroy 7 months ago
- 5 comments
Labels: CLA Signed, Quantization
#1457 - Change role in chat to user
Pull Request -
State: closed - Opened by nlpfollower 7 months ago
- 3 comments
#1456 - Add attention_backend to let user choose
Pull Request -
State: closed - Opened by yanbing-j 7 months ago
- 7 comments
Labels: CLA Signed
#1455 - Update aoti calls to utilize new export and packaging APIs
Pull Request -
State: closed - Opened by angelayi 7 months ago
- 2 comments
Labels: CLA Signed, Compile / AOTI
#1454 - macOS 12.3+ requirement added to README
Pull Request -
State: closed - Opened by manuelcandales 7 months ago
- 1 comment
Labels: CLA Signed
#1453 - Unabled to import torchao experimental quant_api
Issue -
State: closed - Opened by Arthamna 7 months ago
- 1 comment
#1452 - Why Torchchat uses MATH as SDPA backend?
Issue -
State: closed - Opened by yanbing-j 7 months ago
- 8 comments
Labels: enhancement, triaged
#1451 - Update run-readme-pr-mps.yml to fix timeout
Pull Request -
State: closed - Opened by mikekgfb 7 months ago
- 1 comment
Labels: CLA Signed
#1448 - Create local-model.md
Pull Request -
State: closed - Opened by mikekgfb 7 months ago
- 2 comments
Labels: CLA Signed
#1447 - Change role to user for user prompts
Pull Request -
State: closed - Opened by vladoovtcharov 7 months ago
- 4 comments
Labels: CLA Signed
#1446 - Supply Local Weights to an LLM instead of Downloading Weights from HuggingFace
Issue -
State: closed - Opened by sgupta1007 7 months ago
- 2 comments
Labels: documentation, triaged
#1445 - Update README.md to include granite
Pull Request -
State: closed - Opened by mikekgfb 7 months ago
- 1 comment
Labels: CLA Signed
#1444 - We still don't use BFDOT on macOS CPU because Apple compiler used for PyTorch wheel is outdated
Issue -
State: open - Opened by swolchok 7 months ago
- 2 comments
Labels: performance, Known Gaps, MPS/Metal, triaged
#1443 - [retry] Use pytorch-labs/tokenizers and remove tokenizer/ (#1401)
Pull Request -
State: closed - Opened by larryliu0820 7 months ago
- 2 comments
Labels: CLA Signed
#1442 - Update evaluation.md
Pull Request -
State: closed - Opened by mikekgfb 7 months ago
- 1 comment
Labels: CLA Signed
#1441 - Fix how stream flag is read from request
Pull Request -
State: closed - Opened by mreso 7 months ago
- 1 comment
Labels: CLA Signed
#1440 - Migrate Tokenizer Components to utilize pytorch-labs/tokenizers
Issue -
State: closed - Opened by Jack-Khuu 7 months ago
Labels: enhancement, good first issue, actionable, triaged
#1439 - Update run-docs to avoid code duplication
Pull Request -
State: closed - Opened by mikekgfb 7 months ago
- 3 comments
Labels: CLA Signed