Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / kimmishi/torchdistpackage issues and pull requests

#25 - add tiled attn in pytorch

Pull Request - State: closed - Opened by KimmiShi 5 months ago

#24 - Misc

Pull Request - State: open - Opened by KimmiShi 11 months ago

#23 - feat: support Sharded EMA

Pull Request - State: closed - Opened by KimmiShi about 1 year ago

#22 - reorg files, add int8 funcs

Pull Request - State: closed - Opened by KimmiShi about 1 year ago

#21 - Module profiler

Pull Request - State: closed - Opened by KimmiShi about 1 year ago

#20 - add node group for hybrid zero

Pull Request - State: closed - Opened by KimmiShi about 1 year ago

#19 - add slurm job monitor

Pull Request - State: closed - Opened by KimmiShi about 1 year ago

#18 - feat: add sequence parallel

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#18 - feat: add sequence parallel

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#17 - feat(tensor parallel): implement base TP mlp&attn

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#16 - feat(zero): bucketize grad reduce

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#15 - Simple ZeRO impl: test on timm, cifar100, adam

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#14 - add fs-fmoe usage example

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#13 - Create debug_ln_error.py

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#12 - Fx exp

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#11 - feat: support Moe dp

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#10 - draft:scaler for pp

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#9 - fix: ddp reduce hook

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#8 - feat: update pipeline backward fn

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#7 - Feat/nvtx info

Pull Request - State: closed - Opened by ShenglongZ over 1 year ago - 1 comment

#6 - Update pipeline.md

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#5 - fix: pipeline code

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#4 - feat: clip_grad_norm_mp for pipeline

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#3 - feat: pipeline: add eval func

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#2 - feat: add model parallel ckpt fname helper api

Pull Request - State: closed - Opened by KimmiShi over 1 year ago

#1 - add nccl bw test fn

Pull Request - State: closed - Opened by KimmiShi over 1 year ago