Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / feifeibear/long-context-attention issues and pull requests

#67 - LICENSE problem

Issue - State: closed - Opened by pustar 4 months ago - 1 comment

#67 - LICENSE problem

Issue - State: closed - Opened by pustar 4 months ago - 1 comment

#66 - GPU Memory Usage

Issue - State: closed - Opened by guanzhchen 4 months ago - 1 comment

#66 - GPU Memory Usage

Issue - State: closed - Opened by guanzhchen 4 months ago - 1 comment

#66 - GPU Memory Usage

Issue - State: closed - Opened by guanzhchen 4 months ago - 1 comment

#65 - Is there example of how to use the hybrid-sp in Megatron-LM?

Issue - State: closed - Opened by xs1997zju 4 months ago - 1 comment

#65 - Is there example of how to use the hybrid-sp in Megatron-LM?

Issue - State: closed - Opened by xs1997zju 4 months ago - 1 comment

#65 - Is there example of how to use the hybrid-sp in Megatron-LM?

Issue - State: closed - Opened by xs1997zju 4 months ago - 1 comment

#64 - flash_attn version dependency

Issue - State: closed - Opened by Eigensystem 4 months ago - 1 comment

#64 - flash_attn version dependency

Issue - State: closed - Opened by Eigensystem 4 months ago - 1 comment

#64 - flash_attn version dependency

Issue - State: closed - Opened by Eigensystem 4 months ago - 1 comment

#63 - support multiple node

Pull Request - State: closed - Opened by feifeibear 5 months ago

#63 - support multiple node

Pull Request - State: closed - Opened by feifeibear 5 months ago

#63 - support multiple node

Pull Request - State: closed - Opened by feifeibear 5 months ago

#62 - add reference to this project

Pull Request - State: closed - Opened by feifeibear 5 months ago

#62 - add reference to this project

Pull Request - State: closed - Opened by feifeibear 5 months ago

#62 - add reference to this project

Pull Request - State: closed - Opened by feifeibear 5 months ago

#61 - release V0.2

Pull Request - State: closed - Opened by feifeibear 5 months ago

#60 - add tesla supports for ulysses

Pull Request - State: closed - Opened by feifeibear 5 months ago

#60 - add tesla supports for ulysses

Pull Request - State: closed - Opened by feifeibear 5 months ago

#60 - add tesla supports for ulysses

Pull Request - State: closed - Opened by feifeibear 5 months ago

#59 - ulysses do not use flash_attn on T4 GPU

Pull Request - State: closed - Opened by feifeibear 5 months ago

#59 - ulysses do not use flash_attn on T4 GPU

Pull Request - State: closed - Opened by feifeibear 5 months ago

#59 - ulysses do not use flash_attn on T4 GPU

Pull Request - State: closed - Opened by feifeibear 5 months ago

#58 - add loss curve

Pull Request - State: closed - Opened by feifeibear 6 months ago

#58 - add loss curve

Pull Request - State: closed - Opened by feifeibear 6 months ago

#58 - add loss curve

Pull Request - State: closed - Opened by feifeibear 6 months ago

#57 - Fix r_rank/u_rank in extract local to be compatible with DP

Pull Request - State: closed - Opened by ShomyLiu 6 months ago

#57 - Fix r_rank/u_rank in extract local to be compatible with DP

Pull Request - State: closed - Opened by ShomyLiu 6 months ago

#57 - Fix r_rank/u_rank in extract local to be compatible with DP

Pull Request - State: closed - Opened by ShomyLiu 6 months ago

#56 - 显存占用问题

Issue - State: closed - Opened by realgump 6 months ago - 1 comment

#56 - 显存占用问题

Issue - State: closed - Opened by realgump 6 months ago - 1 comment

#56 - 显存占用问题

Issue - State: closed - Opened by realgump 6 months ago - 1 comment

#55 - update readme

Pull Request - State: closed - Opened by feifeibear 6 months ago

#55 - update readme

Pull Request - State: closed - Opened by feifeibear 6 months ago

#55 - update readme

Pull Request - State: closed - Opened by feifeibear 6 months ago

#54 - update readme

Pull Request - State: closed - Opened by feifeibear 7 months ago

#54 - update readme

Pull Request - State: closed - Opened by feifeibear 7 months ago

#54 - update readme

Pull Request - State: closed - Opened by feifeibear 7 months ago

#53 - Hybrid中zigzag ring attention 的数据分片问题

Issue - State: closed - Opened by YouYouCoding 7 months ago - 3 comments

#53 - Hybrid中zigzag ring attention 的数据分片问题

Issue - State: closed - Opened by YouYouCoding 7 months ago - 3 comments

#53 - Hybrid中zigzag ring attention 的数据分片问题

Issue - State: closed - Opened by YouYouCoding 7 months ago - 3 comments

#52 - add patches

Pull Request - State: closed - Opened by feifeibear 7 months ago

#52 - add patches

Pull Request - State: closed - Opened by feifeibear 7 months ago

#52 - add patches

Pull Request - State: closed - Opened by feifeibear 7 months ago

#51 - add megatron-deepspeed patch

Pull Request - State: closed - Opened by feifeibear 7 months ago

#51 - add megatron-deepspeed patch

Pull Request - State: closed - Opened by feifeibear 7 months ago

#51 - add megatron-deepspeed patch

Pull Request - State: closed - Opened by feifeibear 7 months ago

#50 - set_seq_parallel_pg compatible with DP process group

Pull Request - State: closed - Opened by feifeibear 7 months ago

#50 - set_seq_parallel_pg compatible with DP process group

Pull Request - State: closed - Opened by feifeibear 7 months ago

#50 - set_seq_parallel_pg compatible with DP process group

Pull Request - State: closed - Opened by feifeibear 7 months ago

#49 - hotfix import error

Pull Request - State: closed - Opened by feifeibear 7 months ago

#49 - hotfix import error

Pull Request - State: closed - Opened by feifeibear 7 months ago

#49 - hotfix import error

Pull Request - State: closed - Opened by feifeibear 7 months ago

#48 - update comprehensive benchmark results

Pull Request - State: closed - Opened by feifeibear 7 months ago

#48 - update comprehensive benchmark results

Pull Request - State: closed - Opened by feifeibear 7 months ago

#48 - update comprehensive benchmark results

Pull Request - State: closed - Opened by feifeibear 7 months ago

#47 - fix qkvpacked strip and zigzag test error

Pull Request - State: closed - Opened by feifeibear 7 months ago

#47 - fix qkvpacked strip and zigzag test error

Pull Request - State: closed - Opened by feifeibear 7 months ago

#47 - fix qkvpacked strip and zigzag test error

Pull Request - State: closed - Opened by feifeibear 7 months ago

#45 - remove useless code

Pull Request - State: closed - Opened by feifeibear 7 months ago

#45 - remove useless code

Pull Request - State: closed - Opened by feifeibear 7 months ago

#45 - remove useless code

Pull Request - State: closed - Opened by feifeibear 7 months ago

#44 - async hybrid attention forward only

Pull Request - State: closed - Opened by feifeibear 7 months ago

#44 - async hybrid attention forward only

Pull Request - State: closed - Opened by feifeibear 7 months ago

#44 - async hybrid attention forward only

Pull Request - State: closed - Opened by feifeibear 7 months ago

#43 - initial async ulysses attn

Pull Request - State: closed - Opened by feifeibear 8 months ago

#43 - initial async ulysses attn

Pull Request - State: closed - Opened by feifeibear 8 months ago

#43 - initial async ulysses attn

Pull Request - State: closed - Opened by feifeibear 8 months ago

#42 - move all_to_all to ./comm

Pull Request - State: closed - Opened by feifeibear 8 months ago

#42 - move all_to_all to ./comm

Pull Request - State: closed - Opened by feifeibear 8 months ago

#42 - move all_to_all to ./comm

Pull Request - State: closed - Opened by feifeibear 8 months ago

#41 - add torch profiler

Pull Request - State: closed - Opened by feifeibear 8 months ago

#41 - add torch profiler

Pull Request - State: closed - Opened by feifeibear 8 months ago

#41 - add torch profiler

Pull Request - State: closed - Opened by feifeibear 8 months ago

#40 - Comparing Ulysses and Ring with torch profiler

Issue - State: closed - Opened by feifeibear 8 months ago - 4 comments

#40 - Comparing Ulysses and Ring with torch profiler

Issue - State: closed - Opened by feifeibear 8 months ago - 4 comments

#40 - Comparing Ulysses and Ring with torch profiler

Issue - State: closed - Opened by feifeibear 8 months ago - 4 comments

#38 - add gqa support and benchmark results in readme

Pull Request - State: closed - Opened by feifeibear 8 months ago

#38 - add gqa support and benchmark results in readme

Pull Request - State: closed - Opened by feifeibear 8 months ago

#38 - add gqa support and benchmark results in readme

Pull Request - State: closed - Opened by feifeibear 8 months ago

#37 - 关于数据分割和合并

Issue - State: closed - Opened by Kwen-Chen 8 months ago - 12 comments

#37 - 关于数据分割和合并

Issue - State: closed - Opened by Kwen-Chen 8 months ago - 12 comments

#37 - 关于数据分割和合并

Issue - State: closed - Opened by Kwen-Chen 8 months ago - 12 comments

#36 - warmup longctx no pack benchmark

Pull Request - State: closed - Opened by feifeibear 8 months ago

#36 - warmup longctx no pack benchmark

Pull Request - State: closed - Opened by feifeibear 8 months ago

#36 - warmup longctx no pack benchmark

Pull Request - State: closed - Opened by feifeibear 8 months ago

#35 - use global process group

Pull Request - State: closed - Opened by feifeibear 8 months ago

#35 - use global process group

Pull Request - State: closed - Opened by feifeibear 8 months ago

#35 - use global process group

Pull Request - State: closed - Opened by feifeibear 8 months ago

#34 - 0409v3

Pull Request - State: closed - Opened by feifeibear 8 months ago

#34 - 0409v3

Pull Request - State: closed - Opened by feifeibear 8 months ago

#34 - 0409v3

Pull Request - State: closed - Opened by feifeibear 8 months ago

#33 - process group as global vars

Issue - State: closed - Opened by feifeibear 8 months ago