Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / flagopen/flagattention issues and pull requests

#23 - Supporting memory efficient dropout in flash attention

Pull Request - State: closed - Opened by tongxin 6 months ago

#22 - support grouped query attention(MQA & GQA) for flash_attn

Pull Request - State: closed - Opened by iclementine 6 months ago

#21 - Feishu bot test

Pull Request - State: closed - Opened by StrongSpoon 8 months ago

#20 - add paged-attention

Pull Request - State: closed - Opened by kaiyuanm 9 months ago

#19 - update README and fix typos

Pull Request - State: closed - Opened by iclementine 10 months ago

#18 - add logo for flag-attention & link to flag-open

Pull Request - State: closed - Opened by iclementine 10 months ago

#17 - Add flash decoding(flash attention with split_kv)

Pull Request - State: closed - Opened by iclementine 10 months ago

#16 - add workflow & precommit

Pull Request - State: closed - Opened by iclementine 10 months ago

#15 - Add workflow and pre-commit

Pull Request - State: closed - Opened by iclementine 10 months ago

#14 - Test

Pull Request - State: closed - Opened by iclementine 10 months ago

#13 - fix a bug in config selection introduced in PR #9

Pull Request - State: closed - Opened by iclementine 10 months ago
Labels: bugfix

#12 - Change the causal masking when seqlen_q > seqlen_kv

Pull Request - State: closed - Opened by iclementine 10 months ago

#11 - support seqlen_q > seqlen_kv

Pull Request - State: closed - Opened by iclementine 10 months ago

#10 - add options to retutn log normalizer & total attention

Pull Request - State: closed - Opened by iclementine 10 months ago - 1 comment

#9 - refactor the code to allow overwriting the function to get config

Pull Request - State: closed - Opened by iclementine 10 months ago

#8 - fix a bug in upper bound of kernels that loop along tiles in a row

Pull Request - State: closed - Opened by iclementine 11 months ago

#7 - Feature request: Add Dropout

Issue - State: open - Opened by hypnopump 11 months ago - 4 comments

#6 - add testing for non divisible m & non-divisible n

Pull Request - State: closed - Opened by iclementine 11 months ago

#5 - Hypno/add bias

Pull Request - State: open - Opened by hypnopump 11 months ago - 6 comments

#4 - Comparison with triton-included flash attention2

Issue - State: closed - Opened by hypnopump 11 months ago - 2 comments

#3 - Flash Attention 2: Save mask application if block is not in boundary

Pull Request - State: closed - Opened by hypnopump 11 months ago - 5 comments

#2 - Optimization of operators

Pull Request - State: closed - Opened by iclementine 12 months ago

#1 - fix error in pointer computation _bwd_preprocess

Pull Request - State: closed - Opened by iclementine about 1 year ago