Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / HazyResearch/flash-attention issues and pull requests

#139 - Looking for guidance to port WeNet attention code to flash_attention

Issue - State: open - Opened by jprobichaud almost 2 years ago - 1 comment

#138 - v0.2.8: flash_attn_cuda.bwd failing on nvidia a6000 -- sm86 vs sm80 support issue?

Issue - State: open - Opened by timohear almost 2 years ago - 11 comments

#134 - H100 Support Timelines

Issue - State: closed - Opened by sdtblck almost 2 years ago - 9 comments

#133 - Jax support

Issue - State: open - Opened by brando90 almost 2 years ago - 3 comments

#131 - installing dropout_layer_norm

Issue - State: open - Opened by sgunasekar almost 2 years ago - 18 comments

#130 - no package 'dropout_layer_norm'

Issue - State: closed - Opened by christallire almost 2 years ago - 2 comments

#126 - GPT-J style fused rotary

Issue - State: closed - Opened by kurumuz almost 2 years ago - 3 comments

#122 - INT8 versions of FMHA and Flash-Attention (Forward)

Issue - State: open - Opened by jundaf2 almost 2 years ago - 3 comments

#104 - Key padding mask for Triton version

Issue - State: closed - Opened by EBGU about 2 years ago - 1 comment

#76 - add the attention mask for flash-attention.

Pull Request - State: closed - Opened by MayDomine about 2 years ago - 3 comments

#71 - No module named `rotary_emb`

Issue - State: closed - Opened by PeterZhizhin about 2 years ago - 5 comments

#57 - support attentions in AlphaFold2

Pull Request - State: open - Opened by guolinke over 2 years ago - 19 comments

#40 - parallel execution of read/write operations (paper vs implementation)

Issue - State: closed - Opened by pommedeterresautee over 2 years ago - 10 comments

#31 - sparsity_config in FlashBlocksparseMHA?

Issue - State: open - Opened by cmlakhan over 2 years ago - 6 comments

#29 - test flash attention with model

Pull Request - State: open - Opened by lw921014 over 2 years ago

#17 - Masking + biasing

Issue - State: open - Opened by gahdritz over 2 years ago - 20 comments

#1 - Merging this into apex / pytorch?

Issue - State: closed - Opened by justheuristic over 2 years ago - 4 comments