Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / lucidrains/memory-efficient-attention-pytorch issues and pull requests

#8 - Example for long embedding sequence prediction using this attention

Issue - State: open - Opened by ramdhan1989 8 months ago

#7 - Import partial

Pull Request - State: closed - Opened by marksgraham almost 2 years ago - 1 comment

#6 - Added dropout support to memory efficient variant

Pull Request - State: closed - Opened by usryokousha about 2 years ago - 3 comments

#5 - Making this work with relative position bias from XTransformers

Issue - State: open - Opened by pfeatherstone about 2 years ago - 5 comments

#4 - save_for_backward can only save variables, but argument 5 is of type bool

Issue - State: open - Opened by abalikhan over 2 years ago - 1 comment

#3 - Checkpointing is not compatible with .grad() or when an `inputs` parameter is passed to .backward()

Issue - State: open - Opened by vrobot over 2 years ago - 1 comment

#2 - [feature request] Combining with flash attention?

Issue - State: closed - Opened by Vbansal21 over 2 years ago - 15 comments

#1 - i did this, we could build on top

Issue - State: closed - Opened by hypnopump almost 3 years ago - 5 comments