Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / feifeibear/odysseus-transformer issues and pull requests

#18 - Attn with Ulysses and LinearZero3

Issue - State: closed - Opened by GeneZC 6 months ago - 2 comments

#17 - update readme

Pull Request - State: closed - Opened by feifeibear 8 months ago

#16 - polish readme

Pull Request - State: closed - Opened by feifeibear 8 months ago

#15 - polish readme

Pull Request - State: closed - Opened by feifeibear 8 months ago

#14 - update readme

Pull Request - State: closed - Opened by feifeibear 8 months ago

#13 - update run.sh

Pull Request - State: closed - Opened by feifeibear 8 months ago

#12 - use self implmented zero3 for Odysseus MLP

Pull Request - State: closed - Opened by feifeibear 8 months ago

#11 - add experimental results

Pull Request - State: closed - Opened by feifeibear 8 months ago

#10 - add test for mlp with pack_weigh and sequence parallel

Pull Request - State: closed - Opened by feifeibear 8 months ago

#9 - memory efficient TP-SP

Pull Request - State: closed - Opened by feifeibear 8 months ago

#8 - RoadMap

Issue - State: closed - Opened by feifeibear 8 months ago

#7 - add ring attn

Pull Request - State: closed - Opened by feifeibear 8 months ago

#6 - keep_master_weight_for_test as param for NewLlamaFlashAttention2

Pull Request - State: closed - Opened by feifeibear 8 months ago

#5 - use huggingface llama2 training as example

Pull Request - State: closed - Opened by feifeibear 8 months ago

#4 - update readme with TODO

Pull Request - State: closed - Opened by feifeibear 9 months ago

#4 - update readme with TODO

Pull Request - State: closed - Opened by feifeibear 9 months ago

#3 - update readme

Pull Request - State: closed - Opened by feifeibear 9 months ago

#2 - add readme

Pull Request - State: closed - Opened by feifeibear 9 months ago

#1 - add ulyssess from yunchang

Pull Request - State: closed - Opened by feifeibear 9 months ago