TUDB-Labs/mLoRA issues and pull requests

#67 - add experiment results to readme

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 2 comments

#66 - Memory test report

Issue - State: closed - Opened by yezhengmao1 about 1 year ago - 8 comments
Labels: documentation

#66 - Memory test report

Issue - State: closed - Opened by yezhengmao1 about 1 year ago - 8 comments
Labels: documentation

#65 - feature: add micro batch size for gradient accumulation

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#65 - feature: add micro batch size for gradient accumulation

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#63 - update github link

Pull Request - State: closed - Opened by LianxinGao about 1 year ago

#63 - update github link

Pull Request - State: closed - Opened by LianxinGao about 1 year ago

#62 - Merge good-readme to main branch.

Pull Request - State: closed - Opened by Antlera about 1 year ago

#62 - Merge good-readme to main branch.

Pull Request - State: closed - Opened by Antlera about 1 year ago

#61 - Fix: fix picture alignment and update repo description.

Pull Request - State: closed - Opened by Antlera about 1 year ago

#61 - Fix: fix picture alignment and update repo description.

Pull Request - State: closed - Opened by Antlera about 1 year ago

#60 - update the author lists

Pull Request - State: closed - Opened by merlintang about 1 year ago - 1 comment

#60 - update the author lists

Pull Request - State: closed - Opened by merlintang about 1 year ago - 1 comment

#59 - Improve README and example configuration

Pull Request - State: closed - Opened by mikecovlee about 1 year ago

#59 - Improve README and example configuration

Pull Request - State: closed - Opened by mikecovlee about 1 year ago

#58 - Add citation information

Pull Request - State: closed - Opened by mikecovlee about 1 year ago

#58 - Add citation information

Pull Request - State: closed - Opened by mikecovlee about 1 year ago

#57 - feature[wip]: add parallel backward to accelerate multi-lora training.

Pull Request - State: closed - Opened by Antlera about 1 year ago - 2 comments

#57 - feature[wip]: add parallel backward to accelerate multi-lora training.

Pull Request - State: closed - Opened by Antlera about 1 year ago - 2 comments

#56 - [WIP] Aspen test report

Issue - State: closed - Opened by yezhengmao1 about 1 year ago

#56 - [WIP] Aspen test report

Issue - State: closed - Opened by yezhengmao1 about 1 year ago

#55 - The CI test gpu run error.

Issue - State: closed - Opened by yezhengmao1 about 1 year ago
Labels: bug

#55 - The CI test gpu run error.

Issue - State: closed - Opened by yezhengmao1 about 1 year ago
Labels: bug

#54 - bug fixed

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#54 - bug fixed

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#53 - function: can dispatch different task per iteration.

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#53 - function: can dispatch different task per iteration.

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#52 - How to test the performance.

Issue - State: closed - Opened by yezhengmao1 about 1 year ago - 2 comments
Labels: documentation

#52 - How to test the performance.

Issue - State: closed - Opened by yezhengmao1 about 1 year ago - 2 comments
Labels: documentation

#51 - Update .gitignore to ignoring junk files generated by macOS

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 1 comment

#51 - Update .gitignore to ignoring junk files generated by macOS

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 1 comment

#50 - feature: dispatch different lora train task

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#50 - feature: dispatch different lora train task

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#49 - add function - early stop inference

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago - 1 comment

#49 - add function - early stop inference

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago - 1 comment

#48 - add inference function

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago - 1 comment

#48 - add inference function

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago - 1 comment

#47 - add model evaluate script

Pull Request - State: closed - Opened by LianxinGao about 1 year ago - 2 comments

#47 - add model evaluate script

Pull Request - State: closed - Opened by LianxinGao about 1 year ago - 2 comments

#46 - format tests

Pull Request - State: closed - Opened by LianxinGao about 1 year ago

#46 - format tests

Pull Request - State: closed - Opened by LianxinGao about 1 year ago

#45 - add rouge and bleu metrics

Pull Request - State: closed - Opened by LianxinGao about 1 year ago - 2 comments

#45 - add rouge and bleu metrics

Pull Request - State: closed - Opened by LianxinGao about 1 year ago - 2 comments

#44 - Offload Performance Test Result

Issue - State: closed - Opened by yezhengmao1 about 1 year ago
Labels: documentation

#44 - Offload Performance Test Result

Issue - State: closed - Opened by yezhengmao1 about 1 year ago
Labels: documentation

#43 - Add docker file for developer

Pull Request - State: closed - Opened by LianxinGao about 1 year ago - 5 comments

#43 - Add docker file for developer

Pull Request - State: closed - Opened by LianxinGao about 1 year ago - 5 comments

#42 - Integrate QLoRA (4bit Quantization)

Pull Request - State: closed - Opened by mikecovlee about 1 year ago

#42 - Integrate QLoRA (4bit Quantization)

Pull Request - State: closed - Opened by mikecovlee about 1 year ago

#41 - add checkpoint function

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#41 - add checkpoint function

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#40 - Integrate evaluation methods into tests

Issue - State: closed - Opened by LianxinGao about 1 year ago - 5 comments

#40 - Integrate evaluation methods into tests

Issue - State: closed - Opened by LianxinGao about 1 year ago - 5 comments

#39 - TODO List of v0.1 Beta Release

Issue - State: closed - Opened by mikecovlee about 1 year ago

#39 - TODO List of v0.1 Beta Release

Issue - State: closed - Opened by mikecovlee about 1 year ago

#38 - bug fixed: pytorch reproducibility

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago
Labels: bug

#38 - bug fixed: pytorch reproducibility

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago
Labels: bug

#37 - v0.1 Beta

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 1 comment
Labels: help wanted

#37 - v0.1 Beta

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 1 comment
Labels: help wanted

#36 - v0.1 Beta

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 1 comment
Labels: help wanted

#36 - v0.1 Beta

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 1 comment
Labels: help wanted

#35 - Revert Experimental Multi-device Loading

Pull Request - State: closed - Opened by mikecovlee about 1 year ago

#35 - Revert Experimental Multi-device Loading

Pull Request - State: closed - Opened by mikecovlee about 1 year ago

#34 - Update README.md

Pull Request - State: closed - Opened by merlintang about 1 year ago

#34 - Update README.md

Pull Request - State: closed - Opened by merlintang about 1 year ago

#33 - Multi-device Model Loading and Training

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 5 comments

#33 - Multi-device Model Loading and Training

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 5 comments

#32 - Performance Test

Issue - State: closed - Opened by LianxinGao about 1 year ago - 1 comment
Labels: documentation

#32 - Performance Test

Issue - State: closed - Opened by LianxinGao about 1 year ago - 1 comment
Labels: documentation

#31 - Test on multiple GPU cards like 4090 and 3090

Issue - State: closed - Opened by merlintang about 1 year ago - 1 comment

#31 - Test on multiple GPU cards like 4090 and 3090

Issue - State: closed - Opened by merlintang about 1 year ago - 1 comment

#30 - how to support fine tune on two different dataset?

Issue - State: closed - Opened by merlintang about 1 year ago - 1 comment

#30 - how to support fine tune on two different dataset?

Issue - State: closed - Opened by merlintang about 1 year ago - 1 comment

#29 - checkpoint offload policy

Issue - State: closed - Opened by yezhengmao1 about 1 year ago - 1 comment
Labels: enhancement, help wanted

#29 - checkpoint offload policy

Issue - State: closed - Opened by yezhengmao1 about 1 year ago - 1 comment
Labels: enhancement, help wanted

#28 - The test report compare to alpaca-lora.

Issue - State: closed - Opened by yezhengmao1 about 1 year ago - 4 comments
Labels: documentation

#28 - The test report compare to alpaca-lora.

Issue - State: closed - Opened by yezhengmao1 about 1 year ago - 4 comments
Labels: documentation

#27 - WIP: checkpoint offload policy

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#27 - WIP: checkpoint offload policy

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#26 - Add bleu, rouge evaluation indicators.

Issue - State: open - Opened by LianxinGao about 1 year ago - 2 comments

#26 - Add bleu, rouge evaluation indicators.

Issue - State: open - Opened by LianxinGao about 1 year ago - 2 comments

#25 - change loss function calc method

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#25 - change loss function calc method

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago

#24 - Fix 8bit bypass in Windows

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 2 comments

#24 - Fix 8bit bypass in Windows

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 2 comments

#23 - fix pad_token_id is -1

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago - 1 comment

#23 - fix pad_token_id is -1

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago - 1 comment

#22 - Improve model loading

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 2 comments

#22 - Improve model loading

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 2 comments

#21 - Fix CI errors

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 2 comments

#21 - Fix CI errors

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 2 comments

#20 - test llama model

Pull Request - State: closed - Opened by LianxinGao about 1 year ago

#20 - test llama model

Pull Request - State: closed - Opened by LianxinGao about 1 year ago

#19 - clear the legacy code

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago - 1 comment

#19 - clear the legacy code

Pull Request - State: closed - Opened by yezhengmao1 about 1 year ago - 1 comment

#18 - Test workflow on gpu

Pull Request - State: closed - Opened by LianxinGao about 1 year ago

#18 - Test workflow on gpu

Pull Request - State: closed - Opened by LianxinGao about 1 year ago

#17 - merge main

Pull Request - State: closed - Opened by LianxinGao about 1 year ago

#17 - merge main

Pull Request - State: closed - Opened by LianxinGao about 1 year ago

#16 - Finish mlora.py

Pull Request - State: closed - Opened by mikecovlee about 1 year ago - 1 comment

GitHub / TUDB-Labs/mLoRA issues and pull requests