facebookresearch/dadaptation issues and pull requests

#42 - Running issues of d_hat < 0

Issue - State: closed - Opened by zhujiem 7 months ago - 3 comments

#41 - TypeError: DAdaptLion.init() got an unexpected keyword argument 'decouple'

Issue - State: closed - Opened by DarkAlchy 8 months ago - 2 comments

#40 - Support layer-wise scaling

Pull Request - State: closed - Opened by adefazio 11 months ago - 1 comment
Labels: CLA Signed

#39 - Small bug fix: change default eps in DAdaptAdaGrad to avoid value error

Pull Request - State: closed - Opened by brunzema 11 months ago - 1 comment
Labels: CLA Signed

#38 - dadapt_adam.py Shouldn't it be Ak+1 here?

Issue - State: closed - Opened by lu-minous about 1 year ago

#37 - No easy way to read the `dlr` during the training

Issue - State: closed - Opened by mitalbert about 1 year ago - 3 comments

#35 - Dadapt Lion feedback

Issue - State: closed - Opened by Goldenkoron over 1 year ago - 6 comments

#32 - Fix for d_hat logging in lion #30

Pull Request - State: closed - Opened by adefazio over 1 year ago
Labels: CLA Signed

#31 - Correct default eps to 0.0

Pull Request - State: closed - Opened by kozistr over 1 year ago - 1 comment
Labels: CLA Signed

#30 - Exception in Lion optimizer

Issue - State: closed - Opened by tjennings over 1 year ago

#29 - Learning rates

Issue - State: open - Opened by RealBeyondMaster over 1 year ago - 2 comments

#28 - Remove betas from DAdaptSGD documentation

Pull Request - State: closed - Opened by rockerBOO over 1 year ago - 2 comments
Labels: CLA Signed

#27 - SGD default momentum is 0

Pull Request - State: closed - Opened by rockerBOO over 1 year ago - 3 comments
Labels: CLA Signed

#26 - No momentum for DAdaptAdam

Pull Request - State: closed - Opened by rockerBOO over 1 year ago - 3 comments
Labels: CLA Signed

#25 - Steps per Epoc in Sample images?

Issue - State: closed - Opened by DarksealStudios over 1 year ago - 5 comments

#24 - Support for Dylora

Issue - State: open - Opened by sdbds over 1 year ago - 11 comments

#23 - V3

Pull Request - State: closed - Opened by adefazio over 1 year ago
Labels: CLA Signed

#22 - Added Lion

Pull Request - State: closed - Opened by adefazio over 1 year ago
Labels: CLA Signed

#21 - Fix `exp_avg_diff` and `exp_avg_sq` assignment in D-Adaptation Adan

Pull Request - State: closed - Opened by kozistr over 1 year ago - 1 comment
Labels: CLA Signed

#20 - Add Lion with d-adaptation

Issue - State: closed - Opened by nviwch over 1 year ago - 7 comments

#19 - Fully-sharded data parallel support

Pull Request - State: closed - Opened by adefazio over 1 year ago
Labels: CLA Signed

#18 - First inequality on page 3 derivation?

Issue - State: closed - Opened by mega-optimus over 1 year ago - 2 comments

#17 - Any chance TF version will be realeased?

Issue - State: closed - Opened by georgeYanch over 1 year ago - 1 comment

#16 - D-Adaptation Adan

Pull Request - State: closed - Opened by qwopqwop200 over 1 year ago - 1 comment
Labels: CLA Signed

#15 - Complex number not supported for max() operation

Issue - State: closed - Opened by jinyi12 over 1 year ago - 3 comments

#14 - [Suggestions]D-Adaptation for Adan(Adaptive Nesterov Momentum Algorithm)

Issue - State: closed - Opened by qwopqwop200 over 1 year ago - 1 comment

#13 - Bugfix/call with no grads

Pull Request - State: closed - Opened by ariaameri over 1 year ago - 4 comments
Labels: CLA Signed

#12 - Complex number support

Pull Request - State: closed - Opened by adefazio over 1 year ago - 1 comment
Labels: CLA Signed

#11 - Any tips for training on my own dataset / fixing scale from COLMAP?

Issue - State: closed - Opened by nlml over 1 year ago - 2 comments

#10 - '<' not supported between instances of 'float' and 'complex'

Issue - State: closed - Opened by jinyi12 over 1 year ago - 4 comments

#9 - fix improper capitalization

Pull Request - State: closed - Opened by ksadov over 1 year ago - 1 comment

#8 - Import Error

Issue - State: closed - Opened by stefanwezel over 1 year ago - 3 comments

#7 - Doc and Naming

Pull Request - State: closed - Opened by adefazio over 1 year ago
Labels: CLA Signed

#6 - Float 16?

Issue - State: closed - Opened by TKassis over 1 year ago - 1 comment

#5 - Correctly spell optimizer class names

Pull Request - State: closed - Opened by HelgeS over 1 year ago - 1 comment
Labels: CLA Signed

#4 - ZeroDivisionError: float division by zero

Issue - State: closed - Opened by egorsmkv over 1 year ago - 5 comments

#3 - Pip restructuring

Pull Request - State: closed - Opened by adefazio over 1 year ago
Labels: CLA Signed

#2 - Pip package or official PyTorch integration?

Issue - State: closed - Opened by TKassis over 1 year ago - 2 comments

#1 - missing gsq_weighted in dadapt_sgd

Issue - State: closed - Opened by mortadhaaj over 1 year ago - 1 comment

GitHub / facebookresearch/dadaptation issues and pull requests