google-research/precondition issues and pull requests

#44 - upgrading init2winit from pmap to jit

Pull Request - State: open - Opened by copybara-service[bot] about 2 months ago

#43 - Pretokenization notebook

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago - 1 comment

#42 - Wikipedia processing and pretokenizing notebooks

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago - 1 comment

#41 - Added pretokenization notebook for dolly, metamath

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago - 1 comment

#40 - Add pretokenization notebook for Dolly, MetaMath, CodeAlpaca, and Openwebmath.

Pull Request - State: open - Opened by copybara-service[bot] 4 months ago - 1 comment

#39 - Added codealpaca data

Pull Request - State: open - Opened by copybara-service[bot] 4 months ago - 1 comment

#38 - Added readme

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago - 1 comment

#37 - Initial commit of datamix

Pull Request - State: closed - Opened by copybara-service[bot] 4 months ago - 1 comment

#36 - Replace deprecated `jax.tree_` functions with `jax.tree.`

Pull Request - State: closed - Opened by copybara-service[bot] 9 months ago

#35 - Replace deprecated jax.random.shuffle with jax.random.permutation

Pull Request - State: closed - Opened by copybara-service[bot] 10 months ago

#34 - FKM dynamic sketchy memory reallocation

Pull Request - State: open - Opened by copybara-service[bot] about 1 year ago - 1 comment

#33 - [LSC] Ignore incorrect type annotations related to jax.numpy APIs

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#32 - internal

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#31 - internal

Pull Request - State: open - Opened by copybara-service[bot] over 1 year ago - 1 comment

#30 - internal

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago - 1 comment

#29 - added python file for rank reallocation

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago - 1 comment

#28 - added option for linearly approximated tail

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago - 1 comment

#27 - [JAX] Replace uses of jax.experimental.pjit.with_sharding_constraint with jax.lax.with_sharding_constraint.

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#26 - added ekfac preconditioner option

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago - 1 comment

#25 - add in options for custom rank allocation across layers

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago - 1 comment

#24 - advice on how to reduce compile times?

Issue - State: open - Opened by GallagherCommaJack over 1 year ago

#23 - Use default_factory instead of an instance for this dataclass field's default value.

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#22 - Use default_factory instead of an instance for this dataclass field's default value.

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#21 - fix: deprecation of tree_flatten / tree_unflatten

Pull Request - State: open - Opened by borisdayma over 1 year ago - 1 comment

#20 - Internal

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago - 1 comment

#19 - fix sign flip in adafactor grafting.py

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago - 1 comment

#18 - Add matrix epsilon diagonal instead of truncating numerical noise.

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#17 - internal

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#16 - resolve doctring/code mismatch for clipping_threshold argument in adafactor grafting option

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago - 1 comment

#15 - added adafactor grafting

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago - 1 comment

#14 - Sketchy OCO experiments on benchmark datasets a9a, cifar10, gisette_scale

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago - 1 comment

#13 - Add sketchy logic

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#12 - Add Sketchy skeleton and single-cpu smoketest

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#11 - Only add lr to wd if not decoupled.

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#10 - Remove nannying ValueErrors when non-rmsprop grafting is set; allow param skipping; introduce epsilon and zero accumulator for rmsprop grafting.

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#9 - integrate tearfree into i2w

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#8 - Create tearfree optimizer, which will generalize pjit-capable Shampoo & Sketchy optimizers.

Pull Request - State: closed - Opened by copybara-service[bot] over 1 year ago

#7 - Internal

Pull Request - State: closed - Opened by copybara-service[bot] almost 2 years ago

#6 - Fix pytype failures related to teaching pytype about NumPy scalar types.

Pull Request - State: closed - Opened by copybara-service[bot] almost 2 years ago

#5 - Add total square frobenius norm for diagnostics in sketchy

Pull Request - State: closed - Opened by copybara-service[bot] almost 2 years ago

#4 - Internal

Pull Request - State: closed - Opened by vlad17 almost 2 years ago

#3 - pip cache & version update to test pypi push

Pull Request - State: closed - Opened by copybara-service[bot] almost 2 years ago

#2 - Add install blurb to readme

Pull Request - State: closed - Opened by copybara-service[bot] almost 2 years ago

#1 - use precondition-opt in pypi; keep package name the same.

Pull Request - State: closed - Opened by copybara-service[bot] almost 2 years ago

GitHub / google-research/precondition issues and pull requests