codekansas/ml-starter issues and pull requests

#514 - fixes for get-mask function

Pull Request - State: closed - Opened by codekansas over 1 year ago

#513 - cross-attention

Pull Request - State: closed - Opened by codekansas over 1 year ago

#512 - log git state when training

Pull Request - State: closed - Opened by codekansas over 1 year ago

#511 - functions for computing attention matrices

Pull Request - State: closed - Opened by codekansas over 1 year ago

#510 - more loss type options

Pull Request - State: closed - Opened by codekansas over 1 year ago

#509 - spectrogram function changes

Pull Request - State: closed - Opened by codekansas over 1 year ago

#508 - triton refactoring

Pull Request - State: closed - Opened by codekansas over 1 year ago

#507 - vq refactor

Pull Request - State: closed - Opened by codekansas over 1 year ago

#506 - lookup-free quantization

Pull Request - State: closed - Opened by codekansas over 1 year ago

#505 - finite scalar quantization

Pull Request - State: closed - Opened by codekansas over 1 year ago

#504 - Rwkv to api

Pull Request - State: closed - Opened by codekansas over 1 year ago

#503 - log when training is over

Pull Request - State: closed - Opened by codekansas over 1 year ago

#502 - conditional cross consistency models

Pull Request - State: closed - Opened by codekansas over 1 year ago

#501 - Unconditional consistency

Pull Request - State: closed - Opened by codekansas over 1 year ago

#500 - Huen steps for diffusion

Pull Request - State: closed - Opened by codekansas over 1 year ago

#499 - consistency model stuff

Pull Request - State: closed - Opened by codekansas over 1 year ago

#498 - small fix to attention

Pull Request - State: closed - Opened by codekansas over 1 year ago

#497 - consistency models

Pull Request - State: closed - Opened by codekansas over 1 year ago

#496 - same function for sampling and partial sampling

Pull Request - State: closed - Opened by codekansas over 1 year ago

#495 - conditional generation + remove spinner

Pull Request - State: closed - Opened by codekansas over 1 year ago

#494 - conditional diffusion model example

Pull Request - State: closed - Opened by codekansas over 1 year ago

#493 - batch size multiplier for test dl

Pull Request - State: closed - Opened by codekansas over 1 year ago

#492 - round robin gan training

Pull Request - State: closed - Opened by codekansas over 1 year ago

#491 - constant config

Pull Request - State: closed - Opened by codekansas over 1 year ago

#490 - flow matching stub

Pull Request - State: closed - Opened by codekansas over 1 year ago

#489 - add attention mask

Pull Request - State: closed - Opened by codekansas over 1 year ago

#488 - gqa with broadcasting attention instead of repeat

Pull Request - State: closed - Opened by codekansas over 1 year ago

#487 - gqa attention

Pull Request - State: closed - Opened by codekansas over 1 year ago

#486 - batch size multiplier

Pull Request - State: closed - Opened by codekansas over 1 year ago

#485 - weights & biases logger

Pull Request - State: closed - Opened by codekansas over 1 year ago

#484 - slurm account

Pull Request - State: closed - Opened by codekansas over 1 year ago

#483 - slurm enable tensorboard

Pull Request - State: closed - Opened by codekansas over 1 year ago

#482 - get ckpt prefix

Pull Request - State: closed - Opened by codekansas over 1 year ago

#481 - diffusion api update

Pull Request - State: closed - Opened by codekansas over 1 year ago

#480 - clamp idxs

Pull Request - State: closed - Opened by codekansas over 1 year ago

#479 - gan logging

Pull Request - State: closed - Opened by codekansas over 1 year ago

#473 - update tensorboard logging

Pull Request - State: closed - Opened by codekansas over 1 year ago

#472 - rotary embeddings

Pull Request - State: closed - Opened by codekansas over 1 year ago

#471 - gated residual

Pull Request - State: closed - Opened by codekansas over 1 year ago

#470 - fix nucleus sampling

Pull Request - State: closed - Opened by codekansas over 1 year ago

#469 - fix audio dataset

Pull Request - State: closed - Opened by codekansas over 1 year ago

#468 - migrate tarfile to sarfile

Pull Request - State: closed - Opened by codekansas over 1 year ago

#467 - add env stuff to api

Pull Request - State: closed - Opened by codekansas over 1 year ago

#466 - incorporate smart open

Pull Request - State: closed - Opened by codekansas over 1 year ago

#465 - slurm fixes

Pull Request - State: closed - Opened by codekansas over 1 year ago

#464 - test audio speaker matches waveform

Pull Request - State: closed - Opened by codekansas over 1 year ago

#463 - streamable cbr plus residual

Pull Request - State: closed - Opened by codekansas over 1 year ago

#462 - misc refactoring

Pull Request - State: closed - Opened by codekansas over 1 year ago

#461 - fixes for validation checks

Pull Request - State: closed - Opened by codekansas over 1 year ago

#460 - fix checkpoint loading

Pull Request - State: closed - Opened by codekansas over 1 year ago

#459 - audio ds fix

Pull Request - State: closed - Opened by codekansas over 1 year ago

#458 - multiprocess test

Pull Request - State: closed - Opened by codekansas over 1 year ago

#457 - mixed precision string

Pull Request - State: closed - Opened by codekansas over 1 year ago

#456 - changes to validation

Pull Request - State: closed - Opened by codekansas over 1 year ago

#455 - only latest ckpt

Pull Request - State: closed - Opened by codekansas over 1 year ago

#454 - state dict fix

Pull Request - State: closed - Opened by codekansas over 1 year ago

#453 - fix checkpoint stupidness

Pull Request - State: closed - Opened by codekansas over 1 year ago

#452 - fix bug with mixed precision checkpointing

Pull Request - State: closed - Opened by codekansas over 1 year ago

#451 - self attention module

Pull Request - State: closed - Opened by codekansas over 1 year ago

#450 - add number of speakers to audio dataset

Pull Request - State: closed - Opened by codekansas over 1 year ago

#449 - Slurm fixes

Pull Request - State: closed - Opened by codekansas over 1 year ago

#448 - set slurm master port

Pull Request - State: closed - Opened by codekansas over 1 year ago

#447 - formatting changes

Pull Request - State: closed - Opened by codekansas over 1 year ago

#446 - Fix load checkpoint

Pull Request - State: closed - Opened by codekansas over 1 year ago

#445 - Cleanup unused audio stuff

Pull Request - State: closed - Opened by codekansas over 1 year ago

#444 - audio tar ds

Pull Request - State: closed - Opened by codekansas over 1 year ago

#443 - fix distributed codebook

Pull Request - State: closed - Opened by codekansas over 1 year ago

#442 - tar audio ds

Pull Request - State: closed - Opened by codekansas over 1 year ago

#441 - add devices to init

Pull Request - State: closed - Opened by codekansas over 1 year ago

#440 - make subclasses

Pull Request - State: closed - Opened by codekansas over 1 year ago

#439 - better streaming

Pull Request - State: closed - Opened by codekansas over 1 year ago

#438 - streaming conv1d

Pull Request - State: closed - Opened by codekansas over 1 year ago

#437 - stft magnitude loss

Pull Request - State: closed - Opened by codekansas over 1 year ago

#436 - add to api

Pull Request - State: closed - Opened by codekansas over 1 year ago

#435 - small timer fix

Pull Request - State: closed - Opened by codekansas over 1 year ago

#434 - train a model on aws

Pull Request - State: closed - Opened by codekansas over 1 year ago

#433 - standalone rotary embeddings function

Pull Request - State: closed - Opened by codekansas over 1 year ago

#432 - module to without dtype

Pull Request - State: closed - Opened by codekansas over 1 year ago

#431 - codebook constants

Pull Request - State: closed - Opened by codekansas over 1 year ago

#430 - more loss functions in api, better documentation

Pull Request - State: closed - Opened by codekansas over 1 year ago

#429 - more audio losses

Pull Request - State: closed - Opened by codekansas over 1 year ago

#428 - fewer changes between runs

Pull Request - State: closed - Opened by codekansas over 1 year ago

#427 - add num resets to cosine decay scheduler

Pull Request - State: closed - Opened by codekansas over 1 year ago

#426 - fallback to torch.save for checkpoints that fail with safetensors

Pull Request - State: closed - Opened by codekansas over 1 year ago

#425 - parametrization norm

Pull Request - State: closed - Opened by codekansas over 1 year ago

#424 - gradient balancer

Pull Request - State: closed - Opened by codekansas over 1 year ago

#423 - torch distributed fixes

Pull Request - State: closed - Opened by codekansas over 1 year ago

#422 - add prefetcher to api

Pull Request - State: closed - Opened by codekansas over 1 year ago

#421 - use time.time less

Pull Request - State: closed - Opened by codekansas over 1 year ago

#420 - add types to torch distributed launcher using paramspec

Pull Request - State: closed - Opened by codekansas over 1 year ago

#419 - disable tensorboard waiting

Pull Request - State: closed - Opened by codekansas over 1 year ago

#418 - use safe tensors for saving and loading checkpoints

Pull Request - State: closed - Opened by codekansas over 1 year ago

#417 - small fix

Pull Request - State: closed - Opened by codekansas over 1 year ago

#416 - lazy start tensorboard

Pull Request - State: closed - Opened by codekansas over 1 year ago

#415 - return all quant

Pull Request - State: closed - Opened by codekansas over 1 year ago

#414 - Rework token writer

Pull Request - State: closed - Opened by codekansas over 1 year ago

#413 - speed up audio dataset

Pull Request - State: closed - Opened by codekansas over 1 year ago

#412 - fix missing attribute on concat-speaker-dataset

Pull Request - State: closed - Opened by codekansas over 1 year ago

#411 - audio loss warning

Pull Request - State: closed - Opened by codekansas over 1 year ago

#410 - small speaker dataset change

Pull Request - State: closed - Opened by codekansas over 1 year ago

GitHub / codekansas/ml-starter issues and pull requests