GitHub / mlcommons/algorithmic-efficiency issues and pull requests
#872 - Update pyproject.toml
Pull Request -
State: closed - Opened by priyakasimbeg about 2 months ago
- 1 comment
#871 - [WIP] Update metrics.py - fix for ogbg pytorch
Pull Request -
State: open - Opened by davidtweedle about 2 months ago
- 3 comments
#870 - Proposal: Unify Versioning for Codebase, Leaderboard, and Rules
Issue -
State: open - Opened by fsschneider 2 months ago
- 1 comment
Labels: โจ Feature Request
#869 - [WIP] Jit switch
Pull Request -
State: open - Opened by priyakasimbeg 2 months ago
- 1 comment
#868 - Publish Docker Image to Docker Hub to Support a Wider Set of Contributors
Issue -
State: open - Opened by Naeemkh 3 months ago
#867 - v2 Self-Tuning Budget for ResNet is Half of Benchmark Schedule-Free Run Time
Issue -
State: open - Opened by tfaod 3 months ago
- 2 comments
#866 - ogbg fails on pytorch submissions, pthread_create() failed
Issue -
State: open - Opened by tfaod 3 months ago
- 2 comments
#865 - submission_runner_test.py is not included in CI tests
Issue -
State: open - Opened by Naeemkh 4 months ago
Labels: ๐งช Test
#864 - Dropout JAX -> dropout_support
Pull Request -
State: open - Opened by priyakasimbeg 4 months ago
- 1 comment
#863 - [do not merge]
Pull Request -
State: closed - Opened by priyakasimbeg 4 months ago
- 1 comment
#862 - Dev -> main
Pull Request -
State: closed - Opened by priyakasimbeg 4 months ago
- 1 comment
#861 - Add basic summary of benchmark to README
Pull Request -
State: closed - Opened by priyakasimbeg 4 months ago
- 1 comment
#860 - [WIP] LM Workload
Pull Request -
State: open - Opened by rka97 4 months ago
- 1 comment
#859 - [WIP] Refactor modeldiffs tests to improve variable names script names and deduplicate logic
Pull Request -
State: closed - Opened by Naeemkh 4 months ago
- 1 comment
#858 - Recalibrate eval time intervals
Issue -
State: open - Opened by priyakasimbeg 4 months ago
#857 - Jit switch for ogbg
Pull Request -
State: closed - Opened by davidtweedle 4 months ago
- 2 comments
#856 - LM workload - first steps
Pull Request -
State: closed - Opened by Niccolo-Ajroldi 4 months ago
- 3 comments
#855 - Dev -> main
Pull Request -
State: closed - Opened by priyakasimbeg 5 months ago
- 2 comments
#854 - Added test for Evaluating Timing Consistency in MNIST Workload Training for PyTorch and JAX and changed the int32 to uint32
Pull Request -
State: open - Opened by harneet862 5 months ago
- 1 comment
#853 - Optimize Git Hook Configuration
Issue -
State: open - Opened by Naeemkh 5 months ago
#852 - Fix self-tuning submissions hyperparams definition
Pull Request -
State: closed - Opened by Niccolo-Ajroldi 5 months ago
- 2 comments
#851 - Allow self-tuning submissions to specify `dropout_rate` and `aux_dropout_rate`
Pull Request -
State: open - Opened by Niccolo-Ajroldi 5 months ago
- 2 comments
#850 - Fix `prepare_for_eval` usage in self-tuning track
Pull Request -
State: closed - Opened by Niccolo-Ajroldi 5 months ago
- 2 comments
#849 - Update scoring scripts and add slurm batch script
Pull Request -
State: closed - Opened by priyakasimbeg 5 months ago
- 1 comment
#848 - [WIP] Migrate JAX workloads from pmap to jit
Pull Request -
State: open - Opened by priyakasimbeg 5 months ago
- 1 comment
#847 - Dev -> main
Pull Request -
State: closed - Opened by priyakasimbeg 5 months ago
- 1 comment
#846 - Updates in GCP set up
Pull Request -
State: closed - Opened by priyakasimbeg 5 months ago
- 1 comment
#845 - add basic summary of benchmark to beginning of readme
Pull Request -
State: closed - Opened by qpwo 5 months ago
- 5 comments
#844 - fix: frozen dict conversion
Pull Request -
State: closed - Opened by init-22 6 months ago
- 1 comment
#843 - Dev -> main
Pull Request -
State: closed - Opened by priyakasimbeg 6 months ago
- 1 comment
#842 - Improved Documentation for the Rolling Leaderboard
Pull Request -
State: closed - Opened by fsschneider 6 months ago
- 1 comment
#841 - Improved Documentation for the Rolling Leaderboard
Pull Request -
State: closed - Opened by fsschneider 6 months ago
- 1 comment
#840 - Python and package upgrades
Pull Request -
State: closed - Opened by priyakasimbeg 6 months ago
- 1 comment
#839 - isort fixes
Pull Request -
State: closed - Opened by priyakasimbeg 6 months ago
- 1 comment
#838 - Update Runtime Bugets and Step Hints
Pull Request -
State: closed - Opened by fsschneider 6 months ago
- 1 comment
Labels: ๐ AlgoPerf Leaderboard
#837 - DeepSpeech Pytorch: NotImplementedError: DDPOptimizer backend: Found a higher order op in the graph.
Issue -
State: closed - Opened by priyakasimbeg 6 months ago
- 2 comments
#836 - Adjust the Workload's Runtime Budgets
Issue -
State: closed - Opened by fsschneider 6 months ago
- 4 comments
Labels: ๐ท In Progress, ๐ AlgoPerf Leaderboard
#835 - fix: fixing the range of np.int32
Pull Request -
State: closed - Opened by init-22 6 months ago
- 2 comments
#834 - Fixes to random_utils.py
Pull Request -
State: closed - Opened by priyakasimbeg 6 months ago
- 1 comment
#833 - Rename package to `algoperf`
Pull Request -
State: closed - Opened by fsschneider 7 months ago
- 2 comments
#832 - Minor nits
Pull Request -
State: closed - Opened by fsschneider 7 months ago
- 3 comments
#831 - (Automatic) version bump
Pull Request -
State: closed - Opened by fsschneider 7 months ago
- 1 comment
#830 - Switch to `pyproject.toml`
Pull Request -
State: closed - Opened by fsschneider 7 months ago
- 4 comments
#829 - Update Documentation to link to submission repo for rolling leaderboard
Issue -
State: closed - Opened by priyakasimbeg 7 months ago
- 1 comment
Labels: ๐ AlgoPerf Leaderboard
#828 - Removed the sacrebleu dependency
Pull Request -
State: closed - Opened by init-22 7 months ago
- 2 comments
#827 - Update Deprecated Functions
Pull Request -
State: closed - Opened by init-22 7 months ago
- 1 comment
#826 - fix: changing all PRNGKey to key because its going to be deprecated soon
Pull Request -
State: closed - Opened by init-22 7 months ago
- 1 comment
#825 - Dev -> Main
Pull Request -
State: closed - Opened by priyakasimbeg 7 months ago
- 1 comment
#824 - [do not merge] Running regression tests for python upgrades
Pull Request -
State: closed - Opened by priyakasimbeg 7 months ago
- 3 comments
#823 - Fsdp pytorch draft PR
Pull Request -
State: closed - Opened by davidtweedle 7 months ago
- 2 comments
#822 - [WIP] JAX.JIT Switch and Sharding
Pull Request -
State: closed - Opened by rka97 8 months ago
- 3 comments
#821 - fix contrast() transform
Pull Request -
State: open - Opened by EIFY 8 months ago
- 1 comment
#820 - Refactor diffs module to use ModelDiffRunner class
Pull Request -
State: closed - Opened by SujataSaurabh 8 months ago
- 3 comments
#819 - fix pytorch_default_init()
Pull Request -
State: closed - Opened by EIFY 8 months ago
- 4 comments
#818 - Update dev with hotfixes on main
Pull Request -
State: closed - Opened by priyakasimbeg 8 months ago
- 1 comment
#817 - Formatting fixes
Pull Request -
State: closed - Opened by priyakasimbeg 8 months ago
- 1 comment
#816 - Resume from Checkpoint bug: ValueError: The sharded dimension must be equal to the number of devices passed to PmapSharding.
Issue -
State: closed - Opened by init-22 8 months ago
#815 - IndexError: Too many indices: 0-dimensional array indexed with 1 regular index, while migrating from jax.random.PRNGKey to jax.random.key
Issue -
State: closed - Opened by init-22 8 months ago
- 3 comments
#814 - Update README.md
Pull Request -
State: closed - Opened by priyakasimbeg 8 months ago
- 1 comment
#813 - ValueError: pmap was requested to map its argument along axis 0, which implies that its rank should be at least 1, but is only 0 (its shape is ())
Issue -
State: closed - Opened by init-22 8 months ago
- 3 comments
#812 - Dev -> main
Pull Request -
State: closed - Opened by priyakasimbeg 8 months ago
- 1 comment
#811 - Moving from Python3.8 to Python 3.11
Pull Request -
State: closed - Opened by init-22 9 months ago
- 8 comments
#810 - fix: changing the dtype in random_utils to uint32
Pull Request -
State: closed - Opened by init-22 9 months ago
- 3 comments
#809 - Add schedule-free adamw submission in JAX
Issue -
State: open - Opened by priyakasimbeg 9 months ago
- 9 comments
#808 - Clean up train diff tests
Issue -
State: open - Opened by priyakasimbeg 9 months ago
Labels: Good First Issue
#807 - Clean up modeldiff tests
Issue -
State: open - Opened by priyakasimbeg 9 months ago
Labels: Good First Issue
#806 - Feat default dropout in doc
Pull Request -
State: closed - Opened by init-22 9 months ago
- 7 comments
#805 - Upgrade to Python 3.11
Issue -
State: closed - Opened by priyakasimbeg 9 months ago
Labels: ๐ท In Progress, ๐ AlgoPerf Leaderboard
#804 - Workload Title: Decoder only LM
Issue -
State: open - Opened by priyakasimbeg 9 months ago
Labels: โ๏ธ Workload
#803 - Improving package setup to pyproject.toml
Issue -
State: closed - Opened by IFFranciscoME 9 months ago
- 2 comments
Labels: Good First Issue
#802 - Update setup.cfg
Pull Request -
State: closed - Opened by priyakasimbeg 9 months ago
- 1 comment
#801 - TypeError: JAX encountered invalid PRNG key data: expected key_data.dtype = uint32; got dtype=int32
Issue -
State: closed - Opened by init-22 9 months ago
- 6 comments
Labels: Good First Issue
#800 - Dev -> main
Pull Request -
State: closed - Opened by priyakasimbeg 9 months ago
- 1 comment
#799 - Update setup.cfg
Pull Request -
State: closed - Opened by priyakasimbeg 9 months ago
- 1 comment
#798 - BatchNorm fixes for JAX and PyTorch workloads
Pull Request -
State: closed - Opened by priyakasimbeg 10 months ago
- 1 comment
#797 - Support FSDP in JAX workloads
Issue -
State: open - Opened by priyakasimbeg 10 months ago
- 2 comments
Labels: ๐ท In Progress
#796 - Support FSDP in PyTorch
Issue -
State: open - Opened by priyakasimbeg 10 months ago
- 6 comments
Labels: ๐ท In Progress
#795 - BN fixes in JAX
Pull Request -
State: closed - Opened by priyakasimbeg 10 months ago
- 1 comment
#794 - Fixes to script that runs submissions for scoring
Pull Request -
State: closed - Opened by priyakasimbeg 10 months ago
- 1 comment
#793 - Dev -> main
Pull Request -
State: closed - Opened by priyakasimbeg 10 months ago
- 1 comment
#792 - Fix scoring bug in `get_summary_df`
Pull Request -
State: closed - Opened by Niccolo-Ajroldi 10 months ago
- 2 comments
#791 - Scoring logging bug ๐ - incorrect computation of `time to target on val (s)` in `get_summary_df`
Issue -
State: closed - Opened by Niccolo-Ajroldi 10 months ago
- 2 comments
#790 - Pass `train_state `to `update_params`
Pull Request -
State: closed - Opened by Niccolo-Ajroldi 10 months ago
- 1 comment
#789 - Introduce prepare for eval, fix evaluation bug
Pull Request -
State: closed - Opened by Niccolo-Ajroldi 11 months ago
- 4 comments
#788 - Issue 452: Added the assertion for consistency check and evaluation frequency check
Pull Request -
State: closed - Opened by harneet862 11 months ago
- 1 comment
#787 - Add function that submissions can call that can change the dropout value
Issue -
State: closed - Opened by priyakasimbeg 11 months ago
- 1 comment
#786 - Document the default per-workload dropout value
Issue -
State: closed - Opened by priyakasimbeg 11 months ago
- 1 comment
Labels: Good First Issue
#785 - Inform submission about `accumulated_submission_time`
Issue -
State: closed - Opened by Niccolo-Ajroldi 11 months ago
- 2 comments
#784 - Dev -> main
Pull Request -
State: closed - Opened by priyakasimbeg 11 months ago
- 1 comment
#783 - BN Fixes
Pull Request -
State: closed - Opened by adefazio 11 months ago
- 3 comments
#782 - Update readme with results announcement
Pull Request -
State: closed - Opened by fsschneider 11 months ago
- 1 comment
#781 - Dev -> main
Pull Request -
State: closed - Opened by priyakasimbeg 11 months ago
- 1 comment
#780 - Fix scoring bug, properly handeling `nan` values
Pull Request -
State: closed - Opened by fsschneider 11 months ago
- 1 comment
#779 - Added instructions to install Cloud Ops Agent for monitoring
Pull Request -
State: closed - Opened by BharatKatyal 12 months ago
- 2 comments
#778 - Minor fix scoring code & speedup computation
Pull Request -
State: closed - Opened by fsschneider about 1 year ago
- 1 comment
#777 - Dev -> Main
Pull Request -
State: closed - Opened by priyakasimbeg about 1 year ago
- 1 comment
#776 - Scoring: Quality of Life improvements
Pull Request -
State: closed - Opened by fsschneider about 1 year ago
- 2 comments
#775 - Dev -> main
Pull Request -
State: closed - Opened by priyakasimbeg about 1 year ago
- 1 comment
#774 - Scoring updates
Pull Request -
State: closed - Opened by priyakasimbeg about 1 year ago
- 1 comment
#773 - Update results date
Issue -
State: closed - Opened by josejg about 1 year ago
- 2 comments