Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / aai-institute/nnbench issues and pull requests
#168 - Some tweaks related to context ingestion
Pull Request -
State: open - Opened by nicholasjng 10 days ago
#167 - Inline boolean option pairs, change subcommand section
Pull Request -
State: closed - Opened by nicholasjng 10 days ago
#166 - Add --version switch to print version
Pull Request -
State: closed - Opened by nicholasjng 11 days ago
#165 - Refactor console reporter
Pull Request -
State: closed - Opened by nicholasjng 11 days ago
- 1 comment
#164 - Add `nnbench compare` subcommand, comparison function
Pull Request -
State: closed - Opened by nicholasjng 12 days ago
- 2 comments
#163 - Remove compression, support file reporting and context passing on the command line
Pull Request -
State: closed - Opened by nicholasjng 17 days ago
#162 - Add `Benchmark.to_list()` and `to_json()` to improve record IO
Pull Request -
State: closed - Opened by nicholasjng 17 days ago
#161 - Remove transform facility and examples
Pull Request -
State: closed - Opened by nicholasjng 19 days ago
#160 - Remove context processing options
Pull Request -
State: closed - Opened by nicholasjng 19 days ago
#159 - Configure certain classes with files for the command line case
Issue -
State: open - Opened by nicholasjng 19 days ago
#158 - Support greedy / immediate result reporting
Issue -
State: open - Opened by nicholasjng 19 days ago
#157 - Implement URI scheme for command-line (and SDK) IO
Issue -
State: open - Opened by nicholasjng 19 days ago
Labels: enhancement
#156 - Remove setuptools_scm in favor of explicit version management
Pull Request -
State: closed - Opened by nicholasjng about 1 month ago
- 1 comment
#155 - Add Python 3.13 tests to CI
Pull Request -
State: closed - Opened by nicholasjng about 1 month ago
- 2 comments
#154 - refactor: Remove context class, back to raw dictionaries
Pull Request -
State: closed - Opened by nicholasjng about 1 month ago
#153 - Run pre-commit autoupdate
Pull Request -
State: closed - Opened by nicholasjng about 1 month ago
#152 - Add CLI entrypoints for module and program invocation
Pull Request -
State: closed - Opened by nicholasjng about 1 month ago
- 1 comment
#151 - Better support for CLI / script usage
Issue -
State: open - Opened by nicholasjng about 1 month ago
#150 - Remove unused io module stub
Pull Request -
State: closed - Opened by nicholasjng about 1 month ago
#149 - Remove requirement files, strict version pins from examples
Pull Request -
State: closed - Opened by nicholasjng about 2 months ago
- 1 comment
#148 - Switch project to uv lockfile
Pull Request -
State: closed - Opened by nicholasjng about 2 months ago
#147 - Bump oldest supported Python to 3.10
Pull Request -
State: closed - Opened by nicholasjng about 2 months ago
#146 - Safe setting of CPU Info
Pull Request -
State: closed - Opened by maxmynter 4 months ago
#145 - macOS test failure due to GitHub Apple Silicon oddities
Issue -
State: closed - Opened by maxmynter 4 months ago
#144 - Add nnbench video to readme
Pull Request -
State: closed - Opened by maxmynter 4 months ago
- 1 comment
#143 - Explore a CLI workflow for usage in ML pipelines and CI
Issue -
State: closed - Opened by nicholasjng 8 months ago
Labels: enhancement, help wanted
#142 - Stabilize the record IO interface
Issue -
State: closed - Opened by nicholasjng 8 months ago
Labels: help wanted, refactor
#141 - Add small parameter representation guide for the benchmark runner
Issue -
State: open - Opened by nicholasjng 8 months ago
Labels: documentation, enhancement
#140 - Add `transform` slot to record IO types
Issue -
State: open - Opened by nicholasjng 8 months ago
Labels: enhancement, refactor
#139 - (fix) Change default == value to is
Pull Request -
State: closed - Opened by maxmynter 8 months ago
#138 - Investigate binding params to benchmarks with weakrefs
Issue -
State: open - Opened by nicholasjng 8 months ago
Labels: enhancement
#137 - Implement memo garbage collection
Pull Request -
State: closed - Opened by nicholasjng 8 months ago
Labels: enhancement
#136 - Update dev requirements, add Memray artifacts to gitignore
Pull Request -
State: closed - Opened by nicholasjng 8 months ago
#135 - Organize `nnbench.types.types` into different files
Pull Request -
State: closed - Opened by maxmynter 8 months ago
#134 - Add memo followups to the user guide
Issue -
State: closed - Opened by nicholasjng 8 months ago
Labels: documentation
#133 - Update HuggingFace example to use memoization
Pull Request -
State: closed - Opened by nicholasjng 8 months ago
Labels: documentation
#132 - Hint all `name` arguments as `str` only
Issue -
State: closed - Opened by nicholasjng 8 months ago
- 1 comment
Labels: refactor
#131 - Supplying `nnbench.Transform`s directly to record IO
Issue -
State: open - Opened by nicholasjng 8 months ago
Labels: enhancement, refactor
#130 - Add global memo cache and integrate with the setUp and teardown injection
Pull Request -
State: closed - Opened by maxmynter 8 months ago
- 1 comment
#129 - Add new memoization guide
Pull Request -
State: closed - Opened by nicholasjng 8 months ago
- 1 comment
Labels: documentation
#128 - Update Artifact Tutorial
Issue -
State: closed - Opened by Maciej818 8 months ago
#127 - State injection into setup and teardown
Pull Request -
State: closed - Opened by maxmynter 8 months ago
#126 - Add global memo cache and eviction API
Issue -
State: closed - Opened by nicholasjng 8 months ago
Labels: enhancement
#125 - Add `nnbench.State` object holding current benchmark information, inject into setup/teardown tasks
Issue -
State: closed - Opened by nicholasjng 8 months ago
Labels: enhancement
#124 - Add transform submodule, parameter compression transform
Pull Request -
State: closed - Opened by nicholasjng 8 months ago
Labels: documentation, refactor
#123 - Rollforward of lakefs-spec doc changes
Pull Request -
State: closed - Opened by nicholasjng 8 months ago
#122 - Parameter representations instead of parameters in benchmark records
Issue -
State: closed - Opened by nicholasjng 8 months ago
- 3 comments
Labels: urgent, refactor
#121 - Enhance API Reference Documentation for nnbench
Issue -
State: closed - Opened by leonpawelzik 8 months ago
- 1 comment
Labels: documentation, enhancement
#120 - Feature: Thunks as an alternative to artifacts
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
Labels: refactor
#119 - Check loaded module names before importing a new one from a file
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
- 1 comment
#118 - Make `Transform` an abstract base class, delete iapply method ...
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
Labels: refactor
#117 - Improve base `Transform` interface
Issue -
State: closed - Opened by nicholasjng 9 months ago
Labels: refactor
#116 - `functools.partial`ize the `nnbench.parametrize` decorators.
Pull Request -
State: closed - Opened by maxmynter 9 months ago
- 1 comment
#115 - Module path construction causes typecheck fails
Issue -
State: closed - Opened by nicholasjng 9 months ago
Labels: bug
#114 - Redesign artifact concept
Issue -
State: closed - Opened by nicholasjng 9 months ago
- 1 comment
#113 - Add transform proposal
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
- 1 comment
#112 - Unique keys
Pull Request -
State: closed - Opened by maxmynter 9 months ago
#111 - Inline the `_cleanup` function for the `FilePathArtifactLoader`.
Pull Request -
State: closed - Opened by maxmynter 9 months ago
- 2 comments
#110 - Add checksum verification to artifacts and loaders
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
- 3 comments
#109 - Remove the `ArtifactCollection` class
Pull Request -
State: closed - Opened by maxmynter 9 months ago
#108 - Remove `ArtifactCollection` Wrapper
Issue -
State: closed - Opened by maxmynter 9 months ago
#107 - Add Artifacts guide
Pull Request -
State: closed - Opened by maxmynter 9 months ago
#106 - Docs: Versioning considerations
Issue -
State: open - Opened by AdrianoKF 9 months ago
Labels: documentation, enhancement
#105 - Set up best practice for easy record serialization + parametrization + reproducibility
Issue -
State: closed - Opened by nicholasjng 9 months ago
- 1 comment
Labels: urgent
#104 - Run pre-commit autoupdate, bump dependencies
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
#103 - Add Parameters to Benchmarks
Pull Request -
State: closed - Opened by maxmynter 9 months ago
#102 - Hotfix: Adjust snippet paths
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
- 1 comment
Labels: documentation
#101 - Benchmark results do not contain parameters
Issue -
State: closed - Opened by nicholasjng 9 months ago
Labels: good first issue, urgent
#100 - Implement a FSspec based ArtifactLoader
Pull Request -
State: closed - Opened by maxmynter 9 months ago
#99 - Improve ensure unique keys in `Contexts` upon merge.
Issue -
State: closed - Opened by maxmynter 9 months ago
#98 - Add a lightning demo to the README.md
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
- 3 comments
#97 - Add common ArtifactLoaders to make nnbench provide them out of the box
Issue -
State: closed - Opened by maxmynter 9 months ago
- 1 comment
#96 - Make `nnbench.parametrize` work with `functools.partial`
Issue -
State: closed - Opened by maxmynter 9 months ago
Labels: enhancement
#95 - User guide: benchmarking on saved artifacts
Issue -
State: closed - Opened by Maciej818 9 months ago
#94 - Implement fsspec artifact loader for nnbench
Issue -
State: closed - Opened by Maciej818 9 months ago
#93 - Run `pre-commit autoupdate`, upgrade requirement lockfiles
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
#92 - Example Guide: Benchmark on Saved Models
Pull Request -
State: closed - Opened by maxmynter 9 months ago
- 2 comments
#91 - Add duckDB example
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
- 1 comment
Labels: documentation
#90 - Restructure test suite and add file IO roundtrip tests
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
- 1 comment
Labels: tests
#89 - Switch author and maintainer description in example .toml's
Pull Request -
State: closed - Opened by maxmynter 9 months ago
#88 - Revert file extension coercion, add raise statement for missing driver
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
#87 - Add parquet, ndjson drivers, change registration mechanisms
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
#86 - Streaming results to a database: verify SQL model, decide on what API to go forward
Issue -
State: closed - Opened by Maciej818 9 months ago
- 2 comments
#85 - Add BQ example to showcase cloud streaming of benchmark records
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
Labels: documentation
#84 - Add compression algorithms facility to file IO
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
Labels: enhancement
#83 - Unify batching in file drivers, remove read/write stubs on base reporter
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
Labels: refactor
#82 - Improve file drivers, add dict roundtrip methods to `BenchmarkRecord`
Pull Request -
State: closed - Opened by nicholasjng 9 months ago
#81 - Streamlit Integration
Pull Request -
State: closed - Opened by maxmynter 10 months ago
- 1 comment
#80 - Support compression for file reading and writing
Issue -
State: closed - Opened by nicholasjng 10 months ago
Labels: enhancement
#79 - Add BenchmarkContext Class
Pull Request -
State: closed - Opened by maxmynter 10 months ago
#78 - Feature/file reporter
Pull Request -
State: open - Opened by Hrsj123 10 months ago
- 2 comments
#77 - Improve some aspects on benchmark reporters
Pull Request -
State: closed - Opened by nicholasjng 10 months ago
#76 - Inline console reporter into BenchmarkReporter.display()
Pull Request -
State: closed - Opened by nicholasjng 10 months ago
- 1 comment
#75 - Add barebones duckDB reporter
Pull Request -
State: closed - Opened by nicholasjng 10 months ago
#74 - Added IOMixin for reporter
Pull Request -
State: open - Opened by Hrsj123 10 months ago
- 2 comments
#73 - Orchestrator examples
Pull Request -
State: closed - Opened by maxmynter 10 months ago
#72 - Add proper `Context` object, manipulation methods
Issue -
State: closed - Opened by nicholasjng 10 months ago
- 1 comment
#71 - Change `nnbench.reporter` file to submodule, add base reporter
Pull Request -
State: closed - Opened by nicholasjng 10 months ago
- 1 comment
#70 - Fix runner collection by checking file path first
Pull Request -
State: closed - Opened by nicholasjng 10 months ago
#69 - Benchmark discovery fails if "./" is not prepended to a relative path
Issue -
State: closed - Opened by nicholasjng 10 months ago
Labels: bug, urgent