aai-institute/nnbench issues and pull requests

#45 - Add Streamlit integration Example for `nnbench`

Issue - State: closed - Opened by maxmynter 8 months ago
Labels: documentation

#44 - Remove test PyPI job

Pull Request - State: closed - Opened by nicholasjng 8 months ago

#43 - Make first argument to `@nnbench.parametrize` a single iterable

Pull Request - State: closed - Opened by nicholasjng 8 months ago - 1 comment

#42 - Add missing triple quotes to start code block

Pull Request - State: closed - Opened by maxmynter 8 months ago

#41 - Fix benchmark user guide formatting

Pull Request - State: closed - Opened by maxmynter 8 months ago

#40 - Add `namegen` argument to `@nnbench.{parametrize,product}`

Issue - State: closed - Opened by nicholasjng 8 months ago
Labels: enhancement, good first issue

#39 - Add benchmark organization guide

Pull Request - State: closed - Opened by nicholasjng 8 months ago
Labels: documentation

#38 - Add user guide: Runners

Issue - State: closed - Opened by Maciej818 8 months ago
Labels: documentation

#37 - Add user guide: Reporters usage, streaming, creating custom ones, registering

Issue - State: closed - Opened by Maciej818 8 months ago - 1 comment
Labels: documentation

#36 - Benchmark-user-guide

Pull Request - State: closed - Opened by maxmynter 8 months ago

#35 - Add user guide: Examples of customizing benchmarks and user-defined `nnbench.Parameters` for type safety

Issue - State: closed - Opened by Maciej818 8 months ago
Labels: documentation, urgent

#34 - Add user guide: Defining and parametrizing benchmarks by applying decorators

Issue - State: closed - Opened by Maciej818 8 months ago - 2 comments
Labels: documentation, urgent

#33 - Defining and parametrizing benchmarks by applying decorators (`@benchmark,@parametrize,@product)` - motivation, behavior, and one usage example for each.

Issue - State: closed - Opened by Maciej818 8 months ago - 3 comments
Labels: duplicate

#32 - Add user guide: Best practices on modularizing benchmark code

Issue - State: closed - Opened by Maciej818 8 months ago
Labels: documentation, urgent

#31 - Add user guide: Defining and parametrizing benchmarks by applying decorators

Issue - State: closed - Opened by Maciej818 8 months ago - 1 comment
Labels: documentation, urgent

#30 - Emergency fixes in preparation for the MNIST example

Pull Request - State: closed - Opened by nicholasjng 8 months ago
Labels: urgent

#29 - Fix tag check in collection

Pull Request - State: closed - Opened by maxmynter 8 months ago

#28 - [umbrella ticket] Add more examples to showcase different applications of the project

Issue - State: closed - Opened by nicholasjng 8 months ago - 1 comment
Labels: documentation

#27 - Add user guides on various topics to documentation

Issue - State: closed - Opened by nicholasjng 8 months ago - 1 comment
Labels: documentation, urgent

#26 - Rename `AbstractBenchmarkRunner->BenchmarkRunner`

Pull Request - State: closed - Opened by nicholasjng 8 months ago

#25 - Add usage example to README.md

Pull Request - State: closed - Opened by maxmynter 8 months ago

#24 - Rethink reporter concept

Issue - State: closed - Opened by nicholasjng 8 months ago - 3 comments

#23 - Reorganize test directory structure

Pull Request - State: closed - Opened by maxmynter 8 months ago - 1 comment

#22 - Refactor and improve combined interface check

Pull Request - State: closed - Opened by nicholasjng 8 months ago

#21 - Add parameter<->interface check to `nnbench.parametrize`

Pull Request - State: closed - Opened by nicholasjng 8 months ago

#20 - Add interface class member to Benchmark class

Pull Request - State: closed - Opened by maxmynter 8 months ago - 1 comment

#19 - Add warning for supplied and default parameter collision

Pull Request - State: closed - Opened by maxmynter 8 months ago

#18 - Handle untyped interfaces in `_check`

Pull Request - State: closed - Opened by maxmynter 8 months ago - 3 comments

#17 - Add a usage example explaining nnbench to the new comers

Issue - State: closed - Opened by Maciej818 8 months ago - 2 comments

#16 - Add cartesian product decorator for benchmarks

Pull Request - State: closed - Opened by nicholasjng 8 months ago - 1 comment

#15 - Remove benchmark `params` slot, type core decorators

Pull Request - State: closed - Opened by nicholasjng 8 months ago - 1 comment

#14 - Refactor context values to be dicts

Pull Request - State: closed - Opened by nicholasjng 8 months ago

#13 - Improve test directory organization

Issue - State: closed - Opened by nicholasjng 8 months ago

#12 - Add Interface-checks

Pull Request - State: closed - Opened by maxmynter 8 months ago

#11 - Add MNIST example

Pull Request - State: closed - Opened by nicholasjng 8 months ago
Labels: documentation

#10 - Add reporter entrypoint

Pull Request - State: closed - Opened by nicholasjng 8 months ago

#9 - Provide an importlib entry point for registering custom reporters

Issue - State: closed - Opened by nicholasjng 8 months ago

#8 - Add `nnbench.reporter` module, first tabular console implementation

Pull Request - State: closed - Opened by nicholasjng 8 months ago

#7 - Add barebones Artifact abstraction

Pull Request - State: closed - Opened by nicholasjng 8 months ago

#6 - Add a tabular ostream reporter class

Issue - State: closed - Opened by nicholasjng 8 months ago
Labels: urgent

#5 - Add cartesian product decorator

Issue - State: closed - Opened by nicholasjng 8 months ago

#4 - Re-evaluate `Benchmarkable` vs. `Benchmark` split for polymorphism

Issue - State: closed - Opened by nicholasjng 8 months ago - 1 comment
Labels: not urgent

#3 - Save benchmark function interface, validate parameters

Issue - State: closed - Opened by nicholasjng 8 months ago

#2 - Add barebones user documentation

Pull Request - State: closed - Opened by nicholasjng 8 months ago

#1 - Add `Artifact` class (and specialisations for models, datasets etc.)

Issue - State: closed - Opened by nicholasjng 8 months ago
Labels: enhancement, urgent

GitHub / aai-institute/nnbench issues and pull requests