Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / aai-institute/nnbench issues and pull requests

#68 - Simplify nullcols helper, flatten nested context

Pull Request - State: closed - Opened by nicholasjng 10 months ago

#67 - Add example: Integration with workflow engines

Issue - State: closed - Opened by Maciej818 10 months ago
Labels: documentation

#66 - Add example: Streaming results to a database

Issue - State: closed - Opened by Maciej818 10 months ago - 2 comments
Labels: documentation

#65 - Group context structs under top-level semantic keys

Pull Request - State: closed - Opened by nicholasjng 10 months ago

#64 - Add git info and Python package info providers

Pull Request - State: closed - Opened by nicholasjng 10 months ago - 1 comment
Labels: enhancement

#63 - Add example: Implement benchmarking on saved artifacts

Issue - State: closed - Opened by Maciej818 10 months ago - 1 comment
Labels: documentation

#61 - Fix dev status classifier

Pull Request - State: closed - Opened by nicholasjng 10 months ago

#60 - Final docs changes in preparation for v0.1.0

Pull Request - State: closed - Opened by nicholasjng 10 months ago
Labels: documentation

#59 - Add more default information to benchmark JSON result

Pull Request - State: closed - Opened by nicholasjng 10 months ago
Labels: enhancement

#58 - Check type of parametrized argument to avoid mismatch

Pull Request - State: closed - Opened by nicholasjng 10 months ago - 1 comment

#57 - Add customization user guide

Pull Request - State: closed - Opened by nicholasjng 10 months ago
Labels: documentation

#56 - Add some default context values and benchmark metadata

Issue - State: closed - Opened by nicholasjng 10 months ago - 1 comment
Labels: enhancement

#55 - Add benchmark runners user guide

Pull Request - State: closed - Opened by maxmynter 10 months ago - 1 comment
Labels: documentation

#54 - Add test coverage

Pull Request - State: closed - Opened by maxmynter 10 months ago
Labels: tests

#53 - Finalize names

Pull Request - State: closed - Opened by maxmynter 10 months ago

#52 - Define and Implement abstract `BenchmarkReporter` Interface.

Pull Request - State: closed - Opened by maxmynter 10 months ago

#51 - Add namegen argument to `@nnbench.{parametrize,product}`

Pull Request - State: closed - Opened by nicholasjng 10 months ago - 2 comments

#50 - Add test coverage for nnbench core abstractions

Issue - State: closed - Opened by nicholasjng 10 months ago
Labels: urgent, tests

#49 - Finalize names of user-facing abstract classes

Issue - State: closed - Opened by nicholasjng 10 months ago
Labels: good first issue, urgent

#48 - Add flexible base reporters for file IO, web, and DBs

Issue - State: open - Opened by nicholasjng 10 months ago - 3 comments
Labels: enhancement

#47 - Define abstract `BenchmarkReporter` interface

Issue - State: closed - Opened by nicholasjng 10 months ago
Labels: enhancement, urgent

#46 - Remove the test PyPI job entirely

Pull Request - State: closed - Opened by nicholasjng 10 months ago

#45 - Add Streamlit integration Example for `nnbench`

Issue - State: closed - Opened by maxmynter 10 months ago
Labels: documentation

#44 - Remove test PyPI job

Pull Request - State: closed - Opened by nicholasjng 10 months ago

#43 - Make first argument to `@nnbench.parametrize` a single iterable

Pull Request - State: closed - Opened by nicholasjng 10 months ago - 1 comment

#42 - Add missing triple quotes to start code block

Pull Request - State: closed - Opened by maxmynter 10 months ago

#41 - Fix benchmark user guide formatting

Pull Request - State: closed - Opened by maxmynter 10 months ago

#40 - Add `namegen` argument to `@nnbench.{parametrize,product}`

Issue - State: closed - Opened by nicholasjng 10 months ago
Labels: enhancement, good first issue

#39 - Add benchmark organization guide

Pull Request - State: closed - Opened by nicholasjng 10 months ago
Labels: documentation

#38 - Add user guide: Runners

Issue - State: closed - Opened by Maciej818 10 months ago
Labels: documentation

#37 - Add user guide: Reporters usage, streaming, creating custom ones, registering

Issue - State: closed - Opened by Maciej818 10 months ago - 1 comment
Labels: documentation

#36 - Benchmark-user-guide

Pull Request - State: closed - Opened by maxmynter 10 months ago

#34 - Add user guide: Defining and parametrizing benchmarks by applying decorators

Issue - State: closed - Opened by Maciej818 10 months ago - 2 comments
Labels: documentation, urgent

#32 - Add user guide: Best practices on modularizing benchmark code

Issue - State: closed - Opened by Maciej818 10 months ago
Labels: documentation, urgent

#31 - Add user guide: Defining and parametrizing benchmarks by applying decorators

Issue - State: closed - Opened by Maciej818 10 months ago - 1 comment
Labels: documentation, urgent

#30 - Emergency fixes in preparation for the MNIST example

Pull Request - State: closed - Opened by nicholasjng 10 months ago
Labels: urgent

#29 - Fix tag check in collection

Pull Request - State: closed - Opened by maxmynter 10 months ago

#28 - [umbrella ticket] Add more examples to showcase different applications of the project

Issue - State: closed - Opened by nicholasjng 10 months ago - 1 comment
Labels: documentation

#27 - Add user guides on various topics to documentation

Issue - State: closed - Opened by nicholasjng 10 months ago - 1 comment
Labels: documentation, urgent

#26 - Rename `AbstractBenchmarkRunner->BenchmarkRunner`

Pull Request - State: closed - Opened by nicholasjng 10 months ago

#25 - Add usage example to README.md

Pull Request - State: closed - Opened by maxmynter 10 months ago

#24 - Rethink reporter concept

Issue - State: closed - Opened by nicholasjng 10 months ago - 3 comments

#23 - Reorganize test directory structure

Pull Request - State: closed - Opened by maxmynter 10 months ago - 1 comment

#22 - Refactor and improve combined interface check

Pull Request - State: closed - Opened by nicholasjng 10 months ago

#21 - Add parameter<->interface check to `nnbench.parametrize`

Pull Request - State: closed - Opened by nicholasjng 10 months ago

#20 - Add interface class member to Benchmark class

Pull Request - State: closed - Opened by maxmynter 10 months ago - 1 comment

#19 - Add warning for supplied and default parameter collision

Pull Request - State: closed - Opened by maxmynter 10 months ago

#18 - Handle untyped interfaces in `_check`

Pull Request - State: closed - Opened by maxmynter 10 months ago - 3 comments

#17 - Add a usage example explaining nnbench to the new comers

Issue - State: closed - Opened by Maciej818 10 months ago - 2 comments

#16 - Add cartesian product decorator for benchmarks

Pull Request - State: closed - Opened by nicholasjng 10 months ago - 1 comment

#15 - Remove benchmark `params` slot, type core decorators

Pull Request - State: closed - Opened by nicholasjng 10 months ago - 1 comment

#14 - Refactor context values to be dicts

Pull Request - State: closed - Opened by nicholasjng 10 months ago

#13 - Improve test directory organization

Issue - State: closed - Opened by nicholasjng 10 months ago

#12 - Add Interface-checks

Pull Request - State: closed - Opened by maxmynter 10 months ago

#11 - Add MNIST example

Pull Request - State: closed - Opened by nicholasjng 10 months ago
Labels: documentation

#10 - Add reporter entrypoint

Pull Request - State: closed - Opened by nicholasjng 10 months ago

#7 - Add barebones Artifact abstraction

Pull Request - State: closed - Opened by nicholasjng 11 months ago

#6 - Add a tabular ostream reporter class

Issue - State: closed - Opened by nicholasjng 11 months ago
Labels: urgent

#5 - Add cartesian product decorator

Issue - State: closed - Opened by nicholasjng 11 months ago

#4 - Re-evaluate `Benchmarkable` vs. `Benchmark` split for polymorphism

Issue - State: closed - Opened by nicholasjng 11 months ago - 1 comment
Labels: not urgent

#3 - Save benchmark function interface, validate parameters

Issue - State: closed - Opened by nicholasjng 11 months ago

#2 - Add barebones user documentation

Pull Request - State: closed - Opened by nicholasjng 11 months ago

#1 - Add `Artifact` class (and specialisations for models, datasets etc.)

Issue - State: closed - Opened by nicholasjng 11 months ago
Labels: enhancement, urgent