openml/automlbenchmark issues and pull requests

#686 - Tiny bug : oml_id must be an int in load_openml_task

Pull Request - State: closed - Opened by SubhadityaMukherjee 30 days ago - 1 comment

#685 - Error when frameworks installation script fails

Pull Request - State: open - Opened by PGijsbers about 1 month ago - 2 comments

#684 - `config_load` should error (by default) instead if file is not found

Issue - State: open - Opened by PGijsbers about 1 month ago
Labels: enhancement

#683 - Enh/error on timeout

Pull Request - State: open - Opened by PGijsbers about 1 month ago - 1 comment

#682 - Adopt modern syntax for setting env variables

Pull Request - State: closed - Opened by PGijsbers about 1 month ago - 1 comment
Labels: enhancement

#681 - Program continues after setup fails

Issue - State: open - Opened by PGijsbers about 2 months ago
Labels: bug

#680 - Run CI on master

Pull Request - State: closed - Opened by PGijsbers about 2 months ago - 1 comment
Labels: automation

#679 - Remove TODOs from the code base, use issue tracker instead

Pull Request - State: closed - Opened by PGijsbers about 2 months ago - 1 comment

#678 - Add cleanup functionality for container runner

Issue - State: open - Opened by PGijsbers about 2 months ago - 1 comment
Labels: enhancement

#677 - Support providing OpenML datasets in other file formats

Issue - State: open - Opened by PGijsbers about 2 months ago
Labels: enhancement

#676 - Support auto-splits for file datasets

Issue - State: open - Opened by PGijsbers about 2 months ago
Labels: enhancement

#675 - Have a closer look at the usage of `features` for FileDatasets

Issue - State: open - Opened by PGijsbers about 2 months ago
Labels: quality

#674 - Support `missing_policy="mask"` on inverse transform

Issue - State: open - Opened by PGijsbers about 2 months ago
Labels: enhancement

#673 - [opt] Allow returning data when re-ordering data and storing it to disk

Issue - State: open - Opened by PGijsbers about 2 months ago
Labels: enhancement

#672 - Check if stream is already closed

Pull Request - State: open - Opened by PGijsbers about 2 months ago - 1 comment

#671 - Upload CodeCov BASE report

Issue - State: closed - Opened by PGijsbers about 2 months ago
Labels: automation

#670 - Quote mount paths to allow presence of whitespace

Pull Request - State: open - Opened by PGijsbers about 2 months ago - 1 comment

#669 - Add non-interactive mode when building images

Issue - State: open - Opened by PGijsbers about 2 months ago
Labels: enhancement

#668 - Simplify and test container image names

Pull Request - State: closed - Opened by PGijsbers about 2 months ago - 1 comment

#667 - Separate out framework def as dataclass

Pull Request - State: closed - Opened by PGijsbers about 2 months ago - 1 comment
Labels: enhancement

#666 - Add bug report template and helper

Issue - State: open - Opened by PGijsbers about 2 months ago
Labels: enhancement

#665 - Ruff formatting

Pull Request - State: closed - Opened by PGijsbers about 2 months ago - 4 comments

#664 - bug: Error with logging

Issue - State: open - Opened by eddiebergman about 2 months ago - 12 comments
Labels: bug

#662 - Autosklearn Issue could not convert string to float

Issue - State: open - Opened by annawiewer 2 months ago - 3 comments
Labels: framework

#661 - AutoGluon v1.2 fails

Issue - State: open - Opened by PGijsbers 2 months ago - 10 comments
Labels: bug, framework

#660 - Disallow use of Pickle since numpy versions diverge

Pull Request - State: closed - Opened by PGijsbers 2 months ago - 2 comments

#659 - Remove from_config and only keep from_configs

Pull Request - State: closed - Opened by PGijsbers 2 months ago - 4 comments

#658 - Refactor

Pull Request - State: open - Opened by PGijsbers 2 months ago - 1 comment

#657 - remove breakpoints

Pull Request - State: closed - Opened by PGijsbers 2 months ago - 1 comment

#656 - Add test that runs benchmark locally

Pull Request - State: closed - Opened by PGijsbers 2 months ago - 1 comment
Labels: tests

#655 - Add code coverage to CI

Pull Request - State: closed - Opened by PGijsbers 2 months ago - 2 comments
Labels: automation

#654 - Add pre-commit hook with ruff

Pull Request - State: closed - Opened by PGijsbers 2 months ago
Labels: automation

#653 - Do away with strict version requirements for mainline?

Issue - State: open - Opened by PGijsbers 2 months ago
Labels: enhancement, question, Benchmark Design

#652 - Can't launch FEDOT framework in Linux (Ubuntu 20.04.3 LTS)

Issue - State: open - Opened by dmitryglhf 2 months ago - 2 comments
Labels: bug

#651 - No module named 'dask.compatibility' for autogluon docker image

Issue - State: open - Opened by SubhadityaMukherjee 2 months ago - 4 comments
Labels: question

#650 - Add tests for OpenML benchmark definitions

Pull Request - State: closed - Opened by PGijsbers 2 months ago

#649 - Add hack that allows specifying the user directory as git

Pull Request - State: open - Opened by PGijsbers 3 months ago - 2 comments
Labels: enhancement

#648 - Integration of Ludwig and TabPFN

Issue - State: open - Opened by annawiewer 3 months ago - 3 comments
Labels: framework add

#647 - Make output artifacts live in the task hierarchy they were produced in

Issue - State: open - Opened by Innixma 3 months ago - 3 comments
Labels: enhancement

#646 - Docs/fix

Pull Request - State: closed - Opened by PGijsbers 3 months ago

#645 - User Guide missing

Issue - State: closed - Opened by PGijsbers 3 months ago - 1 comment
Labels: bug, Documentation

#644 - Add jobhistory argument to runbenchmark.py

Pull Request - State: closed - Opened by Innixma 3 months ago - 1 comment

#643 - Update AutoGluon to use uv during setup.sh

Pull Request - State: closed - Opened by Innixma 3 months ago

#642 - Defaults to improve framework integration setup

Issue - State: open - Opened by PGijsbers 4 months ago - 1 comment
Labels: enhancement

#641 - Add PerpetualBooster

Issue - State: open - Opened by deadsoul44 4 months ago - 10 comments

#640 - Bug: AttributeError: 'MultiIndex' object has no attribute '_data'

Issue - State: closed - Opened by DRMPN 5 months ago - 4 comments

#639 - Add generic callback configuration logic

Pull Request - State: closed - Opened by PGijsbers 5 months ago - 1 comment

#638 - Early stopping for AG and inference time enabled for FEDOT

Pull Request - State: closed - Opened by israel-cj 5 months ago - 1 comment

#637 - Drop usage of ARFF files in favor of parquet

Issue - State: open - Opened by PGijsbers 5 months ago
Labels: enhancement, data

#636 - Add type annotation for benchmark parser module

Pull Request - State: closed - Opened by PGijsbers 5 months ago

#635 - Set up `ruff`

Issue - State: closed - Opened by PGijsbers 5 months ago - 1 comment
Labels: automation

#634 - Add type annotations for data module

Pull Request - State: closed - Opened by PGijsbers 5 months ago
Labels: quality

#633 - Future Annotation Improvements

Issue - State: open - Opened by PGijsbers 5 months ago - 1 comment
Labels: quality

#632 - Typehint

Pull Request - State: closed - Opened by PGijsbers 5 months ago
Labels: quality

#631 - [AutoGluon] Added Support for Learning Curve Artifacts

Pull Request - State: closed - Opened by adibiasio 5 months ago - 5 comments

#630 - Add SapientML to automl benchmark

Pull Request - State: closed - Opened by kimusaku 6 months ago - 3 comments
Labels: framework add

#629 - Add CI to periodically check whether frameworks install and run

Pull Request - State: closed - Opened by PGijsbers 7 months ago - 1 comment
Labels: automation, WIP

#628 - Minor modification on plotting notebook

Pull Request - State: closed - Opened by liam-sbhoo 7 months ago

#627 - Update the GAMA repository location

Pull Request - State: closed - Opened by PGijsbers 8 months ago - 1 comment
Labels: framework

#626 - Fix FLAML installation problems, support version >=2

Pull Request - State: closed - Opened by PGijsbers 8 months ago - 1 comment
Labels: bug, framework

#625 - Fix code annotation and admonition

Pull Request - State: closed - Opened by PGijsbers 8 months ago

#624 - Add a page with some notes on reproducibility

Pull Request - State: closed - Opened by PGijsbers 8 months ago
Labels: Documentation

#623 - 'NoResultError' raised by FLAML Framework During Benchmark Execution

Issue - State: closed - Opened by tomsz92161 8 months ago - 5 comments
Labels: bug

#622 - Quote paths in docker invocation

Issue - State: open - Opened by juliocartier 8 months ago - 4 comments
Labels: bug

#620 - How can we view training data results?

Issue - State: closed - Opened by fathollahzadeh 8 months ago - 1 comment

#619 - Issue #356, Default Telemetry (Off)

Pull Request - State: closed - Opened by mcnojo 9 months ago - 1 comment

#618 - Website/generator

Pull Request - State: closed - Opened by PGijsbers 10 months ago - 1 comment
Labels: Documentation, automation

#617 - Update references to include JMLR on the main website

Pull Request - State: closed - Opened by PGijsbers 10 months ago
Labels: Documentation

#616 - Add contribution page to mobile website

Issue - State: open - Opened by PGijsbers 10 months ago - 1 comment
Labels: Documentation

#615 - Fix tail exception when from_line=None

Pull Request - State: closed - Opened by Innixma 10 months ago

#614 - Update for publication

Pull Request - State: closed - Opened by PGijsbers 10 months ago
Labels: Documentation

#613 - reporting and visualizing the results

Issue - State: open - Opened by ilhembekkr 11 months ago - 1 comment

#612 - Add overhead_time_multiplier as a configurable option

Pull Request - State: closed - Opened by Innixma 11 months ago

#611 - Add time series forecasting support

Pull Request - State: closed - Opened by Lopa10ko 11 months ago - 8 comments

#610 - Time series forecasting support for FEDOT

Issue - State: closed - Opened by Lopa10ko 11 months ago - 4 comments
Labels: enhancement, framework

#609 - Error while installing autogluon-tabular[skex]

Issue - State: open - Opened by liam-sbhoo 11 months ago - 4 comments
Labels: bug, framework, external

#607 - Broken link (interactive visualization tool)

Issue - State: closed - Opened by CarachinoAlessio about 1 year ago - 2 comments

#605 - Add 30, 10, and 5 minute constraints

Pull Request - State: open - Opened by Innixma about 1 year ago - 1 comment

#604 - Update AutoGluon to 1.0 API

Pull Request - State: closed - Opened by Innixma about 1 year ago

#601 - Add optional dependencies

Issue - State: open - Opened by PGijsbers over 1 year ago
Labels: enhancement, dependencies

#600 - Fix minor bugs in time series forecasting

Pull Request - State: closed - Opened by shchur over 1 year ago

#599 - More detailed results from the paper

Issue - State: closed - Opened by sedol1339 over 1 year ago - 1 comment
Labels: question

#598 - Multiple predictions in a single exec.py

Issue - State: closed - Opened by sedol1339 over 1 year ago - 2 comments
Labels: question

#597 - Add contribution guide

Pull Request - State: closed - Opened by PGijsbers over 1 year ago
Labels: Documentation

#596 - Example "Stacking" is not working

Issue - State: closed - Opened by sedol1339 over 1 year ago - 2 comments

#595 - Does H2OAutoML run in venv?

Issue - State: closed - Opened by sedol1339 over 1 year ago - 2 comments
Labels: question

#594 - Update Stacking example to work out of the box on Python 3.9

Pull Request - State: closed - Opened by PGijsbers over 1 year ago
Labels: bug, Documentation

#593 - Error with custom framework

Issue - State: closed - Opened by sedol1339 over 1 year ago - 7 comments
Labels: bug, Documentation

#592 - Any documentation on OpenmlDataset and TaskConfig?

Issue - State: open - Opened by sedol1339 over 1 year ago - 2 comments

#591 - Benchmark name "amlb.yaml" causes error.

Issue - State: closed - Opened by sedol1339 over 1 year ago - 2 comments
Labels: question

#590 - Add redirect pages to easier redirect traffic after publication

Pull Request - State: closed - Opened by PGijsbers over 1 year ago
Labels: website

#589 - Make AMLB pip installable

Issue - State: open - Opened by PGijsbers over 1 year ago
Labels: enhancement

#588 - Master to stable v2

Pull Request - State: closed - Opened by PGijsbers over 1 year ago

#587 - Update naml, fix evaluation of sparse target

Pull Request - State: closed - Opened by PGijsbers over 1 year ago
Labels: bug, framework

#586 - Add toggle to disable `results/backup/` files in AWS mode

Issue - State: open - Opened by Innixma over 1 year ago - 1 comment

#585 - Add support for static and time-varying covariates in time series tasks

Pull Request - State: closed - Opened by shchur over 1 year ago

#584 - Error when trying to launch locally with local files

Issue - State: closed - Opened by celianlrf over 1 year ago - 2 comments

#582 - Question Paper

Issue - State: closed - Opened by cynthiamaia over 1 year ago - 1 comment
Labels: question

#581 - Fix `FEDOT` predict duration measurement

Issue - State: open - Opened by PGijsbers over 1 year ago
Labels: framework

#580 - Docker container encountered `git` errors when running benchmark

Issue - State: closed - Opened by suzhoum over 1 year ago - 8 comments

GitHub / openml/automlbenchmark issues and pull requests