conbench/conbench issues and pull requests

#1532 - devprod: Fix CI on forks

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago - 1 comment

#1530 - benchclients: fix bug on 3.8

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago

#1528 - Add get_all() method to ConbenchClient

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago

#1527 - api/compare/runs: paginate

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago - 5 comments

#1526 - Allow PUT modification of the `optional_benchmark_info` field

Issue - State: open - Opened by johanpel almost 2 years ago - 4 comments

#1524 - webapp: auto-render URL lists as a href

Pull Request - State: closed - Opened by johanpel almost 2 years ago - 3 comments

#1522 - app/benchmark-results: page returns 500 when commit is missing timestamp

Issue - State: open - Opened by DeaMariaLeon almost 2 years ago - 8 comments

#1521 - doc: correcting README from `publish_results()`to `post_results()`

Pull Request - State: closed - Opened by DeaMariaLeon almost 2 years ago - 1 comment

#1520 - docs: clarify the use of a container for a conbench's sever vs. configuring the web application

Issue - State: closed - Opened by DeaMariaLeon almost 2 years ago

#1519 - Getting "Invalid email or password." when trying to use `post_results()`

Issue - State: closed - Opened by DeaMariaLeon almost 2 years ago - 1 comment

#1518 - docs: Add to the documentation how to get the REGISTRATION_KEY to be registered as a user on sign-up page

Issue - State: open - Opened by DeaMariaLeon almost 2 years ago - 1 comment

#1517 - docs: Clarify installation steps?

Issue - State: closed - Opened by DeaMariaLeon almost 2 years ago

#1516 - docs: Update docs from publish_results() to post_results() for adapter

Issue - State: closed - Opened by DeaMariaLeon almost 2 years ago

#1515 - devprod: type hint the session object

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago

#1514 - api/history: change schema to prepare for pagination

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago

#1513 - compare UI: arrange cards chronologically

Issue - State: open - Opened by alistaire47 almost 2 years ago

#1512 - lookback z-score algorithm: change how width of lookback window is defined

Issue - State: open - Opened by austin3dickey almost 2 years ago

#1510 - benchclients: add get_all() method to conbench client

Issue - State: closed - Opened by austin3dickey almost 2 years ago

#1509 - api/runs: paginate

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago - 1 comment

#1508 - api/benchmark-results: additional filters?

Issue - State: open - Opened by austin3dickey almost 2 years ago

#1507 - api/compare/runs: introduce pagination if it makes sense

Issue - State: closed - Opened by austin3dickey almost 2 years ago - 1 comment

#1506 - api/history: introduce pagination if it makes sense

Issue - State: open - Opened by austin3dickey almost 2 years ago - 2 comments

#1505 - api/runs: introduce pagination if it makes sense

Issue - State: closed - Opened by austin3dickey almost 2 years ago - 2 comments

#1504 - app/runs: show more than 1000 results

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago

#1502 - api/benchmark-results: big performance regression on large data

Issue - State: closed - Opened by austin3dickey almost 2 years ago - 8 comments

#1501 - ci instability: db migrations: the database system is starting up

Issue - State: open - Opened by austin3dickey almost 2 years ago - 1 comment

#1500 - server: upgrade to python 3.12

Issue - State: open - Opened by austin3dickey almost 2 years ago

#1498 - conbenchlegacy: fix moving target dep

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago

#1497 - conbenchlegacy testing bug: werkzeug import error

Issue - State: closed - Opened by alistaire47 almost 2 years ago - 2 comments

#1496 - api/benchmark-results: add pagination

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago - 1 comment

#1495 - webapp: plot benchmark results missing commits

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago

#1494 - ci: kube-prom: jb install from local dir (respect pyrra version pin)

Pull Request - State: closed - Opened by jgehrcke almost 2 years ago - 1 comment

#1492 - Increase DB statement timeout

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago - 1 comment

#1491 - benchadapt: add run_tags to BenchmarkResult

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago

#1490 - benchalerts: re-enable integration tests

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago

#1489 - webapp: result, compare results: plots should show contender results missing commits

Issue - State: closed - Opened by austin3dickey almost 2 years ago

#1488 - webapp plots: fix NoneType err

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago - 1 comment

#1487 - webapp plots: `TypeError: 'NoneType' object is not subscriptable` again

Issue - State: closed - Opened by austin3dickey almost 2 years ago

#1486 - architecture sanity: rename `benchmark_result.commit_repo_url` to `benchmark_result.repo_url`

Issue - State: open - Opened by austin3dickey almost 2 years ago

#1485 - _plots.py: use commit_repo_url prop, fix #1483

Pull Request - State: closed - Opened by jgehrcke almost 2 years ago

#1484 - benchadapt: supplying github information in `result_fields_override` is broken

Issue - State: open - Opened by austin3dickey almost 2 years ago - 3 comments

#1483 - res-res cmp: `TypeError: 'NoneType' object is not subscriptable`

Issue - State: closed - Opened by jgehrcke almost 2 years ago
Labels: bug

#1482 - landing page: 'recent runs' query may still be slow occasionally (> 10 s)

Issue - State: closed - Opened by jgehrcke almost 2 years ago - 7 comments

#1481 - testing

Pull Request - State: closed - Opened by deepsihag almost 2 years ago

#1480 - api/runs: removing days filter when sha is used

Pull Request - State: closed - Opened by deepsihag almost 2 years ago - 2 comments

#1479 - benchalerts: skip integration tests failing due to #1478

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago

#1478 - /api/runs/: if sha arg is given, don't restrict to days

Issue - State: closed - Opened by austin3dickey almost 2 years ago - 2 comments

#1477 - big arrow migration branch

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago - 2 comments

#1475 - api/compare/runs: speed up

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago - 1 comment

#1474 - landing page: repair result count (again)

Pull Request - State: closed - Opened by jgehrcke almost 2 years ago - 1 comment

#1473 - ci: address chromedriver/selenium issue #1472

Pull Request - State: closed - Opened by jgehrcke almost 2 years ago

#1472 - ci breakage: `ci-screenshot` fails with This version of ChromeDriver only supports Chrome version 115

Issue - State: closed - Opened by jgehrcke almost 2 years ago - 1 comment
Labels: bug

#1471 - landing page: show result count again, cache _get_recent_runs() result briefly

Pull Request - State: closed - Opened by jgehrcke almost 2 years ago - 2 comments

#1470 - api/runs/run_id: speed up query

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago - 4 comments

#1469 - DB: history fingerprint migration: add primary key

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago

#1468 - DB: history fingerprint migration: switch to CTAS

Pull Request - State: closed - Opened by austin3dickey almost 2 years ago - 2 comments

#1467 - UI: landing page: query distinct runs from DB (address issue 1466)

Pull Request - State: closed - Opened by jgehrcke almost 2 years ago - 1 comment

#1466 - OOM on landing page: 'most recent runs' cannot be built based on results from last 30 days

Issue - State: closed - Opened by jgehrcke almost 2 years ago - 14 comments
Labels: bug

#1465 - ui: compare view: adjust help text for z-score sign

Pull Request - State: closed - Opened by jgehrcke almost 2 years ago - 1 comment

#1464 - result compare page: Display error

Pull Request - State: closed - Opened by alistaire47 about 2 years ago

#1463 - DB: formalize history_fingerprint concept

Pull Request - State: open - Opened by austin3dickey about 2 years ago - 1 comment

#1462 - legacy: Remove legacy code from webapp

Pull Request - State: closed - Opened by alistaire47 about 2 years ago

#1461 - devprod: `current_session` type hint isn't optimal

Issue - State: closed - Opened by austin3dickey about 2 years ago - 1 comment
Labels: devprod

#1460 - API, webapp: results without commit hashes should be able to get history

Issue - State: closed - Opened by austin3dickey about 2 years ago - 1 comment

#1459 - DB: make `benchmark_result.commit_repo_url` not null

Pull Request - State: closed - Opened by austin3dickey about 2 years ago - 2 comments

#1457 - API POST result: require github prop again

Pull Request - State: closed - Opened by austin3dickey about 2 years ago

#1456 - benchadapt: fix github handling

Pull Request - State: closed - Opened by austin3dickey about 2 years ago

#1455 - ci instability: auth error pulling db image during db-migrations step

Issue - State: open - Opened by austin3dickey about 2 years ago
Labels: ci-instability

#1454 - api/results: adding days and limit filter

Pull Request - State: closed - Opened by deepsihag about 2 years ago - 1 comment

#1453 - DB: store commit repo URL on benchmark_result

Pull Request - State: closed - Opened by austin3dickey about 2 years ago - 1 comment

#1452 - benchconnect: Remove run posting and BenchmarkRun usage

Pull Request - State: closed - Opened by alistaire47 about 2 years ago

#1451 - benchalerts: stop using /api/runs links key

Pull Request - State: closed - Opened by austin3dickey about 2 years ago

#1450 - DB: Run table removal

Pull Request - State: closed - Opened by austin3dickey about 2 years ago

#1449 - DB: speed up and fix run table migration

Pull Request - State: closed - Opened by austin3dickey about 2 years ago

#1448 - api/results: document run_reason arg

Pull Request - State: closed - Opened by austin3dickey about 2 years ago

#1447 - devprod: reorganize run code

Pull Request - State: closed - Opened by austin3dickey about 2 years ago

#1446 - devprod: move entities/run.py code into files that make more sense

Issue - State: closed - Opened by austin3dickey about 2 years ago - 1 comment

#1445 - benchmark result API: add run link back

Pull Request - State: closed - Opened by austin3dickey about 2 years ago

#1444 - list runs API: change default to 14d, add query param

Pull Request - State: closed - Opened by austin3dickey about 2 years ago - 2 comments

#1443 - DB: data migration for removing run table

Pull Request - State: closed - Opened by austin3dickey about 2 years ago - 1 comment

#1442 - history API/plots: z-scores may disagree with compare endpoint z-scores due to DISTRIBUTION_COMMITS

Issue - State: open - Opened by austin3dickey about 2 years ago

#1441 - legacy code: Separate out conbenchlegacy package

Pull Request - State: closed - Opened by alistaire47 about 2 years ago

#1440 - legacy package: Remove legacy code from webapp

Issue - State: closed - Opened by alistaire47 about 2 years ago

#1439 - legacy package: Switch all users to new legacy package

Issue - State: closed - Opened by alistaire47 about 2 years ago

#1438 - legacy package: Create separate package for legacy CLI and library

Issue - State: closed - Opened by alistaire47 about 2 years ago

#1437 - DB: Remove run table

Pull Request - State: closed - Opened by austin3dickey about 2 years ago - 3 comments

#1435 - c-bench UI: more tests, BMRT cache: add reinit() interface, module docstring, move to bmrt.py

Pull Request - State: closed - Opened by jgehrcke about 2 years ago - 1 comment

#1434 - job.py: split orthogonal concepts; decouple BMRT cache logic

Issue - State: closed - Opened by jgehrcke about 2 years ago - 1 comment
Labels: devprod

#1432 - benchmark result view: use same terminology as API, clarify 'breaks history' in tooltip.

Issue - State: closed - Opened by jgehrcke about 2 years ago - 1 comment
Labels: UI/UX, UX - terminology

#1431 - test suite: have test runner and API in different processes, use as much of actual HTTP as possible

Issue - State: open - Opened by jgehrcke about 2 years ago
Labels: devprod, testing

#1430 - benchadapt: Remove BenchmarkRun class

Issue - State: closed - Opened by alistaire47 about 2 years ago - 2 comments
Labels: benchadapt

#1429 - benchconnect: Remove run POST/PUT

Issue - State: closed - Opened by alistaire47 about 2 years ago
Labels: benchconnect

#1428 - benchalerts: include direct link to all run comparisons in check run

Issue - State: open - Opened by austin3dickey about 2 years ago

#1427 - BMRT cache population, c-bench UI: start adding test infra and tests

Pull Request - State: closed - Opened by jgehrcke about 2 years ago - 1 comment

#1426 - Remove `Info` table, remove support for `optional_benchmark_info`

Issue - State: open - Opened by jgehrcke about 2 years ago
Labels: api JSON schemas and spec, DB schema

#1425 - benchmark result submission API spec: make `info` optional, improve spec for `github`, `context`, misc

Pull Request - State: closed - Opened by jgehrcke about 2 years ago - 2 comments

#1423 - UI: benchmark result view: expose CSV download url

Pull Request - State: closed - Opened by jgehrcke about 2 years ago - 2 comments

#1422 - app/compare.py: fix baseline hw checksum

Pull Request - State: closed - Opened by jgehrcke about 2 years ago

#1421 - benchmark result `stats` object: make `iterations` optional

Pull Request - State: closed - Opened by jgehrcke about 2 years ago - 1 comment

#1420 - ci instability: registry-1.docker.io returned 503

Issue - State: open - Opened by jgehrcke about 2 years ago

GitHub / conbench/conbench issues and pull requests