Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / princeton-nlp/SWE-bench issues and pull requests

#246 - pyvista__pyvista-4315 isn't working

Issue - State: open - Opened by thaiminhpv 5 days ago - 1 comment
Labels: bug

#245 - Evaluation hangs on "Building environment images"

Issue - State: closed - Opened by thetonywu 6 days ago
Labels: documentation

#244 - PR of `sympy__sympy-17655` did not resolve the problem

Issue - State: open - Opened by SmartManoj 8 days ago
Labels: bug

#243 - Pin Jinja2 to version <3.1 for Sphinx

Pull Request - State: open - Opened by SmartManoj 14 days ago

#242 - Want apptainer support

Issue - State: open - Opened by HotineXie 15 days ago - 1 comment
Labels: future, help wanted

#241 - Jinja2 is not pinned for sphinx

Issue - State: open - Opened by SmartManoj 17 days ago - 2 comments
Labels: bug

#240 - Fix dataset.save_to_disk(output_file) does not accept pathlib.Path object

Pull Request - State: closed - Opened by thaiminhpv 17 days ago - 2 comments

#239 - Errors building Matplotlib env instances

Issue - State: closed - Opened by martinbel 18 days ago - 3 comments
Labels: bug

#238 - Test smells

Pull Request - State: closed - Opened by ethansin 18 days ago

#237 - Add support for Modal

Pull Request - State: open - Opened by azliu0 18 days ago - 1 comment

#236 - Fix fix for yanked packages

Pull Request - State: closed - Opened by klieret 19 days ago - 1 comment

#235 - Fix misplaced quotes in `get_top_pypi.py`

Pull Request - State: closed - Opened by dash-xa 25 days ago - 2 comments

#234 - docs: use latest doc translations

Pull Request - State: closed - Opened by Undertone0809 about 1 month ago - 1 comment

#233 - Cleanup

Pull Request - State: closed - Opened by klieret about 1 month ago - 2 comments

#232 - Fix: Issues with yanked pkg types-setuptools

Pull Request - State: closed - Opened by klieret about 1 month ago - 2 comments

#231 - Excessive memory usage in conda 23.11.0

Issue - State: closed - Opened by beornf about 1 month ago - 1 comment
Labels: bug, wontfix

#230 - Questions about RAG baselines

Issue - State: closed - Opened by dlibk about 1 month ago - 1 comment
Labels: documentation

#229 - Dependencies version in constants.py

Issue - State: closed - Opened by SZU-ZJW about 1 month ago - 1 comment
Labels: documentation

#228 - All Sphinx tests are incorrectly reported as failing

Issue - State: open - Opened by eschluntz about 1 month ago - 4 comments
Labels: bug

#227 - allow for subscription to top of leaderboard change on the website (email).

Issue - State: closed - Opened by RealmX1 about 1 month ago - 1 comment

#226 - fix docker building issues with sklearn

Pull Request - State: closed - Opened by wistuba about 1 month ago - 1 comment

#225 - Error in `astropy__astropy-14539` when using numpy==1.25.2

Issue - State: closed - Opened by SmartManoj about 1 month ago - 3 comments
Labels: bug

#224 - failure to build env image for astropy__astropy-7606

Issue - State: closed - Opened by kjslag about 2 months ago - 3 comments
Labels: bug

#223 - nonexistent PASS_TO_PASS test in dataset for astropy__astropy-7606

Issue - State: closed - Opened by kjslag about 2 months ago - 2 comments
Labels: bug

#222 - astropy__astropy-14182 - `test_patch` includes Unnecessary `read` Method Modifications

Issue - State: closed - Opened by SmartManoj about 2 months ago - 1 comment
Labels: bug

#221 - fix: install tzdata noninteractively

Pull Request - State: closed - Opened by JiyangZhang about 2 months ago - 1 comment

#220 - Running Evaluation on Runpod.

Issue - State: closed - Opened by saadan1234 about 2 months ago - 1 comment
Labels: documentation, wontfix

#219 - Incorrect Issue Description for Instance 'astropy__astropy-14182'

Issue - State: closed - Opened by SmartManoj about 2 months ago - 3 comments
Labels: bug

#218 - scikit-learn__scikit-learn images built error

Issue - State: closed - Opened by JiyangZhang 2 months ago - 2 comments
Labels: bug

#217 - Versioning and execution

Pull Request - State: closed - Opened by vinhowe 2 months ago

#214 - Update README.md to fix dead link

Pull Request - State: closed - Opened by lukasberglund 2 months ago - 1 comment

#213 - Fix broken links in README.md

Pull Request - State: closed - Opened by thaiminhpv 2 months ago - 1 comment

#212 - fix: sympy log parser fails to recognize the last test case

Pull Request - State: closed - Opened by yuxqiu 3 months ago - 1 comment

#211 - Want a docker image tar file

Issue - State: open - Opened by WentaoTan 3 months ago - 4 comments
Labels: documentation

#210 - matplotlib__matplotlib-23476 failed at pre-install

Issue - State: closed - Opened by HejiaZ2023 3 months ago - 1 comment

#209 - 404 for tutorial links in the README

Issue - State: closed - Opened by fhfonsecaa 3 months ago - 1 comment
Labels: bug

#208 - Test for human falsehoods

Issue - State: closed - Opened by MovGP0 3 months ago - 7 comments

#206 - avoid raising error when removing non-existent image

Pull Request - State: closed - Opened by carlosejimenez 3 months ago - 1 comment

#205 - Pin tox packages for sphinx images

Pull Request - State: closed - Opened by aorwall 3 months ago - 2 comments

#204 - fix flask dependency issues

Pull Request - State: closed - Opened by wistuba 3 months ago - 1 comment

#203 - Is it fair to inform the final test command to the Agent?

Issue - State: closed - Opened by bin123apple 3 months ago - 2 comments
Labels: documentation

#202 - fix bug when remove images

Pull Request - State: closed - Opened by yitianlian 3 months ago - 1 comment

#201 - base_commit & patch how to use?

Issue - State: closed - Opened by xlisp 3 months ago - 4 comments
Labels: documentation

#200 - Pin types-pkg-resources to avoid issues with yankedness

Pull Request - State: closed - Opened by klieret 3 months ago - 2 comments

#199 - Yanked package `types-pkg-resources` causes failures when evaluating on `sqlfluff`

Issue - State: closed - Opened by klieret 3 months ago - 8 comments
Labels: bug

#197 - Handle xfail in grading

Pull Request - State: closed - Opened by wenting-zhao 3 months ago - 1 comment

#196 - image build fail in issue pallets__flask-4045

Issue - State: closed - Opened by tangken333 3 months ago
Labels: bug

#195 - Clarification on Identifying fail2pass and pass2pass Test Cases for an Instance

Issue - State: closed - Opened by gnohgnailoug 3 months ago - 2 comments
Labels: documentation

#194 - How to inference without docker?

Issue - State: closed - Opened by WentaoTan 3 months ago - 3 comments
Labels: documentation

#193 - Don't remove and rebuild images based on creation date

Pull Request - State: open - Opened by JunShern 3 months ago

#192 - The expected result of post-installation testing output.

Issue - State: closed - Opened by sh0416 3 months ago - 2 comments
Labels: documentation

#191 - Benchmarks and leaderboards published on your website are out of date. Please update them.

Issue - State: closed - Opened by Emasoft 3 months ago - 1 comment
Labels: documentation

#190 - Reimplementing validation script as part of dataset creation

Pull Request - State: closed - Opened by kwanUm 4 months ago - 3 comments

#189 - fix: remove incorrect `exec_run` calls

Pull Request - State: open - Opened by yuxqiu 4 months ago

#188 - Issues with data collection - supported?

Issue - State: closed - Opened by kwanUm 4 months ago - 3 comments
Labels: documentation

#187 - Compatibility Issue with Updated Pandas Version in Xarray

Issue - State: closed - Opened by SmartManoj 4 months ago - 1 comment
Labels: bug

#186 - fix: correct some typings and a incorrect function call

Pull Request - State: closed - Opened by yuxqiu 4 months ago - 1 comment

#185 - Issue in building environment for SWE-Bench train instances

Issue - State: closed - Opened by jatinganhotra 4 months ago - 2 comments

#184 - Astropy and xarray fixes

Pull Request - State: closed - Opened by aorwall 4 months ago - 1 comment

#183 - Fix timeout

Pull Request - State: closed - Opened by carlosejimenez 4 months ago

#182 - Why SWE-Bench Train does not contains data of "test_patch"? I could not find them.

Issue - State: closed - Opened by BoxiYu 4 months ago - 1 comment
Labels: documentation

#181 - Why SWE-Bench Train does not contains data of "test_patch"

Issue - State: closed - Opened by BoxiYu 4 months ago
Labels: documentation

#180 - Where can I find training set to train swe-llama?

Issue - State: closed - Opened by Hodge931 4 months ago - 2 comments
Labels: documentation

#179 - Query about how to trace the github issue corresponding to the data

Issue - State: closed - Opened by tangken333 4 months ago - 2 comments
Labels: documentation

#178 - Add schema version to report card

Pull Request - State: closed - Opened by klieret 4 months ago - 2 comments

#177 - Fix run live scripts

Pull Request - State: closed - Opened by carlosejimenez 4 months ago

#176 - Move inference to swebench.inference sub-package

Pull Request - State: closed - Opened by carlosejimenez 4 months ago - 1 comment

#175 - Fix link in collect README.md

Pull Request - State: closed - Opened by ssh-randy 4 months ago - 1 comment

#174 - Confused about the usage of fields `test_patch`, `PASS_TO_PASS` and `FAIL_TO_PASS`

Issue - State: closed - Opened by DavdGao 4 months ago - 2 comments
Labels: documentation

#173 - Fix: Allow to set GH token from env var in collect/print_pulls

Pull Request - State: closed - Opened by klieret 4 months ago - 2 comments

#172 - matplotlib__matplotlib-18869 can't pass (?) due to test_tmpconfigdir_warning

Issue - State: closed - Opened by waterson 4 months ago - 1 comment
Labels: bug

#171 - Don't let tox install a virtualenv during evaluation

Pull Request - State: closed - Opened by waterson 4 months ago - 2 comments

#170 - sphinx-doc instances create an unecessary tox virutalenv during eval

Issue - State: closed - Opened by waterson 4 months ago
Labels: bug

#169 - Handle failures because of None/empty patches

Pull Request - State: closed - Opened by klieret 4 months ago - 2 comments

#168 - Update reporting and skip empty model patch predictions

Pull Request - State: closed - Opened by carlosejimenez 4 months ago - 1 comment

#167 - Failing benchmark instances

Issue - State: open - Opened by aorwall 4 months ago - 6 comments
Labels: bug, in progress

#166 - Fix newline outputs for django's log parser

Pull Request - State: closed - Opened by xingyaoww 4 months ago - 1 comment

#165 - Passed test case count as failure?

Issue - State: closed - Opened by xingyaoww 4 months ago
Labels: bug

#164 - Fix so it doesn't crash when no env imgs to build

Pull Request - State: closed - Opened by JunShern 4 months ago - 1 comment

#164 - Fix so it doesn't crash when no env imgs to build

Pull Request - State: closed - Opened by JunShern 4 months ago - 1 comment

#163 - Missing `validation.ipynb`?

Issue - State: closed - Opened by xingyaoww 4 months ago - 1 comment
Labels: documentation

#162 - Fix evaluation hanging issue and improve patch apply

Pull Request - State: closed - Opened by xingyaoww 4 months ago - 2 comments

#162 - Fix evaluation hanging issue and improve patch apply

Pull Request - State: closed - Opened by xingyaoww 4 months ago - 2 comments

#161 - Fix path to image in docs

Pull Request - State: closed - Opened by klieret 4 months ago

#160 - `exec_run_with_timeout` does not actually kill long-running thread

Issue - State: closed - Opened by klieret 4 months ago - 1 comment
Labels: bug, in progress

#159 - Add timeout for overal execution of instance

Pull Request - State: closed - Opened by klieret 4 months ago - 1 comment

#158 - swe-bench can get badly stuck in `future.result()`

Issue - State: closed - Opened by klieret 4 months ago - 2 comments
Labels: bug

#158 - swe-bench can get badly stuck in `future.result()`

Issue - State: closed - Opened by klieret 4 months ago - 2 comments
Labels: bug

#157 - docker evaluation gets stuck

Issue - State: closed - Opened by crhf 4 months ago - 5 comments
Labels: bug

#156 - Which Python version to use?

Issue - State: closed - Opened by anupamme 5 months ago - 3 comments
Labels: documentation

#155 - Fix link to collection tutorial

Pull Request - State: closed - Opened by klieret 5 months ago

#154 - It seems that current evaluation does not handle the apply failure case?

Issue - State: closed - Opened by Hodge931 5 months ago - 4 comments
Labels: documentation

#153 - Various nitpicks

Pull Request - State: closed - Opened by klieret 5 months ago - 1 comment

#152 - Add very simple CI

Pull Request - State: closed - Opened by klieret 5 months ago - 2 comments

#151 - Fix: Support JSON datasets (avoid loading json twice)

Pull Request - State: closed - Opened by klieret 5 months ago

#150 - Cannot load dataset from JSON file

Issue - State: closed - Opened by klieret 5 months ago
Labels: bug