Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / swe-bench/SWE-bench issues and pull requests
#308 - fix: handle dict-format JSON correctly when loading predictions
Pull Request -
State: closed - Opened by carlosejimenez about 14 hours ago
#307 - Filter for base models
Issue -
State: open - Opened by clearfram3 about 15 hours ago
#306 - [agent_farm] testing
Issue -
State: closed - Opened by theskcd 3 days ago
#305 - [agent_farm] testing
Issue -
State: closed - Opened by theskcd 3 days ago
#304 - [agent_farm] testing
Issue -
State: closed - Opened by theskcd 3 days ago
#303 - [agent_farm] run both agent_bin and agent_bin_reasoning in parallel
Issue -
State: closed - Opened by theskcd 3 days ago
#302 - [agent_farm] testing
Issue -
State: closed - Opened by theskcd 3 days ago
#301 - Clarification about setup of repos
Issue -
State: open - Opened by c-flaherty 3 days ago
Labels: documentation
#300 - X86_64 base image fails to build
Issue -
State: open - Opened by 1udvig 7 days ago
Labels: bug
#299 - blackboxai.com is still visible. this shouldnt be the case cause they are scammers and fakers
Issue -
State: closed - Opened by stjema 9 days ago
- 5 comments
Labels: bug
#298 - Support sweagent merge-preds json output
Issue -
State: closed - Opened by dashesy 9 days ago
Labels: bug
#297 - Building base image (sweb.base.py.x86_64:latest)
Issue -
State: open - Opened by kamuy-shennai 11 days ago
- 1 comment
Labels: bug
#296 - Unable to run evaluation on gold predictions with princeton-nlp/SWE-bench_Multimodal dataset
Issue -
State: open - Opened by thetonywu 11 days ago
Labels: bug
#295 - Request to add released version tags in GitHub
Issue -
State: open - Opened by MattFisher 11 days ago
#294 - How stable is run_evaluation.py with gold patch for SWE-bench_Verified?
Issue -
State: open - Opened by MarcCote 13 days ago
- 1 comment
Labels: documentation
#293 - Environment images failed to build in running "swebench.harness.run_evaluation"
Issue -
State: open - Opened by haoxianghz 15 days ago
Labels: bug
#292 - Some SWE-bench_Verified test specs are missing test parameters
Issue -
State: open - Opened by jsdelfino 16 days ago
Labels: bug
#291 - Fix: remove a duplicate code block to prevent unexpected exit from empty `dataset` when using Modal
Pull Request -
State: closed - Opened by gameofby 17 days ago
- 1 comment
#290 - Truncated parametrized test names in SWE-bench_Verified
Issue -
State: open - Opened by jsdelfino 17 days ago
Labels: bug
#289 - Tests incorrectly named [100%] in SWE-bench-Verified instances pytest-5262 and pytest-7521
Issue -
State: open - Opened by jsdelfino 18 days ago
Labels: bug
#288 - Replace `modal.Mount(` with suggested fix
Pull Request -
State: closed - Opened by john-b-yang 18 days ago
#287 - How can I populate the FAIL_TO_PASS and PASS_TO_PASS fields?
Issue -
State: open - Opened by ErsjanKeri 18 days ago
- 2 comments
Labels: documentation
#286 - Failed to build matplotlib images.
Issue -
State: open - Opened by kohankhaki 20 days ago
- 5 comments
#285 - SWE-bench Multimodal Dev
Pull Request -
State: closed - Opened by john-b-yang 20 days ago
#284 - Docker build updates for repos
Pull Request -
State: closed - Opened by naterush 23 days ago
#283 - failed to build env images
Issue -
State: open - Opened by jianzzz 23 days ago
- 2 comments
Labels: bug
#282 - Misleading removed images count.
Issue -
State: open - Opened by SmartManoj 23 days ago
Labels: bug
#281 - Remove duplicate code
Pull Request -
State: closed - Opened by SmartManoj 23 days ago
#280 - "Successful" patches fail on unexecuted developer-written tests
Issue -
State: open - Opened by PrinzyW 23 days ago
Labels: bug
#279 - Avoid breaking apart testcase name when they contain spaces
Pull Request -
State: open - Opened by MarcCote 24 days ago
- 1 comment
#278 - Code Generators only tested on MBPP
Issue -
State: closed - Opened by BradKML 25 days ago
- 3 comments
Labels: documentation
#277 - Bug Report: Error Building Instance Image sweb.eval.x86_64.astropy__astropy-14995:latest
Issue -
State: open - Opened by MichaelYang-lyx 26 days ago
- 1 comment
Labels: bug
#276 - Docker images are rebuilt unnecessarily on second run of evaluation command
Issue -
State: closed - Opened by MichaelYang-lyx 27 days ago
Labels: documentation
#275 - Incorrect unit tests in `FAIL_TO_PASS` and `PASS_TO_PASS`
Issue -
State: open - Opened by WuYff about 2 months ago
- 1 comment
Labels: bug
#274 - `pvlib/pvlib-python` in dev set failed for Gold Patch
Issue -
State: open - Opened by thaiminhpv about 2 months ago
- 1 comment
Labels: bug
#273 - Fix sympy version for specific instance
Pull Request -
State: closed - Opened by SmartManoj about 2 months ago
- 4 comments
#268 - fix dependencies for some astropy problems
Pull Request -
State: closed - Opened by wistuba 2 months ago
#267 - 5 Instances in Verified Fail for Gold Patch
Issue -
State: open - Opened by wistuba 2 months ago
- 4 comments
Labels: bug
#265 - Regarding package version
Issue -
State: closed - Opened by SmartManoj 2 months ago
- 1 comment
Labels: documentation
#264 - For `sympy__sympy-21379`, original issue was mentioned in the hint
Issue -
State: closed - Opened by SmartManoj 2 months ago
- 2 comments
Labels: bug
#263 - Can't reproduce the issue `sympy__sympy-18199`
Issue -
State: closed - Opened by SmartManoj 2 months ago
- 1 comment
Labels: bug
#262 - Issue of `sympy__sympy-17630` has two PRs.
Issue -
State: closed - Opened by SmartManoj 2 months ago
- 1 comment
Labels: bug
#261 - Fix: issues of 'harness' in Windows
Pull Request -
State: closed - Opened by 3N4N 2 months ago
#260 - Errors in swebench.harness.run_evaluation in Windows
Issue -
State: closed - Opened by 3N4N 2 months ago
Labels: bug
#253 - Instance `django__django-14155` has strike-out text
Issue -
State: closed - Opened by SmartManoj 3 months ago
- 3 comments
Labels: bug
#252 - Deprecated utcnow() method used in the test patch
Issue -
State: closed - Opened by SmartManoj 3 months ago
- 1 comment
Labels: bug
#250 - Image build error running gold_patch
Issue -
State: closed - Opened by jintheman 3 months ago
- 2 comments
Labels: bug
#247 - Last image is not building
Issue -
State: closed - Opened by lukaspetersson 3 months ago
- 6 comments
Labels: bug
#244 - PR of `sympy__sympy-17655` did not resolve the problem
Issue -
State: closed - Opened by SmartManoj 3 months ago
- 1 comment
Labels: bug
#237 - Add support for Modal
Pull Request -
State: closed - Opened by azliu0 3 months ago
- 4 comments
#223 - nonexistent PASS_TO_PASS test in dataset for astropy__astropy-7606
Issue -
State: closed - Opened by kjslag 4 months ago
- 8 comments
Labels: bug
#207 - Make `run_report` more intuitive when using `instance_ids` filter during evaluation
Pull Request -
State: closed - Opened by carlosejimenez 6 months ago
- 1 comment
#206 - avoid raising error when removing non-existent image
Pull Request -
State: closed - Opened by carlosejimenez 6 months ago
- 1 comment
#189 - fix: remove incorrect `exec_run` calls
Pull Request -
State: open - Opened by yuxqiu 6 months ago
#100 - Update collection.md
Pull Request -
State: closed - Opened by eltociear 10 months ago
- 1 comment
#100 - Update collection.md
Pull Request -
State: closed - Opened by eltociear 10 months ago
- 1 comment
#99 - Dataset field & set up reliable environment
Issue -
State: closed - Opened by Hodge931 10 months ago
- 1 comment
Labels: documentation
#99 - Dataset field & set up reliable environment
Issue -
State: closed - Opened by Hodge931 10 months ago
- 1 comment
Labels: documentation
#98 - Repository not found while running python3 create_text_dataset.py
Issue -
State: closed - Opened by hsm1997 10 months ago
- 2 comments
Labels: inference
#98 - Repository not found while running python3 create_text_dataset.py
Issue -
State: closed - Opened by hsm1997 10 months ago
- 2 comments
Labels: inference
#97 - Update environment.yml
Pull Request -
State: closed - Opened by moresearch 10 months ago
- 1 comment
#97 - Update environment.yml
Pull Request -
State: closed - Opened by moresearch 10 months ago
- 1 comment
#96 - `/bin/sh: pytest: command not found` when running evaluations
Issue -
State: closed - Opened by psykhi 10 months ago
- 3 comments
Labels: bug
#96 - `/bin/sh: pytest: command not found` when running evaluations
Issue -
State: closed - Opened by psykhi 10 months ago
- 3 comments
Labels: bug
#95 - Remove `pre_install` from install specs
Issue -
State: closed - Opened by carlosejimenez 10 months ago
- 1 comment
Labels: evaluation, future
#95 - Remove `pre_install` from install specs
Issue -
State: closed - Opened by carlosejimenez 10 months ago
- 1 comment
Labels: evaluation, future
#93 - Update evaluation.md evaluation argument hints
Pull Request -
State: closed - Opened by ssh-randy 10 months ago
#93 - Update evaluation.md evaluation argument hints
Pull Request -
State: closed - Opened by ssh-randy 10 months ago
#92 - Fix dev 2
Pull Request -
State: closed - Opened by carlosejimenez 10 months ago
- 2 comments
#92 - Fix dev 2
Pull Request -
State: closed - Opened by carlosejimenez 10 months ago
- 2 comments
#91 - Adding LLM tokens to the generated inference for cost calculation
Issue -
State: closed - Opened by moresearch 10 months ago
- 1 comment
Labels: wontfix, inference
#91 - Adding LLM tokens to the generated inference for cost calculation
Issue -
State: closed - Opened by moresearch 10 months ago
- 1 comment
Labels: wontfix, inference
#90 - Fix dev
Pull Request -
State: closed - Opened by carlosejimenez 10 months ago
#90 - Fix dev
Pull Request -
State: closed - Opened by carlosejimenez 10 months ago
#89 - conda activate && conda install gxx_linux-64 gcc_linux-64 make -y' returned non-zero exit status 2 and Syntax error: "(" unexpected
Issue -
State: closed - Opened by SZU-ZJW 10 months ago
- 8 comments
Labels: bug, evaluation
#89 - conda activate && conda install gxx_linux-64 gcc_linux-64 make -y' returned non-zero exit status 2 and Syntax error: "(" unexpected
Issue -
State: closed - Opened by SZU-ZJW 10 months ago
- 8 comments
Labels: bug, evaluation
#88 - Running create_text_dataset.py gets Killed and takes too long
Issue -
State: open - Opened by vishwa27yvs 10 months ago
- 3 comments
Labels: inference, in progress
#88 - Running create_text_dataset.py gets Killed and takes too long
Issue -
State: open - Opened by vishwa27yvs 10 months ago
- 3 comments
Labels: inference, in progress
#87 - inference issue run live
Issue -
State: closed - Opened by kneeraj-AIDE 10 months ago
- 4 comments
Labels: inference, in progress
#87 - inference issue run live
Issue -
State: closed - Opened by kneeraj-AIDE 10 months ago
- 4 comments
Labels: inference, in progress
#86 - Update log parsing to remove paths from test names
Pull Request -
State: closed - Opened by carlosejimenez 10 months ago
#86 - Update log parsing to remove paths from test names
Pull Request -
State: closed - Opened by carlosejimenez 10 months ago
#85 - Use the more portable . instead of source
Pull Request -
State: closed - Opened by kevinlu1248 10 months ago
#85 - Use the more portable . instead of source
Pull Request -
State: closed - Opened by kevinlu1248 10 months ago
#84 - Fix pip/python paths in context_manager.py (fixes #55)
Pull Request -
State: closed - Opened by thakkarparth007 10 months ago
- 2 comments
#84 - Fix pip/python paths in context_manager.py (fixes #55)
Pull Request -
State: closed - Opened by thakkarparth007 10 months ago
- 2 comments
#83 - Fix env_list parsing
Pull Request -
State: closed - Opened by carlosejimenez 10 months ago
#83 - Fix env_list parsing
Pull Request -
State: closed - Opened by carlosejimenez 10 months ago
#82 - Use LogWrapper in ExecWrapper instead of logger
Pull Request -
State: closed - Opened by carlosejimenez 10 months ago
#82 - Use LogWrapper in ExecWrapper instead of logger
Pull Request -
State: closed - Opened by carlosejimenez 10 months ago
#81 - update: translate readme to Chinese.
Pull Request -
State: closed - Opened by iFurySt 10 months ago
- 1 comment
#81 - update: translate readme to Chinese.
Pull Request -
State: closed - Opened by iFurySt 10 months ago
- 1 comment
#80 - Issue with Django gold patch results not evaluating to "Resolved" when logs say "All tests passed"
Issue -
State: closed - Opened by brombaut 10 months ago
- 8 comments
Labels: evaluation
#80 - Issue with Django gold patch results not evaluating to "Resolved" when logs say "All tests passed"
Issue -
State: closed - Opened by brombaut 10 months ago
- 8 comments
Labels: evaluation
#79 - lv3-0
Issue -
State: closed - Opened by Iv3-0 10 months ago
#79 - lv3-0
Issue -
State: closed - Opened by Iv3-0 10 months ago
#78 - Fix typo in utils.py
Pull Request -
State: closed - Opened by eltociear 10 months ago
#78 - Fix typo in utils.py
Pull Request -
State: closed - Opened by eltociear 10 months ago