Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / hendrycks/apps issues and pull requests

#33 - fix pyext for python 3.11

Pull Request - State: open - Opened by leogao2 about 2 months ago

#32 - Leaderboard?

Issue - State: open - Opened by TomLucidor 2 months ago - 1 comment

#30 - Update apps evaluations to use HF

Pull Request - State: closed - Opened by steven-safeai 7 months ago

#29 - Problem in ground-truth solutions

Issue - State: closed - Opened by nicoladainese96 9 months ago - 2 comments

#28 - Can this dataset test for chatgpt?(gpt 3.5?)

Issue - State: closed - Opened by syccxdr almost 2 years ago - 10 comments

#27 - check5 in function "run_test" seem to bring some wrong result

Issue - State: open - Opened by Zyq-scut almost 2 years ago - 2 comments

#26 - About Solutiions' validity

Issue - State: closed - Opened by MrBlack0220 almost 2 years ago - 1 comment

#25 - Steps About Generated Code Solutions Post-processing

Issue - State: closed - Opened by MrBlack0220 about 2 years ago - 1 comment

#24 - answer_type calculation is different for train/val and eval

Issue - State: closed - Opened by minimario about 2 years ago - 1 comment

#23 - Unable to run pre-trained (1.5B) model on test set

Issue - State: closed - Opened by geajack about 2 years ago - 2 comments

#22 - Too Long Problems

Issue - State: open - Opened by MT010104 about 2 years ago - 8 comments

#21 - Actually call reliability guard

Pull Request - State: closed - Opened by bycn about 2 years ago

#20 - Problems With APPS

Issue - State: closed - Opened by MT010104 over 2 years ago - 4 comments

#20 - Problems With APPS

Issue - State: closed - Opened by MT010104 over 2 years ago - 4 comments

#19 - Problems with fine-tuning

Issue - State: closed - Opened by MT010104 over 2 years ago

#19 - Problems with fine-tuning

Issue - State: closed - Opened by MT010104 over 2 years ago

#18 - Request for scripts of fine-tuning

Issue - State: closed - Opened by MT010104 over 2 years ago - 3 comments

#17 - Running instructions

Issue - State: closed - Opened by PulkitMadan over 2 years ago - 4 comments

#16 - Fix memory leak and add reliabilty guard

Pull Request - State: closed - Opened by loubnabnl over 2 years ago - 2 comments

#15 - Test case average of solutions in real dataset

Issue - State: closed - Opened by sindhura97 over 2 years ago - 8 comments

#14 - Nan test case average

Issue - State: closed - Opened by sindhura97 over 2 years ago - 5 comments

#13 - evaluation on multiple solutions at once causes memory leak

Issue - State: closed - Opened by loubnabnl over 2 years ago - 14 comments

#12 - update the computation of scores and errors

Pull Request - State: closed - Opened by loubnabnl over 2 years ago - 1 comment

#11 - Computation of the accuracy scores when there are compilation and runtime errors

Issue - State: closed - Opened by loubnabnl over 2 years ago - 7 comments

#10 - Show a data instance in the readme

Issue - State: closed - Opened by ocramz over 2 years ago - 2 comments
Labels: good first issue

#9 - DeepSpeed config and TrainingArguments mismatch

Issue - State: closed - Opened by dpfried over 2 years ago - 2 comments

#8 - Request for pretrained models

Issue - State: closed - Opened by changranelk about 3 years ago - 2 comments

#7 - Asking for scripts for pre-processing

Issue - State: closed - Opened by zfchenUnique about 3 years ago - 2 comments

#6 - GPT-2 0.1B weights

Issue - State: closed - Opened by pczubows about 3 years ago - 1 comment

#5 - Broken dataset download link

Issue - State: closed - Opened by pczubows over 3 years ago - 2 comments

#4 - Missing apps-train-files json file?

Issue - State: closed - Opened by ywen666 over 3 years ago - 5 comments

#3 - Why don't add sorted(problems) to pin problems sorting?

Issue - State: closed - Opened by guoday over 3 years ago - 1 comment

#2 - Categorization of Problem Difficulty

Issue - State: closed - Opened by eelxpeng over 3 years ago - 3 comments

#1 - Wrong arXiv link in main read me file

Issue - State: closed - Opened by santiontanon over 3 years ago - 1 comment