Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / openai/human-eval issues and pull requests
#48 - Error running evaluate_functional_correctness samples.json
Issue -
State: open - Opened by nextdoorUncleLiu 18 days ago
#47 - About how to use
Issue -
State: open - Opened by RIKI0913 20 days ago
#46 - Fix k parameter handling
Pull Request -
State: closed - Opened by LlamaEnjoyer 25 days ago
#45 - Evaluation doesn't work on Windows
Issue -
State: open - Opened by peter-ch 3 months ago
- 4 comments
#44 - Tests in task 67 are impossible to satisfy
Issue -
State: closed - Opened by geajack 4 months ago
#43 - Task 145 makes no sense
Issue -
State: open - Opened by geajack 4 months ago
#42 - Removed deprecated fields.
Issue -
State: open - Opened by Youniqueli 6 months ago
#41 - Error in tests for HumanEval/163
Issue -
State: open - Opened by mono-jiarui 7 months ago
#40 - Evaluations timing out
Issue -
State: closed - Opened by antonkarlsson1 7 months ago
#39 - When running the code generated by the model, an error occurs: failed: No module named 'scipy'
Issue -
State: open - Opened by HangXue-lab 8 months ago
#38 - fix: python3.10 upgrade and entry point change
Pull Request -
State: closed - Opened by ayushkalani 8 months ago
#37 - HE vAL
Issue -
State: open - Opened by Youniqueli 8 months ago
- 1 comment
#36 - why use ThreadPoolExecutor with GIL in background?
Issue -
State: open - Opened by johnmclain 8 months ago
- 1 comment
#35 - bug in estimate_pass_at_k
Issue -
State: open - Opened by sidaw 8 months ago
#34 - Why do I use the phi model to output the same result for all samples at a temperature of 0.8?
Issue -
State: open - Opened by Mrzhang-dada 10 months ago
#33 - Where to find the leaderboard?
Issue -
State: open - Opened by zhimin-z 10 months ago
#32 - I do not understand how to run human eval
Issue -
State: open - Opened by teknium1 11 months ago
- 1 comment
#30 - fix Can't pickle local object 'check_correctness.<locals>.unsafe_execute
Pull Request -
State: open - Opened by Fazziekey about 1 year ago
- 1 comment
#29 - Fix 3
Pull Request -
State: closed - Opened by marcusm117 about 1 year ago
#28 - Fix 2
Pull Request -
State: closed - Opened by marcusm117 about 1 year ago
#27 - AttributeError: Can't pickle local object 'check_correctness.<locals>.unsafe_execute'
Issue -
State: open - Opened by tianzhaotju over 1 year ago
- 6 comments
#26 - # Realizar ajustes en la arquitectura
Issue -
State: closed - Opened by D0yi over 1 year ago
- 1 comment
#25 - fix: reset `os.getcwd` system call after sandbox execution
Pull Request -
State: open - Opened by yaohui-wyh over 1 year ago
#24 - file missing
Issue -
State: open - Opened by shuaiwang2022 over 1 year ago
- 1 comment
#23 - Fix Mistakes in the Dataset
Pull Request -
State: open - Opened by marcusm117 over 1 year ago
- 1 comment
#22 - Error in canonical solution 95 check_dict_case
Issue -
State: open - Opened by PootieT over 1 year ago
#20 - Error in canonical solution and tests for HumanEval/163
Issue -
State: open - Opened by bmosaicml over 1 year ago
- 1 comment
#19 - Codex Training Data
Issue -
State: open - Opened by zachares over 1 year ago
- 1 comment
#18 - evaluate_functional_correctness can't run
Issue -
State: closed - Opened by BoyuanJackChen almost 2 years ago
- 9 comments
#17 - Finetuning With HumanEval
Issue -
State: open - Opened by MT010104 almost 2 years ago
#17 - Finetuning With HumanEval
Issue -
State: open - Opened by MT010104 almost 2 years ago
#16 - Why pass@k =1.0? use the "evaluate_functional_correctness data/example_samples.jsonl --problem_file=data/example_problem.jsonl"
Issue -
State: open - Opened by Smithol almost 2 years ago
- 3 comments
#15 - Why not allow contribution?
Issue -
State: open - Opened by rafidka over 2 years ago
#15 - Why not allow contribution?
Issue -
State: open - Opened by rafidka over 2 years ago
#14 - Install fails if entry point is not provided
Pull Request -
State: open - Opened by gaarutyunov over 2 years ago
#14 - Install fails if entry point is not provided
Pull Request -
State: open - Opened by gaarutyunov over 2 years ago
#13 - pass@k on filtered samples
Issue -
State: open - Opened by henryhungle over 2 years ago
#13 - pass@k on filtered samples
Issue -
State: open - Opened by henryhungle over 2 years ago
#12 - Entry point error while Installing the package.
Issue -
State: closed - Opened by Ali1858 over 2 years ago
- 1 comment
#11 - Prompt used in APPS
Issue -
State: closed - Opened by henryhungle over 2 years ago
- 2 comments
#11 - Prompt used in APPS
Issue -
State: closed - Opened by henryhungle over 2 years ago
- 2 comments
#10 - Evaluation.py failing on KeyError: 'test/0'
Issue -
State: open - Opened by briviere almost 3 years ago
- 3 comments
#9 - Fix type signature of read_problems function
Pull Request -
State: closed - Opened by Linyxus almost 3 years ago
- 1 comment
#8 - Re-produce raw GPT-Neo with 125M and 1.3B on this human-eval dataset
Issue -
State: closed - Opened by BitcoinNLPer almost 3 years ago
- 1 comment
#8 - Re-produce raw GPT-Neo with 125M and 1.3B on this human-eval dataset
Issue -
State: closed - Opened by BitcoinNLPer almost 3 years ago
- 1 comment
#7 - indentation error in execution file
Pull Request -
State: closed - Opened by mrinal18 almost 3 years ago
- 1 comment
#7 - indentation error in execution file
Pull Request -
State: closed - Opened by mrinal18 almost 3 years ago
- 1 comment
#6 - Error in the prompt of HumanEval/47
Issue -
State: open - Opened by Kim-mins about 3 years ago
- 1 comment
#5 - Question about the generate_one_completion
Issue -
State: open - Opened by xupeng1910 about 3 years ago
- 1 comment
#5 - Question about the generate_one_completion
Issue -
State: open - Opened by xupeng1910 about 3 years ago
- 1 comment
#4 - Problems with installation instructions
Issue -
State: open - Opened by jonpincus about 3 years ago
- 3 comments
#3 - execution.py bug request
Issue -
State: closed - Opened by rainmaker712 about 3 years ago
- 1 comment
#3 - execution.py bug request
Issue -
State: closed - Opened by rainmaker712 about 3 years ago
- 1 comment
#2 - Add license file.
Pull Request -
State: closed - Opened by qimingyuan about 3 years ago
#2 - Add license file.
Pull Request -
State: closed - Opened by qimingyuan about 3 years ago
#1 - Will this be helpful for people reading the paper ?
Issue -
State: open - Opened by jalotra about 3 years ago
- 2 comments
#1 - Will this be helpful for people reading the paper ?
Issue -
State: open - Opened by jalotra about 3 years ago
- 2 comments