Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / openai/human-eval issues and pull requests

#47 - About how to use

Issue - State: open - Opened by RIKI0913 20 days ago

#46 - Fix k parameter handling

Pull Request - State: closed - Opened by LlamaEnjoyer 25 days ago

#45 - Evaluation doesn't work on Windows

Issue - State: open - Opened by peter-ch 3 months ago - 4 comments

#44 - Tests in task 67 are impossible to satisfy

Issue - State: closed - Opened by geajack 4 months ago

#43 - Task 145 makes no sense

Issue - State: open - Opened by geajack 4 months ago

#42 - Removed deprecated fields.

Issue - State: open - Opened by Youniqueli 6 months ago

#41 - Error in tests for HumanEval/163

Issue - State: open - Opened by mono-jiarui 7 months ago

#40 - Evaluations timing out

Issue - State: closed - Opened by antonkarlsson1 7 months ago

#38 - fix: python3.10 upgrade and entry point change

Pull Request - State: closed - Opened by ayushkalani 8 months ago

#37 - HE vAL

Issue - State: open - Opened by Youniqueli 8 months ago - 1 comment

#36 - why use ThreadPoolExecutor with GIL in background?

Issue - State: open - Opened by johnmclain 8 months ago - 1 comment

#35 - bug in estimate_pass_at_k

Issue - State: open - Opened by sidaw 8 months ago

#33 - Where to find the leaderboard?

Issue - State: open - Opened by zhimin-z 10 months ago

#32 - I do not understand how to run human eval

Issue - State: open - Opened by teknium1 11 months ago - 1 comment

#30 - fix Can't pickle local object 'check_correctness.<locals>.unsafe_execute

Pull Request - State: open - Opened by Fazziekey about 1 year ago - 1 comment

#29 - Fix 3

Pull Request - State: closed - Opened by marcusm117 about 1 year ago

#28 - Fix 2

Pull Request - State: closed - Opened by marcusm117 about 1 year ago

#26 - # Realizar ajustes en la arquitectura

Issue - State: closed - Opened by D0yi over 1 year ago - 1 comment

#25 - fix: reset `os.getcwd` system call after sandbox execution

Pull Request - State: open - Opened by yaohui-wyh over 1 year ago

#24 - file missing

Issue - State: open - Opened by shuaiwang2022 over 1 year ago - 1 comment

#23 - Fix Mistakes in the Dataset

Pull Request - State: open - Opened by marcusm117 over 1 year ago - 1 comment

#22 - Error in canonical solution 95 check_dict_case

Issue - State: open - Opened by PootieT over 1 year ago

#20 - Error in canonical solution and tests for HumanEval/163

Issue - State: open - Opened by bmosaicml over 1 year ago - 1 comment

#19 - Codex Training Data

Issue - State: open - Opened by zachares over 1 year ago - 1 comment

#18 - evaluate_functional_correctness can't run

Issue - State: closed - Opened by BoyuanJackChen almost 2 years ago - 9 comments

#17 - Finetuning With HumanEval

Issue - State: open - Opened by MT010104 almost 2 years ago

#17 - Finetuning With HumanEval

Issue - State: open - Opened by MT010104 almost 2 years ago

#15 - Why not allow contribution?

Issue - State: open - Opened by rafidka over 2 years ago

#15 - Why not allow contribution?

Issue - State: open - Opened by rafidka over 2 years ago

#14 - Install fails if entry point is not provided

Pull Request - State: open - Opened by gaarutyunov over 2 years ago

#14 - Install fails if entry point is not provided

Pull Request - State: open - Opened by gaarutyunov over 2 years ago

#13 - pass@k on filtered samples

Issue - State: open - Opened by henryhungle over 2 years ago

#13 - pass@k on filtered samples

Issue - State: open - Opened by henryhungle over 2 years ago

#12 - Entry point error while Installing the package.

Issue - State: closed - Opened by Ali1858 over 2 years ago - 1 comment

#11 - Prompt used in APPS

Issue - State: closed - Opened by henryhungle over 2 years ago - 2 comments

#11 - Prompt used in APPS

Issue - State: closed - Opened by henryhungle over 2 years ago - 2 comments

#10 - Evaluation.py failing on KeyError: 'test/0'

Issue - State: open - Opened by briviere almost 3 years ago - 3 comments

#9 - Fix type signature of read_problems function

Pull Request - State: closed - Opened by Linyxus almost 3 years ago - 1 comment

#8 - Re-produce raw GPT-Neo with 125M and 1.3B on this human-eval dataset

Issue - State: closed - Opened by BitcoinNLPer almost 3 years ago - 1 comment

#8 - Re-produce raw GPT-Neo with 125M and 1.3B on this human-eval dataset

Issue - State: closed - Opened by BitcoinNLPer almost 3 years ago - 1 comment

#7 - indentation error in execution file

Pull Request - State: closed - Opened by mrinal18 almost 3 years ago - 1 comment

#7 - indentation error in execution file

Pull Request - State: closed - Opened by mrinal18 almost 3 years ago - 1 comment

#6 - Error in the prompt of HumanEval/47

Issue - State: open - Opened by Kim-mins about 3 years ago - 1 comment

#5 - Question about the generate_one_completion

Issue - State: open - Opened by xupeng1910 about 3 years ago - 1 comment

#5 - Question about the generate_one_completion

Issue - State: open - Opened by xupeng1910 about 3 years ago - 1 comment

#4 - Problems with installation instructions

Issue - State: open - Opened by jonpincus about 3 years ago - 3 comments

#3 - execution.py bug request

Issue - State: closed - Opened by rainmaker712 about 3 years ago - 1 comment

#3 - execution.py bug request

Issue - State: closed - Opened by rainmaker712 about 3 years ago - 1 comment

#2 - Add license file.

Pull Request - State: closed - Opened by qimingyuan about 3 years ago

#2 - Add license file.

Pull Request - State: closed - Opened by qimingyuan about 3 years ago

#1 - Will this be helpful for people reading the paper ?

Issue - State: open - Opened by jalotra about 3 years ago - 2 comments

#1 - Will this be helpful for people reading the paper ?

Issue - State: open - Opened by jalotra about 3 years ago - 2 comments