leolty/repobench issues and pull requests

#19 - 咨询如何构造更长的测试集

Issue - State: open - Opened by anda4 2 months ago - 2 comments

#18 - 评估代码中没有codebleu_score模块

Issue - State: closed - Opened by sbyalx 3 months ago - 2 comments

#17 - v1.1 代码跑不起来，看起来是适配 googledrive 里边的数据

Issue - State: closed - Opened by yiyepiaoling0715 4 months ago - 1 comment

#16 - Inconsistent Newline Characters in Python Dataset Affecting Test Accuracy

Issue - State: closed - Opened by HaomiaoPan 4 months ago - 3 comments

#15 - Dataset Loading Error: 404

Issue - State: closed - Opened by alat-rights 4 months ago

#14 - Clarification Needed on Dataset Fields in Repobench

Issue - State: open - Opened by ramsey-coding 5 months ago - 1 comment

#13 - Download the original repositories for constructing RepoBench

Issue - State: closed - Opened by oceaneLIU 6 months ago - 1 comment

#12 - Problem in run_repobench_r.py

Issue - State: open - Opened by yhshu 7 months ago - 1 comment

#11 - Prompt construction with cross-file context

Issue - State: open - Opened by IQ179 7 months ago - 1 comment

#10 - Error when loading the V1.1 dataset from Huggingface

Issue - State: closed - Opened by Symbolk 8 months ago - 2 comments

#9 - Fix: drop lines from end

Pull Request - State: closed - Opened by ASC8384 8 months ago

#8 - Question regarding evaluation on RepoBench-R

Issue - State: closed - Opened by Xin-Cheng-Wen 9 months ago - 5 comments

#7 - Determination of Gold Context/Snippet in RepoBench

Issue - State: closed - Opened by nikhilk7153 10 months ago - 1 comment

#6 - The candidate code snippets for retrieval

Issue - State: closed - Opened by oceaneLIU 11 months ago - 4 comments

#5 - What is the difference between multi-line prediction and one-line prediction

Issue - State: closed - Opened by 18liumin about 1 year ago - 1 comment

#4 - Why there is no c/c++ code