Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / princeton-nlp/helmet issues and pull requests
#13 - CUDA memory issue (80G A100) of eval for Llama-70b
Issue -
State: open - Opened by xinchen9 4 days ago
#12 - Reproducing meta-llama/Llama-3.2-1B-Instruct results
Issue -
State: closed - Opened by gcampesanae 26 days ago
- 2 comments
#11 - Data preprocessing is non deterministic due to python's builtin hash function
Issue -
State: closed - Opened by xinyangz about 2 months ago
- 1 comment
#10 - How to evaluate the base models?
Issue -
State: closed - Opened by canghongjian 3 months ago
- 2 comments
#9 - Evaluation with larger batch size
Issue -
State: closed - Opened by prakamya-mishra 3 months ago
- 1 comment
#8 - Reproducing results on Llama-3.1-8B-Inst
Issue -
State: open - Opened by chtmp223 4 months ago
- 3 comments
#7 - ALCE citation evaluation
Issue -
State: open - Opened by carriex 4 months ago
- 3 comments
#6 - Discrepancy in gpt4o-mini Results on MSMarco Compared to Reported Results
Issue -
State: open - Opened by 8188zq 4 months ago
- 9 comments
#5 - fix: add trust_remote_code for banking77
Pull Request -
State: closed - Opened by Wangmerlyn 4 months ago
- 1 comment
#4 - Is the code of eval_gpt4_longqa.sh is correct?
Issue -
State: closed - Opened by enze5088 4 months ago
- 1 comment
#3 - Making the full eval sheet a read-only excel
Issue -
State: closed - Opened by LeoXinhaoLee 4 months ago
- 1 comment
#2 - Download data link
Issue -
State: closed - Opened by maxjeblick 4 months ago
- 1 comment
#1 - Missing requirements
Issue -
State: closed - Opened by maxjeblick 4 months ago
- 1 comment