Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / open-compass/t-eval issues and pull requests

#64 - BUG

Issue - State: open - Opened by Jasperzkk 9 days ago

#63 - Cannot download dataset

Issue - State: closed - Opened by YEEthanCC about 2 months ago

#59 - 数据链接打不开

Issue - State: open - Opened by cobraheleah 6 months ago - 2 comments

#58 - 如何计算的分数

Issue - State: open - Opened by hmppt 6 months ago

#57 - Opensource Model not found ——Nanbeige-Agent-32B

Issue - State: open - Opened by tttonytan 7 months ago

#56 - 结果要怎么算总的均值呢

Issue - State: closed - Opened by li-aolong 8 months ago - 1 comment

#55 - llama2模板有问题

Issue - State: open - Opened by li-aolong 8 months ago

#54 - 推理速度慢

Issue - State: open - Opened by lihaibineric 8 months ago

#54 - 推理速度慢

Issue - State: open - Opened by lihaibineric 8 months ago

#53 - Review测评指标失真，Qwen被严重低估了

Issue - State: open - Opened by fengzhu1 8 months ago - 1 comment

#53 - Review测评指标失真，Qwen被严重低估了

Issue - State: open - Opened by fengzhu1 8 months ago - 1 comment

#52 - 测试结果不完整

Issue - State: open - Opened by Mrak6192 9 months ago - 2 comments

#52 - 测试结果不完整

Issue - State: open - Opened by Mrak6192 9 months ago - 2 comments

#50 - 对数据集case数的疑问

Issue - State: open - Opened by AmberXu98 9 months ago - 2 comments

#50 - 对数据集case数的疑问

Issue - State: open - Opened by AmberXu98 9 months ago - 2 comments

#49 - 请问能否提供一份完全对齐openai输入格式的测试数据

Issue - State: open - Opened by Watebear 10 months ago - 2 comments

#49 - 请问能否提供一份完全对齐openai输入格式的测试数据

Issue - State: open - Opened by Watebear 10 months ago - 2 comments

#48 - Can not eval when set batch_size>1

Issue - State: open - Opened by dkqkxx 10 months ago - 2 comments

#48 - Can not eval when set batch_size>1

Issue - State: open - Opened by dkqkxx 10 months ago - 2 comments

#47 - support vllm generation

Pull Request - State: open - Opened by eitanturok 10 months ago

#47 - support vllm generation

Pull Request - State: open - Opened by eitanturok 10 months ago

#46 - fix pip command

Pull Request - State: closed - Opened by eitanturok 10 months ago

#46 - fix pip command

Pull Request - State: closed - Opened by eitanturok 10 months ago

#45 - Questions about T-Eval

Issue - State: closed - Opened by Cppowboy 10 months ago

#45 - Questions about T-Eval

Issue - State: closed - Opened by Cppowboy 10 months ago

#44 - Llama2 7b chat 模型，输入长度超过 4096

Issue - State: open - Opened by Watebear 10 months ago - 1 comment

#44 - Llama2 7b chat 模型，输入长度超过 4096

Issue - State: open - Opened by Watebear 10 months ago - 1 comment

#43 - When do you want to support internlm2

Issue - State: closed - Opened by seanxuu 10 months ago - 1 comment

#43 - When do you want to support internlm2

Issue - State: closed - Opened by seanxuu 10 months ago - 1 comment

#42 - How to use multi-gpu to test?

Issue - State: open - Opened by seanxuu 10 months ago

#42 - How to use multi-gpu to test?

Issue - State: open - Opened by seanxuu 10 months ago

#41 - Update README.md

Pull Request - State: open - Opened by seanxuu 10 months ago

#41 - Update README.md

Pull Request - State: open - Opened by seanxuu 10 months ago

#40 - qwen14B测试python test.py 报错

Issue - State: open - Opened by chococatsrin 10 months ago

#40 - qwen14B测试python test.py 报错

Issue - State: open - Opened by chococatsrin 10 months ago

#39 - qwen1.5 tokenizer错误

Issue - State: open - Opened by chococatsrin 10 months ago

#39 - qwen1.5 tokenizer错误

Issue - State: open - Opened by chococatsrin 10 months ago

#38 - qwen-14b评测结果疑问

Issue - State: open - Opened by Fenglly 11 months ago

#38 - qwen-14b评测结果疑问

Issue - State: open - Opened by Fenglly 11 months ago

#37 - Evaluate Claude 3

Issue - State: open - Opened by stalkermustang 11 months ago

#37 - Evaluate Claude 3

Issue - State: open - Opened by stalkermustang 11 months ago

#36 - 关于plan_json_v1_zh.json数据文件答案问题

Issue - State: open - Opened by 13416157913 11 months ago

#36 - 关于plan_json_v1_zh.json数据文件答案问题

Issue - State: open - Opened by 13416157913 11 months ago

#35 - 关于plan_json_v1_zh.json数据文件答案问题

Issue - State: open - Opened by 13416157913 11 months ago

#35 - 关于plan_json_v1_zh.json数据文件答案问题

Issue - State: open - Opened by 13416157913 11 months ago

#34 - API model

Issue - State: open - Opened by Fenglly 11 months ago - 3 comments

#34 - API model

Issue - State: open - Opened by Fenglly 11 months ago - 3 comments

#33 - BUG: stop_words

Issue - State: open - Opened by ZHUANGMINGXI 11 months ago - 5 comments

#33 - BUG: stop_words

Issue - State: open - Opened by ZHUANGMINGXI 11 months ago - 5 comments

#32 - BUG: stop_words

Issue - State: closed - Opened by ZHUANGMINGXI 11 months ago

#32 - BUG: stop_words

Issue - State: closed - Opened by ZHUANGMINGXI 11 months ago

#31 - API model ERROR

Issue - State: open - Opened by HC-Guo 11 months ago - 3 comments

#31 - API model ERROR

Issue - State: open - Opened by HC-Guo 11 months ago - 3 comments

#28 - 代码bug

Issue - State: open - Opened by xjwhy 11 months ago - 1 comment

#28 - 代码bug

Issue - State: open - Opened by xjwhy 11 months ago - 1 comment

#27 - Tool Set的问题

Issue - State: open - Opened by yitianlian 11 months ago - 5 comments

#27 - Tool Set的问题

Issue - State: open - Opened by yitianlian 11 months ago - 5 comments

#26 - 有关数据开源的问题

Issue - State: open - Opened by pengming617 11 months ago - 2 comments

#26 - 有关数据开源的问题

Issue - State: open - Opened by pengming617 11 months ago - 2 comments

#25 - BUG

Issue - State: open - Opened by nyBball 11 months ago - 13 comments

#25 - BUG

Issue - State: open - Opened by nyBball 11 months ago - 13 comments

#24 - cannot import name 'HFTransformerChat' from 'lagent.llms.huggingface

Issue - State: closed - Opened by xjwhy 11 months ago - 2 comments

#24 - cannot import name 'HFTransformerChat' from 'lagent.llms.huggingface

Issue - State: closed - Opened by xjwhy 11 months ago - 2 comments

#23 - 论文结果无法复现

Issue - State: closed - Opened by nyBball 12 months ago - 1 comment

#23 - 论文结果无法复现

Issue - State: closed - Opened by nyBball 12 months ago - 1 comment

#22 - add TODO for opencompass support

Pull Request - State: closed - Opened by zehuichen123 12 months ago

#22 - add TODO for opencompass support

Pull Request - State: closed - Opened by zehuichen123 12 months ago

#21 - 对评测速度和结果的疑问

Issue - State: open - Opened by klykq111 12 months ago - 4 comments

#21 - 对评测速度和结果的疑问

Issue - State: open - Opened by klykq111 12 months ago - 4 comments

#20 - T-Eval加入open-compass框架

Issue - State: open - Opened by merlinarer almost 1 year ago - 1 comment

#20 - T-Eval加入open-compass框架

Issue - State: open - Opened by merlinarer almost 1 year ago - 1 comment

#19 - update TODO for T-eval

Pull Request - State: closed - Opened by zehuichen123 almost 1 year ago

#19 - update TODO for T-eval

Pull Request - State: closed - Opened by zehuichen123 almost 1 year ago

#18 - 您好，请问中文数据集测试一轮大概花多长时间？

Issue - State: closed - Opened by 13416157913 about 1 year ago - 1 comment

#18 - 您好，请问中文数据集测试一轮大概花多长时间？

Issue - State: closed - Opened by 13416157913 about 1 year ago - 1 comment

#17 - 请问plan和instruct的区别？

Issue - State: closed - Opened by milk-bottle-liyu about 1 year ago - 4 comments

#17 - 请问plan和instruct的区别？

Issue - State: closed - Opened by milk-bottle-liyu about 1 year ago - 4 comments

#15 - update web image

Pull Request - State: closed - Opened by StigLidu about 1 year ago

#15 - update web image

Pull Request - State: closed - Opened by StigLidu about 1 year ago

#14 - QWen测试message格式问题

Issue - State: open - Opened by gewenbin0992 about 1 year ago - 1 comment

#14 - QWen测试message格式问题

Issue - State: open - Opened by gewenbin0992 about 1 year ago - 1 comment

#13 - update hf link

Pull Request - State: closed - Opened by zehuichen123 about 1 year ago

#13 - update hf link

Pull Request - State: closed - Opened by zehuichen123 about 1 year ago

#12 - update figure

Pull Request - State: closed - Opened by StigLidu about 1 year ago

#12 - update figure

Pull Request - State: closed - Opened by StigLidu about 1 year ago

#11 - vllm兼容性问题

Issue - State: open - Opened by Double-bear about 1 year ago - 9 comments

#11 - vllm兼容性问题

Issue - State: open - Opened by Double-bear about 1 year ago - 9 comments

#10 - update readme

Pull Request - State: closed - Opened by StigLidu about 1 year ago