Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / open-compass/mmbench issues and pull requests

#44 - 无法访问https://mmbench.opencompass.org.cn/mmbench-submission

Issue - State: closed - Opened by Purshow 30 days ago - 2 comments

#44 - 无法访问https://mmbench.opencompass.org.cn/mmbench-submission

Issue - State: closed - Opened by Purshow 30 days ago - 2 comments

#42 - Math dataset

Issue - State: open - Opened by moghadas76 about 1 month ago - 1 comment

#42 - Math dataset

Issue - State: open - Opened by moghadas76 about 1 month ago - 1 comment

#39 - mmbench-v1.1

Issue - State: closed - Opened by aoji0606 2 months ago - 4 comments

#39 - mmbench-v1.1

Issue - State: closed - Opened by aoji0606 2 months ago - 4 comments

#38 - [dataset] The download link[VLMEvalKit & Legacy] seems to be broken.

Issue - State: closed - Opened by YunfengLiu 2 months ago - 2 comments

#38 - [dataset] The download link[VLMEvalKit & Legacy] seems to be broken.

Issue - State: closed - Opened by YunfengLiu 2 months ago - 2 comments

#37 - Confusion about mmbench testset v1 vs v1.1

Issue - State: closed - Opened by khiemkhanh98 3 months ago - 3 comments

#37 - Confusion about mmbench testset v1 vs v1.1

Issue - State: closed - Opened by khiemkhanh98 3 months ago - 3 comments

#36 - Update README.md

Pull Request - State: closed - Opened by kennymckormick 3 months ago

#36 - Update README.md

Pull Request - State: closed - Opened by kennymckormick 3 months ago

#35 - 您好，请问1.1版本更新的具体内容是什么？

Issue - State: closed - Opened by hl0737 3 months ago - 2 comments

#35 - 您好，请问1.1版本更新的具体内容是什么？

Issue - State: closed - Opened by hl0737 3 months ago - 2 comments

#34 - Update README.md

Pull Request - State: closed - Opened by kennymckormick 6 months ago

#34 - Update README.md

Pull Request - State: closed - Opened by kennymckormick 6 months ago

#33 - where is the images in dataset?

Issue - State: closed - Opened by ALR-alr 6 months ago - 5 comments

#33 - where is the images in dataset?

Issue - State: closed - Opened by ALR-alr 6 months ago - 5 comments

#32 - V1.1 Test 评测

Issue - State: closed - Opened by Sync-yxh 6 months ago - 6 comments

#32 - V1.1 Test 评测

Issue - State: closed - Opened by Sync-yxh 6 months ago - 6 comments

#31 - About the number of dataset.

Issue - State: closed - Opened by zhouqiji 7 months ago - 1 comment

#31 - About the number of dataset.

Issue - State: closed - Opened by zhouqiji 7 months ago - 1 comment

#30 - difference between "lmms-lab/MMBench" in huggingface

Issue - State: closed - Opened by Coobiw 7 months ago - 2 comments

#30 - difference between "lmms-lab/MMBench" in huggingface

Issue - State: closed - Opened by Coobiw 7 months ago - 2 comments

#29 - Consult the 'circle eval' code

Issue - State: closed - Opened by Baiqi-Li 7 months ago - 1 comment

#29 - Consult the 'circle eval' code

Issue - State: closed - Opened by Baiqi-Li 7 months ago - 1 comment

#28 - 什么时候能测评一下llama 3

Issue - State: closed - Opened by ytcheng 7 months ago - 1 comment

#28 - 什么时候能测评一下llama 3

Issue - State: closed - Opened by ytcheng 7 months ago - 1 comment

#27 - 可以放出gpt4v的L3分数吗？

Issue - State: closed - Opened by shipengai 8 months ago - 1 comment

#27 - 可以放出gpt4v的L3分数吗？

Issue - State: closed - Opened by shipengai 8 months ago - 1 comment

#26 - Unable to log in to the mmbench website

Issue - State: closed - Opened by jdy18 9 months ago

#26 - Unable to log in to the mmbench website

Issue - State: closed - Opened by jdy18 9 months ago

#25 - Evaluation server return 0 score

Issue - State: closed - Opened by czczup 10 months ago - 5 comments

#25 - Evaluation server return 0 score

Issue - State: closed - Opened by czczup 10 months ago - 5 comments

#24 - Scores of L-3 Abilities on the Leaderboard

Issue - State: closed - Opened by TsuTikgiau 10 months ago - 2 comments

#24 - Scores of L-3 Abilities on the Leaderboard

Issue - State: closed - Opened by TsuTikgiau 10 months ago - 2 comments

#23 - How can i download the image?

Issue - State: closed - Opened by SCAUapc 11 months ago - 2 comments

#23 - How can i download the image?

Issue - State: closed - Opened by SCAUapc 11 months ago - 2 comments

#22 - Where is the report or paper on CCBench?

Issue - State: closed - Opened by zhimin-z 11 months ago - 2 comments

#22 - Where is the report or paper on CCBench?

Issue - State: closed - Opened by zhimin-z 11 months ago - 2 comments

#21 - Evaluation returns all zeros

Issue - State: closed - Opened by simplelifetime 11 months ago - 6 comments

#20 - An error in CCBench file

Issue - State: closed - Opened by schuper 11 months ago - 2 comments

#19 - binascii.Error: Incorrect padding

Issue - State: closed - Opened by Isaachhh 11 months ago - 1 comment

#18 - How to download the entire leaderboard?

Issue - State: closed - Opened by zhimin-z 12 months ago - 5 comments

#17 - Still in the queue in two total days

Issue - State: closed - Opened by simplelifetime 12 months ago - 1 comment

#15 - Is CCBench evaluation metrics accuracy?

Issue - State: closed - Opened by zhimin-z about 1 year ago - 1 comment

#14 - The benchmark website is always broken

Issue - State: closed - Opened by simplelifetime about 1 year ago

#13 - 请问为何MMBench (CN)和CCBench下没有闭源leaderboards啊？

Issue - State: closed - Opened by zhimin-z about 1 year ago - 1 comment

#12 - Problem about Numbers of MMBench

Issue - State: closed - Opened by 1649759610 about 1 year ago - 2 comments

#11 - Update README.md

Pull Request - State: closed - Opened by kennymckormick about 1 year ago

#9 - 测评很慢，测了一晚上都没出结果...

Issue - State: closed - Opened by SihengLi99 about 1 year ago - 2 comments

#8 - The Circular Evaluation Strategy && LLM-based Choice Extractors

Issue - State: closed - Opened by yyy809643573 about 1 year ago - 1 comment

#7 - [Doc] Update README.md

Pull Request - State: closed - Opened by kennymckormick about 1 year ago

#6 - 评测集版本问题

Issue - State: closed - Opened by buptlihang about 1 year ago - 1 comment

#5 - [Doc] Add qualitative examples

Pull Request - State: closed - Opened by kennymckormick about 1 year ago

#4 - Confused by online results

Issue - State: closed - Opened by FeipengMa6 about 1 year ago

#3 - [NewRelease] Update and Provide a new CN version

Pull Request - State: closed - Opened by kennymckormick about 1 year ago

#2 - Do you have any plan to support few-shot evaluation?

Issue - State: closed - Opened by wjfwzzc about 1 year ago - 1 comment

#1 - [Feature]: Update README

Pull Request - State: closed - Opened by YuanLiuuuuuu about 1 year ago