Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / bradyfu/video-mme issues and pull requests

#33 - raw evaluations for proprietary models

Issue - State: open - Opened by orrzohar 3 months ago

#32 - Evaluation frame counts inconsistent

Issue - State: open - Opened by my-other-github-account 4 months ago

#32 - Evaluation frame counts inconsistent

Issue - State: open - Opened by my-other-github-account 4 months ago

#31 - add eval Molmo-7B-D-0924

Issue - State: open - Opened by wuhongsheng 4 months ago

#31 - add eval Molmo-7B-D-0924

Issue - State: open - Opened by wuhongsheng 4 months ago

#30 - How can randomness be avoided?

Issue - State: open - Opened by Lanbai-eleven 5 months ago

#30 - How can randomness be avoided?

Issue - State: open - Opened by Lanbai-eleven 5 months ago

#29 - About the question template

Issue - State: open - Opened by jdsannchao 5 months ago

#29 - About the question template

Issue - State: open - Opened by jdsannchao 5 months ago

#28 - Some subtitles are missing

Issue - State: closed - Opened by Richar-Du 5 months ago - 2 comments

#28 - Some subtitles are missing

Issue - State: closed - Opened by Richar-Du 5 months ago - 2 comments

#27 - Validation set

Issue - State: closed - Opened by sanjayss34 5 months ago - 1 comment

#27 - Validation set

Issue - State: closed - Opened by sanjayss34 5 months ago - 1 comment

#26 - Question about VideoMME' s certificated length

Issue - State: closed - Opened by EricLina 6 months ago

#26 - Question about VideoMME' s certificated length

Issue - State: closed - Opened by EricLina 6 months ago

#25 - What's the license of Video-MME?

Issue - State: closed - Opened by whwu95 6 months ago - 1 comment

#25 - What's the license of Video-MME?

Issue - State: closed - Opened by whwu95 6 months ago - 1 comment

#24 - Results of LLaVA-Next-video-7B

Issue - State: closed - Opened by farewellthree 6 months ago - 2 comments

#24 - Results of LLaVA-Next-video-7B

Issue - State: closed - Opened by farewellthree 6 months ago - 2 comments

#23 - Aligning Question Count with eval_your_results.py

Issue - State: closed - Opened by JinhuiYE 6 months ago - 1 comment

#23 - Aligning Question Count with eval_your_results.py

Issue - State: closed - Opened by JinhuiYE 6 months ago - 1 comment

#22 - where is the dataset

Issue - State: closed - Opened by Derek-Kun 7 months ago - 1 comment

#22 - where is the dataset

Issue - State: closed - Opened by Derek-Kun 7 months ago - 1 comment

#21 - Exact results number for Figure 3

Issue - State: closed - Opened by Ziyang412 7 months ago - 2 comments

#21 - Exact results number for Figure 3

Issue - State: closed - Opened by Ziyang412 7 months ago - 2 comments

#20 - GPT4o evaluation

Issue - State: closed - Opened by resi1ience 7 months ago - 4 comments

#20 - GPT4o evaluation

Issue - State: closed - Opened by resi1ience 7 months ago - 4 comments

#19 - Question about the evaluation script in the leaderboard

Issue - State: closed - Opened by Richar-Du 7 months ago - 2 comments

#19 - Question about the evaluation script in the leaderboard

Issue - State: closed - Opened by Richar-Du 7 months ago - 2 comments

#18 - how to evaluate gemini-1.5 pro

Issue - State: closed - Opened by royzhang12 7 months ago - 2 comments

#18 - how to evaluate gemini-1.5 pro

Issue - State: closed - Opened by royzhang12 7 months ago - 2 comments

#17 - How to use video-mme?

Issue - State: closed - Opened by OliverLeeXZ 7 months ago - 1 comment

#17 - How to use video-mme?

Issue - State: closed - Opened by OliverLeeXZ 7 months ago - 1 comment

#16 - Certificates of the videos

Issue - State: closed - Opened by Ciel127 7 months ago - 2 comments

#16 - Certificates of the videos

Issue - State: closed - Opened by Ciel127 7 months ago - 2 comments

#15 - Fix leaderboard sorting by LLM parameters on project page

Issue - State: closed - Opened by maxbourke 7 months ago - 1 comment

#15 - Fix leaderboard sorting by LLM parameters on project page

Issue - State: closed - Opened by maxbourke 7 months ago - 1 comment

#14 - A video is broken

Issue - State: closed - Opened by sunh-23 8 months ago - 1 comment

#14 - A video is broken

Issue - State: closed - Opened by sunh-23 8 months ago - 1 comment

#13 - The settings of videollava when reproducing

Issue - State: closed - Opened by Kongyj 8 months ago - 5 comments

#13 - The settings of videollava when reproducing

Issue - State: closed - Opened by Kongyj 8 months ago - 5 comments

#12 - request for participating the leaderboard

Issue - State: closed - Opened by Share14 8 months ago

#12 - request for participating the leaderboard

Issue - State: closed - Opened by Share14 8 months ago

#11 - An open-source video understanding model that supports audio input

Issue - State: closed - Opened by AshOneN 8 months ago - 1 comment

#11 - An open-source video understanding model that supports audio input

Issue - State: closed - Opened by AshOneN 8 months ago - 1 comment

#10 - InternVL-Eval

Issue - State: closed - Opened by BlueBlueFF 8 months ago - 1 comment

#9 - About dataset download

Issue - State: closed - Opened by mary-0830 8 months ago - 1 comment

#8 - where is the question json file?

Issue - State: closed - Opened by mu-cai 8 months ago - 1 comment

#7 - Updated results of VideoChat2 and some problems

Issue - State: closed - Opened by Andy1621 9 months ago - 1 comment

#6 - ❓[Question] How to acquire the subtitles of all videos?

Issue - State: closed - Opened by clownrat6 9 months ago - 1 comment

#5 - internvideo model result？

Issue - State: closed - Opened by BlueBlueFF 9 months ago - 1 comment

#3 - Several urls deprecated

Issue - State: closed - Opened by Lyken17 9 months ago - 1 comment

#2 - Hi, How to evaluate image-vlm model on your video benchmark?

Issue - State: closed - Opened by dragen1860 9 months ago - 3 comments