Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / bradyfu/video-mme issues and pull requests

#32 - Evaluation frame counts inconsistent

Issue - State: open - Opened by my-other-github-account 15 days ago

#32 - Evaluation frame counts inconsistent

Issue - State: open - Opened by my-other-github-account 15 days ago

#31 - add eval Molmo-7B-D-0924

Issue - State: open - Opened by wuhongsheng 16 days ago

#31 - add eval Molmo-7B-D-0924

Issue - State: open - Opened by wuhongsheng 16 days ago

#30 - How can randomness be avoided?

Issue - State: open - Opened by Lanbai-eleven about 2 months ago

#30 - How can randomness be avoided?

Issue - State: open - Opened by Lanbai-eleven about 2 months ago

#29 - About the question template

Issue - State: open - Opened by jdsannchao about 2 months ago

#29 - About the question template

Issue - State: open - Opened by jdsannchao about 2 months ago

#28 - Some subtitles are missing

Issue - State: closed - Opened by Richar-Du 2 months ago - 2 comments

#28 - Some subtitles are missing

Issue - State: closed - Opened by Richar-Du 2 months ago - 2 comments

#27 - Validation set

Issue - State: closed - Opened by sanjayss34 2 months ago - 1 comment

#27 - Validation set

Issue - State: closed - Opened by sanjayss34 2 months ago - 1 comment

#26 - Question about VideoMME' s certificated length

Issue - State: closed - Opened by EricLina 3 months ago

#26 - Question about VideoMME' s certificated length

Issue - State: closed - Opened by EricLina 3 months ago

#25 - What's the license of Video-MME?

Issue - State: closed - Opened by whwu95 3 months ago - 1 comment

#25 - What's the license of Video-MME?

Issue - State: closed - Opened by whwu95 3 months ago - 1 comment

#24 - Results of LLaVA-Next-video-7B

Issue - State: closed - Opened by farewellthree 3 months ago - 2 comments

#24 - Results of LLaVA-Next-video-7B

Issue - State: closed - Opened by farewellthree 3 months ago - 2 comments

#23 - Aligning Question Count with eval_your_results.py

Issue - State: closed - Opened by JinhuiYE 3 months ago - 1 comment

#23 - Aligning Question Count with eval_your_results.py

Issue - State: closed - Opened by JinhuiYE 3 months ago - 1 comment

#22 - where is the dataset

Issue - State: closed - Opened by Derek-Kun 3 months ago - 1 comment

#22 - where is the dataset

Issue - State: closed - Opened by Derek-Kun 3 months ago - 1 comment

#21 - Exact results number for Figure 3

Issue - State: closed - Opened by Ziyang412 3 months ago - 2 comments

#21 - Exact results number for Figure 3

Issue - State: closed - Opened by Ziyang412 3 months ago - 2 comments

#20 - GPT4o evaluation

Issue - State: closed - Opened by resi1ience 4 months ago - 4 comments

#20 - GPT4o evaluation

Issue - State: closed - Opened by resi1ience 4 months ago - 4 comments

#19 - Question about the evaluation script in the leaderboard

Issue - State: closed - Opened by Richar-Du 4 months ago - 2 comments

#19 - Question about the evaluation script in the leaderboard

Issue - State: closed - Opened by Richar-Du 4 months ago - 2 comments

#18 - how to evaluate gemini-1.5 pro

Issue - State: closed - Opened by royzhang12 4 months ago - 2 comments

#18 - how to evaluate gemini-1.5 pro

Issue - State: closed - Opened by royzhang12 4 months ago - 2 comments

#17 - How to use video-mme?

Issue - State: closed - Opened by OliverLeeXZ 4 months ago - 1 comment

#17 - How to use video-mme?

Issue - State: closed - Opened by OliverLeeXZ 4 months ago - 1 comment

#16 - Certificates of the videos

Issue - State: closed - Opened by Ciel127 4 months ago - 2 comments

#16 - Certificates of the videos

Issue - State: closed - Opened by Ciel127 4 months ago - 2 comments

#15 - Fix leaderboard sorting by LLM parameters on project page

Issue - State: closed - Opened by maxbourke 4 months ago - 1 comment

#15 - Fix leaderboard sorting by LLM parameters on project page

Issue - State: closed - Opened by maxbourke 4 months ago - 1 comment

#14 - A video is broken

Issue - State: closed - Opened by sunh-23 4 months ago - 1 comment

#14 - A video is broken

Issue - State: closed - Opened by sunh-23 4 months ago - 1 comment

#13 - The settings of videollava when reproducing

Issue - State: closed - Opened by Kongyj 5 months ago - 5 comments

#13 - The settings of videollava when reproducing

Issue - State: closed - Opened by Kongyj 5 months ago - 5 comments

#12 - request for participating the leaderboard

Issue - State: closed - Opened by Share14 5 months ago

#12 - request for participating the leaderboard

Issue - State: closed - Opened by Share14 5 months ago

#11 - An open-source video understanding model that supports audio input

Issue - State: closed - Opened by AshOneN 5 months ago - 1 comment

#11 - An open-source video understanding model that supports audio input

Issue - State: closed - Opened by AshOneN 5 months ago - 1 comment

#10 - InternVL-Eval

Issue - State: closed - Opened by BlueBlueFF 5 months ago - 1 comment

#9 - About dataset download

Issue - State: closed - Opened by mary-0830 5 months ago - 1 comment

#8 - where is the question json file?

Issue - State: closed - Opened by mu-cai 5 months ago - 1 comment

#7 - Updated results of VideoChat2 and some problems

Issue - State: closed - Opened by Andy1621 5 months ago - 1 comment

#6 - ❓[Question] How to acquire the subtitles of all videos?

Issue - State: closed - Opened by clownrat6 5 months ago - 1 comment

#5 - internvideo model result？

Issue - State: closed - Opened by BlueBlueFF 5 months ago - 1 comment

#3 - Several urls deprecated

Issue - State: closed - Opened by Lyken17 5 months ago - 1 comment

#2 - Hi, How to evaluate image-vlm model on your video benchmark?

Issue - State: closed - Opened by dragen1860 5 months ago - 3 comments