Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / EvolvingLMMs-Lab/lmms-eval issues and pull requests

#19 - Unable to reproduce llava evaluation

Issue - State: closed - Opened by jacob-hansen 11 months ago - 7 comments
Labels: bug, documentation

#19 - Unable to reproduce llava evaluation

Issue - State: closed - Opened by jacob-hansen 11 months ago - 7 comments
Labels: bug, documentation

#18 - Module 'exact_match' doesn't exist on the Hugging Face Hub either.

Issue - State: closed - Opened by xienan0326 11 months ago - 14 comments

#18 - Module 'exact_match' doesn't exist on the Hugging Face Hub either.

Issue - State: closed - Opened by xienan0326 11 months ago - 14 comments

#17 - Refcoco Metric

Issue - State: open - Opened by Jiahaohong 11 months ago

#16 - Unit of data in More Results

Issue - State: closed - Opened by Jiahaohong 11 months ago - 1 comment

#15 - How to specify dataset paths？

Issue - State: open - Opened by Jiahaohong 11 months ago - 14 comments

#14 - MathVista Eval Support

Issue - State: closed - Opened by yqy2001 11 months ago - 1 comment

#13 - [Tasks] Fix MMBench

Pull Request - State: closed - Opened by pufanyi 11 months ago

#12 - [Feature] Evaluate model with 2gpu per process.

Issue - State: closed - Opened by tzjtatata 11 months ago - 5 comments

#11 - few-shot test error

Issue - State: closed - Opened by youngwanLEE 11 months ago - 2 comments

#10 - cmmmu

Issue - State: closed - Opened by phellonchen 11 months ago - 3 comments

#9 - update version to 0.1.1

Pull Request - State: closed - Opened by pufanyi 11 months ago

#8 - Typo in results sheet for llava-v1.6-vicuna-7b

Issue - State: closed - Opened by FGiuliari 11 months ago - 1 comment

#7 - Fix mmbench dataset submission format

Pull Request - State: closed - Opened by pufanyi 11 months ago

#6 - quetions about the evals

Issue - State: closed - Opened by CrossLee1 11 months ago - 4 comments

#5 - a bug for "exact_match"

Issue - State: closed - Opened by mary-0830 11 months ago - 4 comments

#4 - [Feat] add correct tensor parallelism for larger size model.

Pull Request - State: closed - Opened by Luodian 11 months ago
Labels: enhancement

#3 - Not Support LLava 1.6or llava-Next?

Issue - State: closed - Opened by BlueBlueFF 11 months ago - 3 comments

#2 - llava_bench_wild seems not a valid parameter

Issue - State: closed - Opened by wusize 11 months ago - 1 comment

#1 - pip package

Pull Request - State: closed - Opened by pufanyi 11 months ago