Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / EvolvingLMMs-Lab/lmms-eval issues and pull requests

#50 - Issues when running evaluation with multiple processes

Issue - State: open - Opened by simplelifetime 10 months ago - 5 comments

#50 - Issues when running evaluation with multiple processes

Issue - State: open - Opened by simplelifetime 10 months ago - 5 comments

#50 - Issues when running evaluation with multiple processes

Issue - State: open - Opened by simplelifetime 10 months ago - 5 comments

#50 - Issues when running evaluation with multiple processes

Issue - State: open - Opened by simplelifetime 10 months ago - 5 comments

#49 - OOM issue

Issue - State: closed - Opened by yiyexy 10 months ago - 1 comment

#49 - OOM issue

Issue - State: closed - Opened by yiyexy 10 months ago - 1 comment

#49 - OOM issue

Issue - State: closed - Opened by yiyexy 10 months ago - 1 comment

#49 - OOM issue

Issue - State: closed - Opened by yiyexy 10 months ago - 1 comment

#48 - 关于CMMMU生成结果截断的问题

Issue - State: open - Opened by lucasjinreal 10 months ago - 4 comments

#48 - 关于CMMMU生成结果截断的问题

Issue - State: open - Opened by lucasjinreal 10 months ago - 4 comments

#48 - 关于CMMMU生成结果截断的问题

Issue - State: open - Opened by lucasjinreal 10 months ago - 4 comments

#48 - 关于CMMMU生成结果截断的问题

Issue - State: open - Opened by lucasjinreal 10 months ago - 4 comments

#47 - Add `llava` model for 🤗 Transformers

Pull Request - State: closed - Opened by lewtun 11 months ago - 10 comments

#47 - Add `llava` model for 🤗 Transformers

Pull Request - State: closed - Opened by lewtun 11 months ago - 10 comments

#47 - Add `llava` model for 🤗 Transformers

Pull Request - State: closed - Opened by lewtun 11 months ago - 10 comments

#47 - Add `llava` model for 🤗 Transformers

Pull Request - State: closed - Opened by lewtun 11 months ago - 10 comments

#46 - [WIP] adding mmbench dev evaluation (#75)

Pull Request - State: closed - Opened by Luodian 11 months ago - 2 comments

#46 - [WIP] adding mmbench dev evaluation (#75)

Pull Request - State: closed - Opened by Luodian 11 months ago - 2 comments

#46 - [WIP] adding mmbench dev evaluation (#75)

Pull Request - State: closed - Opened by Luodian 11 months ago - 2 comments

#46 - [WIP] adding mmbench dev evaluation (#75)

Pull Request - State: closed - Opened by Luodian 11 months ago - 2 comments

#45 - [WIP] add local evaluation for MMBench dev split

Pull Request - State: closed - Opened by Luodian 11 months ago

#45 - [WIP] add local evaluation for MMBench dev split

Pull Request - State: closed - Opened by Luodian 11 months ago

#45 - [WIP] add local evaluation for MMBench dev split

Pull Request - State: closed - Opened by Luodian 11 months ago

#45 - [WIP] add local evaluation for MMBench dev split

Pull Request - State: closed - Opened by Luodian 11 months ago

#44 - [WIP] MMBench evaluate dev split locally

Pull Request - State: closed - Opened by Luodian 11 months ago

#44 - [WIP] MMBench evaluate dev split locally

Pull Request - State: closed - Opened by Luodian 11 months ago

#44 - [WIP] MMBench evaluate dev split locally

Pull Request - State: closed - Opened by Luodian 11 months ago

#44 - [WIP] MMBench evaluate dev split locally

Pull Request - State: closed - Opened by Luodian 11 months ago

#43 - N/A scores when running `mmbench`

Issue - State: closed - Opened by lewtun 11 months ago - 10 comments

#43 - N/A scores when running `mmbench`

Issue - State: closed - Opened by lewtun 11 months ago - 10 comments

#43 - N/A scores when running `mmbench`

Issue - State: closed - Opened by lewtun 11 months ago - 10 comments

#43 - N/A scores when running `mmbench`

Issue - State: closed - Opened by lewtun 11 months ago - 10 comments

#42 - Remove dependency on Llava repo

Issue - State: open - Opened by lewtun 11 months ago - 2 comments

#42 - Remove dependency on Llava repo

Issue - State: open - Opened by lewtun 11 months ago - 2 comments

#42 - Remove dependency on Llava repo

Issue - State: open - Opened by lewtun 11 months ago - 2 comments

#42 - Remove dependency on Llava repo

Issue - State: open - Opened by lewtun 11 months ago - 2 comments

#39 - [DO NOT MERGE NOW] [Feat] Few shot eval

Pull Request - State: closed - Opened by pufanyi 11 months ago

#39 - [DO NOT MERGE NOW] [Feat] Few shot eval

Pull Request - State: closed - Opened by pufanyi 11 months ago

#39 - [DO NOT MERGE NOW] [Feat] Few shot eval

Pull Request - State: closed - Opened by pufanyi 11 months ago

#39 - [DO NOT MERGE NOW] [Feat] Few shot eval

Pull Request - State: closed - Opened by pufanyi 11 months ago

#38 - The discord link is expired

Issue - State: closed - Opened by caopulan 11 months ago - 2 comments

#38 - The discord link is expired

Issue - State: closed - Opened by caopulan 11 months ago - 2 comments

#38 - The discord link is expired

Issue - State: closed - Opened by caopulan 11 months ago - 2 comments

#38 - The discord link is expired

Issue - State: closed - Opened by caopulan 11 months ago - 2 comments

#37 - Joshua/olympiadbench

Pull Request - State: closed - Opened by JvThunder 11 months ago

#37 - Joshua/olympiadbench

Pull Request - State: closed - Opened by JvThunder 11 months ago

#37 - Joshua/olympiadbench

Pull Request - State: closed - Opened by JvThunder 11 months ago

#37 - Joshua/olympiadbench

Pull Request - State: closed - Opened by JvThunder 11 months ago

#36 - [Fix] repr llava doc

Pull Request - State: closed - Opened by cocoshe 11 months ago - 5 comments

#36 - [Fix] repr llava doc

Pull Request - State: closed - Opened by cocoshe 11 months ago - 5 comments

#36 - [Fix] repr llava doc

Pull Request - State: closed - Opened by cocoshe 11 months ago - 5 comments

#34 - Llava1.6 Mistral ScienceQA Performance

Issue - State: open - Opened by daniel-z-kaplan 11 months ago - 2 comments

#34 - Llava1.6 Mistral ScienceQA Performance

Issue - State: open - Opened by daniel-z-kaplan 11 months ago - 2 comments

#34 - Llava1.6 Mistral ScienceQA Performance

Issue - State: open - Opened by daniel-z-kaplan 11 months ago - 2 comments

#34 - Llava1.6 Mistral ScienceQA Performance

Issue - State: open - Opened by daniel-z-kaplan 11 months ago - 2 comments

#32 - Can not using multiple batch on MMBench

Issue - State: open - Opened by lucasjinreal 11 months ago - 4 comments

#32 - Can not using multiple batch on MMBench

Issue - State: open - Opened by lucasjinreal 11 months ago - 4 comments

#32 - Can not using multiple batch on MMBench

Issue - State: open - Opened by lucasjinreal 11 months ago - 4 comments

#31 - Evaluation with multiple GPUs

Issue - State: open - Opened by lucasjinreal 11 months ago - 13 comments

#31 - Evaluation with multiple GPUs

Issue - State: open - Opened by lucasjinreal 11 months ago - 13 comments

#31 - Evaluation with multiple GPUs

Issue - State: open - Opened by lucasjinreal 11 months ago - 13 comments

#31 - Evaluation with multiple GPUs

Issue - State: open - Opened by lucasjinreal 11 months ago - 13 comments

#29 - Local dataasets config didn't work

Issue - State: open - Opened by lucasjinreal 11 months ago

#29 - Local dataasets config didn't work

Issue - State: open - Opened by lucasjinreal 11 months ago

#28 - add_ocrbench

Pull Request - State: closed - Opened by echo840 11 months ago - 1 comment

#28 - add_ocrbench

Pull Request - State: closed - Opened by echo840 11 months ago - 1 comment

#27 - Performance about cuda version

Issue - State: open - Opened by xmu-xiaoma666 11 months ago - 1 comment

#27 - Performance about cuda version

Issue - State: open - Opened by xmu-xiaoma666 11 months ago - 1 comment

#26 - upload dataset

Issue - State: closed - Opened by echo840 11 months ago

#26 - upload dataset

Issue - State: closed - Opened by echo840 11 months ago

#24 - [Fix] Fix llava reproduce error

Pull Request - State: closed - Opened by kcz358 11 months ago

#24 - [Fix] Fix llava reproduce error

Pull Request - State: closed - Opened by kcz358 11 months ago

#23 - How to load dataset in offline mode?

Issue - State: closed - Opened by pipixin321 11 months ago - 2 comments

#23 - How to load dataset in offline mode?

Issue - State: closed - Opened by pipixin321 11 months ago - 2 comments

#22 - How to debug in vscode

Issue - State: closed - Opened by xmu-xiaoma666 11 months ago - 1 comment

#22 - How to debug in vscode

Issue - State: closed - Opened by xmu-xiaoma666 11 months ago - 1 comment

#21 - Config will not be added to registry

Issue - State: open - Opened by xienan0326 11 months ago - 2 comments

#21 - Config will not be added to registry

Issue - State: open - Opened by xienan0326 11 months ago - 2 comments