Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / tri-ml/vlm-evaluation issues and pull requests

#16 - [Question] mismatch between bbox and image in RefCOCO

Issue - State: open - Opened by WeitaiKang 4 months ago - 1 comment

#15 - Inconsistent POPE expected number of examples

Issue - State: open - Opened by iancovert 4 months ago

#14 - Script to compute z scores.

Pull Request - State: closed - Opened by kushal-tri 6 months ago

#14 - Script to compute z scores.

Pull Request - State: closed - Opened by kushal-tri 6 months ago

#13 - Transformer version conflict with prismatic-vlm

Issue - State: open - Opened by tangwh20 6 months ago

#12 - Support InstructBLIP AI2D Eval

Pull Request - State: open - Opened by ashwin-balakrishna96 9 months ago

#11 - conflict error: pip install - e .

Issue - State: open - Opened by WenjunHuang94 9 months ago - 4 comments

#10 - The issue of abnormal indicators.

Issue - State: open - Opened by tayton42 10 months ago - 2 comments

#9 - About the number of POPE dataset

Issue - State: closed - Opened by Hannibal046 10 months ago - 1 comment

#8 - Question about the Dataset Type

Issue - State: closed - Opened by Hannibal046 10 months ago - 2 comments

#7 - Evaluation for more datasets

Issue - State: closed - Opened by Lauch1ng 10 months ago - 1 comment

#6 - merge hf-demo <- main

Pull Request - State: closed - Opened by matthiasbuchner 10 months ago

#5 - Add in AI2D Eval

Pull Request - State: closed - Opened by ashwin-balakrishna96 11 months ago

#4 - Evaluation hangs with accelerate over multiple gpus.

Issue - State: open - Opened by tyleryzhu 11 months ago - 3 comments

#3 - Slow model inference when evaluation

Issue - State: closed - Opened by zeyuanyin 11 months ago - 1 comment

#2 - Error when evaluating on POPE-full

Issue - State: closed - Opened by djghosh13 11 months ago - 4 comments

#1 - Infer llava model_dir if model_id is given.

Pull Request - State: closed - Opened by lukaemon 12 months ago