Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / lupantech/mathvista issues and pull requests
#33 - re organize model and utilties.py and evaluation
Issue -
State: open - Opened by YerongLi about 1 month ago
#33 - re organize model and utilties.py and evaluation
Issue -
State: open - Opened by YerongLi about 1 month ago
#32 - Could anyone update on how to use extract answer
Issue -
State: open - Opened by YerongLi about 1 month ago
- 1 comment
#32 - Could anyone update on how to use extract answer
Issue -
State: open - Opened by YerongLi about 1 month ago
- 1 comment
#31 - How can I evaluate MathVista on llava-1.6-vicuna-7b
Issue -
State: open - Opened by Jacksonha7 about 1 month ago
#31 - How can I evaluate MathVista on llava-1.6-vicuna-7b
Issue -
State: open - Opened by Jacksonha7 about 1 month ago
#30 - problem['query'] Missing from the sample output file
Issue -
State: closed - Opened by YerongLi 2 months ago
- 3 comments
#30 - problem['query'] Missing from the sample output file
Issue -
State: closed - Opened by YerongLi 2 months ago
- 3 comments
#29 - Correct the fetching of query variable extract_answer.py
Pull Request -
State: closed - Opened by YerongLi 3 months ago
- 2 comments
#29 - Correct the fetching of query variable extract_answer.py
Pull Request -
State: closed - Opened by YerongLi 3 months ago
- 2 comments
#28 - Date GPT-4V evaluation in README.md
Pull Request -
State: closed - Opened by dandv 3 months ago
- 1 comment
#28 - Date GPT-4V evaluation in README.md
Pull Request -
State: closed - Opened by dandv 3 months ago
- 1 comment
#27 - Questions about GPT-4O score on MathVista?
Issue -
State: closed - Opened by Luodian 6 months ago
- 2 comments
#27 - Questions about GPT-4O score on MathVista?
Issue -
State: closed - Opened by Luodian 6 months ago
- 2 comments
#26 - Update calculate_score.py
Pull Request -
State: closed - Opened by eltociear 6 months ago
#26 - Update calculate_score.py
Pull Request -
State: closed - Opened by eltociear 6 months ago
#25 - How can I evaluate MathVista on llava-7b?
Issue -
State: closed - Opened by QAQdev 8 months ago
#25 - How can I evaluate MathVista on llava-7b?
Issue -
State: closed - Opened by QAQdev 8 months ago
#24 - Syntax Correction Needed in README for Unzipping and Removing Command
Issue -
State: closed - Opened by Aboriginer 9 months ago
- 1 comment
#24 - Syntax Correction Needed in README for Unzipping and Removing Command
Issue -
State: closed - Opened by Aboriginer 9 months ago
- 1 comment
#23 - Gemini and GPT4V output file
Issue -
State: closed - Opened by ggg0919 9 months ago
- 3 comments
#23 - Gemini and GPT4V output file
Issue -
State: closed - Opened by ggg0919 9 months ago
- 3 comments
#22 - Add .devcontainer, update GPT to use OpenAI >1.x, make Claude and Bard imports dynamics and optional, use HuggingFace datasets
Pull Request -
State: closed - Opened by mattmazzola 9 months ago
- 1 comment
#22 - Add .devcontainer, update GPT to use OpenAI >1.x, make Claude and Bard imports dynamics and optional, use HuggingFace datasets
Pull Request -
State: closed - Opened by mattmazzola 9 months ago
- 1 comment
#21 - How to apply for a leaderboard test
Issue -
State: closed - Opened by zRzRzRzRzRzRzR 9 months ago
- 1 comment
#21 - How to apply for a leaderboard test
Issue -
State: closed - Opened by zRzRzRzRzRzRzR 9 months ago
- 1 comment
#20 - Return None when str coercion fails or when empty
Pull Request -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#20 - Return None when str coercion fails or when empty
Pull Request -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#19 - Possible Bug in calculate_score.py, empty responses or extractions results in non-empty normalized extraction due to `get_most_similar`
Issue -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#19 - Possible Bug in calculate_score.py, empty responses or extractions results in non-empty normalized extraction due to `get_most_similar`
Issue -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#18 - What was the intention of `image_path` in the model files such as gpt.py?
Issue -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#18 - What was the intention of `image_path` in the model files such as gpt.py?
Issue -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#17 - Inefficient file write operations - writing entire results dictionary to output path in loops
Issue -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#17 - Inefficient file write operations - writing entire results dictionary to output path in loops
Issue -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#16 - Redundant implementations of `get_chat_response`
Issue -
State: closed - Opened by mattmazzola 10 months ago
#16 - Redundant implementations of `get_chat_response`
Issue -
State: closed - Opened by mattmazzola 10 months ago
#15 - Extract `pid` from problem in extract_answer.py
Pull Request -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#15 - Extract `pid` from problem in extract_answer.py
Pull Request -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#14 - extract_answer.py - When exception occurs in `extract_answer` function, pid referenced in exception handler, but is not defined
Issue -
State: closed - Opened by mattmazzola 10 months ago
#14 - extract_answer.py - When exception occurs in `extract_answer` function, pid referenced in exception handler, but is not defined
Issue -
State: closed - Opened by mattmazzola 10 months ago
#13 - How to use generate_responses.py? (References non-existing utilities module)
Issue -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#13 - How to use generate_responses.py? (References non-existing utilities module)
Issue -
State: closed - Opened by mattmazzola 10 months ago
- 1 comment
#12 - Wrong answer to problems
Issue -
State: closed - Opened by WesleyHsieh0806 10 months ago
- 1 comment
#12 - Wrong answer to problems
Issue -
State: closed - Opened by WesleyHsieh0806 10 months ago
- 1 comment
#11 - Update README.md
Pull Request -
State: closed - Opened by pitmonticone 10 months ago
#10 - About source data
Issue -
State: closed - Opened by steven640pixel 11 months ago
- 1 comment
#10 - About source data
Issue -
State: closed - Opened by steven640pixel 11 months ago
- 1 comment
#9 - GPT4V output file
Issue -
State: closed - Opened by TobiasLee 11 months ago
- 2 comments
#8 - Ordering of hint_text and other text when constructing the query
Issue -
State: closed - Opened by MikeWangWZHL about 1 year ago
- 1 comment
#7 - Problem 479: Incorrect answer to a problem
Issue -
State: closed - Opened by mbchang about 1 year ago
- 1 comment
#6 - Problem 699 (among others): Ambiguous problem about age gap
Issue -
State: closed - Opened by mbchang about 1 year ago
- 1 comment
#5 - Problems 107 and 663 (among others): Duplicated question that does actually not test math ability
Issue -
State: closed - Opened by mbchang about 1 year ago
- 1 comment
#4 - Problem 781: Ambiguous Problem
Issue -
State: closed - Opened by mbchang about 1 year ago
- 1 comment
#3 - Problem 791: Malformed problem
Issue -
State: closed - Opened by mbchang about 1 year ago
- 1 comment
#2 - Problem 272: Mismatch between answer choices in the problem and answer choices in the query
Issue -
State: closed - Opened by mbchang about 1 year ago
- 1 comment
#1 - Reference Part
Issue -
State: closed - Opened by tonysy about 1 year ago
- 1 comment