Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / nlp-uoregon/mlmm-evaluation issues and pull requests

#14 - The leaderboard is broken

Issue - State: open - Opened by constanzafierro 3 months ago - 2 comments

#13 - Falcon Multilingual Results

Pull Request - State: open - Opened by Mugariya 6 months ago

#12 - Few Shot configuration

Issue - State: open - Opened by Nkluge-correa 6 months ago

#11 - Add Azerbaijani(Arabic Script) to languages

Issue - State: open - Opened by Jalilnkh 6 months ago

#10 - Please add support for Adapter Models

Issue - State: open - Opened by 1rsh 8 months ago - 1 comment

#9 - feature: evaluate Qwen2-7B on ar_arc dataset

Pull Request - State: open - Opened by mouhandalkadri 8 months ago

#8 - Need to submit results

Issue - State: open - Opened by Mugariya 8 months ago

#7 - How to use multiple gpu for inference?

Issue - State: open - Opened by SefaZeng 8 months ago

#6 - Doesn't work with any HF model

Issue - State: open - Opened by PovedaAqui 9 months ago - 1 comment

#5 - Not Support English MMLU?

Issue - State: open - Opened by moore3930 9 months ago - 1 comment

#4 - ollama installed models

Issue - State: open - Opened by PovedaAqui 9 months ago - 1 comment

#3 - feature: evaluate Jais13B on ar_arc dataset

Pull Request - State: open - Opened by mouhandalkadri 10 months ago

#2 - ARC-Easy Dataset

Issue - State: open - Opened by yaof20 11 months ago

#1 - Got stuck when evaluating MMLU

Issue - State: open - Opened by zhangliang-04 about 1 year ago - 4 comments