Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / qcri/llmebench issues and pull requests

#370 - Add wise-24 assets

Pull Request - State: open - Opened by MohamedBayan 7 days ago

#369 - fix dataset MultiNativQA

Pull Request - State: closed - Opened by AridHasan 2 months ago

#368 - Need to fix QA assets structure

Issue - State: open - Opened by firojalam 2 months ago

#367 - Update MultiNativQA.py

Pull Request - State: closed - Opened by AridHasan 2 months ago

#366 - fix gpt4 assets for MultiNativQA

Pull Request - State: closed - Opened by AridHasan 2 months ago

#362 - add asset GPT4-o TR

Pull Request - State: closed - Opened by AridHasan 3 months ago

#361 - add asset GPT4-o NE

Pull Request - State: closed - Opened by AridHasan 3 months ago

#360 - add asset GPT4-o HI

Pull Request - State: closed - Opened by AridHasan 3 months ago

#359 - add asset GPT4-o EN-QA

Pull Request - State: closed - Opened by AridHasan 3 months ago

#358 - add asset GPT4-o EN-BD

Pull Request - State: closed - Opened by AridHasan 3 months ago

#357 - add asset GPT4-o BN-IN

Pull Request - State: closed - Opened by AridHasan 3 months ago

#356 - add asset GPT4-o BN-BD

Pull Request - State: closed - Opened by AridHasan 3 months ago

#355 - add asset GPT4-o ASM

Pull Request - State: closed - Opened by AridHasan 3 months ago

#354 - update post-processing GPT4-o AR

Pull Request - State: closed - Opened by AridHasan 3 months ago

#353 - add mistral asset TR

Pull Request - State: closed - Opened by AridHasan 3 months ago

#352 - add mistral asset NE

Pull Request - State: closed - Opened by AridHasan 3 months ago

#351 - add mistral asset HI

Pull Request - State: closed - Opened by AridHasan 3 months ago

#350 - add mistral asset EN-QA

Pull Request - State: closed - Opened by AridHasan 3 months ago

#349 - add mistral asset EN-BD

Pull Request - State: closed - Opened by AridHasan 3 months ago

#348 - add mistral asset BN-IN

Pull Request - State: closed - Opened by AridHasan 3 months ago

#347 - add mistral asset BN-BD

Pull Request - State: closed - Opened by AridHasan 3 months ago

#346 - fix assistant prompt

Pull Request - State: closed - Opened by AridHasan 3 months ago

#345 - add mistral asset MNQA ASM

Pull Request - State: closed - Opened by AridHasan 3 months ago

#344 - update mistral prompt MNQA AR

Pull Request - State: closed - Opened by AridHasan 3 months ago

#343 - update prompt MNQA AR

Pull Request - State: closed - Opened by AridHasan 3 months ago

#342 - update prompt MNQA TR

Pull Request - State: closed - Opened by AridHasan 3 months ago

#341 - update prompt MNQA ASM

Pull Request - State: closed - Opened by AridHasan 3 months ago

#340 - update prompt MNQA EN-QA

Pull Request - State: closed - Opened by AridHasan 3 months ago

#339 - update prompt MNQA NE

Pull Request - State: closed - Opened by AridHasan 3 months ago

#338 - update prompt MNQA HI

Pull Request - State: closed - Opened by AridHasan 3 months ago

#337 - update prompt MNQA EN-BD

Pull Request - State: closed - Opened by AridHasan 3 months ago

#336 - update prompt MNQA BN-IN

Pull Request - State: closed - Opened by AridHasan 3 months ago

#335 - updating prompt for MultiNativQA BN-BD

Pull Request - State: closed - Opened by AridHasan 3 months ago

#334 - updating prompt for MultiNativQA BN-BD

Pull Request - State: closed - Opened by AridHasan 3 months ago

#333 - updating prompt for arabic MultiNativQA

Pull Request - State: closed - Opened by AridHasan 3 months ago

#332 - Release v1.0.1

Pull Request - State: closed - Opened by fdalvi 4 months ago

#330 - Bump version to v1.0.0

Pull Request - State: closed - Opened by fdalvi 4 months ago

#329 - Add a new `assets` subcommand to manage assets.

Pull Request - State: closed - Opened by fdalvi 4 months ago - 1 comment

#328 - added test for AzureModel

Pull Request - State: closed - Opened by firojalam 4 months ago

#327 - Add Python 3.11 as supported version

Pull Request - State: closed - Opened by firojalam 4 months ago

#326 - Feat/anthropic

Pull Request - State: closed - Opened by firojalam 4 months ago - 1 comment

#325 - VLLMLlama3 deployment

Pull Request - State: closed - Opened by firojalam 4 months ago

#324 - updated information about current models and assets

Pull Request - State: closed - Opened by firojalam 4 months ago

#323 - anthropic model (Sonet tested) and a asset file added

Pull Request - State: closed - Opened by firojalam 4 months ago

#322 - update of the PR: https://github.com/qcri/LLMeBench/pull/321

Pull Request - State: closed - Opened by firojalam 4 months ago

#321 - VLLM/FastChat updates

Pull Request - State: closed - Opened by fdalvi 5 months ago - 1 comment

#320 - openai api refactoring update

Pull Request - State: closed - Opened by firojalam 5 months ago

#319 - asset MultiNativQA-Llama3 for Turkish

Pull Request - State: closed - Opened by AridHasan 5 months ago

#318 - asset MultiNativQA-Llama3 for Nepali

Pull Request - State: closed - Opened by AridHasan 5 months ago

#317 - asset MultiNativQA-Llama3 for Hindi

Pull Request - State: closed - Opened by AridHasan 5 months ago

#316 - Subjectivity/thati ar dataset -- assets llama3

Pull Request - State: closed - Opened by firojalam 5 months ago

#315 - asset MultiNativQA-Llama3 for English Qatar

Pull Request - State: closed - Opened by AridHasan 5 months ago

#314 - asset MultiNativQA-Llama3 for English BD

Pull Request - State: closed - Opened by AridHasan 5 months ago

#313 - asset MultiNativQA-Llama3 for Assamese

Pull Request - State: closed - Opened by AridHasan 5 months ago

#312 - asset MultiNativQA-Llama3 for Bangla IN

Pull Request - State: closed - Opened by AridHasan 5 months ago

#311 - asset MultiNativQA-Llama3 for Bangla BD

Pull Request - State: closed - Opened by AridHasan 5 months ago

#310 - sentiment llama3 assest

Pull Request - State: closed - Opened by firojalam 5 months ago

#309 - added assets ArMemes_Image_GPT4V_ZeroShot

Pull Request - State: closed - Opened by firojalam 5 months ago

#308 - subjectivity tasks/datasets implemented by Reem

Pull Request - State: closed - Opened by firojalam 5 months ago

#307 - Feat/natural qa

Pull Request - State: closed - Opened by firojalam 5 months ago

#306 - GPT-4 vision, dataset and assests added

Pull Request - State: closed - Opened by firojalam 6 months ago

#305 - Added Fanar 7b assets for QA tasks, edited sentiment asset to reflect…

Pull Request - State: closed - Opened by MaramHasanain 6 months ago - 1 comment

#304 - Added Jais results for in 11 assests/tasks

Pull Request - State: closed - Opened by firojalam 6 months ago

#303 - added jais score

Pull Request - State: closed - Opened by firojalam 6 months ago

#302 - added jais score for attentionworthy

Pull Request - State: closed - Opened by firojalam 6 months ago

#301 - added jais score

Pull Request - State: closed - Opened by firojalam 6 months ago

#300 - Jais/demographic/location

Pull Request - State: closed - Opened by firojalam 6 months ago

#299 - Arid main branch, from which other branches inherited

Pull Request - State: closed - Opened by firojalam 6 months ago

#298 - Tests for new model

Issue - State: open - Opened by MaramHasanain 6 months ago

#297 - Jais/sarcasm/ar sarcasm2

Pull Request - State: closed - Opened by firojalam 7 months ago - 1 comment

#296 - added VLLM-fanar model

Pull Request - State: closed - Opened by firojalam 7 months ago - 1 comment

#295 - formatting-issues updated

Pull Request - State: closed - Opened by firojalam 7 months ago

#294 - Issue with OSACT4SubtaskB dataset loading

Issue - State: open - Opened by AridHasan 7 months ago

#293 - Add score Jais/sarcasm/ar sarcasm2

Pull Request - State: closed - Opened by AridHasan 9 months ago

#292 - Add score Jais/semantics/sts/semeval17t2

Pull Request - State: closed - Opened by AridHasan 9 months ago

#291 - Add score Jais/semantics/sts/semeval17t1

Pull Request - State: closed - Opened by AridHasan 9 months ago

#290 - Add score Jais/semantics/sts/q2q

Pull Request - State: closed - Opened by AridHasan 9 months ago

#289 - Add score Jais/news/alkhaleej

Pull Request - State: closed - Opened by AridHasan 9 months ago

#288 - Add score Jais/news/alarabia

Pull Request - State: closed - Opened by AridHasan 9 months ago

#287 - Add score Jais/news/akhbarona

Pull Request - State: closed - Opened by AridHasan 9 months ago

#286 - Add score Jais/factuality/subjectivity

Pull Request - State: closed - Opened by AridHasan 9 months ago

#285 - Add score Jais/factuality/spam

Pull Request - State: closed - Opened by AridHasan 9 months ago

#284 - Add score Jais/factuality/propaganda

Pull Request - State: closed - Opened by AridHasan 9 months ago

#283 - Add score Jais/factuality/harm

Pull Request - State: closed - Opened by AridHasan 9 months ago

#282 - Add score Jais/factuality/factuality/unified fc

Pull Request - State: closed - Opened by AridHasan 9 months ago

#281 - Add score Jais/factuality/factuality/covid19

Pull Request - State: closed - Opened by AridHasan 9 months ago

#280 - Add score Jais/factuality/factuality/ans

Pull Request - State: closed - Opened by AridHasan 9 months ago

#279 - Add score Jais/factuality/claim

Pull Request - State: closed - Opened by AridHasan 9 months ago

#278 - Jais/factuality/checkworthy

Pull Request - State: closed - Opened by AridHasan 9 months ago

#277 - Jais/factuality/attentionworthy

Pull Request - State: closed - Opened by AridHasan 9 months ago

#276 - Add jais benchmark score for Factuality adult content

Pull Request - State: closed - Opened by AridHasan 9 months ago

#275 - Add jais benchmark score for Location

Pull Request - State: closed - Opened by AridHasan 9 months ago

#274 - Add Jais benchmark score for ArapTweet

Pull Request - State: closed - Opened by AridHasan 9 months ago

#273 - updated tutorial with video links

Pull Request - State: closed - Opened by firojalam 10 months ago

#272 - updated bib entries

Pull Request - State: closed - Opened by firojalam 10 months ago

#271 - feat/subjectivity/jais13b zeroshot

Pull Request - State: closed - Opened by firojalam 10 months ago