Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / JohnSnowLabs/nlptest issues and pull requests

#456 - update QA is_pass

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#455 - fix eval score

Pull Request - State: closed - Opened by alytarik over 1 year ago

#454 - Fix/tutorial nbs

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#453 - Fix/tutorial nbs

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#452 - DRAFT: Fix/max f1 score

Pull Request - State: closed - Opened by alytarik over 1 year ago

#451 - update summarization prompt

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#450 - fix format for qa task

Pull Request - State: closed - Opened by alytarik over 1 year ago

#449 - hot-fix/XSum-test

Pull Request - State: closed - Opened by Prikshit7766 over 1 year ago

#448 - Update/docs for summarization

Pull Request - State: closed - Opened by Prikshit7766 over 1 year ago - 5 comments

#447 - hot-fix: harness_config in Harness Class

Pull Request - State: closed - Opened by chakravarthik27 over 1 year ago

#446 - Feature/accuracy fairness for summarization

Pull Request - State: closed - Opened by alytarik over 1 year ago

#445 - Feature/update bias in summarization

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#443 - Update docs for summarization on website

Issue - State: closed - Opened by ArshaanNazir over 1 year ago
Labels: documentation, v1.3.0

#442 - Curate dataset for bias from NarrativeQA

Issue - State: open - Opened by dcecchini over 1 year ago
Labels: low priority, v1.4.0

#441 - Update documentation of models on webpage

Issue - State: open - Opened by dcecchini over 1 year ago
Labels: v1.4.0

#440 - Curate datataset for bias from CNN/Daily Mail

Issue - State: open - Opened by dcecchini over 1 year ago
Labels: medium priority, v1.4.0

#439 - Add more datasets benchmarks for QA

Issue - State: open - Opened by dcecchini over 1 year ago
Labels: v1.4.0

#438 - Create Toxicity test

Issue - State: open - Opened by dcecchini over 1 year ago
Labels: v1.4.0

#437 - Research NMT in NLP Test

Issue - State: open - Opened by dcecchini over 1 year ago
Labels: v1.4.0

#436 - feature/add_ocr_typo_for_QA_and_Summarization

Pull Request - State: closed - Opened by Prikshit7766 over 1 year ago

#435 - Chore: add logos to landing page

Pull Request - State: closed - Opened by luca-martial over 1 year ago

#434 - Draft: Chore: website logos additions

Pull Request - State: closed - Opened by luca-martial over 1 year ago

#433 - feature/add-support-for-summarization

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#432 - Clean the tutorial notebooks

Issue - State: closed - Opened by ArshaanNazir over 1 year ago
Labels: fixes, v1.3.0

#431 - tutorials/Cleaned notebooks

Pull Request - State: closed - Opened by Prikshit7766 over 1 year ago

#430 - feature/fairness for qa task

Pull Request - State: closed - Opened by alytarik over 1 year ago
Labels: feature, v1.3.0

#429 - Docs/add disclaimer for QAEval

Pull Request - State: closed - Opened by RakshitKhajuria over 1 year ago

#428 - feature/added ocr typo test

Pull Request - State: closed - Opened by Prikshit7766 over 1 year ago

#427 - common_OCR_mistakes_correction

Pull Request - State: closed - Opened by Prikshit7766 over 1 year ago

#426 - Add disclaimer in QAEval docs

Issue - State: closed - Opened by dcecchini over 1 year ago
Labels: documentation, good first issue, v1.3.0

#425 - Release/1.2.0

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#424 - False Negative Results in swap_entities robustness Test

Issue - State: closed - Opened by RakshitKhajuria over 1 year ago - 1 comment
Labels: bug

#423 - Sponsors in readme

Pull Request - State: closed - Opened by agsfer over 1 year ago - 1 comment

#417 - Feature/dyslexia swap feature

Pull Request - State: open - Opened by ArkajyotiChakraborty over 1 year ago

#416 - Docs/website number to word robustnes test

Pull Request - State: closed - Opened by RakshitKhajuria over 1 year ago

#415 - Release/1.2.0

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#414 - docs/added Number to word robustness tests

Pull Request - State: closed - Opened by RakshitKhajuria over 1 year ago

#413 - Docs/number to word robustness test

Pull Request - State: closed - Opened by RakshitKhajuria over 1 year ago

#412 - Docs/website llm accuracy tests

Pull Request - State: closed - Opened by alytarik over 1 year ago

#411 - notebooks and default_config paths updated.

Pull Request - State: closed - Opened by chakravarthik27 over 1 year ago
Labels: fixes

#410 - added number_to_words test to robustness nb

Pull Request - State: closed - Opened by RakshitKhajuria over 1 year ago

#409 - Fix: switch default HF classifier dataset from tweet to imdb

Pull Request - State: closed - Opened by luca-martial over 1 year ago

#408 - Fix prompt template llm and transformer version

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#407 - Fix/llm accuracy bug fix

Pull Request - State: closed - Opened by alytarik over 1 year ago

#406 - fix typo and order of columns

Pull Request - State: closed - Opened by alytarik over 1 year ago

#405 - Feature: Add representation tests for LLMs

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#404 - Feature: Add support for bias tests for question answering

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#403 - Chore: Adding supported hubs as logos to landing page

Pull Request - State: closed - Opened by luca-martial over 1 year ago

#402 - Fix: default HF text classification model issue

Pull Request - State: closed - Opened by chakravarthik27 over 1 year ago
Labels: fixes

#401 - Chore: Website updates for new LLMs and pages

Pull Request - State: closed - Opened by luca-martial over 1 year ago

#400 - Fix/bias_tests Enable multi-token name replacements

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago - 1 comment
Labels: fixes

#395 - Bias replace test issue

Issue - State: closed - Opened by ArshaanNazir over 1 year ago
Labels: fixes, v1.2.0

#394 - DRAFT: Feature/accuracy for qa task

Pull Request - State: closed - Opened by alytarik over 1 year ago

#393 - Issue in ethnicity religion names

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#392 - Default HF classification model is not working

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: fixes, v1.2.0

#391 - Issues in ethnicity/religion names in utils.py

Issue - State: closed - Opened by ArshaanNazir over 1 year ago
Labels: fixes, v1.2.0

#390 - Add boolq dev dataset

Pull Request - State: closed - Opened by alytarik over 1 year ago

#389 - Add unit tests for LLMs (keeping in mind cost)

Issue - State: open - Opened by luca-martial over 1 year ago
Labels: fixes

#388 - Feature: Adding support for 4 new LLM APIs

Pull Request - State: closed - Opened by chakravarthik27 over 1 year ago

#386 - Add support for NaturalQuestions (closed-book)

Issue - State: open - Opened by luca-martial over 1 year ago
Labels: feature, v1.3.0

#385 - Add support for summarization with the `XSum` dataset

Issue - State: closed - Opened by luca-martial over 1 year ago - 1 comment
Labels: feature, v1.3.0

#384 - Curate bias dataset from BoolQ (full dataset)

Issue - State: open - Opened by luca-martial over 1 year ago
Labels: low priority, feature

#383 - Curate bias dataset from BoolQ-test

Issue - State: open - Opened by luca-martial over 1 year ago
Labels: feature, v1.3.0

#381 - Issue 374 add representation tests

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#380 - Add support for Speech2Text typos

Issue - State: open - Opened by luca-martial over 1 year ago - 3 comments
Labels: good first issue, feature, v1.4.0

#379 - Add support for OCR typos test

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: good first issue, feature, v1.3.0

#378 - fix/task test supoort check

Pull Request - State: closed - Opened by alytarik over 1 year ago - 1 comment

#377 - Feature: Add support for number to words robustness test

Pull Request - State: closed - Opened by RakshitKhajuria over 1 year ago

#375 - Review issues with QAEval in OpenAI Natural Questions

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: bug, medium priority, v1.3.0

#374 - Add representation testing for OpenAI question-answering on BoolQ and Natural Questions

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: feature, v1.2.0

#373 - Add fairness testing for question-answering on BoolQ and Natural Questions

Issue - State: open - Opened by luca-martial over 1 year ago
Labels: feature, v1.3.0

#372 - Add accuracy testing for OpenAI question-answering on BoolQ and Natural Questions

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: feature, v1.2.0

#371 - Add bias testing for OpenAI question-answering on BoolQ and Natural Questions

Issue - State: closed - Opened by luca-martial over 1 year ago - 1 comment
Labels: feature, v1.2.0

#370 - Add support for 5 new LLM APIs

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: feature, v1.2.0

#369 - Chore: Website updates for LLM release

Pull Request - State: closed - Opened by luca-martial over 1 year ago

#368 - Update notebooks

Pull Request - State: closed - Opened by alytarik over 1 year ago - 1 comment

#367 - Release/1.1.0

Pull Request - State: closed - Opened by luca-martial over 1 year ago

#366 - update boolQ prompt

Pull Request - State: closed - Opened by ArshaanNazir over 1 year ago

#365 - Get rid of langchain warning when trying to use chat models

Issue - State: open - Opened by luca-martial over 1 year ago
Labels: fixes

#364 - Add supported tasks page under Test Harness section in website

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: maintenance, v1.2.0

#363 - Add supported hubs page under Test Harness section in website

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: maintenance, v1.2.0

#362 - Add config page under Test Harness section in website

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: maintenance, v1.2.0

#360 - Draft: Issue 349 llm modelhandler

Pull Request - State: closed - Opened by chakravarthik27 over 1 year ago

#359 - Refactor how perturbations are applied to samples for QA vs other tasks

Issue - State: open - Opened by luca-martial over 1 year ago
Labels: fixes, v1.3.0

#357 - Create a tutorial notebook for testing OpenAI models with nlptest

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: maintenance

#356 - Model parameters should be regrouped in config file

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: fixes

#355 - Remove API key from config files, make user set it as env variable instead

Issue - State: closed - Opened by luca-martial over 1 year ago - 1 comment
Labels: fixes

#354 - `defaults` in config file should go under the `tests` section

Issue - State: closed - Opened by luca-martial over 1 year ago - 2 comments
Labels: fixes

#353 - Update website and docs with LLM integration

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: maintenance

#352 - Add support for number_to_word test

Issue - State: closed - Opened by alytarik over 1 year ago - 2 comments
Labels: good first issue, feature

#351 - Add support for slangificator test

Issue - State: open - Opened by alytarik over 1 year ago
Labels: good first issue, feature, v1.4.0

#350 - Create QASample and its subclasses

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: feature

#349 - Create llm_modelhandler using langchain - supporting OpenAI

Issue - State: closed - Opened by luca-martial over 1 year ago
Labels: feature

#348 - Fix/country names

Pull Request - State: closed - Opened by alytarik over 1 year ago - 1 comment

#347 - fix country names

Pull Request - State: closed - Opened by alytarik over 1 year ago - 3 comments