IBM/unitxt issues and pull requests

#903 - Rename AddFields to Set, a name that represent its role better and concisely

Pull Request - State: closed - Opened by elronbandel 4 months ago

#902 - Add TokensSlice operator

Pull Request - State: closed - Opened by elronbandel 4 months ago

#901 - split train to train and validation sets in billsum

Pull Request - State: closed - Opened by alonh 4 months ago - 1 comment

#900 - Add input type checking in LoadFromDictionary

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#899 - Update glossary.rst

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#898 - Improve demo

Pull Request - State: closed - Opened by elronbandel 4 months ago

#897 - Fix demo and organize files

Pull Request - State: closed - Opened by elronbandel 4 months ago - 1 comment

#896 - Update gradio version on website

Pull Request - State: closed - Opened by elronbandel 4 months ago

#895 - Fix huggingface assets to have versions and up to date readme

Pull Request - State: closed - Opened by elronbandel 4 months ago

#894 - fixed the pitty diff in perplexity result

Pull Request - State: closed - Opened by dafnapension 4 months ago - 1 comment

#893 - Add optional default values to task fields

Issue - State: open - Opened by yoavkatz 4 months ago - 4 comments

#892 - Make sacrebleu robust

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#891 - Add view option for Task definitions in UI explorer.

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#890 - use aggregators as a uniform incarnation for the across-instances computation for both instance and global metrics

Pull Request - State: open - Opened by dafnapension 4 months ago

#889 - Touch up numeric nlg

Pull Request - State: closed - Opened by elronbandel 4 months ago

#888 - Allow eager execution

Pull Request - State: closed - Opened by elronbandel 4 months ago

#887 - Added tags and descriptions to safety cards

Pull Request - State: closed - Opened by bnayahu 4 months ago

#886 - Improved documentation

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#885 - Unitxt explores fails on generation tasks that require additional dependencies

Issue - State: closed - Opened by yoavkatz 4 months ago - 2 comments
Labels: bug

#884 - Using cached metrics in consecutive test_card runs can be faulty

Issue - State: open - Opened by antonioan 4 months ago - 3 comments

#883 - Michal Jacovi's completed manual review of the card descriptions

Pull Request - State: closed - Opened by dafnapension 4 months ago

#882 - Add numeric nlg dataset

Pull Request - State: closed - Opened by ShirApp 4 months ago

#881 - Add numeric nlg dataset

Pull Request - State: closed - Opened by ShirApp 4 months ago

#880 - Add numeric nlg dataset

Pull Request - State: closed - Opened by ShirApp 4 months ago - 1 comment

#879 - Update version to 1.10.0

Pull Request - State: closed - Opened by elronbandel 4 months ago

#878 - Fix operator and metrics data bugs and add metric prefix in main

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#877 - Typo fix in unitext operators docs

Pull Request - State: closed - Opened by duckling69 4 months ago - 1 comment

#876 - change CopyFields operators name to Copy

Pull Request - State: closed - Opened by duckling69 4 months ago - 3 comments

#875 - Fix operator and metrics data bugs and add metric prefix

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#874 - In card preparers, generate the tags with "singletons" rather than values paired with True

Pull Request - State: closed - Opened by dafnapension 4 months ago - 3 comments

#873 - LLMaaJ implementation of MLCommons' simple-safety-tests

Pull Request - State: closed - Opened by bnayahu 4 months ago - 2 comments

#872 - Add to_list_by_hyphen_space processor

Pull Request - State: closed - Opened by marukaz 4 months ago - 4 comments

#871 - Convert outputs to list by hyphen with a space ("- ")

Issue - State: closed - Opened by marukaz 4 months ago

#870 - Add Mt-Bench datasets + add operators

Pull Request - State: closed - Opened by OfirArviv 4 months ago

#869 - Documentation Typo

Issue - State: closed - Opened by allyssonf 4 months ago

#868 - Modified recipe and dataset creation to support data classification policy

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#867 - add MinimumOneExamplePerLabelRefiner

Pull Request - State: closed - Opened by alonh 4 months ago

#866 - Fix code blocks in loaders docs

Pull Request - State: closed - Opened by elronbandel 4 months ago

#865 - Adding go emotions dataset

Pull Request - State: closed - Opened by shaigrt 4 months ago

#864 - Add documntation to loaders

Pull Request - State: closed - Opened by elronbandel 4 months ago - 1 comment

#863 - Adding operator tutorial and standarizing operators names

Pull Request - State: closed - Opened by elronbandel 4 months ago - 1 comment

#862 - Modest eager

Pull Request - State: closed - Opened by dafnapension 4 months ago - 1 comment

#861 - Improved testing of cards

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#860 - Added loader from HF spaces

Pull Request - State: closed - Opened by pawelknes 4 months ago - 2 comments

#859 - Update CONTRIBUTING.md

Pull Request - State: closed - Opened by elronbandel 4 months ago

#858 - Add relation extraction

Pull Request - State: open - Opened by pklpriv 4 months ago - 3 comments

#857 - Add new Loader from Huggingface space

Issue - State: closed - Opened by yoavkatz 4 months ago

#856 - FormTask deprecation

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#855 - Explorer UI crashed when no templates were defined in card

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#854 - Implementation of select safety benchmarks

Pull Request - State: closed - Opened by bnayahu 4 months ago - 1 comment

#853 - Implementation of select safety benchmarks

Pull Request - State: closed - Opened by bnayahu 4 months ago

#852 - Changes to introduction page

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#851 - Update version to 1.9.0

Pull Request - State: closed - Opened by elronbandel 4 months ago

#850 - Rename task

Pull Request - State: closed - Opened by elronbandel 4 months ago

#849 - Updated documentation

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#848 - Fix default format

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#847 - Update llm_as_judge.rst

Pull Request - State: closed - Opened by yoavkatz 4 months ago

#846 - Add seperation between eagered streams and regular streams

Pull Request - State: closed - Opened by elronbandel 4 months ago

#845 - Simplified and thereby extended grouping, filtering, and splitting to control-comparison, over to global metrics and to bulk-instance metrics

Pull Request - State: closed - Opened by dafnapension 5 months ago - 2 comments

#844 - Ensure consistent evaluation of CI across implementations [Might change previous results]

Pull Request - State: closed - Opened by dafnapension 5 months ago

#843 - Eagerizing through ListStreams and GeneratorStreams

Pull Request - State: closed - Opened by dafnapension 5 months ago - 7 comments

#842 - Rename FormTask to Task

Pull Request - State: closed - Opened by elronbandel 5 months ago - 1 comment

#841 - Add to all base operator eager mode

Issue - State: open - Opened by elronbandel 5 months ago - 1 comment

#840 - Wrong naming and compositions

Issue - State: open - Opened by elronbandel 5 months ago - 2 comments

#839 - Skip artifact prepare and verify in catalog consistency tests

Pull Request - State: closed - Opened by elronbandel 5 months ago

#838 - Fix catalog reference

Pull Request - State: closed - Opened by elronbandel 5 months ago

#837 - catalog items that depends on huggingface and needs approval of HF terms cannot work

Issue - State: open - Opened by OfirArviv 5 months ago
Labels: bug

#836 - Fixed YesNoTemplate and Diverse LabelSampler, to support binary task typing.

Pull Request - State: closed - Opened by yoavkatz 5 months ago

#835 - Attaq500

Pull Request - State: closed - Opened by naamaz 5 months ago

#834 - Produce should not run assertion on the output on a template

Issue - State: open - Opened by OfirArviv 5 months ago

#833 - Separate tests to python 3.8 and 3.9 tests

Issue - State: open - Opened by OfirArviv 5 months ago

#832 - Ner typing had a mistake.

Pull Request - State: closed - Opened by yoavkatz 5 months ago

#831 - Add tldr dataset

Pull Request - State: closed - Opened by perlitz 5 months ago

#830 - Add billsum dataset

Pull Request - State: closed - Opened by perlitz 5 months ago

#829 - Fix missing mandatory new line in the begging of code block in documentation

Pull Request - State: closed - Opened by elronbandel 5 months ago

#828 - Add financebench

Pull Request - State: closed - Opened by perlitz 5 months ago

#827 - Add 5 legalbench tasks (the 5 existing in HELM)

Pull Request - State: closed - Opened by perlitz 5 months ago - 1 comment

#826 - Add metadata to every instance task_data

Pull Request - State: closed - Opened by elronbandel 5 months ago - 1 comment

#825 - Fix clash between dir names and artifact names in catalog website

Pull Request - State: closed - Opened by elronbandel 5 months ago

#824 - Add precision and recall scores to f1_binary, max_f1_binary

Pull Request - State: closed - Opened by lilacheden 5 months ago

#823 - Update adding_task.rst

Pull Request - State: closed - Opened by michal-jacovi 5 months ago

#822 - Changed default log verbosity to "info" instead of "debug"

Pull Request - State: closed - Opened by yoavkatz 5 months ago

#821 - Fix the link to the operators tutorial

Pull Request - State: closed - Opened by elronbandel 5 months ago

#820 - More documentation changes in metrics

Pull Request - State: closed - Opened by yoavkatz 5 months ago

#819 - Handle empty text in Literal Eval

Pull Request - State: closed - Opened by antonpibm 5 months ago

#818 - description, homepage, and citation obtained from HF with datasets.load_dataset_builder

Pull Request - State: closed - Opened by dafnapension 5 months ago - 4 comments

#817 - Reviewing Unitxt tutorials

Pull Request - State: closed - Opened by michal-jacovi 5 months ago

#816 - Update wikitq.py

Pull Request - State: closed - Opened by elronbandel 5 months ago

#811 - Add RAG (response generation part) tasks and datasets

Pull Request - State: closed - Opened by perlitz 5 months ago

#808 - Added new NER metric using fuzzywuzzy logic

Pull Request - State: closed - Opened by sarathsgvr 5 months ago - 3 comments

#806 - Support for handling sensitive data sent to remote services

Pull Request - State: closed - Opened by pawelknes 5 months ago - 9 comments

#791 - Add llm as judge mt-bench dataset and metrics

Pull Request - State: closed - Opened by OfirArviv 5 months ago - 8 comments

#767 - fuse, split, MultiStreamScoreMean, and merge all

Pull Request - State: closed - Opened by dafnapension 6 months ago - 3 comments

#752 - restructure aggregation of InstanceMetric , enabling to expand grouping and filtering option on to GlobalMetric

Pull Request - State: closed - Opened by dafnapension 6 months ago - 6 comments

#658 - Standard metrics

Pull Request - State: closed - Opened by dafnapension 7 months ago - 5 comments

#646 - Handling sensitive data sent to remote services

Issue - State: closed - Opened by yoavkatz 7 months ago - 1 comment

#635 - Gather all string operators in one standard file

Pull Request - State: closed - Opened by elronbandel 7 months ago

#574 - Add plugin operators

Pull Request - State: closed - Opened by elronbandel 8 months ago - 3 comments

#517 - MultiReferenceTemplate fails to apply output_format.

Issue - State: open - Opened by jlqibm 8 months ago

#516 - acknowledge openmoji

Pull Request - State: open - Opened by Roni-Friedman 8 months ago - 1 comment

GitHub / IBM/unitxt issues and pull requests