Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / IBM/unitxt issues and pull requests
#515 - Update tests.yml
Pull Request -
State: closed - Opened by elronbandel 10 months ago
- 1 comment
#514 - possible full import needed in unitxt.dataset
Issue -
State: open - Opened by sam-data-guy-iam 10 months ago
#513 - Update version to 1.5.3
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#512 - Update version to 1.5.2
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#511 - enhanced UI
Pull Request -
State: closed - Opened by Roni-Friedman 10 months ago
- 1 comment
#510 - Prepare load_dataset and evaluate api to fit the paper
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#509 - add human eval dataset
Pull Request -
State: open - Opened by OfirArviv 10 months ago
#508 - Rag metrics
Pull Request -
State: open - Opened by assaftibm 10 months ago
#508 - Rag metrics
Pull Request -
State: closed - Opened by assaftibm 10 months ago
- 1 comment
#507 - add download and extraction operators
Pull Request -
State: open - Opened by ilyashnil 10 months ago
- 2 comments
#507 - add download and extraction operators
Pull Request -
State: open - Opened by ilyashnil 10 months ago
- 2 comments
#506 - attach summarization cards to the summarization task
Pull Request -
State: closed - Opened by arielge 10 months ago
- 1 comment
#505 - Add regression task and fix stsb to use it
Pull Request -
State: open - Opened by elronbandel 10 months ago
- 1 comment
#504 - Add multidoc2dial dataset in its abstractive and extractive forms
Pull Request -
State: closed - Opened by arielge 10 months ago
- 2 comments
#503 - Update catalog artifacts who were not added by mistake?
Pull Request -
State: open - Opened by elronbandel 10 months ago
- 1 comment
#502 - add dataset cards from fmeval
Pull Request -
State: open - Opened by OfirArviv 10 months ago
- 2 comments
#501 - Fix templates for qa datasets
Pull Request -
State: closed - Opened by elronbandel 10 months ago
- 1 comment
#500 - LoadFromIBMCloud is not multi process/thread safe
Issue -
State: open - Opened by yoavkatz 10 months ago
#499 - Improved error message when using TemplateDict
Pull Request -
State: open - Opened by yoavkatz 10 months ago
#498 - Update README with the paper
Issue -
State: open - Opened by borgr 10 months ago
#497 - Update version to 1.5.1
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#496 - fix manifest
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#495 - FIx all datasets
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#494 - 1.5.0
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#493 - Xmmlu template multilingual
Pull Request -
State: closed - Opened by gitMichal 10 months ago
- 1 comment
#492 - Simplify ui launching with the console command unitxt-explore
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#492 - Simplify ui launching with the console command unitxt-explore
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#491 - Improve UI code presentation and organization
Pull Request -
State: closed - Opened by Roni-Friedman 10 months ago
- 1 comment
#491 - Improve UI code presentation and organization
Pull Request -
State: closed - Opened by Roni-Friedman 10 months ago
- 1 comment
#490 - Ui2
Pull Request -
State: closed - Opened by Roni-Friedman 10 months ago
#490 - Ui2
Pull Request -
State: closed - Opened by Roni-Friedman 10 months ago
#489 - Add LRU caching for catalog artifact loading to minimize IO overhead and enhance performance
Pull Request -
State: closed - Opened by elronbandel 10 months ago
- 1 comment
#489 - Add LRU caching for catalog artifact loading to minimize IO overhead and enhance performance
Pull Request -
State: closed - Opened by elronbandel 10 months ago
- 1 comment
#488 - Add process_instance function to every mutli stream operator for easier testing and usage at instance level
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#488 - Add process_instance function to every mutli stream operator for easier testing and usage at instance level
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#487 - Length balancer docstring
Pull Request -
State: closed - Opened by matanor 10 months ago
- 1 comment
#486 - Update QA templates
Pull Request -
State: closed - Opened by matanor 10 months ago
- 1 comment
#486 - Update QA templates
Pull Request -
State: closed - Opened by matanor 10 months ago
- 1 comment
#485 - Cfpb product
Pull Request -
State: closed - Opened by ilyashnil 10 months ago
- 1 comment
#484 - Make postprocessors a general operator that operates on 'prediction' and on 'references' which enables the use of every possible operator as postprocessor
Pull Request -
State: closed - Opened by dafnapension 10 months ago
- 1 comment
#483 - Add QA, NER, Targeted sentiment and Generation tasks, Llama and Alpaca formats and instructions and whitespace augmentor
Pull Request -
State: closed - Opened by matanor 10 months ago
- 2 comments
#482 - Warning in running confidence intervals
Issue -
State: open - Opened by yoavkatz 10 months ago
#481 - add new templates
Pull Request -
State: open - Opened by OfirArviv 10 months ago
- 2 comments
#480 - add CFPB from watson repository
Pull Request -
State: closed - Opened by ilyashnil 10 months ago
- 2 comments
#479 - add a card for HF xsum, a summary dataset
Pull Request -
State: closed - Opened by dafnapension 10 months ago
- 2 comments
#478 - Naive recipe and thin global evaluators - draf for now, for future consideration
Pull Request -
State: open - Opened by dafnapension 10 months ago
- 1 comment
#477 - adding service and remote metric
Pull Request -
State: open - Opened by assaftibm 10 months ago
#476 - Improve Unitxt UI and add support for multiple catalogs
Pull Request -
State: closed - Opened by Roni-Friedman 10 months ago
- 1 comment
#475 - Initial UI
Pull Request -
State: closed - Opened by Roni-Friedman 10 months ago
- 1 comment
#474 - introducing text at the top of loaders.py
Pull Request -
State: closed - Opened by dafnapension 10 months ago
- 1 comment
#473 - Balance demos in fair_tos datasets
Pull Request -
State: closed - Opened by yoavkatz 10 months ago
- 1 comment
#472 - Modify the BertScore metric report to include the metric name
Issue -
State: open - Opened by gitMichal 10 months ago
#471 - Improve ExtractMostCommonFieldValues performance by avoiding the creation of the stream-length long list of values instead building values counter on the fly
Pull Request -
State: closed - Opened by dafnapension 10 months ago
- 1 comment
#470 - override Matthews correlation in cases of perfect correlation
Pull Request -
State: open - Opened by dafnapension 10 months ago
- 1 comment
#469 - override Matthews correlation coefficient in cases of perfect correlation
Pull Request -
State: closed - Opened by dafnapension 10 months ago
#468 - postprocessors become extensions of FieldOperator
Pull Request -
State: closed - Opened by dafnapension 10 months ago
- 2 comments
#467 - Update version to 1.4.6
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#466 - Fix upload to hugginface
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#465 - Update version to 1.4.5
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#464 - Fix HuggingFace resources uploading process by fixing imports
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#463 - Update version to 1.4.4
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#462 - New multi label template
Pull Request -
State: closed - Opened by yoavkatz 10 months ago
#461 - Improve catalog UI on documentation website by separating catalog objects to files and adding information per catalog item
Pull Request -
State: closed - Opened by matanor 10 months ago
- 1 comment
#460 - Improve catalog documentation
Issue -
State: open - Opened by matanor 10 months ago
#459 - convert postprocessors to FieldOperator-s
Pull Request -
State: closed - Opened by dafnapension 10 months ago
#458 - Delete old formats and make SystemFormat the only format exist
Pull Request -
State: closed - Opened by elronbandel 10 months ago
- 2 comments
#457 - Fix HuggingFace integration by changing logging.py to logging_utils.py to comply with hf dataset conventions
Pull Request -
State: closed - Opened by elronbandel 10 months ago
- 1 comment
#456 - Add a new Perturbate operator that is handy for faking prediction as a perturbated version of target or for any other perturbation use cases
Pull Request -
State: closed - Opened by dafnapension 10 months ago
- 1 comment
#455 - make the cola case a simple all operators recipe
Pull Request -
State: closed - Opened by dafnapension 10 months ago
- 4 comments
#454 - Update version to 1.4.3
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#453 - Change formats to be backward compatible
Pull Request -
State: closed - Opened by elronbandel 10 months ago
- 1 comment
#452 - Grouped instance metric inherit from InstanceMetrics
Pull Request -
State: open - Opened by sam-data-guy-iam 10 months ago
- 1 comment
#451 - Update version to 1.4.2
Pull Request -
State: closed - Opened by elronbandel 10 months ago
#450 - Turn instruction to operator
Pull Request -
State: closed - Opened by elronbandel 10 months ago
- 1 comment
#449 - Add FilterByQuery and ExecuteQuery as simple operators receiving textual python query
Pull Request -
State: closed - Opened by dafnapension 11 months ago
- 12 comments
#448 - new req for sacrebleu
Pull Request -
State: closed - Opened by gitMichal 11 months ago
- 1 comment
#447 - MetricPipeline in not limited in n_resamples in tests
Issue -
State: open - Opened by yoavkatz 11 months ago
#446 - Added instructions on how to update the unitxt docs
Pull Request -
State: closed - Opened by matanor 11 months ago
- 2 comments
#445 - Document how to edit the Unitxt docs
Issue -
State: closed - Opened by matanor 11 months ago
#444 - Document release notes
Pull Request -
State: closed - Opened by matanor 11 months ago
- 1 comment
#443 - fixing split definition for debater datatests
Pull Request -
State: closed - Opened by ilyashnil 11 months ago
- 1 comment
#442 - Perplexity
Pull Request -
State: closed - Opened by assaftibm 11 months ago
- 5 comments
#441 - rougeL returns 0 score on perfect prediction in some languages
Issue -
State: open - Opened by yoavkatz 11 months ago
- 1 comment
#440 - Improve test card error messages and allow disabling by env variable
Pull Request -
State: closed - Opened by yoavkatz 11 months ago
- 1 comment
#439 - matthews_correlation returning 0 on perfect correlation
Issue -
State: open - Opened by yoavkatz 11 months ago
- 11 comments
#438 - Document release process
Issue -
State: closed - Opened by matanor 11 months ago
- 1 comment
#437 - Update version to 1.4.1
Pull Request -
State: closed - Opened by yoavkatz 11 months ago
#436 - Update version to 1.4.0
Pull Request -
State: closed - Opened by yoavkatz 11 months ago
#435 - additional verification toward uniquely determined result
Pull Request -
State: closed - Opened by dafnapension 11 months ago
- 11 comments
#434 - Create tasks_taxonomy
Pull Request -
State: open - Opened by gitMichal 11 months ago
- 3 comments
#433 - Added support for Japanese in sacrebleu
Pull Request -
State: open - Opened by yoavkatz 11 months ago
- 3 comments
#433 - Added support for Japanese in sacrebleu
Pull Request -
State: closed - Opened by yoavkatz 11 months ago
- 9 comments
#432 - Explicitly state when to compute confidence intervals
Issue -
State: open - Opened by matanor 11 months ago
- 4 comments
#431 - adding ci to scores other than main_score
Pull Request -
State: closed - Opened by assaftibm 11 months ago
- 2 comments
#430 - Aggregation metrics
Pull Request -
State: closed - Opened by sam-data-guy-iam 11 months ago
- 6 comments
#429 - Add completion task modify lm harness template
Pull Request -
State: closed - Opened by perlitz 11 months ago
- 1 comment
#428 - Add completion task and modify lm harness template
Pull Request -
State: closed - Opened by perlitz 11 months ago
- 1 comment
#427 - Improve docs
Pull Request -
State: closed - Opened by elronbandel 11 months ago
#426 - modify to different bleu impl.
Pull Request -
State: closed - Opened by gitMichal 11 months ago
- 1 comment
#425 - Hard code classes names
Pull Request -
State: closed - Opened by elronbandel 11 months ago