Unbabel/COMET issues and pull requests

#134 - Allow to specify `local_files_only` param when downloading a snapshot

Pull Request - State: closed - Opened by phen0menon about 1 year ago

#133 - Allow for pandas major version 2

Pull Request - State: closed - Opened by BramVanroy about 1 year ago

#132 - UnifiedMetric test failing: test_multitask_with_references

Issue - State: closed - Opened by BramVanroy about 1 year ago - 1 comment
Labels: bug

#131 - [QUESTION] How to finetune `wmt22-comet-da` and have results scaled to 0-1 range

Issue - State: closed - Opened by juliafalcao about 1 year ago - 1 comment
Labels: question

#130 - Support pandas 2

Issue - State: closed - Opened by BramVanroy about 1 year ago
Labels: enhancement

#129 - wmt20-comet-qe-da do not work under huggingface guides (possible version conflicts)

Issue - State: open - Opened by Yaoming95 about 1 year ago - 3 comments
Labels: bug

#128 - Do system scores above 100 really "differ"?

Issue - State: closed - Opened by BramVanroy about 1 year ago - 4 comments
Labels: question

#127 - Can't reproduce Cometinho model scores

Issue - State: closed - Opened by Rexhaif over 1 year ago - 3 comments
Labels: bug

#126 - Support for PyTorch 2.0

Pull Request - State: closed - Opened by HennerM over 1 year ago - 2 comments

#125 - `Unbabel/wmt22-comet-da` model not working as part of Huggingface evaluate

Issue - State: open - Opened by alexandremuzio over 1 year ago - 2 comments
Labels: bug

#124 - tensor_lru_cache is limited to tensors with at least 2-Dimensions

Issue - State: closed - Opened by alvations over 1 year ago - 5 comments
Labels: bug

#123 - [QUESTION]init.py generates a wrong path for hparams.yaml in Windows

Issue - State: closed - Opened by YZhou0413 over 1 year ago - 6 comments
Labels: question

#122 - Inefficient _layer_norm implementation in layerwise_attention.py

Issue - State: closed - Opened by K024 over 1 year ago - 1 comment
Labels: bug

#121 - Models not accessible

Issue - State: closed - Opened by ankunchu over 1 year ago - 2 comments
Labels: bug

#120 - Specifying GPU ID for inference

Issue - State: closed - Opened by jinulee-v over 1 year ago - 4 comments
Labels: enhancement

#119 - Version 2.0

Issue - State: closed - Opened by david-macleod over 1 year ago - 2 comments
Labels: bug

#118 - [QUESTION] default model is not update?

Issue - State: closed - Opened by minghao-wu over 1 year ago - 2 comments
Labels: question

#117 - Use BetterTransformer for fast inference

Issue - State: open - Opened by BramVanroy over 1 year ago - 1 comment
Labels: enhancement

#116 - Avoid downloading XLM-R checkpoint from huggingface

Issue - State: closed - Opened by K024 over 1 year ago - 1 comment
Labels: enhancement

#115 - [QUESTION] Train my own Metric:

Issue - State: closed - Opened by sdlmw over 1 year ago - 4 comments
Labels: question

#114 - Revert "Bump torch from 1.13.0 to 1.13.1"

Pull Request - State: closed - Opened by ricardorei over 1 year ago

#113 - Bump torch from 1.13.0 to 1.13.1

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago
Labels: dependencies

#112 - wmt22-cometkiwi-da is not available for download.

Issue - State: closed - Opened by mabdelrehim over 1 year ago - 10 comments
Labels: bug

#111 - Making paths OS agnostic

Pull Request - State: closed - Opened by kocmitom over 1 year ago

#110 - [QUESTION]Interpretation and comparison of COMET scores across several languages

Issue - State: closed - Opened by clairehua1 over 1 year ago - 5 comments
Labels: question

#109 - `comet-compare` is not working

Issue - State: closed - Opened by foksly over 1 year ago - 3 comments
Labels: bug

#108 - Tag v1.1.3

Issue - State: closed - Opened by BramVanroy over 1 year ago - 2 comments
Labels: documentation, enhancement

#107 - [QUESTION] Load the model from path

Issue - State: closed - Opened by ymoslem over 1 year ago - 5 comments
Labels: question

#106 - [QUESTION] Is WMT data prior to WMT17 unseen?

Issue - State: closed - Opened by emjotde over 1 year ago - 2 comments
Labels: question

#105 - Evaluate excessively long sequence pair[QUESTION]

Issue - State: closed - Opened by minghao-wu over 1 year ago - 7 comments
Labels: question

#104 - t-test is two-tailed instead of one-tailed

Issue - State: closed - Opened by erip over 1 year ago - 9 comments
Labels: bug

#103 - [QUESTION] Batch-normalization in pooling layer

Issue - State: closed - Opened by emjotde over 1 year ago - 2 comments
Labels: question

#102 - Bump certifi from 2022.9.24 to 2022.12.7

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago
Labels: dependencies

#101 - Segment order incorrect when running on >1 GPU

Issue - State: closed - Opened by thompsonb over 1 year ago - 2 comments
Labels: bug

#100 - fix entmax / poetry issue

Pull Request - State: closed - Opened by dblandan over 1 year ago

#99 - Update to entmax 1.1 to fix poetry error

Issue - State: closed - Opened by dblandan over 1 year ago
Labels: enhancement

#98 - Can't install v1.2.0

Issue - State: closed - Opened by dblandan over 1 year ago - 2 comments
Labels: bug

#97 - Bump protobuf from 3.20.1 to 3.20.2

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago
Labels: dependencies

#96 - Unable to find hparam file for a custom model

Issue - State: closed - Opened by me-manikanta over 1 year ago - 1 comment
Labels: bug

#95 - Bootstrap resampling

Issue - State: closed - Opened by st-vincent1 over 1 year ago - 2 comments
Labels: enhancement

#94 - Batch size in words

Issue - State: open - Opened by kocmitom over 1 year ago
Labels: enhancement

#93 - Bump joblib from 1.1.0 to 1.2.0

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies

#92 - pip update

Issue - State: closed - Opened by BramVanroy almost 2 years ago - 4 comments
Labels: enhancement

#91 - Bump oauthlib from 3.2.0 to 3.2.1

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies

#90 - Update get_cache_folder for Windows

Pull Request - State: closed - Opened by BramVanroy almost 2 years ago

#89 - Apple Silicon (M1) support

Pull Request - State: closed - Opened by phen0menon almost 2 years ago

#88 - comet-score [other_params] --to_json True doesn't output a json file

Issue - State: closed - Opened by me-manikanta almost 2 years ago - 1 comment
Labels: bug

#87 - Referenceless QE metrics require reference input

Issue - State: closed - Opened by zouharvi almost 2 years ago - 1 comment
Labels: bug

#86 - Show individual system scores in compare

Issue - State: open - Opened by ZJaume almost 2 years ago
Labels: enhancement

#85 - Hide device info prints in Python

Issue - State: open - Opened by zouharvi almost 2 years ago - 6 comments
Labels: bug

#84 - [QUESTION]

Issue - State: closed - Opened by mahfuzibnalam about 2 years ago - 4 comments
Labels: question

#83 - Force encodings to match across commands

Issue - State: closed - Opened by ioverho about 2 years ago
Labels: bug

#82 - Google protobuf package must be <= 3.20.1

Issue - State: closed - Opened by ugermann about 2 years ago - 5 comments
Labels: bug

#81 - How to configure the precision of the p-value scores?

Issue - State: closed - Opened by andmek about 2 years ago - 5 comments
Labels: question

#80 - mbr-decode triggers an issue with models other than default

Issue - State: closed - Opened by vince62s about 2 years ago - 6 comments
Labels: bug

#79 - ImportError: cannot import name 'StreamWrapper' from 'torch.utils.data.datapipes.utils.common'

Issue - State: closed - Opened by andmek about 2 years ago - 2 comments
Labels: question

#78 - Model link broken (wmt21-comet-qe-da)

Issue - State: closed - Opened by ricardorei about 2 years ago
Labels: bug

#77 - Fix error with custom QE COMET

Pull Request - State: closed - Opened by Joao-Maria-Janeiro about 2 years ago - 3 comments

#76 - Fix error in scorer.py

Pull Request - State: closed - Opened by Joao-Maria-Janeiro about 2 years ago

#75 - Added verification to validate whether the selected activation function exists

Pull Request - State: closed - Opened by Joao-Maria-Janeiro about 2 years ago - 1 comment

#74 - Comet compare for multiple systems.

Pull Request - State: closed - Opened by SamuelLarkin about 2 years ago - 19 comments

#73 - [QUESTION] Importing a multilingual model from huggingface into COMET?

Issue - State: closed - Opened by lfritzke-mitre about 2 years ago - 4 comments
Labels: question

#72 - 'pip install unbabel-comet' error

Issue - State: closed - Opened by Vinayak-Basude about 2 years ago - 6 comments
Labels: question

#71 - [QUESTION] Are all of the encoders fine-tuned?

Issue - State: closed - Opened by kayuksel about 2 years ago - 2 comments
Labels: question

#70 - run CI on PRs so we know if things break before they land

Pull Request - State: closed - Opened by erip about 2 years ago

#69 - allow newer pytorch versions to be installed st they do not break API

Pull Request - State: closed - Opened by erip about 2 years ago - 4 comments

#68 - fix encoding issues for Windows users

Pull Request - State: closed - Opened by erip over 2 years ago

#67 - How to get data for training of own metric? [QUESTION]

Issue - State: closed - Opened by jbgruenwald over 2 years ago - 8 comments
Labels: question

#66 - Different score on Multi-GPU

Issue - State: closed - Opened by ZJaume over 2 years ago - 2 comments
Labels: bug

#65 - No quiet flag

Issue - State: closed - Opened by erip over 2 years ago - 5 comments
Labels: bug

#64 - Multi-system Evaluation

Issue - State: open - Opened by andmek over 2 years ago - 3 comments
Labels: enhancement, good first issue

#63 - Bug fix of num_workers.

Pull Request - State: closed - Opened by devrimcavusoglu over 2 years ago

#62 - Turning off multi-processing for DataLoader

Issue - State: closed - Opened by devrimcavusoglu over 2 years ago
Labels: bug

#61 - Training my own metric

Issue - State: closed - Opened by NourKhdour over 2 years ago - 13 comments
Labels: question

#60 - Problems with MULTI-GPU scoring

Issue - State: closed - Opened by c-soler-u over 2 years ago - 2 comments
Labels: bug

#59 - Warnings like "Some weights of the model checkpoint at xlm-roberta-large were not used when initializing XLMRobertaModel"

Issue - State: closed - Opened by nangying1112 over 2 years ago - 6 comments
Labels: question

#58 - Adds --quiet flag

Pull Request - State: closed - Opened by Remorax over 2 years ago

#57 - Fix minor typo in exception message

Pull Request - State: closed - Opened by alvations over 2 years ago - 1 comment

#56 - Shortened version of comet-score output

Issue - State: closed - Opened by Remorax over 2 years ago - 2 comments
Labels: enhancement

#55 - Benchmark tests?

Issue - State: closed - Opened by cfberger over 2 years ago - 6 comments
Labels: question

#54 - [QUESTION] What is the data format for QE ranker model?

Issue - State: closed - Opened by taquynhnga2001 over 2 years ago - 1 comment
Labels: question

#53 - Get list of models

Issue - State: closed - Opened by mjpost over 2 years ago - 5 comments
Labels: enhancement

#52 - Is there a theoretical range of values for the COMET regressor?

Issue - State: closed - Opened by alvations over 2 years ago - 2 comments
Labels: question

#51 - [QUESTION] What would be a reasonable/sound approach when we only have translation with reference?

Issue - State: closed - Opened by alvations over 2 years ago - 6 comments
Labels: question

#50 - TypeError: 'type' object is not subscriptable

Issue - State: closed - Opened by mjpost over 2 years ago - 6 comments
Labels: bug

#49 - Continue to fine-tune from wmt20-comet-da checkpoint

Issue - State: closed - Opened by xu1998hz over 2 years ago - 1 comment
Labels: question

#48 - [QUESTION] Train my own metrics without source sentences

Issue - State: closed - Opened by xu1998hz over 2 years ago - 11 comments
Labels: question

#47 - Why is COMET_DA default model?

Issue - State: closed - Opened by kocmitom over 2 years ago - 3 comments
Labels: question

#46 - [QUESTION] Training my own metric using Comet regression model

Issue - State: closed - Opened by xu1998hz over 2 years ago - 4 comments
Labels: question

#45 - ImportError: cannot import name 'container_abcs' from 'torch._six'

Issue - State: closed - Opened by salvacarrion over 2 years ago - 1 comment
Labels: bug

#44 - Protect example inside main

Issue - State: closed - Opened by PierreColombo over 2 years ago - 1 comment
Labels: bug

#43 - TypeError: 'NoneType' object is not subscriptable when calling comet-score

Issue - State: closed - Opened by loic-mt over 2 years ago - 4 comments
Labels: bug

#42 - Caching for Embeddings and Length Batching

Pull Request - State: closed - Opened by ricardorei over 2 years ago

#41 - Statistical testing between two systems using T-Test

Issue - State: closed - Opened by ricardorei over 2 years ago
Labels: enhancement

#40 - Added sacrebleu datasets (closes #39)

Pull Request - State: closed - Opened by mjpost over 2 years ago - 1 comment

#37 - Error when running inference on newly trained metric

Issue - State: closed - Opened by chryssa-zrv over 2 years ago - 1 comment
Labels: bug

#36 - [QUESTION] Is comet download still a supported command?

Issue - State: closed - Opened by isabelcachola over 2 years ago - 8 comments
Labels: question

#34 - Calling xlm-roberta-large via HuggingFace

Issue - State: closed - Opened by kayuksel over 2 years ago - 1 comment
Labels: enhancement

#29 - certificate verify failed: unable to get local issuer certificate

Issue - State: closed - Opened by ricardorei over 2 years ago - 7 comments
Labels: bug

#27 - COMET not working with python 3.8

Issue - State: closed - Opened by joncamgui over 2 years ago - 20 comments
Labels: bug

GitHub / Unbabel/COMET issues and pull requests