Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / mjpost/sacrebleu issues and pull requests

#277 - Release v2.5.1

Pull Request - State: closed - Opened by mjpost about 2 months ago

#276 - Add WMT 2024 test sets

Pull Request - State: closed - Opened by mjpost about 2 months ago - 3 comments

#273 - Fix CI error

Pull Request - State: closed - Opened by jkawamoto 6 months ago - 8 comments

#272 - Should BLEU score be dependent on the order of the sequences?

Issue - State: closed - Opened by davidgonmar 6 months ago - 2 comments

#271 - Further standardize the layout and packaging

Issue - State: open - Opened by mjpost 7 months ago - 3 comments

#270 - modernize packaging and add release automation

Pull Request - State: closed - Opened by dhellmann 7 months ago - 19 comments

#269 - no published sdist for 2.4.2

Issue - State: open - Opened by dhellmann 7 months ago - 4 comments

#268 - Removing the change of behavior regarding SIGPIPE from the top-level

Issue - State: closed - Opened by jblespiau 8 months ago - 2 comments

#267 - Check if all docs have domain attribute

Pull Request - State: closed - Opened by jkawamoto 8 months ago - 9 comments

#266 - Fix CI Errors

Pull Request - State: closed - Opened by jkawamoto 8 months ago - 8 comments

#265 - Update DATASETS.md

Pull Request - State: closed - Opened by jkawamoto 8 months ago - 1 comment

#264 - Memory leak in spm tokenizers

Issue - State: open - Opened by nkrasner 9 months ago

#262 - Release v2.4.2

Pull Request - State: closed - Opened by mjpost 10 months ago - 2 comments

#261 - No references found for test set wmt23/*

Issue - State: closed - Opened by kellymarchisio 11 months ago - 4 comments

#260 - wmt23 archive uses `translator="refA"`

Pull Request - State: closed - Opened by martinpopel 11 months ago - 1 comment

#259 - Difference between cli and corpus_score

Issue - State: open - Opened by VarunGumma 11 months ago - 1 comment

#258 - Add project exports

Pull Request - State: closed - Opened by mjpost 11 months ago

#257 - Add optimization for compute_bleu precision initialization

Pull Request - State: closed - Opened by ernlavr 12 months ago - 1 comment

#256 - Compute BLEU from Python mishandles references

Issue - State: closed - Opened by OrianeN about 1 year ago - 2 comments

#255 - __init__.py divergence in 2.4.0

Issue - State: closed - Opened by dustalov about 1 year ago

#254 - Accelerating sentence scores

Issue - State: closed - Opened by AmitMY about 1 year ago - 4 comments

#253 - Version bump to 2.3.3

Pull Request - State: closed - Opened by dustalov about 1 year ago - 5 comments

#252 - Update check-build.yml

Pull Request - State: closed - Opened by dustalov about 1 year ago - 1 comment

#251 - Add BLEU max_ngram_order to signature

Issue - State: open - Opened by BramVanroy about 1 year ago - 2 comments

#250 - Use more linters, better

Pull Request - State: closed - Opened by dustalov about 1 year ago - 14 comments

#249 - Explicitly list the exported symbols

Pull Request - State: closed - Opened by dustalov over 1 year ago - 4 comments

#248 - [Feature Request] HTER Implementation

Issue - State: open - Opened by shivanraptor over 1 year ago - 1 comment

#247 - Added WMT23 data source (closes #245)

Pull Request - State: closed - Opened by mjpost over 1 year ago - 1 comment

#246 - Version bump to 2.3.2

Pull Request - State: closed - Opened by mjpost over 1 year ago

#245 - Add WMT 23 test sets

Issue - State: closed - Opened by mjpost over 1 year ago - 1 comment

#244 - Working on tokenized pairs?

Issue - State: closed - Opened by MostHumble over 1 year ago - 1 comment

#242 - Taking a long time to download the test set

Issue - State: closed - Opened by Phuoc-Hoan-Le over 1 year ago - 3 comments

#241 - Schedule a new release

Issue - State: closed - Opened by daskol over 1 year ago - 2 comments

#240 - BLEU and chrF2 on Chinese

Issue - State: open - Opened by zhhl9101 over 1 year ago - 1 comment

#238 - Update tokenizer_spm.py to issue warning message only when 'spm' is used

Pull Request - State: closed - Opened by Pogayo over 1 year ago - 1 comment

#237 - Inconsistent scores between loop and separate check

Issue - State: open - Opened by 106AbdulBasit over 1 year ago

#236 - fix typos in docstring

Pull Request - State: closed - Opened by martinpopel over 1 year ago

#235 - Docstring improvements normalize/asian_support

Pull Request - State: closed - Opened by BramVanroy almost 2 years ago

#234 - update python and OS versions in CI (issue #233)

Pull Request - State: closed - Opened by ales-t almost 2 years ago

#233 - GitHub workflows CI tests fail on Python 3.6

Issue - State: closed - Opened by martinpopel almost 2 years ago - 2 comments

#232 - Issue #228: TER- special treatment of empty references

Pull Request - State: closed - Opened by ales-t almost 2 years ago - 1 comment

#231 - AttributeError: module 'sacrebleu' has no attribute '__version__'

Issue - State: closed - Opened by dsj96 almost 2 years ago

#230 - Discrepancy in docstrings in TER `normalized`

Issue - State: closed - Opened by BramVanroy almost 2 years ago - 2 comments
Labels: enhancement

#229 - TER asian support

Issue - State: closed - Opened by esalesky almost 2 years ago - 1 comment
Labels: enhancement

#228 - TER between two empty strings is 100

Issue - State: closed - Opened by BramVanroy almost 2 years ago - 3 comments
Labels: question

#226 - fix #225: Empty lines in WMT21/dev Icelandic-English

Pull Request - State: open - Opened by BrightXiaoHan almost 2 years ago

#225 - Empty lines in WMT21/dev Icelandic-English

Issue - State: open - Opened by ZJaume about 2 years ago - 1 comment

#224 - Unicode normalization?

Issue - State: open - Opened by davidweichiang about 2 years ago - 1 comment
Labels: question

#223 - CVE-2007-4559 Patch

Pull Request - State: open - Opened by TrellixVulnTeam about 2 years ago - 1 comment

#222 - module 'sacrebleu' has no attribute 'corpus_bleu

Issue - State: closed - Opened by gongel about 2 years ago - 2 comments

#221 - mention flores200 in README.md

Pull Request - State: closed - Opened by martinpopel over 2 years ago

#220 - Silent failure with incorrect reference format in Python API

Issue - State: open - Opened by mdarcy220 over 2 years ago
Labels: bug

#218 - Set lru_cache for SPM tokenizer

Pull Request - State: closed - Opened by mjpost over 2 years ago

#217 - lru_cache max size is not set in tokenizer_spm.py

Issue - State: closed - Opened by chikiulo over 2 years ago - 1 comment

#216 - Ingested wmt22 data (closes #215)

Pull Request - State: closed - Opened by mjpost over 2 years ago - 2 comments

#215 - Add WMT22 data

Issue - State: closed - Opened by mjpost over 2 years ago

#214 - Added wmt21/systems for system outputs

Pull Request - State: closed - Opened by mjpost over 2 years ago - 1 comment

#213 - Add support to print multi system results as JSON

Pull Request - State: closed - Opened by me-manikanta over 2 years ago - 1 comment

#212 - Support test sets from sign language task?

Issue - State: open - Opened by bricksdont over 2 years ago

#211 - Ability to filter available testsets by language pair

Pull Request - State: closed - Opened by ZJaume over 2 years ago - 6 comments

#210 - List test sets available for a given language pair

Issue - State: closed - Opened by ZJaume over 2 years ago - 2 comments

#209 - Installing latest version via PIP results in an error

Issue - State: closed - Opened by epwalsh over 2 years ago - 8 comments

#208 - TER above 100?

Issue - State: closed - Opened by JoyeBright over 2 years ago - 12 comments

#207 - Support for printing significance score as JSON

Issue - State: closed - Opened by me-manikanta over 2 years ago

#206 - Incorrect sample size?

Issue - State: closed - Opened by kocmitom over 2 years ago - 1 comment

#205 - add wmt18-21 biomedical dataset and "doc aligned" dataset support

Pull Request - State: open - Opened by BrightXiaoHan over 2 years ago - 3 comments

#204 - Multiref bugfix

Pull Request - State: closed - Opened by mjpost over 2 years ago - 3 comments

#203 - Added flores200 spm model

Pull Request - State: closed - Opened by mjpost over 2 years ago

#202 - Switch to poetry for build/install

Issue - State: closed - Opened by mjpost over 2 years ago - 4 comments

#201 - tarball is not defined

Issue - State: closed - Opened by VanyaBK over 2 years ago - 1 comment

#200 - Version 2.2

Pull Request - State: closed - Opened by mjpost over 2 years ago - 5 comments

#199 - [Feature Request] Word Error Rate

Issue - State: open - Opened by jonathanmutal over 2 years ago - 3 comments

#198 - Why give 0 bleu score when evaluating De ?

Issue - State: closed - Opened by Hannibal046 over 2 years ago - 3 comments

#197 - Allow None references in args check

Pull Request - State: closed - Opened by jvamvas almost 3 years ago - 6 comments
Labels: pending

#196 - Upgrade mecab version to fix error on Python 3.10

Pull Request - State: closed - Opened by neubig almost 3 years ago

#195 - Default params for calculating bleu

Issue - State: closed - Opened by base-y almost 3 years ago - 4 comments

#194 - Add a Korean tokenizer

Pull Request - State: closed - Opened by NoUnique almost 3 years ago - 3 comments
Labels: pending

#193 - How to calculate the chrf2 score?

Issue - State: closed - Opened by RamoramaInteractive almost 3 years ago - 2 comments

#192 - Problems about the tokenizers

Issue - State: closed - Opened by DoctorDream almost 3 years ago - 4 comments

#191 - Is it possible to add flores dataset directly to dataset?

Issue - State: closed - Opened by BrightXiaoHan almost 3 years ago

#190 - use TypeError/ValueError for argument checking errors

Pull Request - State: closed - Opened by abcdenis almost 3 years ago - 1 comment

#189 - more accurate exception types on argument checks

Issue - State: closed - Opened by abcdenis almost 3 years ago - 2 comments

#188 - Is ‘extract_ngrams’ removed in the latest version?

Issue - State: closed - Opened by rangehow almost 3 years ago - 2 comments

#187 - Add WMT21 datasets and metadata

Pull Request - State: closed - Opened by BrightXiaoHan almost 3 years ago - 19 comments
Labels: pending

#186 - update readme with mecab japanese installation

Pull Request - State: closed - Opened by sukuya almost 3 years ago - 1 comment

#185 - pip install sacrebleu[ja] not found

Issue - State: closed - Opened by salvacarrion almost 3 years ago - 1 comment

#183 - ImportError: cannot import name 'tokenize_v14_international' from 'sacrebleu'

Issue - State: closed - Opened by hsiang-lee almost 3 years ago - 2 comments

#182 - How do I use sacreBleu with a Syriac language

Issue - State: closed - Opened by mt-empty almost 3 years ago - 2 comments

#181 - Unexpected behavior when using zh/ja sacrebleu in Python

Issue - State: closed - Opened by alvations about 3 years ago - 5 comments

#180 - Use sacreblue in TensorBoard

Issue - State: closed - Opened by MaryaAI about 3 years ago - 1 comment

#179 - Issue with Windows 10 wheel -- DLL load failed while importing win32file

Issue - State: closed - Opened by erip about 3 years ago - 2 comments

#178 - Detokenize problem on wmt14'en-fr

Issue - State: closed - Opened by hemingkx about 3 years ago - 3 comments

#177 - [Question] TEDx directionality versus WMT origlang

Issue - State: closed - Opened by kpu about 3 years ago - 4 comments