neulab/compare-mt issues and pull requests

#134 - Fix bar chart color cycling

Pull Request - State: closed - Opened by Proyag over 2 years ago - 1 comment

#133 - feat: add lru cache to porter stemmer

Pull Request - State: closed - Opened by lyuyangh over 2 years ago

#132 - Fix sacrebleu and NLTK interfaces

Pull Request - State: closed - Opened by neubig over 2 years ago

#131 - [WIP] Added publication to pypi through actions

Pull Request - State: closed - Opened by neubig over 2 years ago

#130 - Unit tests are failing

Issue - State: closed - Opened by neubig over 2 years ago - 1 comment

#129 - Added CI through github actions

Pull Request - State: closed - Opened by neubig over 2 years ago

#128 - Fixed an issue with imports in setup.py

Pull Request - State: closed - Opened by neubig over 2 years ago

#127 - pip install errors

Issue - State: closed - Opened by pfliu-nlp over 2 years ago - 6 comments

#126 - Consider model variance in bootstrap resampling test

Issue - State: open - Opened by odashi almost 3 years ago - 6 comments

#125 - add multilabel bucketer

Pull Request - State: closed - Opened by kayoyin over 3 years ago - 1 comment

#124 - bootstrap sample size

Issue - State: open - Opened by ozancaglayan over 3 years ago

#123 - fix a `math domain error` bug in the GleuScorer

Pull Request - State: closed - Opened by Tbabm almost 4 years ago

#122 - call Scorer.cache_stats with src to align with the signature

Pull Request - State: closed - Opened by Tbabm almost 4 years ago

#121 - Add GLEU scorer

Pull Request - State: closed - Opened by Tbabm almost 4 years ago - 1 comment

#120 - [WIP] Add COMET scorer

Pull Request - State: closed - Opened by CoderPat almost 4 years ago - 2 comments

#119 - stand-alone command line scorer

Issue - State: closed - Opened by neubig over 4 years ago - 1 comment

#118 - pip install does not auto-install requirements

Issue - State: closed - Opened by neubig over 4 years ago - 1 comment

#117 - Option to launch http server to view reports

Pull Request - State: closed - Opened by thammegowda over 4 years ago - 3 comments

#116 - Added summary-level rougeL scorer

Pull Request - State: closed - Opened by zdou0830 almost 5 years ago - 1 comment

#115 - Improvements to latex output

Pull Request - State: closed - Opened by madaan almost 5 years ago - 1 comment

#114 - Bug in sentence level BLEU comparison

Issue - State: open - Opened by madaan about 5 years ago - 1 comment

#113 - Fix a typo in README.md

Pull Request - State: closed - Opened by madaan about 5 years ago - 1 comment

#112 - Some measure of bucketed statistic reliability

Pull Request - State: closed - Opened by zdou0830 about 5 years ago - 5 comments

#111 - Support pre-computing statistics for each system

Pull Request - State: closed - Opened by zdou0830 about 5 years ago - 4 comments

#110 - Click through examples for source word reports

Pull Request - State: closed - Opened by neubig about 5 years ago

#109 - Fix sampling

Pull Request - State: closed - Opened by pmichel31415 about 5 years ago - 1 comment

#108 - Bootstrap resampling without replacement

Issue - State: closed - Opened by pmichel31415 over 5 years ago - 5 comments
Labels: bug

#107 - Create examples of word buckets

Pull Request - State: closed - Opened by neubig over 5 years ago

#106 - Made tokenization on ascii spaces only

Pull Request - State: closed - Opened by neubig over 5 years ago

#105 - Better error checking when reading in alignments

Pull Request - State: closed - Opened by neubig over 5 years ago

#104 - Added word bucketer based on casing of words

Pull Request - State: closed - Opened by neubig over 5 years ago

#103 - Made count reading more robust

Pull Request - State: closed - Opened by neubig over 5 years ago

#102 - Fast Significance Test for SacreBLEU

Pull Request - State: closed - Opened by zdou0830 over 5 years ago

#101 - Bump up version number to update pypi

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago

#100 - Support the latest version of matplotlib

Pull Request - State: closed - Opened by zdou0830 over 5 years ago - 1 comment

#99 - Detokenized BLEU as new scorer type

Pull Request - State: closed - Opened by bricksdont over 5 years ago - 12 comments

#98 - Account for non-ASCII characters

Pull Request - State: closed - Opened by SebastinSanty over 5 years ago - 1 comment

#97 - Fix sentence bucketer for length difference

Pull Request - State: closed - Opened by neubig over 5 years ago

#96 - More informative error messages

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago

#95 - BLEU on a scale of 0 to 100

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago - 4 comments

#94 - Added ability to bucket sentences by external label

Pull Request - State: closed - Opened by zdou0830 over 5 years ago - 5 comments

#93 - Added ability to name analyses

Pull Request - State: closed - Opened by zdou0830 over 5 years ago - 2 comments

#92 - Ability to de-duplicate identical sentences

Pull Request - State: closed - Opened by zdou0830 over 5 years ago

#91 - Add Meteor scorer

Pull Request - State: closed - Opened by zdou0830 over 5 years ago - 3 comments

#90 - Ability to specify p-value threshold

Pull Request - State: closed - Opened by zdou0830 over 5 years ago - 5 comments

#89 - Ability to bucket sentences by external label

Issue - State: closed - Opened by neubig over 5 years ago
Labels: enhancement

#88 - Some measure of bucketed statistic reliability

Issue - State: closed - Opened by neubig over 5 years ago - 2 comments
Labels: enhancement

#87 - Errors resulting from command line formatting can be opaque

Issue - State: closed - Opened by neubig over 5 years ago
Labels: bug

#86 - Better documentation and util script for freq_counts file

Pull Request - State: closed - Opened by neubig over 5 years ago

#85 - Ability to name analyses

Issue - State: closed - Opened by neubig over 5 years ago - 1 comment
Labels: enhancement

#84 - Sentence report should de-duplicate identical sentences

Issue - State: closed - Opened by neubig over 5 years ago
Labels: bug

#83 - No way to specify p-value threshold for significance tests

Issue - State: closed - Opened by pmichel31415 over 5 years ago - 1 comment
Labels: enhancement

#82 - Fix bugs

Pull Request - State: closed - Opened by zdou0830 over 5 years ago

#81 - Undefined name 'sys_names' in compare_mt_main.py

Issue - State: closed - Opened by cclauss over 5 years ago

#80 - Add WER scorer

Pull Request - State: closed - Opened by zdou0830 over 5 years ago

#79 - Implementation of Word Error Rate

Issue - State: closed - Opened by neubig over 5 years ago - 1 comment
Labels: bug

#78 - Update reporters.py

Pull Request - State: closed - Opened by gdemelo over 5 years ago - 1 comment

#77 - Fix requirements

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago

#76 - Change ROUGE scorer's default setting

Pull Request - State: closed - Opened by zdou0830 over 5 years ago

#75 - Bump up version number to 0.2 to fix pypi error

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago

#74 - Added video

Pull Request - State: closed - Opened by neubig over 5 years ago

#73 - Add Rouge scorer and text summarization examples

Pull Request - State: closed - Opened by zdou0830 over 5 years ago - 1 comment

#72 - Make html report friendlier towards special characters

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago - 1 comment

#71 - Upload to PyPI

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago - 1 comment

#70 - Encoding issues in non-ASCII output?

Issue - State: closed - Opened by neubig over 5 years ago - 2 comments
Labels: bug

#69 - A few small bug fixes

Pull Request - State: closed - Opened by neubig over 5 years ago

#68 - Made ability to bucket by numerical labels

Pull Request - State: closed - Opened by neubig over 5 years ago

#67 - Make it possible to customize bucket cutoffs

Pull Request - State: closed - Opened by neubig over 5 years ago

#66 - ROUGE evaluation measure

Issue - State: closed - Opened by zdou0830 over 5 years ago - 8 comments
Labels: enhancement

#65 - Fix a bug

Pull Request - State: closed - Opened by zdou0830 over 5 years ago

#64 - Upload to PyPI

Issue - State: closed - Opened by pmichel31415 over 5 years ago - 3 comments
Labels: enhancement

#63 - Print source sentences if available

Pull Request - State: closed - Opened by zdou0830 over 5 years ago - 4 comments

#60 - Do the more intuitive "BLEU by length" bucketing first

Pull Request - State: closed - Opened by neubig over 5 years ago

#59 - Fix plotting error when not doing sigtest

Pull Request - State: closed - Opened by neubig over 5 years ago

#58 - Control number of decimals when printing floats

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago - 1 comment

#56 - Add back graphical output to tests

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago - 1 comment

#55 - Removed titles from figures

Pull Request - State: closed - Opened by neubig over 5 years ago

#54 - Ability to analyze just one system

Issue - State: closed - Opened by zdou0830 over 5 years ago - 1 comment
Labels: enhancement

#53 - Output source sentences when printing sentence examples

Issue - State: closed - Opened by zdou0830 over 5 years ago - 1 comment
Labels: enhancement

#52 - Made it possible to modify figure size

Pull Request - State: closed - Opened by neubig over 5 years ago

#51 - Made latex table printing possible

Pull Request - State: closed - Opened by neubig over 5 years ago

#50 - Make number format consistent and configurable

Issue - State: closed - Opened by neubig over 5 years ago - 2 comments
Labels: enhancement

#49 - Made tables more concise

Pull Request - State: closed - Opened by neubig over 5 years ago

#48 - Ability to specify system names

Pull Request - State: closed - Opened by neubig over 5 years ago

#47 - Fixes to plots

Pull Request - State: closed - Opened by neubig over 5 years ago

#46 - Fix imports

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago - 1 comment

#45 - Add latex printing capability

Pull Request - State: closed - Opened by neubig over 5 years ago

#43 - [WIP] Graphical styling

Pull Request - State: closed - Opened by neubig over 5 years ago - 1 comment

#42 - Modifications to graphical printing

Pull Request - State: closed - Opened by neubig over 5 years ago

#36 - RIBES score

Pull Request - State: closed - Opened by zdou0830 over 5 years ago - 2 comments

#33 - Add Travis CI

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago - 1 comment

#30 - ChrF score

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago

#27 - "external program" Scorer

Issue - State: closed - Opened by neubig over 5 years ago - 6 comments
Labels: enhancement

#26 - Ability to click through to individual examples

Issue - State: open - Opened by neubig over 5 years ago - 1 comment
Labels: enhancement

#22 - Ability to set custom bucket_cutoffs

Issue - State: closed - Opened by danishpruthi over 5 years ago - 1 comment
Labels: enhancement

#19 - Word reordering errors analysis

Pull Request - State: closed - Opened by zdou0830 over 5 years ago - 8 comments

#18 - [WIP] add graphical print

Pull Request - State: closed - Opened by JunjieHu over 5 years ago - 12 comments

#14 - Formatting table results

Issue - State: closed - Opened by rooa over 5 years ago - 2 comments
Labels: enhancement

#10 - [WIP] Word likelihoods

Pull Request - State: closed - Opened by pmichel31415 over 5 years ago - 3 comments

#7 - Multiple references

Issue - State: open - Opened by zdou0830 over 5 years ago - 3 comments
Labels: enhancement

GitHub / neulab/compare-mt issues and pull requests