Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / facebookresearch/SimulEval issues and pull requests

#106 - FIX: user couldn't add custom cli arguments to be passed to the policy

Pull Request - State: open - Opened by RomanKoshkin 3 months ago - 2 comments
Labels: CLA Signed

#105 - Update instance.py

Pull Request - State: open - Opened by zhongmz 6 months ago - 2 comments
Labels: CLA Signed

#104 - error with fairseq simultaneous

Issue - State: open - Opened by krgy12138 6 months ago

#103 - Request for Batch Sample Generation (with batch_size)

Issue - State: open - Opened by zhongmz 7 months ago

#102 - Bump version to 1.1.4

Pull Request - State: closed - Opened by ibanesh 7 months ago
Labels: CLA Signed

#101 - Bump Version to 1.1.3

Pull Request - State: closed - Opened by ibanesh 7 months ago
Labels: CLA Signed

#100 - add parser to evaluation function

Pull Request - State: closed - Opened by xutaima 7 months ago
Labels: CLA Signed

#99 - Enable parser param passing

Pull Request - State: closed - Opened by ibanesh 7 months ago - 1 comment
Labels: CLA Signed

#98 - Fix evaluation issue when latency unit is spm for iterative dataloader

Pull Request - State: closed - Opened by xutaima 7 months ago - 1 comment
Labels: CLA Signed

#97 - CLI improvements

Pull Request - State: closed - Opened by ibanesh 7 months ago - 1 comment
Labels: CLA Signed

#96 - fix bug in computation aware latency

Pull Request - State: open - Opened by zhangshaolei1998 7 months ago - 3 comments
Labels: CLA Signed

#95 - [demo] Fix upstream states for tree leaf nodes

Pull Request - State: closed - Opened by annasun28 8 months ago
Labels: CLA Signed

#94 - SC streaming eval cli integration

Pull Request - State: closed - Opened by ibanesh 8 months ago
Labels: CLA Signed

#93 - Conflict handler for resolving duplicate args

Pull Request - State: closed - Opened by ibanesh 8 months ago
Labels: CLA Signed

#92 - version bump to 1.1.1

Pull Request - State: closed - Opened by annasun28 8 months ago
Labels: CLA Signed

#91 - Iterable Dataloader Improvements

Pull Request - State: closed - Opened by ibanesh 8 months ago
Labels: CLA Signed

#90 - Auto register dataloader

Pull Request - State: closed - Opened by ibanesh 8 months ago
Labels: CLA Signed

#89 - Add ability to visualize evaluation results

Pull Request - State: open - Opened by SamDewriter 8 months ago
Labels: CLA Signed

#88 - Iterable Dataloader

Pull Request - State: closed - Opened by ibanesh 8 months ago
Labels: CLA Signed

#87 - [demo] segment config

Pull Request - State: closed - Opened by annasun28 8 months ago - 1 comment
Labels: CLA Signed

#86 - Visualize Evaluation results on Simuleval #84

Pull Request - State: closed - Opened by SamDewriter 8 months ago
Labels: CLA Signed

#85 - Update setup.py sacrebleu dependency to be compatible with fairseq's

Pull Request - State: closed - Opened by justinhaaheim 8 months ago - 1 comment
Labels: CLA Signed

#84 - Visualize Evaluation Results on SimulEval

Issue - State: open - Opened by SamDewriter 8 months ago

#83 - Add config to segment, pass through agent pipeline

Pull Request - State: open - Opened by annasun28 8 months ago
Labels: CLA Signed

#82 - Slurm Array and SPM model

Pull Request - State: closed - Opened by xutaima 9 months ago - 1 comment
Labels: CLA Signed

#81 - lint PR #80 changes

Pull Request - State: closed - Opened by annasun28 9 months ago
Labels: CLA Signed

#80 - Upstream states for tree pipeline + fp16 evaluation

Pull Request - State: closed - Opened by annasun28 9 months ago
Labels: CLA Signed

#79 - ReadAction and WriteAction

Issue - State: closed - Opened by ZechengLi19 10 months ago - 2 comments

#78 - Fix Workflow Issue

Pull Request - State: closed - Opened by ibanesh 10 months ago
Labels: CLA Signed

#77 - set temperature to 0 to make results reproducible

Pull Request - State: closed - Opened by 30stomercury 10 months ago - 1 comment
Labels: CLA Signed

#76 - Streaming ASR

Pull Request - State: open - Opened by ibanesh 10 months ago
Labels: CLA Signed

#75 - Postprocessor Improvement

Pull Request - State: open - Opened by lh5844 10 months ago
Labels: CLA Signed

#74 - Add ability to switch output languages for multilingual models #69

Pull Request - State: closed - Opened by SamDewriter 10 months ago
Labels: CLA Signed

#73 - detokenizer agent

Pull Request - State: closed - Opened by annasun28 11 months ago - 1 comment
Labels: CLA Signed

#72 - Add ability to switch output languages for multilingual models #69

Pull Request - State: closed - Opened by SamDewriter 11 months ago - 10 comments
Labels: CLA Signed

#71 - Upstreaming states

Pull Request - State: closed - Opened by xutaima 11 months ago
Labels: CLA Signed

#70 - Add Whisper Wait-K example and WER scorer

Pull Request - State: closed - Opened by xutaima 11 months ago
Labels: CLA Signed

#69 - Add ability to switch output languages for multilingual models

Issue - State: open - Opened by ibanesh 11 months ago
Labels: MLH2023: Demo

#68 - Open source seamless experiences backend server and streaming chrome extension

Pull Request - State: open - Opened by lh5844 11 months ago - 6 comments
Labels: CLA Signed

#67 - Add Dummy Agent For Target Language Passing

Pull Request - State: closed - Opened by ibanesh 11 months ago
Labels: CLA Signed

#66 - Speech to Speech Unit Test

Issue - State: open - Opened by mandyschen 11 months ago

#65 - UI control for debug mode

Issue - State: open - Opened by mandyschen 11 months ago

#64 - Timeout for VC demo + chrome extension

Issue - State: open - Opened by mandyschen 11 months ago

#63 - [streaming] tree pipeline support

Pull Request - State: closed - Opened by annasun28 11 months ago - 1 comment
Labels: CLA Signed

#62 - add stateless case

Pull Request - State: open - Opened by mandyschen 11 months ago
Labels: CLA Signed

#61 - Pypi publish

Pull Request - State: closed - Opened by ibanesh 11 months ago
Labels: CLA Signed

#60 - Move simuleval/tests to top level

Pull Request - State: open - Opened by mandyschen 11 months ago
Labels: CLA Signed

#59 - PyPI automatic deployment through GitHub Action

Pull Request - State: closed - Opened by SamDewriter 12 months ago - 1 comment
Labels: CLA Signed

#58 - [demo] s2t + s2s agent pipelines

Pull Request - State: closed - Opened by annasun28 12 months ago
Labels: CLA Signed

#57 - Unit tests

Pull Request - State: closed - Opened by mandyschen 12 months ago
Labels: CLA Signed

#56 - Unit test for s2t

Pull Request - State: closed - Opened by lh5844 12 months ago - 2 comments
Labels: CLA Signed

#55 - support user-dir and multiple entrypoint by specifying agent-class

Pull Request - State: closed - Opened by annasun28 12 months ago - 1 comment
Labels: CLA Signed

#54 - Integrate demo backend from seamless experience

Issue - State: open - Opened by xutaima 12 months ago
Labels: MLH2023: Demo

#53 - Docker improvement

Issue - State: open - Opened by xutaima 12 months ago
Labels: MLH2023: New Features

#52 - PyPI automatic deployment through github Action

Issue - State: closed - Opened by xutaima 12 months ago - 1 comment
Labels: MLH2023: OSS Improvements

#51 - Typo

Pull Request - State: closed - Opened by xutaima 12 months ago
Labels: CLA Signed

#50 - Add S2T example

Pull Request - State: closed - Opened by xutaima 12 months ago
Labels: CLA Signed

#49 - adding support for yourube download for evaluation

Pull Request - State: closed - Opened by mohamedrfb about 1 year ago
Labels: CLA Signed

#48 - [Streaming] Enable evaluation of youtube videos

Pull Request - State: closed - Opened by mohamedrfb about 1 year ago
Labels: CLA Signed

#47 - support args/kwargs in to()

Pull Request - State: closed - Opened by annasun28 about 1 year ago - 2 comments
Labels: CLA Signed

#46 - Fix the bug end_offset = 0 when running scoring only

Pull Request - State: closed - Opened by xutaima about 1 year ago
Labels: CLA Signed

#45 - fix bug loading sys with nondefault config_name

Pull Request - State: closed - Opened by annasun28 about 1 year ago
Labels: CLA Signed

#44 - some problems with evaluation results

Issue - State: open - Opened by sarapapi about 1 year ago - 2 comments

#43 - Fix issues for remote evaluation

Pull Request - State: closed - Opened by ftshijt about 1 year ago - 1 comment
Labels: CLA Signed

#42 - Add conditions for empty prediction results in simul s2st evaluation

Pull Request - State: closed - Opened by ftshijt about 1 year ago - 1 comment
Labels: CLA Signed

#41 - Update README.md

Pull Request - State: closed - Opened by xutaima about 1 year ago
Labels: CLA Signed

#40 - Save metrics for individual utterance

Pull Request - State: closed - Opened by xutaima about 1 year ago
Labels: CLA Signed

#39 - Dis cont sync

Pull Request - State: closed - Opened by xutaima about 1 year ago
Labels: CLA Signed

#38 - Fixed ATD for no target

Pull Request - State: closed - Opened by master-possible about 1 year ago - 1 comment
Labels: CLA Signed

#36 - Update first_agent.py

Pull Request - State: closed - Opened by bhaddow over 1 year ago - 4 comments
Labels: CLA Signed

#35 - instances metric does not work

Issue - State: closed - Opened by sarapapi over 1 year ago - 2 comments

#34 - fixed ATD for s2s

Pull Request - State: closed - Opened by master-possible over 1 year ago - 2 comments
Labels: CLA Signed

#33 - fix ATD for s2s

Pull Request - State: closed - Opened by master-possible over 1 year ago - 2 comments
Labels: CLA Signed

#32 - Adding instructions for S2S evaluation

Pull Request - State: closed - Opened by xutaima over 1 year ago - 2 comments
Labels: CLA Signed

#31 - Speech features in the new version

Issue - State: closed - Opened by sarapapi over 1 year ago - 1 comment

#30 - Support streaming ASR evaluation

Pull Request - State: open - Opened by hirofumi0810 over 1 year ago
Labels: CLA Signed

#29 - Length Adaptive Average Lagging (LAAL)

Pull Request - State: closed - Opened by pe-trik over 1 year ago - 7 comments
Labels: CLA Signed, Merged

#28 - Add ATDScore

Pull Request - State: closed - Opened by master-possible over 1 year ago - 11 comments
Labels: CLA Signed, Merged

#27 - Several bug and format bug fix

Pull Request - State: closed - Opened by xutaima over 1 year ago - 6 comments
Labels: CLA Signed, Merged

#26 - V1.1.0 Updates

Pull Request - State: closed - Opened by xutaima over 1 year ago - 4 comments
Labels: CLA Signed, Merged

#25 - Length Adaptive Average Lagging (LAAL)

Pull Request - State: closed - Opened by pe-trik over 1 year ago - 3 comments

#24 - Refactor Dataloader

Pull Request - State: closed - Opened by xutaima almost 2 years ago
Labels: CLA Signed

#23 - Add instructions on evaluating t2t system with time stamps

Pull Request - State: closed - Opened by xutaima over 2 years ago
Labels: CLA Signed

#22 - Evaluate T2T system with time stamps

Pull Request - State: closed - Opened by xutaima over 2 years ago
Labels: CLA Signed

#21 - Update README.md

Pull Request - State: closed - Opened by xutaima over 2 years ago
Labels: CLA Signed

#20 - Connection refused when testing set is large

Issue - State: open - Opened by George0828Zhang over 2 years ago - 5 comments

#19 - Character level latency for speech-to-text

Issue - State: open - Opened by George0828Zhang over 2 years ago - 1 comment

#18 - Pre- and post-processing text in Simuleval

Issue - State: open - Opened by kurtisxx almost 3 years ago - 22 comments

#17 - Add batch calculation for latency metrics

Pull Request - State: closed - Opened by xutaima almost 3 years ago - 1 comment
Labels: CLA Signed

#16 - Moses tokenizer/detokenizer in cli options

Issue - State: open - Opened by George0828Zhang almost 3 years ago

#15 - visualization tool

Issue - State: open - Opened by sarapapi about 3 years ago - 1 comment

#14 - Fix AL calculation in latency.py

Pull Request - State: closed - Opened by yasu-possible about 3 years ago - 9 comments
Labels: CLA Signed

#13 - Commit 1753363 changes AL scores for audio input

Issue - State: closed - Opened by patrick-wilken about 3 years ago - 2 comments

#12 - Fails to evaluate wait-k model on SimulEval if sequence is shorter than k

Issue - State: closed - Opened by fury00812 about 3 years ago - 1 comment

#11 - questions about AL and DAL

Issue - State: closed - Opened by Onoratofra over 3 years ago - 2 comments

#10 - Scorer: fixed printing empty hyps list

Pull Request - State: closed - Opened by patrick-wilken over 3 years ago - 3 comments
Labels: CLA Signed

#9 - Error during Simul ST(MuST-C) Evaluation

Issue - State: closed - Opened by mzaidi59 over 3 years ago - 3 comments

#8 - bug in AL calculation

Issue - State: closed - Opened by danliu2 over 3 years ago - 1 comment

#7 - Update README.md

Pull Request - State: closed - Opened by xutaima over 3 years ago
Labels: CLA Signed