facebookresearch/SimulEval issues and pull requests

#111 - Feat: Demo feature for remote streaming speech to text

Pull Request - State: closed - Opened by Epic-Eric 6 months ago
Labels: CLA Signed

#110 - Feat: Docker environment for remote speech to text evaluation

Pull Request - State: closed - Opened by Epic-Eric 6 months ago
Labels: CLA Signed

#109 - Fix: Implement fixes for remote evaluation

Pull Request - State: closed - Opened by Epic-Eric 6 months ago - 1 comment
Labels: CLA Signed

#108 - Fix: typos and logic errors

Pull Request - State: closed - Opened by Epic-Eric 6 months ago - 1 comment
Labels: CLA Signed

#107 - Feat: Visualization tool

Pull Request - State: closed - Opened by Epic-Eric 7 months ago - 3 comments
Labels: CLA Signed

#106 - FIX: user couldn't add custom cli arguments to be passed to the policy

Pull Request - State: open - Opened by RomanKoshkin 10 months ago - 2 comments
Labels: CLA Signed

#105 - Update instance.py

Pull Request - State: open - Opened by zhongmz about 1 year ago - 2 comments
Labels: CLA Signed

#104 - error with fairseq simultaneous

Issue - State: open - Opened by krgy12138 about 1 year ago

#103 - Request for Batch Sample Generation (with batch_size)

Issue - State: open - Opened by zhongmz about 1 year ago

#102 - Bump version to 1.1.4

Pull Request - State: closed - Opened by ibanesh about 1 year ago
Labels: CLA Signed

#101 - Bump Version to 1.1.3

Pull Request - State: closed - Opened by ibanesh about 1 year ago
Labels: CLA Signed

#100 - add parser to evaluation function

Pull Request - State: closed - Opened by xutaima about 1 year ago
Labels: CLA Signed

#99 - Enable parser param passing

Pull Request - State: closed - Opened by ibanesh about 1 year ago - 1 comment
Labels: CLA Signed

#98 - Fix evaluation issue when latency unit is spm for iterative dataloader

Pull Request - State: closed - Opened by xutaima about 1 year ago - 1 comment
Labels: CLA Signed

#97 - CLI improvements

Pull Request - State: closed - Opened by ibanesh about 1 year ago - 1 comment
Labels: CLA Signed

#96 - fix bug in computation aware latency

Pull Request - State: open - Opened by zhangshaolei1998 about 1 year ago - 3 comments
Labels: CLA Signed

#95 - [demo] Fix upstream states for tree leaf nodes

Pull Request - State: closed - Opened by annasun28 about 1 year ago
Labels: CLA Signed

#94 - SC streaming eval cli integration

Pull Request - State: closed - Opened by ibanesh about 1 year ago
Labels: CLA Signed

#93 - Conflict handler for resolving duplicate args

Pull Request - State: closed - Opened by ibanesh about 1 year ago
Labels: CLA Signed

#92 - version bump to 1.1.1

Pull Request - State: closed - Opened by annasun28 about 1 year ago
Labels: CLA Signed

#91 - Iterable Dataloader Improvements

Pull Request - State: closed - Opened by ibanesh about 1 year ago
Labels: CLA Signed

#90 - Auto register dataloader

Pull Request - State: closed - Opened by ibanesh about 1 year ago
Labels: CLA Signed

#89 - Add ability to visualize evaluation results

Pull Request - State: open - Opened by SamDewriter about 1 year ago
Labels: CLA Signed

#88 - Iterable Dataloader

Pull Request - State: closed - Opened by ibanesh about 1 year ago
Labels: CLA Signed

#87 - [demo] segment config

Pull Request - State: closed - Opened by annasun28 about 1 year ago - 1 comment
Labels: CLA Signed

#86 - Visualize Evaluation results on Simuleval #84

Pull Request - State: closed - Opened by SamDewriter about 1 year ago
Labels: CLA Signed

#85 - Update setup.py sacrebleu dependency to be compatible with fairseq's

Pull Request - State: closed - Opened by justinhaaheim about 1 year ago - 1 comment
Labels: CLA Signed

#84 - Visualize Evaluation Results on SimulEval

Issue - State: open - Opened by SamDewriter about 1 year ago

#83 - Add config to segment, pass through agent pipeline

Pull Request - State: open - Opened by annasun28 about 1 year ago
Labels: CLA Signed

#82 - Slurm Array and SPM model

Pull Request - State: closed - Opened by xutaima over 1 year ago - 1 comment
Labels: CLA Signed

#81 - lint PR #80 changes

Pull Request - State: closed - Opened by annasun28 over 1 year ago
Labels: CLA Signed

#80 - Upstream states for tree pipeline + fp16 evaluation

Pull Request - State: closed - Opened by annasun28 over 1 year ago
Labels: CLA Signed

#79 - ReadAction and WriteAction

Issue - State: closed - Opened by ZechengLi19 over 1 year ago - 2 comments

#78 - Fix Workflow Issue

Pull Request - State: closed - Opened by ibanesh over 1 year ago
Labels: CLA Signed

#77 - set temperature to 0 to make results reproducible

Pull Request - State: closed - Opened by 30stomercury over 1 year ago - 1 comment
Labels: CLA Signed

#76 - Streaming ASR

Pull Request - State: open - Opened by ibanesh over 1 year ago
Labels: CLA Signed

#75 - Postprocessor Improvement

Pull Request - State: open - Opened by lh5844 over 1 year ago
Labels: CLA Signed

#74 - Add ability to switch output languages for multilingual models #69

Pull Request - State: closed - Opened by SamDewriter over 1 year ago
Labels: CLA Signed

#73 - detokenizer agent

Pull Request - State: closed - Opened by annasun28 over 1 year ago - 1 comment
Labels: CLA Signed

#72 - Add ability to switch output languages for multilingual models #69

Pull Request - State: closed - Opened by SamDewriter over 1 year ago - 10 comments
Labels: CLA Signed

#71 - Upstreaming states

Pull Request - State: closed - Opened by xutaima over 1 year ago
Labels: CLA Signed

#70 - Add Whisper Wait-K example and WER scorer

Pull Request - State: closed - Opened by xutaima over 1 year ago
Labels: CLA Signed

#69 - Add ability to switch output languages for multilingual models

Issue - State: open - Opened by ibanesh over 1 year ago
Labels: MLH2023: Demo

#68 - Open source seamless experiences backend server and streaming chrome extension

Pull Request - State: open - Opened by lh5844 over 1 year ago - 6 comments
Labels: CLA Signed

#67 - Add Dummy Agent For Target Language Passing

Pull Request - State: closed - Opened by ibanesh over 1 year ago
Labels: CLA Signed

#66 - Speech to Speech Unit Test

Issue - State: open - Opened by mandyschen over 1 year ago

#65 - UI control for debug mode

Issue - State: open - Opened by mandyschen over 1 year ago

#64 - Timeout for VC demo + chrome extension

Issue - State: open - Opened by mandyschen over 1 year ago

#63 - [streaming] tree pipeline support

Pull Request - State: closed - Opened by annasun28 over 1 year ago - 1 comment
Labels: CLA Signed

#62 - add stateless case

Pull Request - State: open - Opened by mandyschen over 1 year ago
Labels: CLA Signed

#61 - Pypi publish

Pull Request - State: closed - Opened by ibanesh over 1 year ago
Labels: CLA Signed

#60 - Move simuleval/tests to top level

Pull Request - State: open - Opened by mandyschen over 1 year ago - 1 comment
Labels: CLA Signed

#59 - PyPI automatic deployment through GitHub Action

Pull Request - State: closed - Opened by SamDewriter over 1 year ago - 1 comment
Labels: CLA Signed

#58 - [demo] s2t + s2s agent pipelines

Pull Request - State: closed - Opened by annasun28 over 1 year ago
Labels: CLA Signed

#57 - Unit tests

Pull Request - State: closed - Opened by mandyschen over 1 year ago
Labels: CLA Signed

#56 - Unit test for s2t

Pull Request - State: closed - Opened by lh5844 over 1 year ago - 2 comments
Labels: CLA Signed

#55 - support user-dir and multiple entrypoint by specifying agent-class

Pull Request - State: closed - Opened by annasun28 over 1 year ago - 1 comment
Labels: CLA Signed

#54 - Integrate demo backend from seamless experience

Issue - State: open - Opened by xutaima over 1 year ago
Labels: MLH2023: Demo

#53 - Docker improvement

Issue - State: open - Opened by xutaima over 1 year ago
Labels: MLH2023: New Features

#52 - PyPI automatic deployment through github Action

Issue - State: closed - Opened by xutaima over 1 year ago - 1 comment
Labels: MLH2023: OSS Improvements

#51 - Typo

Pull Request - State: closed - Opened by xutaima over 1 year ago
Labels: CLA Signed

#50 - Add S2T example

Pull Request - State: closed - Opened by xutaima over 1 year ago
Labels: CLA Signed

#49 - adding support for yourube download for evaluation

Pull Request - State: closed - Opened by mohamedrfb over 1 year ago
Labels: CLA Signed

#48 - [Streaming] Enable evaluation of youtube videos

Pull Request - State: closed - Opened by mohamedrfb over 1 year ago
Labels: CLA Signed

#47 - support args/kwargs in to()

Pull Request - State: closed - Opened by annasun28 almost 2 years ago - 2 comments
Labels: CLA Signed

#46 - Fix the bug end_offset = 0 when running scoring only

Pull Request - State: closed - Opened by xutaima almost 2 years ago
Labels: CLA Signed

#45 - fix bug loading sys with nondefault config_name

Pull Request - State: closed - Opened by annasun28 almost 2 years ago
Labels: CLA Signed

#44 - some problems with evaluation results

Issue - State: open - Opened by sarapapi almost 2 years ago - 2 comments

#43 - Fix issues for remote evaluation

Pull Request - State: closed - Opened by ftshijt almost 2 years ago - 1 comment
Labels: CLA Signed

#42 - Add conditions for empty prediction results in simul s2st evaluation

Pull Request - State: closed - Opened by ftshijt almost 2 years ago - 1 comment
Labels: CLA Signed

#41 - Update README.md

Pull Request - State: closed - Opened by xutaima almost 2 years ago
Labels: CLA Signed

#40 - Save metrics for individual utterance

Pull Request - State: closed - Opened by xutaima almost 2 years ago
Labels: CLA Signed

#39 - Dis cont sync

Pull Request - State: closed - Opened by xutaima almost 2 years ago
Labels: CLA Signed

#38 - Fixed ATD for no target

Pull Request - State: closed - Opened by master-possible almost 2 years ago - 1 comment
Labels: CLA Signed

#37 - importlib.metadata.PackageNotFoundError: No package metadata was found for simuleval

Issue - State: closed - Opened by bhaddow almost 2 years ago - 5 comments

#36 - Update first_agent.py

Pull Request - State: closed - Opened by bhaddow almost 2 years ago - 4 comments
Labels: CLA Signed

#35 - instances metric does not work

Issue - State: closed - Opened by sarapapi almost 2 years ago - 2 comments

#34 - fixed ATD for s2s

Pull Request - State: closed - Opened by master-possible almost 2 years ago - 2 comments
Labels: CLA Signed

#33 - fix ATD for s2s

Pull Request - State: closed - Opened by master-possible almost 2 years ago - 2 comments
Labels: CLA Signed

#32 - Adding instructions for S2S evaluation

Pull Request - State: closed - Opened by xutaima almost 2 years ago - 2 comments
Labels: CLA Signed

#31 - Speech features in the new version

Issue - State: closed - Opened by sarapapi almost 2 years ago - 1 comment

#30 - Support streaming ASR evaluation

Pull Request - State: open - Opened by hirofumi0810 almost 2 years ago
Labels: CLA Signed

#29 - Length Adaptive Average Lagging (LAAL)

Pull Request - State: closed - Opened by pe-trik about 2 years ago - 7 comments
Labels: CLA Signed, Merged

#28 - Add ATDScore

Pull Request - State: closed - Opened by master-possible about 2 years ago - 11 comments
Labels: CLA Signed, Merged

#27 - Several bug and format bug fix

Pull Request - State: closed - Opened by xutaima about 2 years ago - 6 comments
Labels: CLA Signed, Merged

#26 - V1.1.0 Updates

Pull Request - State: closed - Opened by xutaima about 2 years ago - 4 comments
Labels: CLA Signed, Merged

#25 - Length Adaptive Average Lagging (LAAL)

Pull Request - State: closed - Opened by pe-trik about 2 years ago - 3 comments

#24 - Refactor Dataloader

Pull Request - State: closed - Opened by xutaima over 2 years ago
Labels: CLA Signed

#23 - Add instructions on evaluating t2t system with time stamps

Pull Request - State: closed - Opened by xutaima almost 3 years ago
Labels: CLA Signed

#22 - Evaluate T2T system with time stamps

Pull Request - State: closed - Opened by xutaima almost 3 years ago
Labels: CLA Signed

#21 - Update README.md

Pull Request - State: closed - Opened by xutaima almost 3 years ago
Labels: CLA Signed

#20 - Connection refused when testing set is large

Issue - State: open - Opened by George0828Zhang about 3 years ago - 5 comments

#19 - Character level latency for speech-to-text

Issue - State: open - Opened by George0828Zhang about 3 years ago - 1 comment

#18 - Pre- and post-processing text in Simuleval

Issue - State: open - Opened by kurtisxx over 3 years ago - 22 comments

#17 - Add batch calculation for latency metrics

Pull Request - State: closed - Opened by xutaima over 3 years ago - 1 comment
Labels: CLA Signed

#16 - Moses tokenizer/detokenizer in cli options

Issue - State: open - Opened by George0828Zhang over 3 years ago

#15 - visualization tool

Issue - State: open - Opened by sarapapi over 3 years ago - 1 comment

#14 - Fix AL calculation in latency.py

Pull Request - State: closed - Opened by yasu-possible almost 4 years ago - 9 comments
Labels: CLA Signed

#13 - Commit 1753363 changes AL scores for audio input

Issue - State: closed - Opened by patrick-wilken almost 4 years ago - 2 comments

#12 - Fails to evaluate wait-k model on SimulEval if sequence is shorter than k

Issue - State: closed - Opened by fury00812 almost 4 years ago - 1 comment

GitHub / facebookresearch/SimulEval issues and pull requests