nyu-mll/jiant issues and pull requests

#1367 - Not able to install jiant

Issue - State: open - Opened by alisheikh1 3 months ago

#1366 - Are the leaderboard results evaluated using 0-shot settings?

Issue - State: open - Opened by zhimin-z 10 months ago

#1365 - Add `Levenshtein` and `nltk` to `requirements.txt`

Issue - State: open - Opened by TheFloatingString 11 months ago

#1364 - Can I use jiant for multi input task learning like (image, audio, video)?

Issue - State: open - Opened by imrankh46 about 1 year ago

#1363 - Using JIANT to test model bias on winogender task

Issue - State: open - Opened by mzakizadeh about 1 year ago

#1362 - Bump scipy from 1.4.1 to 1.10.0

Pull Request - State: open - Opened by dependabot[bot] about 1 year ago
Labels: dependencies

#1361 - Bump transformers from 4.5.0 to 4.30.0

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago
Labels: dependencies

#1360 - Support for seq2seq task

Issue - State: open - Opened by szamani20 over 1 year ago

#1358 - testing subsample of the test set

Issue - State: open - Opened by LeonardRanaldi almost 2 years ago

#1357 - Black

Pull Request - State: closed - Opened by zphang almost 2 years ago

#1356 - libs

Pull Request - State: closed - Opened by zphang almost 2 years ago

#1355 - CVE-2007-4559 Patch

Pull Request - State: closed - Opened by TrellixVulnTeam almost 2 years ago - 1 comment

#1354 - feat(Distilbert): Added distilbert model support

Pull Request - State: open - Opened by manarea about 2 years ago

#1353 - Issue in `call_predict`: error while getting predictions from trained models

Issue - State: open - Opened by swag2198 about 2 years ago

#1352 - Bump lxml from 4.6.5 to 4.9.1

Pull Request - State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#1351 - Update dependencies

Pull Request - State: closed - Opened by zphang over 2 years ago - 1 comment

#1350 - Bump numpy from 1.18.4 to 1.22.0

Pull Request - State: closed - Opened by dependabot[bot] over 2 years ago - 1 comment
Labels: dependencies

#1349 - Bugfix for simple_run() multiple models with the same type.

Pull Request - State: closed - Opened by TimDettmers over 2 years ago - 1 comment

#1348 - Unable to execute run_simple() with different models of the same type

Issue - State: open - Opened by TimDettmers over 2 years ago

#1347 - Fix commitmentbank labels

Pull Request - State: closed - Opened by zphang over 2 years ago - 1 comment

#1346 - Swapped labels in CommitmentBank

Issue - State: open - Opened by davda54 over 2 years ago - 1 comment

#1345 - Can't instantiate abstract class JiantBartModel with abstract methods normalize_tokenizations

Issue - State: open - Opened by Chang-Hongyang almost 3 years ago

#1344 - Bump lxml from 4.6.3 to 4.6.5

Pull Request - State: closed - Opened by dependabot[bot] almost 3 years ago - 1 comment
Labels: dependencies

#1343 - # Question about the support of DistributedDataParallel

Issue - State: open - Opened by mexiQQ almost 3 years ago

#1342 - Error report about running code in edge probing example notebook.

Issue - State: open - Opened by 24kMengXin almost 3 years ago - 2 comments

#1339 - How can I reproduce the results in SuperGlue paper?

Issue - State: open - Opened by runzeer about 3 years ago - 1 comment

#1338 - how to use multi-gpus to finetune large datasets like ReCoRD?

Issue - State: open - Opened by runzeer about 3 years ago - 3 comments

#1337 - How to train a task with soft label?

Issue - State: closed - Opened by chawannut157 about 3 years ago - 1 comment

#1336 - How to save trained multi-task model & evaluate on test data

Issue - State: closed - Opened by lashmore about 3 years ago - 1 comment

#1335 - Documentation for Trainer and Run experiments is outdated and/or unclear

Issue - State: open - Opened by lashmore about 3 years ago

#1334 - Multi-task Learning - Two instances of the same task

Issue - State: closed - Opened by lashmore about 3 years ago - 5 comments

#1331 - Unable to run RAG model for tokenizing, fine-tuning, and predicting with `jiant` on branch `IRT_experiments`

Issue - State: open - Opened by pk1130 about 3 years ago - 2 comments

#1330 - XTREME tokenize_and_cache script error

Issue - State: closed - Opened by dapurv5 about 3 years ago - 1 comment

#1329 - Fix xlm-r loading

Pull Request - State: closed - Opened by zphang about 3 years ago - 1 comment

#1328 - Custom torch.utils.data.DataLoader.collate_fn

Issue - State: open - Opened by fabriceyhc about 3 years ago - 1 comment

#1327 - Unable to reproduce XTREME numbers

Issue - State: open - Opened by dapurv5 about 3 years ago - 2 comments

#1326 - Pin conll script version

Pull Request - State: closed - Opened by zphang about 3 years ago - 1 comment

#1325 - change win64 numpy default int32 to int64

Pull Request - State: open - Opened by jian-mo about 3 years ago - 1 comment

#1324 - Error in data download while converting conllu files to conll format

Issue - State: closed - Opened by dapurv5 about 3 years ago - 2 comments

#1323 - IndexError in jiant/trainer.py

Issue - State: closed - Opened by felixmeyjr over 3 years ago

#1322 - MLM task is broken in the new update

Issue - State: open - Opened by pooryapzm over 3 years ago - 1 comment

#1321 - Drop support for Python 3.6

Pull Request - State: open - Opened by zphang over 3 years ago - 1 comment

#1320 - Unable to run the simple_api_fine_tuning.ipynb with Python 3.6.9

Issue - State: closed - Opened by lovhag over 3 years ago - 3 comments

#1319 - Installation of jiant using pip fails

Issue - State: open - Opened by zeno17 over 3 years ago - 5 comments

#1318 - Installation of jiant using pip fails

Issue - State: closed - Opened by zeno17 over 3 years ago - 1 comment

#1317 - Implementation Details on the COPA Task

Issue - State: open - Opened by slowwavesleep over 3 years ago

#1316 - blimp-and-npi branch Getting started tutorial doesn't work for me.

Issue - State: closed - Opened by DavidNaak over 3 years ago

#1315 - Release: v2.2.0

Pull Request - State: closed - Opened by jeswan over 3 years ago - 1 comment

#1313 - Help with editing the NER script

Issue - State: open - Opened by adityaarunsinghal over 3 years ago

#1312 - Stuck once in a while during training

Issue - State: open - Opened by zhuohaoyu over 3 years ago - 1 comment

#1311 - Bugfix for simple_api_fine_tuning.ipynb

Pull Request - State: closed - Opened by jeswan over 3 years ago - 1 comment

#1310 - Google Colab Error

Issue - State: closed - Opened by Harry-Rogers over 3 years ago - 1 comment

#1309 - Merge easy_add_model feature branch

Pull Request - State: closed - Opened by jeswan over 3 years ago - 1 comment

#1308 - Add test matrix

Pull Request - State: closed - Opened by jeswan over 3 years ago - 1 comment

#1307 - improve robustness of the simple runscript

Pull Request - State: closed - Opened by sakogan over 3 years ago - 2 comments

#1306 - Using jiant to make BioBERT and SciBERT to run superGLUE tasks

Issue - State: closed - Opened by shi-kejian over 3 years ago - 23 comments

#1305 - Reproducibility of edge probing tasks

Issue - State: open - Opened by sagnik over 3 years ago - 3 comments

#1304 - Bump lxml from 4.6.2 to 4.6.3

Pull Request - State: closed - Opened by dependabot[bot] over 3 years ago - 1 comment
Labels: dependencies

#1303 - tokenize_and_cache clobbers paths.json

Issue - State: open - Opened by eritain over 3 years ago

#1302 - Assert spans <= max_seq_len

Pull Request - State: closed - Opened by zphang over 3 years ago - 1 comment

#1301 - Benchmark script fixes

Pull Request - State: closed - Opened by zphang over 3 years ago - 1 comment

#1300 - axg->axb fix

Pull Request - State: closed - Opened by zphang over 3 years ago - 1 comment

#1299 - typo in supported_tasks.md?

Issue - State: closed - Opened by eritain over 3 years ago - 1 comment

#1298 - fixes in benchmark_submission_formatter.py

Issue - State: open - Opened by eritain over 3 years ago - 1 comment
Labels: assigned

#1297 - Error during edge-probing task when a span is located beyond the max_seq_length

Issue - State: open - Opened by hannamw over 3 years ago - 1 comment
Labels: assigned

#1296 - Fix tasks circular import

Pull Request - State: closed - Opened by jeswan over 3 years ago - 1 comment

#1295 - Add DeBERTa

Pull Request - State: closed - Opened by jeswan over 3 years ago - 1 comment

#1294 - MNLI diagnostic example bug

Pull Request - State: closed - Opened by zphang over 3 years ago - 1 comment

#1293 - DeBERTa support

Issue - State: closed - Opened by nlpist over 3 years ago - 2 comments

#1292 - Error in jiant_MNLI_Diagnostic_Example.ipynb?

Issue - State: closed - Opened by eritain over 3 years ago - 1 comment
Labels: assigned

#1291 - Evaluation script example

Issue - State: open - Opened by nlpist over 3 years ago - 12 comments
Labels: assigned

#1290 - Move tokenization logic to central JiantModelTransformers method

Pull Request - State: closed - Opened by jeswan over 3 years ago - 2 comments

#1289 - Add tests for flat_strip()

Pull Request - State: closed - Opened by jeswan over 3 years ago - 2 comments

#1288 - mlm_weights(), feat_spec(), flat_strip() if-else refactors

Pull Request - State: closed - Opened by jeswan over 3 years ago - 1 comment

#1287 - Sequential Training: How to fine-tune on MLM?

Issue - State: closed - Opened by slowwavesleep over 3 years ago - 3 comments
Labels: assigned

#1285 - Move tokenization logic to central JiantModelTransformers method

Pull Request - State: closed - Opened by jeswan over 3 years ago

#1284 - Ability to define custom models

Issue - State: closed - Opened by thak123 over 3 years ago - 2 comments

#1283 - Refactor get_output_from_encoder() to be member of JiantTaskModel

Pull Request - State: closed - Opened by jeswan over 3 years ago - 1 comment

#1282 - Documentation + cleanup

Pull Request - State: closed - Opened by zphang over 3 years ago - 1 comment

#1281 - tokenize_and_cache cooks up wacky paths

Issue - State: open - Opened by eritain over 3 years ago - 3 comments
Labels: assigned

#1280 - README.md "Quick Introduction" is broken

Issue - State: closed - Opened by eritain over 3 years ago - 1 comment

#1279 - Tutorial Notebooks and Installations do not work

Issue - State: closed - Opened by teshnizi over 3 years ago - 4 comments

#1278 - [IRT Branch] IRT update

Pull Request - State: open - Opened by zphang over 3 years ago

#1277 - export_model tweak

Pull Request - State: closed - Opened by zphang over 3 years ago - 1 comment

#1276 - How to load datasets from local path?

Issue - State: closed - Opened by ast123 over 3 years ago - 1 comment

#1275 - How to start training from a checkpoint or snapshot? [question] [documentation]

Issue - State: open - Opened by eritain over 3 years ago - 2 comments
Labels: assigned

#1274 - Add mobilebert

Pull Request - State: closed - Opened by jeswan over 3 years ago

#1273 - Refactor remaining model specific if-else statements

Pull Request - State: closed - Opened by jeswan over 3 years ago

#1272 - Refactor encoder output to be member method of model

Pull Request - State: closed - Opened by jeswan over 3 years ago

#1271 - Adding Acceptability judgment and SentEval tasks

Pull Request - State: closed - Opened by zphang over 3 years ago - 1 comment

#1270 - Updating notebooks, removing model_type

Pull Request - State: closed - Opened by zphang over 3 years ago - 1 comment

#1269 - How to compute the score GPS for AXG

Issue - State: closed - Opened by ghost over 3 years ago - 1 comment

#1268 - Switch to task model/head factories instead of embedded if-else statements

Pull Request - State: closed - Opened by jeswan over 3 years ago - 1 comment

#1267 - How to open test_preds.p

Issue - State: closed - Opened by Syavaprd over 3 years ago

#1266 - Update to Transformers v4.3.3

Pull Request - State: closed - Opened by jeswan over 3 years ago - 5 comments

#1260 - Switch export_model to use AutoModel and AutoTokenizer

Pull Request - State: closed - Opened by jeswan over 3 years ago - 4 comments

#1255 - how to get results of superglue task Ax-b and Ax-g?

Issue - State: closed - Opened by YoungTimmy over 3 years ago - 13 comments
Labels: question, assigned

#1252 - Examples for Edge Probing Tasks

Issue - State: closed - Opened by abhinavkashyap almost 4 years ago - 4 comments

#1251 - Extract hidden state representation

Issue - State: closed - Opened by macabdul9 almost 4 years ago - 5 comments
Labels: assigned

#1237 - Will you support T5 or GPT based models in the future

Issue - State: open - Opened by HyeondeyKim almost 4 years ago - 7 comments
Labels: assigned

GitHub / nyu-mll/jiant issues and pull requests