Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / allenai/catwalk issues and pull requests

#161 - Add torch.no_grad, fix greedy_until bug

Pull Request - State: closed - Opened by OyvindTafjord 6 months ago

#160 - New tasks and evaluation code for LLMs

Pull Request - State: closed - Opened by OyvindTafjord 10 months ago

#159 - Olmo eval cleanup

Pull Request - State: closed - Opened by OyvindTafjord 10 months ago - 1 comment

#158 - Add siqa and csqa tasks

Pull Request - State: closed - Opened by yulinggu-cs 10 months ago

#157 - Fix bug in loading datasets

Pull Request - State: closed - Opened by OyvindTafjord 10 months ago

#156 - Fix prefix space issues with certain tokenizers

Pull Request - State: closed - Opened by OyvindTafjord 11 months ago

#155 - Verbose perplexity evaluation

Pull Request - State: closed - Opened by OyvindTafjord 12 months ago

#154 - Bump torchmetrics from 0.11.1 to 1.1.0

Pull Request - State: open - Opened by dependabot[bot] about 1 year ago
Labels: dependencies, python

#153 - Update protobuf requirement from <=3.20 to <=4.24.1

Pull Request - State: open - Opened by dependabot[bot] about 1 year ago
Labels: dependencies, python

#152 - Update protobuf requirement from <=3.20 to <=4.24.0

Pull Request - State: closed - Opened by dependabot[bot] about 1 year ago - 1 comment
Labels: dependencies, python

#151 - Bump torchmetrics from 0.11.1 to 1.0.3

Pull Request - State: closed - Opened by dependabot[bot] about 1 year ago - 1 comment
Labels: dependencies, python

#150 - Bump torchmetrics from 0.11.1 to 1.0.2

Pull Request - State: closed - Opened by dependabot[bot] about 1 year ago - 1 comment
Labels: dependencies, python

#149 - Bump torchmetrics from 0.11.1 to 1.0.1

Pull Request - State: closed - Opened by dependabot[bot] about 1 year ago - 1 comment
Labels: dependencies, python

#148 - Update protobuf requirement from <=3.20 to <=4.23.4

Pull Request - State: closed - Opened by dependabot[bot] about 1 year ago - 1 comment
Labels: dependencies, python

#147 - Bump torchmetrics from 0.11.1 to 1.0.0

Pull Request - State: closed - Opened by dependabot[bot] about 1 year ago - 1 comment
Labels: dependencies, python

#146 - Tokenizer remote code

Pull Request - State: closed - Opened by OyvindTafjord over 1 year ago

#145 - Update tango requirement to use latest

Issue - State: open - Opened by AkshitaB over 1 year ago

#144 - Legal classification tasks (EurLex, UnfairTOS, and CaseHold)

Pull Request - State: closed - Opened by pdasigi over 1 year ago - 6 comments

#143 - Add mmlu

Pull Request - State: closed - Opened by tusharkhot over 1 year ago - 8 comments

#142 - Sumtasks

Pull Request - State: closed - Opened by armancohan over 1 year ago

#141 - Add max generation tokens

Pull Request - State: closed - Opened by OyvindTafjord over 1 year ago

#140 - Adding summarization datasets, scitldr and xsum

Pull Request - State: closed - Opened by armancohan over 1 year ago - 1 comment

#139 - Update protobuf requirement from <=3.20 to <=4.23.3

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#138 - Fix superglue tasks

Pull Request - State: closed - Opened by OyvindTafjord over 1 year ago

#137 - Update protobuf requirement from <=3.20 to <=4.23.2

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#136 - Pass in model_max_length to greedy_until

Pull Request - State: closed - Opened by OyvindTafjord over 1 year ago

#135 - Fix model_inputs dict, lower max_gen_toks for now

Pull Request - State: closed - Opened by OyvindTafjord over 1 year ago

#134 - Tweak help string

Pull Request - State: closed - Opened by OyvindTafjord over 1 year ago - 1 comment

#133 - Add natural questions (short only; no context)

Pull Request - State: closed - Opened by tusharkhot over 1 year ago - 1 comment

#132 - Update protobuf requirement from <=3.20 to <=4.23.1

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#131 - Update protobuf requirement from <=3.20 to <=4.23.0

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#130 - Update protobuf requirement from <=3.20 to <=4.22.4

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#129 - Update sphinx requirement from <6 to <8

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, python

#128 - MultiRC is not a QA task

Pull Request - State: closed - Opened by dirkgr over 1 year ago - 1 comment

#127 - Update protobuf requirement from <=3.20 to <=4.22.3

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#126 - Bump torchmetrics from 0.11.1 to 0.11.4

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#125 - OPT-175B

Pull Request - State: closed - Opened by dirkgr over 1 year ago

#124 - Update protobuf requirement from <=3.20 to <=4.22.1

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#123 - Bump allenai/beaker-run-action from 1.1 to 1.2

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, github_actions

#122 - Bump torchmetrics from 0.11.1 to 0.11.3

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#121 - Update sphinx requirement from <6 to <7

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#120 - run tests on Beaker with NFS cache

Pull Request - State: closed - Opened by epwalsh over 1 year ago

#119 - Update protobuf requirement from <=3.20 to <4.23

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#118 - Rename `Task` -> `Dataset` and `Model` -> `ModelWrapper`

Issue - State: open - Opened by dirkgr over 1 year ago

#117 - [wip] adding SciTLDR dataset

Pull Request - State: open - Opened by kyleclo over 1 year ago

#115 - Makes Lambada work with GPT2

Pull Request - State: closed - Opened by dirkgr over 1 year ago

#114 - Bump torchmetrics from 0.11.0 to 0.11.1

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, python

#113 - Update protobuf requirement from <=3.20 to <4.22

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, python

#112 - Fixes Squad metrics computation

Pull Request - State: closed - Opened by dirkgr over 1 year ago

#111 - Bettermap dependency

Pull Request - State: closed - Opened by dirkgr over 1 year ago

#110 - A job that computes a big matrix of results

Pull Request - State: closed - Opened by dirkgr over 1 year ago

#109 - Bump sphinx from 5.3.0 to 6.0.0

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago - 1 comment
Labels: dependencies, python

#108 - Bump furo from 2022.9.29 to 2022.12.7

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python

#107 - `tqdm` has to be closed

Pull Request - State: closed - Opened by dirkgr almost 2 years ago

#106 - Copy `lmeval`

Pull Request - State: closed - Opened by dirkgr almost 2 years ago

#105 - A bunch of changes back ported into `main` from the task complexity work

Pull Request - State: closed - Opened by dirkgr almost 2 years ago

#104 - Bump torchmetrics from 0.10.1 to 0.11.0

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python

#103 - Prefix tuning experiment

Pull Request - State: closed - Opened by dirkgr almost 2 years ago - 2 comments

#102 - More classification

Pull Request - State: closed - Opened by dirkgr almost 2 years ago - 1 comment

#101 - make RC `_make_model` an instance method, steps can take `Lazy[Model]`

Pull Request - State: open - Opened by epwalsh almost 2 years ago

#100 - Bump torchmetrics from 0.10.1 to 0.10.3

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago - 1 comment
Labels: dependencies, python

#99 - Bump sphinx-copybutton from 0.5.0 to 0.5.1

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python

#98 - Bump torchmetrics from 0.10.1 to 0.10.2

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago - 1 comment
Labels: dependencies, python

#97 - Bump torchmetrics from 0.9.3 to 0.10.1

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python

#96 - Bump sphinx from 5.2.3 to 5.3.0

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python

#95 - Train T5 RC style

Pull Request - State: closed - Opened by dirkgr almost 2 years ago - 1 comment

#94 - Backported from the task complexity branch

Pull Request - State: closed - Opened by dirkgr almost 2 years ago

#93 - Bump torchmetrics from 0.9.3 to 0.10.0

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago - 1 comment
Labels: dependencies, python

#92 - Add missing `__init__.py` file

Pull Request - State: closed - Opened by epwalsh almost 2 years ago

#91 - Bump sphinx from 5.2.1 to 5.2.3

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python

#90 - Copy and paste promptsource

Pull Request - State: closed - Opened by dirkgr about 2 years ago - 1 comment

#89 - Bump furo from 2022.9.15 to 2022.9.29

Pull Request - State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies, python

#88 - Bump myst-parser from 0.18.0 to 0.18.1

Pull Request - State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies, python

#87 - Bump sphinx from 5.2.1 to 5.2.2

Pull Request - State: closed - Opened by dependabot[bot] about 2 years ago - 1 comment
Labels: dependencies, python

#86 - Bump sphinx from 5.1.1 to 5.2.1

Pull Request - State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies, python

#85 - Promptsource support

Pull Request - State: closed - Opened by dirkgr about 2 years ago

#84 - Dirk's big training job

Pull Request - State: closed - Opened by dirkgr about 2 years ago

#83 - Auto device map

Pull Request - State: closed - Opened by IanMagnusson about 2 years ago

#82 - Bump furo from 2022.6.21 to 2022.9.15

Pull Request - State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies, python

#81 - Generalized ia3

Pull Request - State: open - Opened by IanMagnusson about 2 years ago

#80 - support for opt in training

Pull Request - State: closed - Opened by IanMagnusson about 2 years ago - 1 comment

#79 - Fairscale training

Pull Request - State: open - Opened by IanMagnusson about 2 years ago

#78 - Updates to GPT models so we can use them for the retrieval LM project

Pull Request - State: open - Opened by epwalsh about 2 years ago

#77 - Support for python 3.8

Pull Request - State: closed - Opened by epwalsh about 2 years ago

#76 - Distributed Data Parallel Training

Pull Request - State: open - Opened by IanMagnusson about 2 years ago - 3 comments

#75 - Huggingface classification support

Pull Request - State: closed - Opened by dirkgr about 2 years ago - 3 comments

#74 - Add support for MetaICL's race-high and numer_sense tasks

Pull Request - State: closed - Opened by IanMagnusson about 2 years ago

#73 - gpu logit processing for rank classification models

Pull Request - State: closed - Opened by IanMagnusson about 2 years ago

#72 - Trainable HF Automodel

Pull Request - State: closed - Opened by dirkgr about 2 years ago

#71 - Expand metaicl

Pull Request - State: closed - Opened by IanMagnusson about 2 years ago

#70 - support decoder only ia3 for ranked classification

Pull Request - State: closed - Opened by IanMagnusson about 2 years ago

#69 - Add MRQA task

Pull Request - State: closed - Opened by anas-awadalla about 2 years ago

#68 - trainable_copy might need override_weights_file

Issue - State: closed - Opened by IanMagnusson about 2 years ago - 1 comment

#67 - Bump sphinx from 5.0.2 to 5.1.1

Pull Request - State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies, python

#65 - Added QA evaluation for GPT & T5

Pull Request - State: closed - Opened by anas-awadalla about 2 years ago

#64 - implement load_weights for cached_transforers.get()

Pull Request - State: closed - Opened by IanMagnusson about 2 years ago - 1 comment

#63 - cached_transformers.get() load_weights arg is not implemented.

Issue - State: closed - Opened by IanMagnusson about 2 years ago - 1 comment

#62 - Optional random_subsample_seed for PredictStep

Pull Request - State: closed - Opened by IanMagnusson about 2 years ago