Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / allenai/catwalk issues and pull requests
#161 - Add torch.no_grad, fix greedy_until bug
Pull Request -
State: closed - Opened by OyvindTafjord 6 months ago
#160 - New tasks and evaluation code for LLMs
Pull Request -
State: closed - Opened by OyvindTafjord 10 months ago
#159 - Olmo eval cleanup
Pull Request -
State: closed - Opened by OyvindTafjord 10 months ago
- 1 comment
#158 - Add siqa and csqa tasks
Pull Request -
State: closed - Opened by yulinggu-cs 10 months ago
#157 - Fix bug in loading datasets
Pull Request -
State: closed - Opened by OyvindTafjord 10 months ago
#156 - Fix prefix space issues with certain tokenizers
Pull Request -
State: closed - Opened by OyvindTafjord 11 months ago
#155 - Verbose perplexity evaluation
Pull Request -
State: closed - Opened by OyvindTafjord 12 months ago
#154 - Bump torchmetrics from 0.11.1 to 1.1.0
Pull Request -
State: open - Opened by dependabot[bot] about 1 year ago
Labels: dependencies, python
#153 - Update protobuf requirement from <=3.20 to <=4.24.1
Pull Request -
State: open - Opened by dependabot[bot] about 1 year ago
Labels: dependencies, python
#152 - Update protobuf requirement from <=3.20 to <=4.24.0
Pull Request -
State: closed - Opened by dependabot[bot] about 1 year ago
- 1 comment
Labels: dependencies, python
#151 - Bump torchmetrics from 0.11.1 to 1.0.3
Pull Request -
State: closed - Opened by dependabot[bot] about 1 year ago
- 1 comment
Labels: dependencies, python
#150 - Bump torchmetrics from 0.11.1 to 1.0.2
Pull Request -
State: closed - Opened by dependabot[bot] about 1 year ago
- 1 comment
Labels: dependencies, python
#149 - Bump torchmetrics from 0.11.1 to 1.0.1
Pull Request -
State: closed - Opened by dependabot[bot] about 1 year ago
- 1 comment
Labels: dependencies, python
#148 - Update protobuf requirement from <=3.20 to <=4.23.4
Pull Request -
State: closed - Opened by dependabot[bot] about 1 year ago
- 1 comment
Labels: dependencies, python
#147 - Bump torchmetrics from 0.11.1 to 1.0.0
Pull Request -
State: closed - Opened by dependabot[bot] about 1 year ago
- 1 comment
Labels: dependencies, python
#146 - Tokenizer remote code
Pull Request -
State: closed - Opened by OyvindTafjord over 1 year ago
#145 - Update tango requirement to use latest
Issue -
State: open - Opened by AkshitaB over 1 year ago
#144 - Legal classification tasks (EurLex, UnfairTOS, and CaseHold)
Pull Request -
State: closed - Opened by pdasigi over 1 year ago
- 6 comments
#143 - Add mmlu
Pull Request -
State: closed - Opened by tusharkhot over 1 year ago
- 8 comments
#142 - Sumtasks
Pull Request -
State: closed - Opened by armancohan over 1 year ago
#141 - Add max generation tokens
Pull Request -
State: closed - Opened by OyvindTafjord over 1 year ago
#140 - Adding summarization datasets, scitldr and xsum
Pull Request -
State: closed - Opened by armancohan over 1 year ago
- 1 comment
#139 - Update protobuf requirement from <=3.20 to <=4.23.3
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#138 - Fix superglue tasks
Pull Request -
State: closed - Opened by OyvindTafjord over 1 year ago
#137 - Update protobuf requirement from <=3.20 to <=4.23.2
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#136 - Pass in model_max_length to greedy_until
Pull Request -
State: closed - Opened by OyvindTafjord over 1 year ago
#135 - Fix model_inputs dict, lower max_gen_toks for now
Pull Request -
State: closed - Opened by OyvindTafjord over 1 year ago
#134 - Tweak help string
Pull Request -
State: closed - Opened by OyvindTafjord over 1 year ago
- 1 comment
#133 - Add natural questions (short only; no context)
Pull Request -
State: closed - Opened by tusharkhot over 1 year ago
- 1 comment
#132 - Update protobuf requirement from <=3.20 to <=4.23.1
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#131 - Update protobuf requirement from <=3.20 to <=4.23.0
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#130 - Update protobuf requirement from <=3.20 to <=4.22.4
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#129 - Update sphinx requirement from <6 to <8
Pull Request -
State: open - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, python
#128 - MultiRC is not a QA task
Pull Request -
State: closed - Opened by dirkgr over 1 year ago
- 1 comment
#127 - Update protobuf requirement from <=3.20 to <=4.22.3
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#126 - Bump torchmetrics from 0.11.1 to 0.11.4
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#125 - OPT-175B
Pull Request -
State: closed - Opened by dirkgr over 1 year ago
#124 - Update protobuf requirement from <=3.20 to <=4.22.1
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#123 - Bump allenai/beaker-run-action from 1.1 to 1.2
Pull Request -
State: open - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, github_actions
#122 - Bump torchmetrics from 0.11.1 to 0.11.3
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#121 - Update sphinx requirement from <6 to <7
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#120 - run tests on Beaker with NFS cache
Pull Request -
State: closed - Opened by epwalsh over 1 year ago
#119 - Update protobuf requirement from <=3.20 to <4.23
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#118 - Rename `Task` -> `Dataset` and `Model` -> `ModelWrapper`
Issue -
State: open - Opened by dirkgr over 1 year ago
#117 - [wip] adding SciTLDR dataset
Pull Request -
State: open - Opened by kyleclo over 1 year ago
#116 - Request: Either remove `short_name_for_model_object` or allow for full name registering of models
Issue -
State: open - Opened by kyleclo over 1 year ago
- 1 comment
#115 - Makes Lambada work with GPT2
Pull Request -
State: closed - Opened by dirkgr over 1 year ago
#114 - Bump torchmetrics from 0.11.0 to 0.11.1
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
Labels: dependencies, python
#113 - Update protobuf requirement from <=3.20 to <4.22
Pull Request -
State: closed - Opened by dependabot[bot] over 1 year ago
- 1 comment
Labels: dependencies, python
#112 - Fixes Squad metrics computation
Pull Request -
State: closed - Opened by dirkgr over 1 year ago
#111 - Bettermap dependency
Pull Request -
State: closed - Opened by dirkgr over 1 year ago
#110 - A job that computes a big matrix of results
Pull Request -
State: closed - Opened by dirkgr over 1 year ago
#109 - Bump sphinx from 5.3.0 to 6.0.0
Pull Request -
State: closed - Opened by dependabot[bot] almost 2 years ago
- 1 comment
Labels: dependencies, python
#108 - Bump furo from 2022.9.29 to 2022.12.7
Pull Request -
State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python
#107 - `tqdm` has to be closed
Pull Request -
State: closed - Opened by dirkgr almost 2 years ago
#106 - Copy `lmeval`
Pull Request -
State: closed - Opened by dirkgr almost 2 years ago
#105 - A bunch of changes back ported into `main` from the task complexity work
Pull Request -
State: closed - Opened by dirkgr almost 2 years ago
#104 - Bump torchmetrics from 0.10.1 to 0.11.0
Pull Request -
State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python
#103 - Prefix tuning experiment
Pull Request -
State: closed - Opened by dirkgr almost 2 years ago
- 2 comments
#102 - More classification
Pull Request -
State: closed - Opened by dirkgr almost 2 years ago
- 1 comment
#101 - make RC `_make_model` an instance method, steps can take `Lazy[Model]`
Pull Request -
State: open - Opened by epwalsh almost 2 years ago
#100 - Bump torchmetrics from 0.10.1 to 0.10.3
Pull Request -
State: closed - Opened by dependabot[bot] almost 2 years ago
- 1 comment
Labels: dependencies, python
#99 - Bump sphinx-copybutton from 0.5.0 to 0.5.1
Pull Request -
State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python
#98 - Bump torchmetrics from 0.10.1 to 0.10.2
Pull Request -
State: closed - Opened by dependabot[bot] almost 2 years ago
- 1 comment
Labels: dependencies, python
#97 - Bump torchmetrics from 0.9.3 to 0.10.1
Pull Request -
State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python
#96 - Bump sphinx from 5.2.3 to 5.3.0
Pull Request -
State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python
#95 - Train T5 RC style
Pull Request -
State: closed - Opened by dirkgr almost 2 years ago
- 1 comment
#94 - Backported from the task complexity branch
Pull Request -
State: closed - Opened by dirkgr almost 2 years ago
#93 - Bump torchmetrics from 0.9.3 to 0.10.0
Pull Request -
State: closed - Opened by dependabot[bot] almost 2 years ago
- 1 comment
Labels: dependencies, python
#92 - Add missing `__init__.py` file
Pull Request -
State: closed - Opened by epwalsh almost 2 years ago
#91 - Bump sphinx from 5.2.1 to 5.2.3
Pull Request -
State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies, python
#90 - Copy and paste promptsource
Pull Request -
State: closed - Opened by dirkgr about 2 years ago
- 1 comment
#89 - Bump furo from 2022.9.15 to 2022.9.29
Pull Request -
State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies, python
#88 - Bump myst-parser from 0.18.0 to 0.18.1
Pull Request -
State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies, python
#87 - Bump sphinx from 5.2.1 to 5.2.2
Pull Request -
State: closed - Opened by dependabot[bot] about 2 years ago
- 1 comment
Labels: dependencies, python
#86 - Bump sphinx from 5.1.1 to 5.2.1
Pull Request -
State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies, python
#85 - Promptsource support
Pull Request -
State: closed - Opened by dirkgr about 2 years ago
#84 - Dirk's big training job
Pull Request -
State: closed - Opened by dirkgr about 2 years ago
#83 - Auto device map
Pull Request -
State: closed - Opened by IanMagnusson about 2 years ago
#82 - Bump furo from 2022.6.21 to 2022.9.15
Pull Request -
State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies, python
#81 - Generalized ia3
Pull Request -
State: open - Opened by IanMagnusson about 2 years ago
#80 - support for opt in training
Pull Request -
State: closed - Opened by IanMagnusson about 2 years ago
- 1 comment
#79 - Fairscale training
Pull Request -
State: open - Opened by IanMagnusson about 2 years ago
#78 - Updates to GPT models so we can use them for the retrieval LM project
Pull Request -
State: open - Opened by epwalsh about 2 years ago
#77 - Support for python 3.8
Pull Request -
State: closed - Opened by epwalsh about 2 years ago
#76 - Distributed Data Parallel Training
Pull Request -
State: open - Opened by IanMagnusson about 2 years ago
- 3 comments
#75 - Huggingface classification support
Pull Request -
State: closed - Opened by dirkgr about 2 years ago
- 3 comments
#74 - Add support for MetaICL's race-high and numer_sense tasks
Pull Request -
State: closed - Opened by IanMagnusson about 2 years ago
#73 - gpu logit processing for rank classification models
Pull Request -
State: closed - Opened by IanMagnusson about 2 years ago
#72 - Trainable HF Automodel
Pull Request -
State: closed - Opened by dirkgr about 2 years ago
#71 - Expand metaicl
Pull Request -
State: closed - Opened by IanMagnusson about 2 years ago
#70 - support decoder only ia3 for ranked classification
Pull Request -
State: closed - Opened by IanMagnusson about 2 years ago
#69 - Add MRQA task
Pull Request -
State: closed - Opened by anas-awadalla about 2 years ago
#68 - trainable_copy might need override_weights_file
Issue -
State: closed - Opened by IanMagnusson about 2 years ago
- 1 comment
#67 - Bump sphinx from 5.0.2 to 5.1.1
Pull Request -
State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies, python
#66 - add likelihood_avging option to RankClassification models with 2 strategies
Pull Request -
State: closed - Opened by IanMagnusson about 2 years ago
#65 - Added QA evaluation for GPT & T5
Pull Request -
State: closed - Opened by anas-awadalla about 2 years ago
#64 - implement load_weights for cached_transforers.get()
Pull Request -
State: closed - Opened by IanMagnusson about 2 years ago
- 1 comment
#63 - cached_transformers.get() load_weights arg is not implemented.
Issue -
State: closed - Opened by IanMagnusson about 2 years ago
- 1 comment
#62 - Optional random_subsample_seed for PredictStep
Pull Request -
State: closed - Opened by IanMagnusson about 2 years ago