Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / allenai/open-instruct issues and pull requests

#302 - Remove oe-eval in docker image

Pull Request - State: closed - Opened by vwxyzjn 5 months ago - 1 comment

#301 - Oe-eval ci test 5

Pull Request - State: closed - Opened by vwxyzjn 5 months ago - 1 comment

#300 - oe-eval test 4

Pull Request - State: closed - Opened by vwxyzjn 5 months ago

#299 - Oe eval ci test3

Pull Request - State: closed - Opened by vwxyzjn 5 months ago

#298 - Oe eval ci test2

Pull Request - State: closed - Opened by vwxyzjn 5 months ago

#297 - oe-eval ci test

Pull Request - State: closed - Opened by vwxyzjn 5 months ago

#296 - Support oe-eval-internal

Pull Request - State: closed - Opened by vwxyzjn 5 months ago

#295 - 70B training + other tweaks

Pull Request - State: closed - Opened by jacob-morrison 5 months ago

#294 - Upload training metadata

Pull Request - State: closed - Opened by hamishivi 5 months ago

#293 - Trigger build

Pull Request - State: closed - Opened by vwxyzjn 5 months ago

#292 - Load from revision

Pull Request - State: closed - Opened by vwxyzjn 5 months ago

#291 - Also do run_oe_eval_experiments in autoeval

Pull Request - State: closed - Opened by vwxyzjn 5 months ago

#290 - Update tulu3_8b_preview_mix_v3.3.yaml

Pull Request - State: closed - Opened by jacob-morrison 5 months ago

#289 - Add hf-transfer to olmo image

Pull Request - State: closed - Opened by vwxyzjn 5 months ago

#288 - Remove unused checkpoints

Pull Request - State: closed - Opened by vwxyzjn 5 months ago

#287 - Fix - call `create_branch` for the revision

Pull Request - State: closed - Opened by vwxyzjn 6 months ago

#286 - Add safety evals via `submit_eval`

Pull Request - State: closed - Opened by hamishivi 6 months ago - 2 comments

#285 - Patch checkpointing step

Pull Request - State: closed - Opened by hamishivi 6 months ago

#284 - Upload to hf models to revision

Pull Request - State: closed - Opened by vwxyzjn 6 months ago

#283 - Add a `train` field to training data

Issue - State: closed - Opened by hamishivi 6 months ago - 3 comments
Labels: enhancement

#282 - Add new eval Benchmarks for evaluating long context

Pull Request - State: open - Opened by nouhadziri 6 months ago

#281 - Try uv for package management (245ms project installation)

Pull Request - State: closed - Opened by vwxyzjn 6 months ago

#280 - Make faster docker build

Issue - State: open - Opened by vwxyzjn 6 months ago

#279 - RS: save config and raw scores

Pull Request - State: closed - Opened by vwxyzjn 6 months ago

#278 - Propagate failure/preemptation and set timeout for multinode training

Pull Request - State: closed - Opened by yizhongw 6 months ago - 1 comment

#277 - Auto evaluation via `--launch_beaker_eval_jobs`

Pull Request - State: closed - Opened by vwxyzjn 6 months ago - 6 comments

#276 - Make open-instruct pip installable

Issue - State: open - Opened by yakazimir 6 months ago - 1 comment
Labels: enhancement

#275 - Fix path in train data script

Pull Request - State: closed - Opened by hamishivi 6 months ago

#274 - Log beaker experiment URL

Pull Request - State: closed - Opened by vwxyzjn 6 months ago

#273 - Added Claude and Gemini models

Pull Request - State: closed - Opened by nouhadziri 6 months ago

#272 - missing sharegpt_html_cleaned_and_split_2048.json

Issue - State: closed - Opened by ppalantir 6 months ago - 1 comment

#265 - small optimization to avoid overhead

Pull Request - State: closed - Opened by vwxyzjn 6 months ago

#259 - Use updated Tulu config in oe-eval and optionally run multiturn fewshot evals

Pull Request - State: closed - Opened by pdasigi 6 months ago - 4 comments

#257 - Add v3.3 config

Pull Request - State: closed - Opened by natolambert 6 months ago

#255 - Commands for model evaluation

Issue - State: closed - Opened by mutiann 6 months ago - 1 comment

#253 - Add rejection sampling analysis

Pull Request - State: closed - Opened by vwxyzjn 6 months ago - 2 comments

#238 - Add safety evaluation as a submodule

Pull Request - State: closed - Opened by nouhadziri 6 months ago - 1 comment

#213 - Precompute DPO logprobs

Issue - State: closed - Opened by natolambert 6 months ago - 3 comments

#204 - Add online trainers

Pull Request - State: closed - Opened by vwxyzjn 7 months ago - 1 comment

#195 - Revamping the human feedback interface frontend with Next.js

Pull Request - State: closed - Opened by darrensapalo 7 months ago - 1 comment

#190 - size mismatch error when running merge_lora.py

Issue - State: closed - Opened by jl3676 7 months ago - 3 comments

#189 - Add Decontamination Script

Issue - State: closed - Opened by hamishivi 7 months ago - 1 comment

#189 - Add Decontamination Script

Issue - State: closed - Opened by hamishivi 7 months ago - 1 comment

#188 - About the training seed

Issue - State: closed - Opened by lucasliunju 7 months ago - 2 comments

#171 - ./scripts/prepare_train_data.sh--throws an error

Issue - State: closed - Opened by dumeixiang 8 months ago - 11 comments

#165 - flash-attn needs data type of bfloat16 or float16

Pull Request - State: closed - Opened by notoookay 9 months ago - 5 comments

#155 - Migrate to tokenizer + fastchat conv templates

Issue - State: closed - Opened by natolambert 9 months ago - 3 comments

#100 - Question about the decoding settings for alpaca_eval

Issue - State: closed - Opened by huchinlp about 1 year ago - 1 comment

#99 - Better HumanEval instructions

Pull Request - State: closed - Opened by Muennighoff about 1 year ago - 4 comments

#96 - Release human evaluation interface and tulu 1 human eval data.

Pull Request - State: closed - Opened by yizhongw about 1 year ago

#95 - Embedding resizing logic may be flawed

Issue - State: closed - Opened by prajdabre about 1 year ago - 1 comment

#94 - File Not Found error while running finetune_lora_with_accelerate.sh

Issue - State: closed - Opened by palash04 about 1 year ago - 1 comment

#93 - Support for tuning on chat data

Issue - State: closed - Opened by xufangzhi about 1 year ago - 1 comment

#92 - Some various fixes and changes for olmo

Pull Request - State: closed - Opened by hamishivi about 1 year ago

#91 - Tulu v2 Sanky Diagram

Issue - State: closed - Opened by nuoma about 1 year ago - 4 comments

#90 - model weights after finetune can not load by vllm or huggingface

Issue - State: closed - Opened by ZiyiLiubird about 1 year ago - 1 comment

#89 - balanced_low_0 Related Issue During Inference

Issue - State: closed - Opened by mshen2 about 1 year ago - 1 comment

#88 - about tulu v2 conversion

Issue - State: closed - Opened by nuoma about 1 year ago - 2 comments

#87 - Possible unreliability of MMLU estimates

Issue - State: closed - Opened by Kong-Aobo about 1 year ago - 1 comment

#86 - DPO scripts + docker update + readme update

Pull Request - State: closed - Opened by hamishivi about 1 year ago - 1 comment

#85 - replace `:` in eval/mmlu/run_eval.py

Pull Request - State: closed - Opened by Forence1999 about 1 year ago - 3 comments

#84 - Improving evaluation scripts

Pull Request - State: closed - Opened by yizhongw about 1 year ago

#83 - The alpaca eval is not working can't reproduce

Issue - State: closed - Opened by sanyalsunny111 about 1 year ago - 3 comments

#81 - How to pull the image

Issue - State: closed - Opened by Forence1999 about 1 year ago - 1 comment

#80 - Use hf tokenizer for portability when preparing data

Pull Request - State: closed - Opened by hamishivi about 1 year ago - 1 comment

#79 - Fix several issues in the evals.

Pull Request - State: closed - Opened by yizhongw about 1 year ago

#78 - Update requirements.txt

Pull Request - State: closed - Opened by pminervini over 1 year ago - 1 comment

#77 - Rotary position embedding scaling 8k for Llama2?

Issue - State: closed - Opened by shi-kejian over 1 year ago - 1 comment

#76 - about SFT dataset and dataset ratio

Issue - State: closed - Opened by huliang2016 over 1 year ago - 2 comments

#75 - Cannot reproduce llama2-7b MMLU score

Issue - State: closed - Opened by harryhan618 over 1 year ago - 2 comments

#74 - Not loading cached datasets for preprocessing

Issue - State: closed - Opened by tangzhy over 1 year ago - 1 comment

#73 - Switch to using the built-in flash attention 2 support in Transformers library.

Pull Request - State: closed - Opened by yizhongw over 1 year ago - 1 comment

#72 - could you please report your training cost?

Issue - State: closed - Opened by lucywang720 over 1 year ago - 2 comments

#71 - This script does not work with cerebras gpt and gpt neox.

Issue - State: closed - Opened by kevinscaria over 1 year ago - 1 comment

#70 - minor difference between results in paper and my reproducing results

Issue - State: closed - Opened by lucywang720 over 1 year ago - 3 comments

#69 - Refine prompting and answer parsing for evals

Pull Request - State: closed - Opened by yizhongw over 1 year ago

#68 - Refine training data preparation and add Tulu V2 mixture.

Pull Request - State: closed - Opened by yizhongw over 1 year ago

#67 - Refine the lora merging code.

Pull Request - State: closed - Opened by yizhongw over 1 year ago

#66 - Fine-tuning Reproducibility

Issue - State: closed - Opened by dongmean over 1 year ago - 4 comments

#65 - CUDA OOM for qlora

Issue - State: closed - Opened by tangzhy over 1 year ago - 12 comments

#64 - Support using vllm for generative evaluations

Pull Request - State: closed - Opened by yizhongw over 1 year ago

#63 - Use latest alpaca_eval library to evaluate performance on alpaca farm.

Pull Request - State: closed - Opened by yizhongw over 1 year ago

#62 - Fix MMLU answer token and probability calculation

Pull Request - State: closed - Opened by OyvindTafjord over 1 year ago - 3 comments

#61 - Support multi-node training on beaker.

Pull Request - State: closed - Opened by yizhongw over 1 year ago

#60 - Qlora Documtation + fixes

Pull Request - State: closed - Opened by hamishivi over 1 year ago

#59 - QLora support

Pull Request - State: closed - Opened by hamishivi over 1 year ago

#58 - Revert "merge in lora"

Pull Request - State: closed - Opened by jacob-morrison over 1 year ago

#57 - merge in lora

Pull Request - State: closed - Opened by jacob-morrison over 1 year ago

#56 - Update merge_lora.py

Pull Request - State: closed - Opened by TJKlein over 1 year ago - 3 comments

#53 - Estimated timeline for human data release

Issue - State: closed - Opened by martiansideofthemoon over 1 year ago - 3 comments

#52 - [Bug Fix] Fix step misalignment when resuming from a checkpoint

Pull Request - State: closed - Opened by tongyx361 over 1 year ago - 3 comments

#51 - Does LoRa finetuning give weight diff or actual weight?

Issue - State: closed - Opened by macabdul9 over 1 year ago - 2 comments

#50 - Any plan to support mt-bench evaluation?

Issue - State: closed - Opened by HuihuiChyan over 1 year ago - 1 comment

#49 - Add demo scripts

Pull Request - State: closed - Opened by hamishivi over 1 year ago