Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / allenai/open-instruct issues and pull requests

#448 - Fix oe-eval gpu count

Pull Request - State: closed - Opened by hamishivi 3 months ago

#448 - Fix oe-eval gpu count

Pull Request - State: closed - Opened by hamishivi 3 months ago

#447 - Allow eval to different repo

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#447 - Allow eval to different repo

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#446 - About cite/ack to OpenRLHF in README.md or paper.

Issue - State: closed - Opened by hijkzzz 3 months ago - 3 comments

#446 - About cite/ack to OpenRLHF in README.md or paper.

Issue - State: closed - Opened by hijkzzz 3 months ago - 3 comments

#445 - Add requirements for decontamination code

Pull Request - State: closed - Opened by pdasigi 3 months ago - 1 comment

#445 - Add requirements for decontamination code

Pull Request - State: open - Opened by pdasigi 3 months ago

#444 - Fix broken image paths

Pull Request - State: closed - Opened by ljvmiranda921 3 months ago

#443 - Push preview

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#443 - Push preview

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#442 - Add code for synthetic preference pipeline

Pull Request - State: closed - Opened by ljvmiranda921 3 months ago - 1 comment

#442 - Add code for synthetic preference pipeline

Pull Request - State: closed - Opened by ljvmiranda921 3 months ago - 1 comment

#441 - faster mmlu oe-eval

Pull Request - State: closed - Opened by hamishivi 3 months ago

#440 - Olmo1124 config

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#440 - Olmo1124 config

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#439 - Update mmlu and deepmind_math configs in oe-eval.sh

Pull Request - State: closed - Opened by pdasigi 3 months ago

#439 - Update mmlu and deepmind_math configs in oe-eval.sh

Pull Request - State: closed - Opened by pdasigi 3 months ago

#438 - Add files via upload

Pull Request - State: closed - Opened by ValentinaPy 3 months ago

#438 - Add files via upload

Pull Request - State: closed - Opened by ValentinaPy 3 months ago

#437 - Mount oe-training weka bucket

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#437 - Mount oe-training weka bucket

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#436 - Support for olmo1124 eval

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#436 - Support for olmo1124 eval

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#435 - Support weka evaluation oe eval

Pull Request - State: closed - Opened by vwxyzjn 3 months ago - 1 comment

#435 - Support weka evaluation oe eval

Pull Request - State: closed - Opened by vwxyzjn 3 months ago - 1 comment

#434 - Olmo1124converter

Pull Request - State: closed - Opened by vwxyzjn 3 months ago - 1 comment

#434 - Olmo1124converter

Pull Request - State: closed - Opened by vwxyzjn 3 months ago - 1 comment

#433 - Latest OLMOE config

Pull Request - State: closed - Opened by natolambert 3 months ago

#433 - Latest OLMOE config

Pull Request - State: closed - Opened by natolambert 3 months ago

#432 - `Olmo1124ForCausalLM` config.

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#432 - `Olmo1124ForCausalLM` config.

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#431 - Add files via upload

Pull Request - State: closed - Opened by ValentinaPy 3 months ago

#431 - Add files via upload

Pull Request - State: open - Opened by ValentinaPy 3 months ago

#430 - Add files via upload

Pull Request - State: closed - Opened by ValentinaPy 3 months ago

#430 - Add files via upload

Pull Request - State: open - Opened by ValentinaPy 3 months ago

#429 - COT added to MMLU

Pull Request - State: closed - Opened by nouhadziri 3 months ago

#429 - COT added to MMLU

Pull Request - State: closed - Opened by nouhadziri 3 months ago

#428 - Use vllm for MMLU Pro

Pull Request - State: closed - Opened by pdasigi 3 months ago

#428 - Use vllm for MMLU Pro

Pull Request - State: closed - Opened by pdasigi 3 months ago

#427 - Error when evaluating the qlora-merged model.

Issue - State: open - Opened by vhientran 3 months ago

#427 - Error when evaluating the qlora-merged model.

Issue - State: open - Opened by vhientran 3 months ago - 1 comment

#426 - Last fix for unseen evals.

Pull Request - State: closed - Opened by natolambert 3 months ago

#426 - Last fix for unseen evals.

Pull Request - State: closed - Opened by natolambert 3 months ago

#425 - Unseen evals n the oe-eval.sh script

Pull Request - State: closed - Opened by pdasigi 3 months ago - 2 comments

#425 - Unseen evals n the oe-eval.sh script

Pull Request - State: closed - Opened by pdasigi 3 months ago - 2 comments

#424 - OLMO + RL

Pull Request - State: closed - Opened by vwxyzjn 3 months ago - 2 comments

#423 - Ability to set oe-eval priority

Pull Request - State: closed - Opened by hamishivi 3 months ago

#423 - Ability to set oe-eval priority

Pull Request - State: closed - Opened by hamishivi 3 months ago

#422 - Add ability to use alternate image for safety eval

Pull Request - State: closed - Opened by hamishivi 3 months ago

#422 - Add ability to use alternate image for safety eval

Pull Request - State: closed - Opened by hamishivi 3 months ago

#421 - Minor additions to the decontamination script

Pull Request - State: closed - Opened by pdasigi 3 months ago

#421 - Minor additions to the decontamination script

Pull Request - State: closed - Opened by pdasigi 3 months ago

#420 - Add files via upload

Pull Request - State: open - Opened by ValentinaPy 3 months ago

#420 - Add files via upload

Pull Request - State: closed - Opened by ValentinaPy 3 months ago

#419 - Add files via upload

Pull Request - State: open - Opened by ValentinaPy 3 months ago

#419 - Add files via upload

Pull Request - State: closed - Opened by ValentinaPy 3 months ago

#418 - quick change

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#418 - quick change

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#417 - Olmo rl

Pull Request - State: closed - Opened by vwxyzjn 3 months ago - 1 comment

#416 - Adding final nc configs for v3.9

Pull Request - State: closed - Opened by jacob-morrison 3 months ago

#416 - Adding final nc configs for v3.9

Pull Request - State: closed - Opened by jacob-morrison 3 months ago

#415 - Fix dataset mixing logic

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#415 - Fix dataset mixing logic

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#414 - eval on intermediate checkpoints

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#414 - eval on intermediate checkpoints

Pull Request - State: closed - Opened by vwxyzjn 3 months ago

#413 - added persona ifdata to dpo mix

Pull Request - State: closed - Opened by fabrahman 3 months ago

#412 - A good DPO mix

Pull Request - State: closed - Opened by ValentinaPy 3 months ago

#412 - A good DPO mix

Pull Request - State: closed - Opened by ValentinaPy 3 months ago

#411 - Batch merge

Pull Request - State: open - Opened by jacob-morrison 3 months ago

#411 - Batch merge

Pull Request - State: open - Opened by jacob-morrison 3 months ago

#410 - update data dist plots

Pull Request - State: closed - Opened by natolambert 3 months ago

#410 - update data dist plots

Pull Request - State: closed - Opened by natolambert 3 months ago

#409 - increase safety evals GPUs; eval nits

Pull Request - State: closed - Opened by natolambert 3 months ago

#409 - increase safety evals GPUs; eval nits

Pull Request - State: closed - Opened by natolambert 3 months ago

#408 - Update safety eval for larger models

Pull Request - State: closed - Opened by hamishivi 3 months ago

#408 - Update safety eval for larger models

Pull Request - State: closed - Opened by hamishivi 3 months ago

#407 - Support multiple gpus for safety eval

Pull Request - State: closed - Opened by hamishivi 3 months ago

#407 - Support multiple gpus for safety eval

Pull Request - State: closed - Opened by hamishivi 3 months ago

#406 - Finalize v3.8 sft mix

Pull Request - State: closed - Opened by jacob-morrison 3 months ago

#406 - Finalize v3.8 sft mix

Pull Request - State: closed - Opened by jacob-morrison 3 months ago

#405 - Typo fix

Pull Request - State: closed - Opened by vwxyzjn 3 months ago - 1 comment

#405 - Typo fix

Pull Request - State: closed - Opened by vwxyzjn 3 months ago - 1 comment

#404 - Eval submission fixes for 70b / other models

Pull Request - State: closed - Opened by natolambert 4 months ago - 1 comment

#404 - Eval submission fixes for 70b / other models

Pull Request - State: closed - Opened by natolambert 4 months ago - 1 comment

#403 - Decontaminate training datasets

Pull Request - State: closed - Opened by pdasigi 4 months ago

#403 - Decontaminate training datasets

Pull Request - State: closed - Opened by pdasigi 4 months ago

#402 - fixing functions

Pull Request - State: closed - Opened by ValentinaPy 4 months ago

#402 - fixing functions

Pull Request - State: closed - Opened by ValentinaPy 4 months ago

#401 - Separate forward head

Pull Request - State: closed - Opened by vwxyzjn 4 months ago - 2 comments

#401 - Separate forward head

Pull Request - State: closed - Opened by vwxyzjn 4 months ago - 2 comments

#400 - fix-trutuful-to-truthfulqa

Pull Request - State: closed - Opened by pendulum445 4 months ago

#400 - fix-trutuful-to-truthfulqa

Pull Request - State: closed - Opened by pendulum445 4 months ago

#399 - Update submit_eval_jobs.py

Pull Request - State: closed - Opened by jacob-morrison 4 months ago

#399 - Update submit_eval_jobs.py

Pull Request - State: closed - Opened by jacob-morrison 4 months ago

#398 - cleaning

Pull Request - State: closed - Opened by ValentinaPy 4 months ago

#398 - cleaning

Pull Request - State: closed - Opened by ValentinaPy 4 months ago

#397 - If constraints functions

Pull Request - State: closed - Opened by ValentinaPy 4 months ago