Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / vwxyzjn/cleanrl issues and pull requests

#488 - Support ToyText env

Issue - State: open - Opened by ace-han 23 days ago

#487 - CleanRL working on a ROS-Gazebo env

Issue - State: open - Opened by ramzibou0735 24 days ago

#486 - Solve bug not updating SAC alpha

Pull Request - State: closed - Opened by GPaolo about 1 month ago - 1 comment

#485 - Dev exploration clean rl all files

Pull Request - State: closed - Opened by sebastien-mart-in about 2 months ago - 2 comments

#484 - Add LeanRL as a related project

Pull Request - State: closed - Opened by vwxyzjn about 2 months ago - 1 comment

#483 - fix ppo-trxl links

Pull Request - State: closed - Opened by MarcoMeter about 2 months ago - 1 comment

#482 - JAX has no gpu version

Issue - State: open - Opened by ItsBean 2 months ago - 1 comment

#481 - Add TD3 and SAC support for multiple envs

Pull Request - State: open - Opened by noahfarr 3 months ago - 1 comment

#480 - Why does num_envs has to be 1 for DQN

Issue - State: closed - Opened by noahfarr 3 months ago - 2 comments

#479 - Add tomli, msgpack, cffi, pip as dependencies - Fixes #455

Pull Request - State: open - Opened by JuliusBairaktaris 3 months ago - 1 comment

#477 - Possible inconsistencies with the PPO implementation

Issue - State: open - Opened by rajfly 3 months ago - 4 comments

#475 - PPO Envpool doesn't account for episode change

Issue - State: open - Opened by pseudo-rnd-thoughts 4 months ago - 2 comments

#473 - WIP: Implement CrossQ for continuous actions

Pull Request - State: closed - Opened by noahfarr 4 months ago - 2 comments

#472 - Add Parallel Q-Networks algorithm (PQN)

Pull Request - State: open - Opened by roger-creus 4 months ago - 16 comments

#471 - Setup issue

Issue - State: open - Opened by catid 4 months ago - 1 comment

#468 - mujoco recorded video is blank screen

Issue - State: open - Opened by skr3178 4 months ago - 2 comments

#467 - fixing ffpeg install on macOS tests

Pull Request - State: closed - Opened by Paul-antoineLeTolguenec 4 months ago - 3 comments

#466 - Adding Munchausen Reinforcement Learning

Pull Request - State: open - Opened by Paul-antoineLeTolguenec 4 months ago - 1 comment

#465 - Why doesn't SAC and DDPG support multi-environment?

Issue - State: open - Opened by ShuoZheLi 5 months ago - 1 comment

#463 - Implement CrossQ

Issue - State: open - Opened by noahfarr 5 months ago - 1 comment

#462 - Dev michelle

Pull Request - State: closed - Opened by michelleho-24 6 months ago - 2 comments

#461 - Improve compatibility with CUDA-enabled pytorch on non-CUDA devices

Issue - State: closed - Opened by mainrs 6 months ago - 4 comments

#459 - Add PPO + Transformer-XL

Pull Request - State: closed - Opened by MarcoMeter 7 months ago - 14 comments

#458 - Change actor_update_interval to policy_frequency in SAC comment

Pull Request - State: open - Opened by JinayJain 7 months ago - 1 comment

#457 - Correct handling of `termination` vs `truncation`?

Issue - State: open - Opened by ankile 7 months ago - 1 comment

#456 - Removing the unused noise_clip from sac_continuous_actions.py

Pull Request - State: closed - Opened by jonas-eschmann 7 months ago - 1 comment

#455 - Any usage of poetry after installation: No module named 'tomli'

Issue - State: open - Opened by MarcoMeter 7 months ago - 3 comments

#454 - Potential bugs in RecordEpisodeStatistics

Issue - State: open - Opened by williamd4112 7 months ago

#453 - Unable to allocate 26.3 GiB for an array

Issue - State: closed - Opened by satyrmipt 8 months ago - 1 comment

#452 - KeyError: 'cleanba_ppo_envpool_procgen'

Issue - State: open - Opened by zhixiongzh 8 months ago

#451 - Docker image is out of date

Issue - State: open - Opened by myxik 8 months ago

#449 - Remove duplicate code

Pull Request - State: closed - Opened by helpingstar 8 months ago - 1 comment

#448 - Enhancing Termination and Truncation Handling in CleanRL's PPO Algorithm

Pull Request - State: open - Opened by Josh00-Lu 9 months ago - 10 comments

#446 - add accelerate example

Pull Request - State: open - Opened by edbeeching 9 months ago - 1 comment

#445 - Gymnasium Version Requirement May Need To Be Updated

Issue - State: open - Opened by plen1lune 10 months ago - 1 comment

#444 - [Docs] Fix in README.md

Pull Request - State: closed - Opened by cosmo3769 10 months ago - 1 comment

#443 - clamp in C51

Issue - State: open - Opened by XinJingHao 10 months ago

#442 - Contributing PPO + Transformer-XL

Issue - State: open - Opened by MarcoMeter 10 months ago - 3 comments

#441 - Why normarlize advantage only for pg_loss but not for vf_loss?

Issue - State: open - Opened by zzhixin 11 months ago - 2 comments

#440 - Reproduction util: wrong command path

Issue - State: open - Opened by qgallouedec 11 months ago

#439 - Update README.md

Pull Request - State: closed - Opened by vwxyzjn 11 months ago - 1 comment

#438 - Why converting observation space to np.float32?

Issue - State: open - Opened by jamartinh 11 months ago - 2 comments

#437 - fix video uploading

Pull Request - State: closed - Opened by vwxyzjn 11 months ago - 1 comment

#436 - can't upload video running ppo_atari.py,wandb has no data

Issue - State: closed - Opened by flypark666 11 months ago - 8 comments

#435 - Adding TRPO

Pull Request - State: open - Opened by Jackory 12 months ago - 2 comments

#434 - Video fix

Pull Request - State: closed - Opened by vwxyzjn 12 months ago - 1 comment

#433 - fixing the env.reset bug

Pull Request - State: closed - Opened by modanesh 12 months ago - 2 comments

#432 - [BUG] Env does not reset when it's terminated

Issue - State: closed - Opened by modanesh 12 months ago - 2 comments

#431 - expected sequence of length 8 at dim 1 (got 0)

Issue - State: closed - Opened by flypark666 12 months ago - 4 comments

#428 - get action in sac_continuous_action.py

Issue - State: open - Opened by zichunxx about 1 year ago - 2 comments

#426 - feat: add vloss clipping to jax ppo.

Pull Request - State: open - Opened by KaleabTessera about 1 year ago - 1 comment

#425 - Poor Evaluation Performance in PPO

Issue - State: open - Opened by sdpkjc about 1 year ago - 5 comments

#424 - Refactor to use tyro

Pull Request - State: closed - Opened by vwxyzjn about 1 year ago - 5 comments

#423 - ppo_continuous_action huggingface integration

Pull Request - State: closed - Opened by sdpkjc about 1 year ago - 3 comments

#422 - Reducing Code Redundancy and Minimize Line Diffs

Pull Request - State: closed - Opened by sdpkjc about 1 year ago - 1 comment

#421 - Is is possible for SAC to support gymnasium too as TD3 and PPO ?

Issue - State: closed - Opened by qiuruiyu about 1 year ago - 4 comments

#420 - td3 huggingface integration

Pull Request - State: closed - Opened by sdpkjc about 1 year ago - 3 comments

#419 - Question about the `noise-clip` parameter in DDPG.

Issue - State: closed - Opened by helpingstar about 1 year ago - 2 comments

#418 - Pyyaml error on poetry install

Issue - State: closed - Opened by hom-bahrani about 1 year ago - 10 comments

#417 - numpy version issue with python 3.10

Issue - State: closed - Opened by martin-nginio about 1 year ago - 1 comment

#416 - Potential bug in PPO+RND?

Issue - State: closed - Opened by roger-creus about 1 year ago - 2 comments

#415 - Make TD3 compatible with gymnasium

Pull Request - State: closed - Opened by aseembits93 about 1 year ago - 3 comments

#408 - Update ppo_pettingzoo_ma_atari.py

Pull Request - State: open - Opened by elliottower over 1 year ago - 8 comments

#405 - Performance compared with SB3

Issue - State: closed - Opened by qiuruiyu over 1 year ago - 2 comments

#399 - run and experiment_name from docs/advanced/resume-training are undefined

Issue - State: closed - Opened by solismortis over 1 year ago - 5 comments

#398 - Update resume-training.md

Pull Request - State: closed - Opened by solismortis over 1 year ago - 1 comment

#397 - Video upload Issue - wandb

Issue - State: closed - Opened by tbasaklar over 1 year ago - 4 comments

#392 - Adding MPO and DMPO

Pull Request - State: open - Opened by Jogima-cyber over 1 year ago - 5 comments

#387 - Liberate the requirements.txt

Issue - State: open - Opened by ThijsvandenBerg over 1 year ago - 4 comments

#384 - Fail to record video

Issue - State: closed - Opened by yxdydgithub over 1 year ago - 3 comments

#378 - Add gymnasium support to SAC

Pull Request - State: closed - Opened by pseudo-rnd-thoughts over 1 year ago - 9 comments

#377 - Add gymnasium support for TD3

Pull Request - State: closed - Opened by pseudo-rnd-thoughts over 1 year ago - 10 comments

#354 - Add Muesli

Pull Request - State: closed - Opened by shermansiu almost 2 years ago - 10 comments

#352 - About PPO+Procgen code on Jax

Issue - State: closed - Opened by sglucas almost 2 years ago - 7 comments

#350 - Reproduction of Muesli

Issue - State: closed - Opened by vwxyzjn almost 2 years ago - 23 comments

#348 - Parallel-envs-friendly ppo_continuous_action.py

Pull Request - State: open - Opened by vwxyzjn almost 2 years ago - 3 comments

#345 - Dreamer v1 / v2 [Model-based RL]

Pull Request - State: closed - Opened by dosssman almost 2 years ago - 10 comments

#340 - Deprecate `ppo_procgen.py` in favor of EnvPool

Issue - State: closed - Opened by vwxyzjn almost 2 years ago - 2 comments

#330 - Cleanrl for MARL

Issue - State: closed - Opened by vbaddam almost 2 years ago - 15 comments

#313 - Brax + PPO integration

Pull Request - State: open - Opened by vwxyzjn about 2 years ago - 2 comments

#311 - Handle truncation properly with PPO

Pull Request - State: closed - Opened by vwxyzjn about 2 years ago - 3 comments

#310 - Why is there no design evaluation and save model module?

Issue - State: open - Opened by madlsj about 2 years ago - 22 comments

#309 - DDPG JAX breaks with python ~3.7

Issue - State: closed - Opened by vwxyzjn about 2 years ago - 2 comments

#293 - Type hints

Pull Request - State: open - Opened by timoklein about 2 years ago - 1 comment

#266 - SAC discrete

Issue - State: closed - Opened by timoklein about 2 years ago - 3 comments

#263 - Upgrade gym version to 0.26.1

Issue - State: closed - Opened by AdityaGudimella about 2 years ago - 2 comments

#262 - Added TQC

Pull Request - State: closed - Opened by AdityaGudimella about 2 years ago - 5 comments

#256 - Data corruption due to run naming convention when running on Slurm/GridEngine

Issue - State: open - Opened by Bam4d about 2 years ago - 1 comment

#248 - Adding Hierarchical RL Algorithms

Issue - State: closed - Opened by DavidSlayback over 2 years ago - 7 comments

#245 - Adding TRPO implementation

Issue - State: closed - Opened by merak0514 over 2 years ago - 5 comments
Labels: enhancement, help wanted

#239 - Replace cloud utilities w/ `torchx`

Issue - State: closed - Opened by vwxyzjn over 2 years ago - 1 comment
Labels: enhancement

#237 - Slow `poetry` dependency locking time, and resolution

Issue - State: closed - Opened by vwxyzjn over 2 years ago