Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / araffin/sbx issues and pull requests

#65 - Update PPO to support `net_arch`

Pull Request - State: open - Opened by araffin 5 days ago

#64 - Upgrade to python 3.9

Pull Request - State: closed - Opened by araffin about 1 month ago

#63 - [Question] Integrate something like jaxtyping for more specific type annotations and runtime type-checking

Issue - State: open - Opened by dantp-ai about 2 months ago - 10 comments
Labels: question

#62 - Few questions about the library regarding performance

Issue - State: open - Opened by KamatMayur 2 months ago - 2 comments
Labels: question

#61 - BRO

Pull Request - State: closed - Opened by naumix 3 months ago - 1 comment

#60 - Add Bigger, Regularized, Optimistic (BRO)

Pull Request - State: open - Opened by naumix 3 months ago - 5 comments

#59 - Add SimBa Policy: Simplicity Bias for Scaling Up Parameters in DRL

Pull Request - State: closed - Opened by araffin 3 months ago - 7 comments

#58 - [Question] Try to use sbx on meltingpot env

Issue - State: open - Opened by ZzzihaoGuo 3 months ago - 1 comment
Labels: question

#57 - RecurrentPPO

Pull Request - State: open - Opened by corentinlger 3 months ago

#56 - Optimize the log of the entropy coeff instead of the entropy coeff

Pull Request - State: closed - Opened by jamesheald 4 months ago - 11 comments

#55 - SB3 and SBX versions of SAC have radically different behaviours

Issue - State: closed - Opened by jamesheald 4 months ago - 7 comments
Labels: question

#54 - [Question] fps drops significantly over time

Issue - State: open - Opened by oxkitsune 4 months ago - 5 comments
Labels: question

#53 - [Question] framestack and train_freq for sbx

Issue - State: open - Opened by Jackflyingzzz 4 months ago - 2 comments
Labels: question

#50 - Feat/rainbow

Pull Request - State: open - Opened by araffin 7 months ago

#49 - Add CNN support for DQN

Pull Request - State: closed - Opened by araffin 7 months ago - 1 comment

#48 - [Feature Request] Dict Obs Spaces Support

Issue - State: open - Opened by alexpalms 8 months ago - 2 comments
Labels: enhancement

#47 - Fix warning and remove DroQ class in favor of SAC config

Pull Request - State: closed - Opened by araffin 8 months ago

#46 - Hotfix - Return the new updated key in function _train

Pull Request - State: closed - Opened by theovincent 10 months ago - 2 comments

#45 - self.key is never updated

Issue - State: closed - Opened by theovincent 10 months ago - 2 comments
Labels: bug

#43 - Support for setting the target entropy

Pull Request - State: closed - Opened by jan1854 10 months ago

#42 - [Bug] TQC Entropy Coefficient

Issue - State: closed - Opened by edmund735 10 months ago - 2 comments
Labels: bug

#41 - Allow to pass custom activation function in `policy_kwargs`

Pull Request - State: closed - Opened by paolodelia99 10 months ago - 1 comment

#40 - [Feature Request] Recurrent policies

Issue - State: open - Opened by jamesheald 10 months ago - 16 comments
Labels: enhancement, help wanted

#39 - Fix for new tensorflow probability version

Pull Request - State: closed - Opened by araffin 10 months ago

#38 - set tensorflow-probability version in setup.py

Pull Request - State: closed - Opened by tonyspumoni 10 months ago - 1 comment

#37 - [Feature Request] Passing custom activation functon in policy_kwargs

Issue - State: closed - Opened by paolodelia99 10 months ago - 2 comments
Labels: enhancement, help wanted, good first issue

#36 - Implemented CrossQ

Pull Request - State: closed - Opened by danielpalen 10 months ago - 10 comments

#35 - [Question] Why is fps much lower than CPU if using GPU

Issue - State: closed - Opened by fanliaoooo 11 months ago - 1 comment
Labels: question

#34 - [Question] MaskablePPO support

Issue - State: closed - Opened by GuillermoHijano 11 months ago - 1 comment
Labels: question

#33 - [Question] TypeError when exporting a model to PyTorch in SBX

Issue - State: closed - Opened by LennertEvens 11 months ago - 3 comments
Labels: question

#32 - [Question] `MultiInputPolicy` not supported (DroQ)

Issue - State: open - Opened by jbirnick 11 months ago - 1 comment
Labels: question

#31 - [Question] Speedup compared to SB3

Issue - State: closed - Opened by thomashirtz 11 months ago - 1 comment
Labels: question

#30 - Support for MultiDiscrete and MultiBinary action spaces in PPO

Pull Request - State: closed - Opened by jan1854 12 months ago - 3 comments

#28 - Add CrossQ

Pull Request - State: closed - Opened by araffin 12 months ago - 6 comments

#27 - SBX becomes super slow when number of cpus are limited

Issue - State: closed - Opened by Deepakgthomas about 1 year ago - 2 comments
Labels: bug

#26 - SBX's forced cpu buffer usage makes SBX much slower than SB3

Issue - State: open - Opened by bascat139 about 1 year ago - 1 comment
Labels: question

#25 - [Feature Request] Support Optax Optimizer Schedules

Issue - State: closed - Opened by bradleypick about 1 year ago - 4 comments
Labels: enhancement

#24 - Fix train signature and update type hints

Pull Request - State: closed - Opened by araffin about 1 year ago

#23 - Mujoco XLA - MJX Integration

Issue - State: closed - Opened by matinmoezzi about 1 year ago - 1 comment
Labels: question

#22 - [Feature Request] Update type annotations

Issue - State: closed - Opened by araffin about 1 year ago
Labels: enhancement, help wanted

#21 - Added support for large values for gradient_steps to SAC, TD3, and TQC

Pull Request - State: closed - Opened by jan1854 about 1 year ago - 12 comments

#20 - Fix replay buffer device at load time

Pull Request - State: closed - Opened by araffin about 1 year ago

#19 - [Feature Request] Multi-Discrete action spaces for PPO

Issue - State: closed - Opened by tobiasmerkt about 1 year ago - 3 comments
Labels: enhancement, help wanted

#16 - Add DDPG and TD3

Pull Request - State: closed - Opened by araffin over 1 year ago

#15 - [Question] Extending sbx algorithms (e.g via a callback)

Issue - State: closed - Opened by asmith26 over 1 year ago - 2 comments
Labels: question

#14 - [Enhancement] Support for large gradient_steps in SAC

Issue - State: closed - Opened by LabChameleon over 1 year ago - 2 comments
Labels: enhancement

#13 - SAC7

Pull Request - State: open - Opened by araffin over 1 year ago

#12 - [Question] is it possible cython use this sbx?

Issue - State: closed - Opened by diybl over 1 year ago - 4 comments
Labels: question

#11 - Basic dict obs support

Pull Request - State: closed - Opened by araffin almost 2 years ago

#10 - Switch to `pyproject.toml`, `ruff`, upgrade SB3

Pull Request - State: closed - Opened by araffin almost 2 years ago

#9 - [Bug] example supplied in readme crashing

Issue - State: closed - Opened by Robokan about 2 years ago - 4 comments
Labels: bug

#8 - crash when using a custom network architecture

Issue - State: closed - Opened by Robokan about 2 years ago - 4 comments
Labels: enhancement, question

#7 - Implement DQN

Pull Request - State: closed - Opened by araffin about 2 years ago

#6 - Implement PPO

Pull Request - State: closed - Opened by araffin about 2 years ago

#5 - Add Qf learning rate param

Pull Request - State: closed - Opened by araffin over 2 years ago

#4 - Implements Feature Extractors

Pull Request - State: open - Opened by joaogui1 over 2 years ago

#3 - Adding Feature Extractors

Issue - State: open - Opened by joaogui1 over 2 years ago - 5 comments
Labels: enhancement

#2 - Add policy delay and fix for vecnormalize

Pull Request - State: closed - Opened by araffin over 2 years ago

#1 - Add SAC and Vectorized critic

Pull Request - State: closed - Opened by araffin over 2 years ago