araffin/sbx issues and pull requests

#54 - [Question] fps drops significantly over time

Issue - State: open - Opened by oxkitsune 12 days ago
Labels: question

#53 - [Question] framestack and train_freq for sbx

Issue - State: open - Opened by Jackflyingzzz 15 days ago - 2 comments
Labels: question

#50 - Feat/rainbow

Pull Request - State: open - Opened by araffin 3 months ago

#49 - Add CNN support for DQN

Pull Request - State: closed - Opened by araffin 3 months ago - 1 comment

#48 - [Feature Request] Dict Obs Spaces Support

Issue - State: open - Opened by alexpalms 4 months ago - 2 comments
Labels: enhancement

#47 - Fix warning and remove DroQ class in favor of SAC config

Pull Request - State: closed - Opened by araffin 4 months ago

#46 - Hotfix - Return the new updated key in function _train

Pull Request - State: closed - Opened by theovincent 6 months ago - 2 comments

#45 - self.key is never updated

Issue - State: closed - Opened by theovincent 6 months ago - 2 comments
Labels: bug

#44 - [Bug] TQC Hyperparameter optimization: Results do not match the reference. This is likely a bug/unexpected loss of precision.

Issue - State: closed - Opened by edmund735 6 months ago - 2 comments
Labels: bug

#43 - Support for setting the target entropy

Pull Request - State: closed - Opened by jan1854 6 months ago

#42 - [Bug] TQC Entropy Coefficient

Issue - State: closed - Opened by edmund735 6 months ago - 2 comments
Labels: bug

#41 - Allow to pass custom activation function in `policy_kwargs`

Pull Request - State: closed - Opened by paolodelia99 6 months ago - 1 comment

#40 - [Feature Request] Recurrent policies

Issue - State: open - Opened by jamesheald 6 months ago - 13 comments
Labels: enhancement, help wanted

#39 - Fix for new tensorflow probability version

Pull Request - State: closed - Opened by araffin 6 months ago

#38 - set tensorflow-probability version in setup.py

Pull Request - State: closed - Opened by tonyspumoni 6 months ago - 1 comment

#37 - [Feature Request] Passing custom activation functon in policy_kwargs

Issue - State: closed - Opened by paolodelia99 6 months ago - 2 comments
Labels: enhancement, help wanted, good first issue

#36 - Implemented CrossQ

Pull Request - State: closed - Opened by danielpalen 6 months ago - 10 comments

#35 - [Question] Why is fps much lower than CPU if using GPU

Issue - State: closed - Opened by fanliaoooo 7 months ago - 1 comment
Labels: question

#34 - [Question] MaskablePPO support

Issue - State: closed - Opened by GuillermoHijano 7 months ago - 1 comment
Labels: question

#33 - [Question] TypeError when exporting a model to PyTorch in SBX

Issue - State: closed - Opened by LennertEvens 7 months ago - 3 comments
Labels: question

#32 - [Question] `MultiInputPolicy` not supported (DroQ)

Issue - State: open - Opened by jbirnick 7 months ago - 1 comment
Labels: question

#31 - [Question] Speedup compared to SB3

Issue - State: closed - Opened by thomashirtz 7 months ago - 1 comment
Labels: question

#30 - Support for MultiDiscrete and MultiBinary action spaces in PPO

Pull Request - State: closed - Opened by jan1854 8 months ago - 3 comments

#29 - [Bug] AttributeError: module 'tensorflow.python.util.tf_inspect' has no attribute 'Parameter'

Issue - State: closed - Opened by ashok-arora 8 months ago - 9 comments
Labels: bug

#28 - Add CrossQ

Pull Request - State: closed - Opened by araffin 8 months ago - 6 comments

#27 - SBX becomes super slow when number of cpus are limited

Issue - State: closed - Opened by Deepakgthomas 8 months ago - 2 comments
Labels: bug

#26 - SBX's forced cpu buffer usage makes SBX much slower than SB3

Issue - State: open - Opened by bascat139 8 months ago - 1 comment
Labels: question

#25 - [Feature Request] Support Optax Optimizer Schedules

Issue - State: closed - Opened by bradleypick 9 months ago - 4 comments
Labels: enhancement

#24 - Fix train signature and update type hints

Pull Request - State: closed - Opened by araffin 9 months ago

#23 - Mujoco XLA - MJX Integration

Issue - State: closed - Opened by matinmoezzi 9 months ago - 1 comment
Labels: question

#22 - [Feature Request] Update type annotations

Issue - State: closed - Opened by araffin 10 months ago
Labels: enhancement, help wanted

#21 - Added support for large values for gradient_steps to SAC, TD3, and TQC

Pull Request - State: closed - Opened by jan1854 10 months ago - 12 comments

#20 - Fix replay buffer device at load time

Pull Request - State: closed - Opened by araffin 10 months ago

#19 - [Feature Request] Multi-Discrete action spaces for PPO

Issue - State: closed - Opened by tobiasmerkt 11 months ago - 3 comments
Labels: enhancement, help wanted

#16 - Add DDPG and TD3

Pull Request - State: closed - Opened by araffin about 1 year ago

#15 - [Question] Extending sbx algorithms (e.g via a callback)

Issue - State: closed - Opened by asmith26 about 1 year ago - 2 comments
Labels: question

#14 - [Enhancement] Support for large gradient_steps in SAC

Issue - State: closed - Opened by LabChameleon about 1 year ago - 2 comments
Labels: enhancement

#13 - SAC7

Pull Request - State: open - Opened by araffin over 1 year ago

#12 - [Question] is it possible cython use this sbx?

Issue - State: closed - Opened by diybl over 1 year ago - 4 comments
Labels: question

#11 - Basic dict obs support

Pull Request - State: closed - Opened by araffin over 1 year ago

#10 - Switch to `pyproject.toml`, `ruff`, upgrade SB3

Pull Request - State: closed - Opened by araffin over 1 year ago

#9 - [Bug] example supplied in readme crashing

Issue - State: closed - Opened by Robokan over 1 year ago - 4 comments
Labels: bug

#8 - crash when using a custom network architecture

Issue - State: closed - Opened by Robokan over 1 year ago - 4 comments
Labels: enhancement, question