ymd_h/cpprb issues and pull requests

#146 - Weight normalization in prioritized experience replay

Issue - State: opened - Opened by anilzeybek over 2 years ago - 5 comments

#145 - [Investigation] GitLab will limit CI/CD pipeline usage.

Issue - State: opened - Opened by ymd_h over 2 years ago
Labels: survey

#144 - [Investigation] Ray RLlib: Replay Buffer API

Issue - State: opened - Opened by ymd_h over 2 years ago - 2 comments
Labels: survey

#143 - `stack_compress` is not working with more than one value

Issue - State: closed - Opened by billiout over 2 years ago - 2 comments
Labels: bug

#142 - Linter / Formatter

Issue - State: opened - Opened by ymd_h over 2 years ago

#141 - Ray Support

Issue - State: closed - Opened by ymd_h over 2 years ago - 4 comments
Labels: enhancement

#140 - Python 3.10 Support

Issue - State: opened - Opened by ymd_h almost 3 years ago
Labels: waiting fix

#139 - Citation of cpprb

Issue - State: closed - Opened by syuntoku14 about 3 years ago - 2 comments

#138 - Save / Load transitions for next_of

Issue - State: closed - Opened by ymd_h over 3 years ago
Labels: enhancement

#137 - Nstep discounts specification is confusing

Issue - State: closed - Opened by ymd_h over 3 years ago - 2 comments
Labels: ToDo

#136 - Vector reward for Nstep

Issue - State: closed - Opened by ymd_h over 3 years ago
Labels: cannot reproduce

#135 - Need cache for stack_compress at next_index

Issue - State: closed - Opened by ymd_h over 3 years ago
Labels: bug

#134 - Prioritized Approximation Loss (PAL)

Issue - State: opened - Opened by ymd_h over 3 years ago
Labels: ToDo, enhancement

#133 - Loss Adjusted Prioritized Experience Replay (LAP)

Issue - State: opened - Opened by ymd_h over 3 years ago
Labels: ToDo, enhancement

#132 - Revisiting Prioritized Experience Replay: A Value Perspective

Issue - State: closed - Opened by ymd_h over 3 years ago
Labels: survey

#131 - ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject

Issue - State: closed - Opened by ymd_h over 3 years ago - 1 comment

#130 - default_dtype in MPPrioritizedReplayBuffer seems no use with float16

Issue - State: closed - Opened by su1mo7dustsigh over 3 years ago - 10 comments

#129 - Learning to Sample with Local and Global Contexts in Experience Replay Buffer

Issue - State: opened - Opened by ymd_h almost 4 years ago
Labels: survey

#128 - ValueError: buffer source array is read-only

Issue - State: closed - Opened by ymd_h almost 4 years ago
Labels: bug

#127 - User Request: Representation Learning inside Replay Buffer

Issue - State: opened - Opened by ymd_h almost 4 years ago
Labels: enhancement, survey

#126 - Revisiting Fundamentals of Experience Replay

Issue - State: closed - Opened by ymd_h almost 4 years ago
Labels: survey

#125 - Prioritized Level Replay

Issue - State: closed - Opened by ymd_h almost 4 years ago - 1 comment
Labels: survey

#124 - Dynamic Experience Replay

Issue - State: closed - Opened by ymd_h almost 4 years ago
Labels: survey

#123 - Competitive Experience Replay

Issue - State: closed - Opened by ymd_h almost 4 years ago
Labels: survey

#122 - Experience Replay Optimization

Issue - State: opened - Opened by ymd_h almost 4 years ago - 1 comment
Labels: enhancement

#121 - Attentive Experience Replay Authors

Issue - State: closed - Opened by ymd_h almost 4 years ago - 1 comment
Labels: survey

#120 - Remember and Forget for Experience Replay

Issue - State: opened - Opened by ymd_h almost 4 years ago
Labels: survey

#119 - Deep Reinforcement Learning with Quantum-inspired Experience Replay

Issue - State: opened - Opened by ymd_h almost 4 years ago
Labels: survey

#118 - Methods at API document twice

Issue - State: closed - Opened by ymd_h almost 4 years ago - 1 comment
Labels: Documentation, bug

#117 - Does cpprb has some protection in multiprocessing? The indexes may change

Issue - State: closed - Opened by su1mo7dustsigh almost 4 years ago - 9 comments

#116 - Confusing Bug ( KeyError: 'discount')

Issue - State: closed - Opened by Hanwant almost 4 years ago - 3 comments
Labels: bug

#115 - compile error on mac using g++

Issue - State: closed - Opened by vNpAwqidk5oedJPM about 4 years ago - 2 comments

#114 - `rb.sample(n)` yields an index out of bound error

Issue - State: closed - Opened by vwxyzjn about 4 years ago - 7 comments
Labels: bug

#113 - Get all transitions with shuffle (no duplicated indexes)

Issue - State: closed - Opened by ymd_h about 4 years ago - 1 comment
Labels: enhancement

#112 - Booleans are implicitly casted, even when explicitly typed

Issue - State: closed - Opened by faas.mitchell over 4 years ago - 2 comments
Labels: bug

#111 - [Nstep PER] TypeError: function() got multiple values for keyword argument 'done'

Issue - State: closed - Opened by ymd_h over 4 years ago - 3 comments
Labels: bug

#110 - Bug: Avoid caching from previous episode

Issue - State: closed - Opened by ymd_h over 4 years ago - 1 comment
Labels: bug

#109 - Benchmark for Revereb is breaking

Issue - State: closed - Opened by ymd_h over 4 years ago - 1 comment
Labels: ToDo, bug

#108 - `stack_compress` Compressed Wrong Dimension

Issue - State: closed - Opened by vwxyzjn over 4 years ago - 12 comments
Labels: bug

#107 - Request for More Specific Instructions for `stack_compress`

Issue - State: closed - Opened by vwxyzjn over 4 years ago - 12 comments

#106 - Prioritized Replay Buffer Demo Code Not Working

Issue - State: closed - Opened by vwxyzjn over 4 years ago - 1 comment

#105 - Memory usage keeps increasing

Issue - State: closed - Opened by ohtake_i over 4 years ago - 8 comments
Labels: bug

#104 - Compare with Reverb

Issue - State: closed - Opened by ymd_h over 4 years ago
Labels: ToDo, site

#103 - Update segment tree only when changed

Issue - State: closed - Opened by ymd_h over 4 years ago
Labels: enhancement, refactoring

#102 - Typo: kwrags

Issue - State: opened - Opened by ymd_h over 4 years ago
Labels: easy, refactoring

#101 - Raise DeprecationWarning at Environment class

Issue - State: opened - Opened by ymd_h over 4 years ago
Labels: easy

#100 - Documentation about raising ValueError at PrioritizedReplayBuffer.add

Issue - State: opened - Opened by ymd_h over 4 years ago
Labels: Documentation, easy

#99 - Should use helper function

Issue - State: opened - Opened by ymd_h over 4 years ago
Labels: easy, refactoring

#98 - cache is not cleared

Issue - State: closed - Opened by ymd_h over 4 years ago
Labels: bug

#97 - Stack_compress unexpected behavior

Issue - State: closed - Opened by ermekaitygulov over 4 years ago - 2 comments
Labels: bug

#96 - [Question] Add method unexpected behavior

Issue - State: closed - Opened by ermekaitygulov over 4 years ago - 2 comments
Labels: bug

#95 - Implement PSER with ADD variant

Issue - State: opened - Opened by ymd_h over 4 years ago
Labels: enhancement

#94 - Implement PSER with MAX variant

Issue - State: opened - Opened by ymd_h over 4 years ago
Labels: enhancement

#93 - Compare with SEED RL

Issue - State: opened - Opened by ymd_h over 4 years ago
Labels: ToDo

#92 - Compare with RLlib: Prioritized Replay Buffer sample

Issue - State: closed - Opened by ymd_h over 4 years ago
Labels: waiting fix

#91 - Compare with TF-Agents

Issue - State: opened - Opened by ymd_h over 4 years ago
Labels: ToDo

#90 - Change `_encode_sample` to `encode_sample`

Issue - State: closed - Opened by ohtake_i over 4 years ago - 6 comments
Labels: enhancement

#89 - Example code for create_env_dict and create_before_add_func

Issue - State: closed - Opened by ymd_h over 4 years ago - 1 comment
Labels: ToDo

#88 - Document for create_env_dict and create_before_add_func

Issue - State: opened - Opened by ymd_h over 4 years ago
Labels: Documentation, site

#87 - Description at PyPI is removed when GitHub Actions added windows binary.

Issue - State: closed - Opened by ymd_h over 4 years ago
Labels: PyPI, bug

#86 - Cannot install 'gym[box2d]' in extras_require if 'gym' is in install_requires

Issue - State: closed - Opened by ymd_h over 4 years ago - 1 comment
Labels: bug, setup.py

#85 - Compare with Chainerrl

Issue - State: closed - Opened by ymd_h over 4 years ago
Labels: ToDo

#84 - Compare with RLlib

Issue - State: closed - Opened by ymd_h over 4 years ago - 1 comment
Labels: ToDo

#83 - Compare with OpenAI Baselines

Issue - State: closed - Opened by ymd_h over 4 years ago
Labels: ToDo

#82 - Compre with tf.models

Issue - State: opened - Opened by ymd_h over 4 years ago
Labels: ToDo

#81 - GitHub Actions upload PyPI

Issue - State: closed - Opened by ymd_h over 4 years ago
Labels: bug

#80 - Binary distribution for Windows

Issue - State: closed - Opened by ymd_h over 4 years ago
Labels: ToDo, enhancement

#79 - Binary distribution for macOS

Issue - State: opened - Opened by ymd_h over 4 years ago - 1 comment
Labels: ToDo, enhancement, waiting fix

#78 - Binary distribution for Linux using manylinux

Issue - State: closed - Opened by ymd_h over 4 years ago - 1 comment
Labels: ToDo, enhancement

#77 - Helper functions making `env_dict` from `gym.spaces`

Issue - State: closed - Opened by ymd_h over 4 years ago - 1 comment
Labels: ToDo, enhancement

#76 - Error playing with tuple spaces, such as Blackjack

Issue - State: closed - Opened by Elfits almost 5 years ago - 8 comments
Labels: question

#75 - site: Section in side bar is not shown

Issue - State: closed - Opened by ymd_h almost 5 years ago - 1 comment
Labels: Documentation, bug, site

#74 - Sphinx API reference generation is broken

Issue - State: closed - Opened by ymd_h almost 5 years ago
Labels: Documentation, bug

#73 - Ubuntu Installation Notes

Issue - State: closed - Opened by janbolle almost 5 years ago - 3 comments
Labels: Documentation

#72 - Coverage badge shows 'unknown'

Issue - State: closed - Opened by ymd_h almost 5 years ago - 1 comment
Labels: bug

#71 - Make compilable at macOS with native development tool chain

Issue - State: closed - Opened by ymd_h almost 5 years ago - 1 comment
Labels: bug

#70 - Improve README: Installation at macOS

Issue - State: closed - Opened by ymd_h almost 5 years ago
Labels: Documentation

#69 - Build CI Error on Python 3.7.6

Issue - State: closed - Opened by ymd_h almost 5 years ago
Labels: bug

#68 - Can i save the replay buffer on the disk like model.save() in tf/pytorch etc.

Issue - State: closed - Opened by fmxfranky almost 5 years ago - 3 comments

#67 - implementation on windows

Issue - State: closed - Opened by Elfits almost 5 years ago - 4 comments

#65 - インストール時に、ModuleNotFoundErrorが表示される

Issue - State: closed - Opened by ymd_h almost 5 years ago
Labels: need help

#64 - how to use NstepReplayBuffer or PrioritizedReplayBuffer in version 8.0.0+?

Issue - State: closed - Opened by fmxfranky almost 5 years ago - 4 comments
Labels: question

#63 - PERにおけるハイパーパラメータの設定

Issue - State: closed - Opened by ohtake_i about 5 years ago - 1 comment

#62 - PERにて weights が更新されない

Issue - State: closed - Opened by ohtake_i about 5 years ago - 2 comments
Labels: won't fix

#61 - done がないと add に失敗する

Issue - State: closed - Opened by ohtake_i over 5 years ago - 1 comment

#60 - sample時にユーザーがindexを指定できるようにする

Issue - State: opened - Opened by ohtake_i over 5 years ago
Labels: enhancement

#59 - buildのdocker環境を、コード（dockerファイル）として管理したい

Issue - State: closed - Opened by ymd_h over 5 years ago - 1 comment
Labels: enhancement

#58 - stack_compress時のstack次元を可変にする

Issue - State: opened - Opened by ymd_h over 5 years ago
Labels: enhancement

#53 - experimental実装のNstep対応

Issue - State: closed - Opened by ymd_h over 5 years ago - 1 comment
Labels: ToDo, enhancement

#52 - 【experimental】環境の変数指定 (env_dict) にデフォルトで含めるべき値は必要？

Issue - State: closed - Opened by ymd_h over 5 years ago - 1 comment
Labels: question

#50 - CI上のユニットテストをレポートする

Issue - State: closed - Opened by ymd_h over 5 years ago
Labels: enhancement

#49 - スタック保存を重複排除して、メモリ効率の改善

Issue - State: closed - Opened by ymd_h over 5 years ago - 1 comment
Labels: enhancement

#48 - 【マルチプロセス】sampleをaddと並行に呼び出せるようにする

Issue - State: closed - Opened by ymd_h over 5 years ago - 1 comment
Labels: enhancement

#42 - Nstep報酬で、Rewardの次元を可変にする

Issue - State: closed - Opened by ymd_h over 5 years ago
Labels: enhancement

#35 - template関数を利用して、pxd定義をへらす

Issue - State: closed - Opened by ymd_h over 5 years ago - 1 comment
Labels: refactoring

#28 - GitLab CIに、Speed Testを作成する

Issue - State: closed - Opened by ymd_h over 5 years ago - 1 comment
Labels: ToDo, won't fix

#27 - Nstep のマルチスレッド対応

Issue - State: closed - Opened by ymd_h over 5 years ago - 1 comment
Labels: won't fix

#26 - Prioritized (= SegmentTree) のマルチプロセス対応

Issue - State: closed - Opened by ymd_h over 5 years ago - 1 comment
Labels: enhancement

#13 - C++のコードにユニットテストを導入

Issue - State: closed - Opened by ymd_h over 5 years ago

#11 - マルチワーカー（マルチスレッド）対応

Issue - State: closed - Opened by ymd_h over 5 years ago - 1 comment
Labels: enhancement

GitLab.com / ymd_h/cpprb issues and pull requests