nalepae/pandarallel issues and pull requests

#278 - Add DataFrame.parallel_map and Dataframe.parallel_agg

Pull Request - State: open - Opened by sirdrakeistda 3 months ago - 2 comments

#277 - OSError: [Errno 28] No space left on device

Issue - State: open - Opened by DTDwind 4 months ago - 6 comments

#276 - Distribute the work more evenly between faster and slower workers

Issue - State: open - Opened by hyungukangphd 4 months ago - 1 comment

#275 - Feature Request: Add Resume Functionality

Issue - State: open - Opened by bruce2233 6 months ago

#274 - how to convert existing df function to use pandarallel

Issue - State: open - Opened by cometta 7 months ago

#273 - Feature sleep

Pull Request - State: open - Opened by 7Zenox 8 months ago

#272 - RuntimeError: Cannot re-initialize CUDA in forked subprocess.

Issue - State: open - Opened by riyajatar37003 9 months ago

#271 - Handle virtual cores more explicitly

Issue - State: open - Opened by JnsLns 9 months ago - 3 comments

#270 - Suggest to be a no-code-change accelerator for pandas.

Issue - State: open - Opened by forhonourlx 10 months ago

#269 - Refactor Pandarallel initialization.

Pull Request - State: open - Opened by shermansiu 10 months ago

#268 - Allow default number of nb_workers to be configured with "None".

Pull Request - State: open - Opened by shermansiu 10 months ago

#267 - Pandarallel is failing with SSLContext error

Issue - State: open - Opened by madhvs 10 months ago - 4 comments

#266 - Is there an implementation that do not require picke dump to any file system?

Issue - State: closed - Opened by jwqian99 10 months ago

#265 - Dataframe with 64000 rows is being processed twice

Issue - State: open - Opened by reinzler 11 months ago - 3 comments

#264 - Memory usage increases across multiple `parallel_apply`

Issue - State: closed - Opened by hogan-roblox 12 months ago - 3 comments

#263 - Parallel_apply gets stuck

Issue - State: open - Opened by zeinabsobhani about 1 year ago - 4 comments

#262 - Pandarallel could stuck without raising any errors when using all the physical cores

Issue - State: open - Opened by LawrentChen about 1 year ago - 2 comments

#261 - Python 3.12.1 with pandarallel==1.6.5 usage of parallel_apply time increase X3

Issue - State: open - Opened by mdclone-oa about 1 year ago - 1 comment

#260 - use pool as spawn

Issue - State: open - Opened by AlexProfi about 1 year ago - 2 comments

#259 - fix DataFrame.applymap has been deprecated.

Pull Request - State: open - Opened by mdclone-oa about 1 year ago - 2 comments

#258 - DataFrame.applymap has been deprecated.

Issue - State: open - Opened by mdclone-oa over 1 year ago - 2 comments

#257 - consider taking in global environment variable for nb_workers and possibly other parameters too

Issue - State: open - Opened by SiRumCz over 1 year ago - 3 comments

#256 - Pandarallel very slow after loading huge dataframe

Issue - State: open - Opened by lpuglia over 1 year ago - 2 comments

#255 - AttributeError: 'DataFrameGroupBy' object has no attribute 'parallel_apply'

Issue - State: open - Opened by beyondguo over 1 year ago - 3 comments

#254 - parallel_apply not working with Pandas >= 2.1

Issue - State: open - Opened by masc-it over 1 year ago - 3 comments

#253 - Does pandarallel not support parallel_apply with multiple columns groupby?

Issue - State: open - Opened by akaymd over 1 year ago - 5 comments

#252 - Error displaying widget: model not found

Issue - State: closed - Opened by alexlenail over 1 year ago - 1 comment

#251 - [General Question] How to properly access an out-of-scope/shared DF

Issue - State: closed - Opened by Infinitay over 1 year ago - 1 comment

#250 - Is there a way to make the progress bar more compact?

Issue - State: open - Opened by wybert over 1 year ago - 1 comment

#249 - Notice on maintenance

Issue - State: closed - Opened by till-m over 1 year ago - 2 comments

#248 - Why the JupyterNoteBook cell is still running after the progress bars have been finished?

Issue - State: open - Opened by thatmee over 1 year ago - 3 comments

#247 - Python 3.13 GIL-free

Issue - State: open - Opened by nalepae over 1 year ago - 1 comment

#246 - cant run on python3.6

Issue - State: closed - Opened by BTFKM over 1 year ago - 2 comments

#245 - Fix ValueError for Empty DataFrames: Ensure Process Count is at Least 1

Pull Request - State: closed - Opened by Mithil467 over 1 year ago - 11 comments

#244 - Some workers stuck while others finish 100%

Issue - State: closed - Opened by SysuJayce over 1 year ago - 5 comments

#243 - Control number of progress bars

Pull Request - State: open - Opened by applio over 1 year ago - 3 comments

#242 - Limit number of progress bars on larger multi-core systems

Issue - State: open - Opened by applio over 1 year ago - 3 comments

#241 - add ipywidgets dependency

Pull Request - State: open - Opened by AurelienBoland over 1 year ago - 2 comments

#240 - automatically dropback to single-process avoid error

Issue - State: closed - Opened by pikakolendo02 over 1 year ago - 2 comments

#239 - Add option to show single progress bar for all workers

Pull Request - State: open - Opened by lpuglia over 1 year ago - 7 comments

#238 - UnpicklingError: pickle data was truncated

Issue - State: closed - Opened by ywsyws almost 2 years ago - 3 comments

#237 - ImportError: cannot import name 'time_ns'

Issue - State: closed - Opened by EduardoCarvalho35 almost 2 years ago - 1 comment

#236 - Bump version `v1.6.5`

Pull Request - State: closed - Opened by nalepae almost 2 years ago - 1 comment

#235 - Add [email protected] to tested versions, fix DataFrame groupby

Pull Request - State: closed - Opened by till-m almost 2 years ago - 2 comments

#234 - Add [email protected] to test matrix

Issue - State: closed - Opened by till-m almost 2 years ago

#233 - groupby.parallel_apply not working int Pandas 2.0

Issue - State: closed - Opened by alexrblohm almost 2 years ago - 10 comments

#232 - Add initializer and initargs

Pull Request - State: open - Opened by gwerbin almost 2 years ago - 1 comment

#231 - Feature request: support for multiprocessing.Pool "initializer".

Issue - State: open - Opened by gwerbin almost 2 years ago - 5 comments

#230 - Memory and parallelism tuning

Issue - State: open - Opened by jamessmith123456 almost 2 years ago - 4 comments

#229 - OSX can not parallel urllib

Issue - State: open - Opened by SysuJayce almost 2 years ago - 6 comments

#228 - time_ns with Python 3.6

Pull Request - State: closed - Opened by SunYanCN almost 2 years ago - 3 comments

#227 - is:issue is:open redirecting stdout not working with progress_bar=True

Issue - State: closed - Opened by luggie almost 2 years ago - 1 comment

#226 - Cannot use all CPUs at the same time

Issue - State: closed - Opened by versatile712 almost 2 years ago - 3 comments

#225 - Using `requests` inside the mapped function causes troubles.

Issue - State: open - Opened by zenodallavalle about 2 years ago - 1 comment

#224 - Drop Python <3.7 support

Pull Request - State: closed - Opened by till-m about 2 years ago - 1 comment

#223 - `from time import time_ns` raise ImportError when using python3.6 (same with #38)

Issue - State: closed - Opened by tongyifan about 2 years ago - 1 comment

#222 - `shm_size_mb` argument of pandarallel.initialize is never used

Issue - State: open - Opened by overmode about 2 years ago - 3 comments

#221 - Add ability to override default MEMORY_FS_ROOT with env var

Pull Request - State: closed - Opened by chris-boson about 2 years ago - 3 comments

#220 - Revert "Add `parallel_apply` for `Resampler` class (#211)"

Pull Request - State: closed - Opened by nalepae about 2 years ago - 1 comment

#219 - Tiny typo fix in docs

Pull Request - State: closed - Opened by guyrosin about 2 years ago - 2 comments

#218 - Rolling with a timeframe and not an int is not working

Issue - State: closed - Opened by idanre1 about 2 years ago - 1 comment

#217 - Problem

Issue - State: closed - Opened by ZSCDumin about 2 years ago - 1 comment

#216 - Exclude `[email protected], [email protected]` from tests

Pull Request - State: closed - Opened by till-m about 2 years ago - 1 comment

#215 - main imposition in code

Pull Request - State: closed - Opened by karunakar2 about 2 years ago - 4 comments

#214 - Global variables cannot be used in parallel_apply with "name 'np' is not defined"

Issue - State: closed - Opened by wubaosheng about 2 years ago - 1 comment

#213 - how to use it in fastapi

Issue - State: open - Opened by lim-0 about 2 years ago - 3 comments

#212 - Fix #197

Pull Request - State: closed - Opened by nalepae about 2 years ago - 3 comments

#211 - Add `parallel_apply` for `Resampler` class

Pull Request - State: closed - Opened by alvail about 2 years ago - 18 comments

#210 - 'functools.partial' object has no attribute 'code' in Jupyter Notebooks

Issue - State: closed - Opened by Meehai over 2 years ago - 2 comments

#209 - Fix pandas `FutureWarning` about series chunking

Pull Request - State: closed - Opened by itssimon over 2 years ago - 2 comments

#208 - Choose which type of progress bar you want in a notebook

Issue - State: open - Opened by astrojarred over 2 years ago - 5 comments

#207 - Fix typos/wording

Pull Request - State: closed - Opened by rbeilvert over 2 years ago - 3 comments

#206 - TypeError: cannot pickle 'sqlite3.Connection' object in pyCharm

Issue - State: open - Opened by wiessall over 2 years ago - 3 comments

#205 - Dose the memory usage related to how many cores we use

Issue - State: closed - Opened by wybert over 2 years ago - 1 comment

#204 - pandarallel freezes if progress bar is True and show multiprocessing related error if progress bar is False

Issue - State: closed - Opened by hsnyn over 2 years ago - 2 comments
Labels: bug

#203 - Add option to show single progress bar for all workers

Pull Request - State: open - Opened by ApolloBian over 2 years ago - 9 comments

#202 - parallel not working

Issue - State: closed - Opened by riyaj8888 over 2 years ago - 3 comments

#201 - `parallel_apply` fails for DataFrame > 4M rows

Issue - State: closed - Opened by Arka161 over 2 years ago - 2 comments

#200 - Fix 178

Pull Request - State: closed - Opened by till-m over 2 years ago - 1 comment

#199 - Rolling on datetime index

Issue - State: closed - Opened by asmodaay over 2 years ago - 1 comment
Labels: enhancement

#198 - Tests Github Actions: Add Windows where it works

Pull Request - State: closed - Opened by nalepae over 2 years ago

#197 - Github Actions: Add Windows in tests

Issue - State: closed - Opened by nalepae over 2 years ago

#196 - Tests Workflow: Remove (temporarily) Windows and adapt exclusions

Pull Request - State: closed - Opened by nalepae over 2 years ago - 1 comment

#195 - (Draft) Add CI using GitHub actions

Pull Request - State: closed - Opened by till-m over 2 years ago - 1 comment

#194 - Fix #191: `TypeError: 'generator' object is not subscriptable` when using colab

Pull Request - State: closed - Opened by till-m over 2 years ago - 3 comments

#193 - Add Github actions tests run

Issue - State: closed - Opened by nalepae over 2 years ago

#192 - `assert` are missing in some failing tests

Issue - State: open - Opened by nalepae over 2 years ago - 1 comment

#191 - TypeError: 'generator' object is not subscriptable error in colab - works in VScode

Issue - State: closed - Opened by agiveon over 2 years ago - 6 comments

#190 - Mate your library takes almost two hours to do what normal `apply()` can do in 30 seconds. WYD?

Issue - State: closed - Opened by rajdeep-biswas over 2 years ago - 2 comments

#189 - df.groupby(args)[colName].parallel_apply(func1) support?

Issue - State: open - Opened by uditrana over 2 years ago - 2 comments
Labels: enhancement

#188 - Fix: `parallel_apply` with data frame as an outcome returns duplicated rows

Pull Request - State: closed - Opened by till-m over 2 years ago - 4 comments

#187 - `df.parallel_apply` doesn't join the columns properly

Issue - State: closed - Opened by till-m over 2 years ago - 1 comment

#186 - Fix typo in `index.md`

Pull Request - State: closed - Opened by till-m over 2 years ago - 1 comment

#185 - OSError: [Errno 9] Bad file descriptor

Issue - State: closed - Opened by heppytt over 2 years ago - 2 comments

#184 - ZeroDivisionError: float division by zero

Issue - State: closed - Opened by heya5 over 2 years ago - 8 comments
Labels: bug

#183 - apply_parallel takes forever

Issue - State: open - Opened by rafikg over 2 years ago - 1 comment

#182 - Improve exception handling from worker

Pull Request - State: open - Opened by paoloalba over 2 years ago - 6 comments

#181 - EOFError: Ran out of input during parallel_apply on pickle.load

Issue - State: closed - Opened by paoloalba over 2 years ago - 1 comment

#180 - pandarallel support for grouped and date indexed dataframe

Issue - State: open - Opened by petrhrobar almost 3 years ago - 2 comments
Labels: enhancement

#179 - Can not use parallel_apply with win_type='freq' in Rolling

Issue - State: open - Opened by dfdd3026 almost 3 years ago - 3 comments

GitHub / nalepae/pandarallel issues and pull requests