scalableminds/cluster_tools issues and pull requests

#106 - Link to new repository in readme

Pull Request - State: closed - Opened by philippotto about 3 years ago

#105 - Avoid hitting slurm limits for maximum job count / array size

Pull Request - State: closed - Opened by daniel-wer over 3 years ago - 2 comments

#104 - Avoid hitting slurm limits for maximum job count / array size

Issue - State: closed - Opened by philippotto over 3 years ago - 1 comment

#103 - add maxjobsize and maxsubmit limits to job_resources

Pull Request - State: closed - Opened by elhuhdron over 3 years ago - 5 comments

#102 - Implement and test debug sequential executor

Pull Request - State: closed - Opened by philippotto over 3 years ago - 1 comment

#101 - Fix multiprocessing logging

Pull Request - State: closed - Opened by daniel-wer over 3 years ago - 2 comments

#100 - Make tailf functionality more robust

Pull Request - State: closed - Opened by philippotto over 3 years ago - 1 comment

#99 - add executor that uses a for-loop

Issue - State: closed - Opened by jstriebel over 3 years ago - 1 comment

#98 - Allow callers to setup logging using a callback

Pull Request - State: closed - Opened by daniel-wer over 3 years ago - 5 comments

#97 - Introduce automatic code formatting using black

Pull Request - State: closed - Opened by daniel-wer over 3 years ago

#96 - Delete preliminary output if it exists before scheduling job on cluster

Pull Request - State: closed - Opened by philippotto almost 4 years ago

#95 - Errorfree checkpoints

Pull Request - State: closed - Opened by philippotto almost 4 years ago

#94 - Upgrade to GitHub-native Dependabot

Pull Request - State: closed - Opened by dependabot-preview[bot] almost 4 years ago
Labels: dependencies

#93 - Fix failing submission of empty job arguments

Pull Request - State: closed - Opened by philippotto almost 4 years ago - 1 comment

#92 - map_to_futures with empty list crashes, should return empty list

Issue - State: closed - Opened by fm3 almost 4 years ago - 2 comments
Labels: bug

#91 - User logger.debug instead of print + debug flag

Issue - State: open - Opened by philippotto almost 4 years ago

#90 - Workaround size constraints in pythons multiprocessing

Pull Request - State: closed - Opened by philippotto almost 4 years ago

#89 - Allow to specify where the job output serialization should be persisted

Pull Request - State: closed - Opened by philippotto about 4 years ago

#88 - Add optional parameter to configure start method for multiprocessing

Pull Request - State: closed - Opened by philippotto about 4 years ago

#87 - Use spawn instead of fork

Pull Request - State: closed - Opened by georgwiese about 4 years ago

#86 - Dependabot couldn't authenticate with https://pypi.python.org/simple/

Issue - State: closed - Opened by dependabot-preview[bot] over 4 years ago

#85 - unexpected end of data

Issue - State: closed - Opened by georgwiese over 4 years ago - 2 comments
Labels: bug

#84 - Allow to create cfut dir at symlink's target

Issue - State: open - Opened by philippotto almost 5 years ago

#83 - Use better random generator

Pull Request - State: closed - Opened by philippotto almost 5 years ago

#82 - Dont assert py extension

Pull Request - State: closed - Opened by philippotto almost 5 years ago

#81 - Redirect stderr of sbatch to main stdout

Pull Request - State: closed - Opened by philippotto almost 5 years ago

#80 - Validate resource requirements

Issue - State: closed - Opened by philippotto almost 5 years ago - 2 comments

#79 - Always notify about crashes futures

Pull Request - State: closed - Opened by philippotto about 5 years ago

#78 - Add license scan report and status

Pull Request - State: closed - Opened by fossabot about 5 years ago - 2 comments

#77 - Do `sys.exit()` when the remote worker is finished

Pull Request - State: closed - Opened by philippotto about 5 years ago

#76 - Derive name from partial functions

Pull Request - State: closed - Opened by philippotto about 5 years ago

#75 - partial functions lead to unknown function name in slurm

Issue - State: closed - Opened by fm3 about 5 years ago

#74 - Improve polling speed

Pull Request - State: closed - Opened by philippotto about 5 years ago

#73 - Implement log-forwarding capabilities

Pull Request - State: closed - Opened by philippotto over 5 years ago

#72 - Fix main pickling for array jobs

Pull Request - State: closed - Opened by philippotto over 5 years ago

#71 - Use a maximum_simultaneous_jobs value of 500

Pull Request - State: closed - Opened by philippotto over 5 years ago

#70 - Batch job submission failed: Invalid job array specification

Issue - State: closed - Opened by georgwiese over 5 years ago - 1 comment

#69 - Slurm: Don't use 100% of the cluster

Issue - State: closed - Opened by georgwiese over 5 years ago - 1 comment

#68 - Re-add workaround for pickled main objects

Pull Request - State: closed - Opened by philippotto over 5 years ago - 1 comment

#67 - Only pickle function once when using map

Pull Request - State: closed - Opened by philippotto over 5 years ago

#66 - Use pickle protocol 4 when dumping

Pull Request - State: closed - Opened by philippotto over 5 years ago

#65 - Pickle scalars only once

Issue - State: closed - Opened by fm3 over 5 years ago - 1 comment

#64 - output cfut dir on instantiation

Pull Request - State: closed - Opened by philippotto over 5 years ago

#63 - Allow to specify cfut dir when instantiating ClusterExecutor

Pull Request - State: closed - Opened by philippotto over 5 years ago

#62 - clean up argument passing for subjobs

Issue - State: closed - Opened by fm3 over 5 years ago - 4 comments

#61 - Use _ for array jobs in log file names

Pull Request - State: closed - Opened by philippotto over 5 years ago

#60 - Skip flaky test

Pull Request - State: closed - Opened by philippotto over 5 years ago

#59 - Warn about uncaught/unhandled futures

Pull Request - State: closed - Opened by philippotto over 5 years ago - 1 comment

#58 - Log forwarding

Issue - State: closed - Opened by normanrz over 5 years ago - 2 comments

#57 - Check whether futures were checked for failures when exiting executor scope

Issue - State: closed - Opened by philippotto over 5 years ago - 1 comment

#56 - fix copying of .pypirc

Pull Request - State: closed - Opened by philippotto over 5 years ago

#55 - ensure that .pypirc is available when publishing package

Pull Request - State: closed - Opened by philippotto over 5 years ago

#54 - Auto publish to pypi

Pull Request - State: closed - Opened by philippotto over 5 years ago

#53 - Add retry for reading outfile

Pull Request - State: closed - Opened by philippotto over 5 years ago

#52 - Use setuptools-scm to auto-bump version number along with git tag

Pull Request - State: closed - Opened by philippotto over 5 years ago

#51 - Use sacct as a fallback for discovery of crashed jobs

Pull Request - State: closed - Opened by philippotto over 5 years ago

#50 - Use sacct in addition to scontrol to catch failed jobs

Issue - State: closed - Opened by philippotto over 5 years ago - 1 comment

#49 - Allow to influence additional setup lines via env var

Issue - State: open - Opened by philippotto over 5 years ago

#48 - bump version to 1.28

Pull Request - State: closed - Opened by jstriebel over 5 years ago

#47 - Don’t install python2 futures backport on python3

Pull Request - State: closed - Opened by fm3 over 5 years ago

#46 - Fix PBS resource declaration

Pull Request - State: closed - Opened by philippotto over 5 years ago

#45 - Use find packages

Pull Request - State: closed - Opened by philippotto over 5 years ago

#44 - Support PBS clusters

Pull Request - State: closed - Opened by philippotto over 5 years ago

#43 - Unify array job notation

Issue - State: closed - Opened by normanrz over 5 years ago

#42 - Prefer explicit job name over generated one

Pull Request - State: closed - Opened by philippotto over 5 years ago

#41 - Implement map_to_futures for all executors

Pull Request - State: closed - Opened by philippotto over 5 years ago

#40 - make pickling more robust

Pull Request - State: closed - Opened by philippotto over 5 years ago

#39 - Delete sbatch sh file only after the job was finished

Issue - State: closed - Opened by philippotto over 5 years ago - 2 comments

#38 - Ensure that failed pickling does not create zombie futures

Issue - State: closed - Opened by philippotto over 5 years ago - 2 comments

#37 - Implement map_to_futures for process pool

Issue - State: closed - Opened by philippotto over 5 years ago

#36 - Add executor for better debugging/testing of pickle mechanism

Pull Request - State: closed - Opened by philippotto over 5 years ago

#35 - Bump to 1.20

Pull Request - State: closed - Opened by philippotto over 5 years ago

#34 - use functions name attribute as a fallback to name slurm jobs

Pull Request - State: closed - Opened by philippotto over 5 years ago

#33 - print pending job ids when killing main thread (fixes #29)

Pull Request - State: closed - Opened by philippotto over 5 years ago

#32 - fix native pickling of main objects

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#31 - Default to better slurm job name

Issue - State: closed - Opened by philippotto almost 6 years ago - 1 comment

#30 - Automate version bumping

Issue - State: closed - Opened by philippotto almost 6 years ago

#29 - React to SIGINT and handle remaining jobs (kill/print?)

Issue - State: closed - Opened by philippotto almost 6 years ago

#28 - Improve dereferencing of main for native pickling

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#27 - Fix function pickling when function's module is main

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#26 - bump version to 1.15

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#25 - Use native pickle by default

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#24 - Add pylint to check for errors

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#23 - Fix missing var

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#22 - bump version

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#21 - output warning when pickling takes longer than 10 minutes

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#20 - Fix exception and speed of polling

Pull Request - State: closed - Opened by philippotto almost 6 years ago - 1 comment

#19 - Job state is completed, but .cfut/….pickle couldn't be found

Issue - State: closed - Opened by fm3 almost 6 years ago
Labels: bug

#18 - Implement map_unordered (fixes #12)

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#17 - [Postponed] Implement synchronous executor (fixes #11)

Pull Request - State: closed - Opened by philippotto almost 6 years ago - 1 comment

#16 - Logging output is swallowed when logging module is used

Issue - State: closed - Opened by philippotto almost 6 years ago - 1 comment

#15 - White-list keyword arguments

Issue - State: closed - Opened by georgwiese almost 6 years ago - 2 comments

#14 - Support PBS scheduler

Issue - State: closed - Opened by normanrz almost 6 years ago - 2 comments

#13 - Use array jobs when using map interface

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#12 - Add map_unordered to executor interface

Issue - State: closed - Opened by georgwiese almost 6 years ago

#11 - Add synchronous Executor

Issue - State: closed - Opened by georgwiese almost 6 years ago - 4 comments

#10 - Add tests for CI and dockered slurm environment

Pull Request - State: closed - Opened by philippotto almost 6 years ago

#8 - Restart Failed Jobs

Issue - State: closed - Opened by georgwiese almost 6 years ago - 3 comments
Labels: slurm

#6 - Use array jobs

Issue - State: closed - Opened by georgwiese almost 6 years ago - 2 comments
Labels: slurm

#2 - Automatically generate job names

Issue - State: closed - Opened by normanrz almost 6 years ago
Labels: slurm

GitHub / scalableminds/cluster_tools issues and pull requests