Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / tomwhite/cubed issues and pull requests

#285 - Bugs with passing allowed_mem as a string

Issue - State: closed - Opened by TomNicholas over 1 year ago
Labels: bug

#284 - Fuse pipelines with different numbers of tasks

Issue - State: closed - Opened by TomNicholas over 1 year ago - 3 comments
Labels: optimization

#283 - [pre-commit.ci] pre-commit autoupdate

Pull Request - State: closed - Opened by pre-commit-ci[bot] over 1 year ago

#282 - Defer to merge_chunks in special cases of rechunk

Issue - State: open - Opened by TomNicholas over 1 year ago - 4 comments
Labels: core, optimization

#281 - Dask check_runtime_memory

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#280 - Remove `DaskDelayedExecutor`

Pull Request - State: closed - Opened by tomwhite over 1 year ago
Labels: runtime

#279 - Dask distributed async executor

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#278 - Generalise async executor code

Pull Request - State: closed - Opened by tomwhite over 1 year ago - 1 comment
Labels: runtime

#277 - Add scan / prefix sum primitive

Issue - State: open - Opened by dcherian over 1 year ago - 4 comments
Labels: array api, core

#276 - Executor feature comparison

Issue - State: open - Opened by tomwhite over 1 year ago - 6 comments
Labels: runtime

#275 - In-process Python executor should not retry

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#274 - Ensure runtime memory is not less than allowed

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#273 - Fix `reserved_mem` in `create_lazy_zarr_arrays`

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#272 - Refactor pipeline mappable

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#271 - Remove duplicate copy of `projected_mem` and `num_tasks` from DAG

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#270 - Allow step size > 1

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#269 - Dask tests

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#268 - Any way we could work with a dataset metadata to be able to partition it?

Issue - State: closed - Opened by abourramouss over 1 year ago - 4 comments

#267 - GitHub Actions workflow for tests is broken

Issue - State: closed - Opened by tomwhite over 1 year ago - 5 comments
Labels: bug, tools

#266 - [pre-commit.ci] pre-commit autoupdate

Pull Request - State: closed - Opened by pre-commit-ci[bot] over 1 year ago

#265 - Add unit tests for `virtual_offsets` function

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#264 - Remove vendored rechunker API, since we only use the algorithm

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#262 - Simplify pipeline object to be single stage and non-optional mappable

Issue - State: closed - Opened by tomwhite over 1 year ago - 1 comment
Labels: runtime

#261 - Fix modal import

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#260 - Coiled Functions executor

Pull Request - State: closed - Opened by TomNicholas over 1 year ago - 7 comments
Labels: runtime

#259 - Lithops compute arrays in parallel

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#258 - Add type hints for runtime

Pull Request - State: closed - Opened by tomwhite over 1 year ago
Labels: runtime

#257 - Surface rechunk intermediates in DAG

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#256 - Use new `merge_chunks` function in `reduction`

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#255 - Unit tests for Dask executor

Issue - State: closed - Opened by tomwhite over 1 year ago
Labels: runtime

#254 - Coiled Functions Executor

Issue - State: closed - Opened by TomNicholas over 1 year ago - 1 comment
Labels: runtime

#253 - Remove PipelineExecutor classes

Pull Request - State: closed - Opened by tomwhite over 1 year ago
Labels: runtime

#252 - Scaling docs

Pull Request - State: closed - Opened by TomNicholas over 1 year ago
Labels: documentation, scaling

#251 - Avoid divide by zero from projected mem

Pull Request - State: closed - Opened by tomwhite over 1 year ago
Labels: bug

#250 - Document strong consistency

Pull Request - State: closed - Opened by tomwhite over 1 year ago
Labels: documentation

#249 - Re-enable rechunker's `consolidate_reads`

Pull Request - State: closed - Opened by tomwhite over 1 year ago - 1 comment

#248 - Introduce VirtualOffsetsArray that is never materialized

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#247 - Don't materialize `full` or offsets arrays

Issue - State: closed - Opened by tomwhite over 1 year ago
Labels: optimization, scaling

#246 - Use np.unravel_index rather than iterating over np.ndindex

Pull Request - State: closed - Opened by tomwhite over 1 year ago
Labels: optimization

#245 - Account for reserved_mem when creating arrays

Pull Request - State: closed - Opened by tomwhite over 1 year ago
Labels: bug

#244 - Add matmul example that validates result

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#243 - Add links to Xarray integration and blog post to docs

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#242 - Don't materialize input iterables to `map_unordered`

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#241 - Dask delayed executor

Pull Request - State: closed - Opened by TomNicholas over 1 year ago - 3 comments
Labels: enhancement

#240 - Test that plan generation scales to very large workloads

Pull Request - State: closed - Opened by tomwhite over 1 year ago - 1 comment
Labels: scaling

#239 - Flow control for worker task submission

Issue - State: open - Opened by tomwhite over 1 year ago - 1 comment
Labels: runtime, scaling

#238 - Improve Modal backups implementation

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#237 - Low-latency storage backends

Issue - State: open - Opened by tomwhite over 1 year ago - 21 comments
Labels: runtime, zarr, storage

#236 - Add type hints for primitive functions

Pull Request - State: closed - Opened by tomwhite over 1 year ago - 1 comment

#235 - Performance regression - `max_workers` not being used

Issue - State: closed - Opened by TomNicholas over 1 year ago - 3 comments

#234 - Performance regression testing using asv?

Issue - State: open - Opened by TomNicholas over 1 year ago - 2 comments
Labels: optimization, benchmarks

#233 - In-process Python executor should not retry

Issue - State: closed - Opened by tomwhite over 1 year ago
Labels: good first issue, runtime

#232 - [pre-commit.ci] pre-commit autoupdate

Pull Request - State: closed - Opened by pre-commit-ci[bot] over 1 year ago

#231 - Print irregular chunking pattern when error raised

Pull Request - State: closed - Opened by TomNicholas over 1 year ago

#230 - Add type hints to blockwise and rechunk primitives

Issue - State: closed - Opened by tomwhite over 1 year ago - 1 comment
Labels: primitive, tools

#229 - Run mypy in CI

Pull Request - State: closed - Opened by tomwhite over 1 year ago - 1 comment

#226 - Allow rechunk to take a dict for chunks

Pull Request - State: closed - Opened by tomwhite over 1 year ago
Labels: bug

#224 - Running on a cluster

Issue - State: closed - Opened by TomNicholas over 1 year ago - 1 comment
Labels: runtime

#222 - Surface any intermediate arrays from rechunk in DAG

Issue - State: closed - Opened by tomwhite over 1 year ago
Labels: primitive, optimization

#221 - Fuse rechunk and blockwise combine operations in reductions

Issue - State: closed - Opened by tomwhite over 1 year ago
Labels: primitive, memory, optimization

#220 - Connect runtime memory to allowed memory

Issue - State: closed - Opened by tomwhite over 1 year ago
Labels: documentation, memory

#219 - Calculating the cost of a computation

Issue - State: open - Opened by tomwhite over 1 year ago - 2 comments
Labels: enhancement, runtime

#217 - Lithops retries and backups

Pull Request - State: closed - Opened by tomwhite over 1 year ago

#204 - Reasoning about scaling and performance

Issue - State: closed - Opened by TomNicholas over 1 year ago - 4 comments
Labels: documentation, scaling

#199 - Add map_overlap as a new core op

Issue - State: open - Opened by TomNicholas over 1 year ago - 4 comments
Labels: enhancement

#196 - NotImplementedError: Slice step must be 1

Issue - State: closed - Opened by TomNicholas over 1 year ago - 1 comment
Labels: bug

#193 - Useful functions not in the Array API Standard

Issue - State: open - Opened by TomNicholas over 1 year ago - 3 comments
Labels: enhancement, array api, xarray-integration

#188 - Convert str to bytes

Pull Request - State: closed - Opened by TomNicholas over 1 year ago - 1 comment

#187 - Use google tensorstore to read/write to zarr?

Issue - State: open - Opened by TomNicholas over 1 year ago - 2 comments
Labels: zarr

#171 - Testing different executors automatically

Issue - State: open - Opened by TomNicholas almost 2 years ago
Labels: runtime

#161 - Dask executor?

Issue - State: closed - Opened by TomNicholas almost 2 years ago - 1 comment
Labels: runtime

#160 - Blockwise memory exceeded when creating random array

Issue - State: closed - Opened by TomNicholas almost 2 years ago - 11 comments
Labels: memory

#153 - np.nanmean executes eagerly on cubed arrays but lazily on dask arrays

Issue - State: open - Opened by TomNicholas almost 2 years ago - 4 comments

#136 - Fuse connected blockwise subgraphs

Issue - State: closed - Opened by tomwhite over 2 years ago - 1 comment
Labels: memory, optimization

#110 - Issue warning if a computation actually used more memory than `max_mem`

Issue - State: open - Opened by tomwhite over 2 years ago
Labels: good first issue, runtime, memory

#80 - Execute tasks for independent pipelines in parallel

Issue - State: closed - Opened by tomwhite over 2 years ago - 3 comments
Labels: runtime, core, optimization

#29 - Implement `var` and `std`

Issue - State: open - Opened by tomwhite over 2 years ago
Labels: good first issue, array api

#14 - Mitigate stragglers

Issue - State: closed - Opened by tomwhite over 2 years ago - 3 comments
Labels: runtime

#7 - Large scale validation testing

Issue - State: closed - Opened by tomwhite almost 3 years ago