fgnt/lazy_dataset issues and pull requests

#65 - add from_file

Pull Request - State: closed - Opened by boeddeker 1 day ago

#64 - fix assess in DynamicTimeSeriesBucket when max_total_size is used

Pull Request - State: open - Opened by JanekEbb 11 months ago - 3 comments

#63 - Add TileDataset

Pull Request - State: open - Opened by alexanderwerning about 1 year ago - 1 comment

#62 - Database: Improve one exception and add alias property

Pull Request - State: closed - Opened by boeddeker about 1 year ago - 1 comment

#61 - merge_database_dicts: Fix copy overhead

Pull Request - State: closed - Opened by boeddeker over 1 year ago - 1 comment

#60 - JsonDatabase: add reduce to support pickle (Useful for mpi)

Pull Request - State: closed - Opened by boeddeker over 1 year ago - 1 comment

#59 - Create doc folder and add immutability options

Pull Request - State: closed - Opened by mdeegen over 1 year ago - 1 comment

#58 - Bugfix for single thread prefetch with buffersize of 1 and a cancel of the loop

Pull Request - State: closed - Opened by boeddeker over 1 year ago

#57 - Add terminate to perfetch on GeneratorExit

Pull Request - State: closed - Opened by boeddeker over 1 year ago - 1 comment

#56 - add database json helper for the cli

Pull Request - State: closed - Opened by boeddeker over 1 year ago - 2 comments

#55 - ToDo: Serialize pickle byte code in numpy array, reduce multiprocessing memory usage

Issue - State: open - Opened by boeddeker almost 2 years ago

#54 - add max_buffer_size and drop python 3.6

Pull Request - State: closed - Opened by JanekEbb almost 2 years ago - 1 comment

#53 - Add a cycle method that repeats a dataset indefinitely

Pull Request - State: closed - Opened by thequilo over 2 years ago - 6 comments

#52 - Fix indexable property of BatchDataset

Pull Request - State: closed - Opened by michael-kuhlmann over 2 years ago - 1 comment

#51 - Add missing import and improved documentation

Pull Request - State: closed - Opened by boeddeker over 2 years ago

#50 - add ApplyDataset and lazy option to apply method

Pull Request - State: closed - Opened by boeddeker almost 3 years ago - 1 comment

#49 - Add from_dataset and support for new(dataset)

Pull Request - State: closed - Opened by thequilo almost 3 years ago - 1 comment

#48 - add test_signature and sync signatures

Pull Request - State: closed - Opened by boeddeker almost 3 years ago - 1 comment

#47 - add ItemsDataset to support .items() also when keys aren't available (e.g. some are filtered based on value).

Pull Request - State: closed - Opened by boeddeker about 3 years ago - 1 comment

#46 - Support lazy_dataset.new(other_dataset)

Issue - State: closed - Opened by thequilo about 3 years ago - 5 comments

#45 - Support items for non-indexable datasets

Issue - State: closed - Opened by thequilo about 3 years ago - 1 comment

#44 - log filtered examples

Pull Request - State: closed - Opened by JanekEbb over 3 years ago - 1 comment

#43 - Add hit counter to ProfilingDataset

Pull Request - State: closed - Opened by thequilo almost 4 years ago

#42 - Add single thread fallback implementation for PrefetchDataset to supp…

Pull Request - State: closed - Opened by boeddeker almost 4 years ago

#41 - fix str(DiskCacheDataset(...)) and some minor improvements

Pull Request - State: closed - Opened by boeddeker almost 4 years ago

#40 - a few improvements to avoid exploding memory and computations when us…

Pull Request - State: closed - Opened by JanekEbb almost 4 years ago - 2 comments

#39 - add batch_map method

Pull Request - State: closed - Opened by JanekEbb almost 4 years ago - 1 comment

#38 - Minor improvements

Pull Request - State: closed - Opened by boeddeker almost 4 years ago - 1 comment

#37 - Fix KeyError if ConcatenateDataset getitem out of range

Pull Request - State: closed - Opened by thequilo almost 4 years ago

#36 - Allow using json_path and database_dict as keyword args in databases

Pull Request - State: closed - Opened by thequilo about 4 years ago

#35 - Create python-package.yml

Pull Request - State: closed - Opened by boeddeker about 4 years ago - 1 comment

#34 - Add support for multiple JSONs to JsonDatabase

Pull Request - State: closed - Opened by thequilo about 4 years ago - 1 comment

#33 - make intersperse work with non-indexable datasets when len is defined

Pull Request - State: closed - Opened by JanekEbb over 4 years ago

#32 - Add DiskCacheDataset

Pull Request - State: closed - Opened by thequilo over 4 years ago

#31 - Add cache functionality

Pull Request - State: closed - Opened by thequilo over 4 years ago - 2 comments

#30 - add IntersperseDataset

Pull Request - State: closed - Opened by JanekEbb over 4 years ago - 1 comment

#29 - fix DynamicBucketDataset to work with buckets which complete at size …

Pull Request - State: closed - Opened by JanekEbb over 4 years ago

#28 - add ProfilingDataset

Pull Request - State: closed - Opened by boeddeker almost 5 years ago - 1 comment

#27 - Add comparison with PyTorch's DataLoader

Pull Request - State: closed - Opened by michael-kuhlmann almost 5 years ago - 4 comments

#26 - update for the private get_dataset function

Pull Request - State: closed - Opened by jensheit almost 5 years ago - 4 comments

#25 - add private get_dataset function

Pull Request - State: closed - Opened by jensheit almost 5 years ago - 2 comments

#24 - enable doctests, add name argument and fix ReShuffleDataset with random state

Pull Request - State: closed - Opened by boeddeker almost 5 years ago - 2 comments

#23 - Fix name type bug

Pull Request - State: closed - Opened by tglarner almost 5 years ago - 1 comment

#22 - Migrate database tests

Pull Request - State: closed - Opened by tglarner almost 5 years ago - 1 comment

#21 - rename it (iterator) to ds (dataset)

Pull Request - State: closed - Opened by boeddeker about 5 years ago - 2 comments

#20 - adapt ZipDataset to buildin zip behavior and add KeyZipDataset.

Pull Request - State: closed - Opened by JanekEbb about 5 years ago - 1 comment

#19 - Add get_examples method to database…

Pull Request - State: closed - Opened by JanekEbb over 5 years ago - 1 comment

#18 - introduce bucket classes to allow custom bucketing strategies

Pull Request - State: closed - Opened by JanekEbb over 5 years ago

#17 - add Database class

Pull Request - State: closed - Opened by boeddeker over 5 years ago - 2 comments

#16 - Documentation

Pull Request - State: closed - Opened by thequilo over 5 years ago - 2 comments

#15 - Give PrefetchDataset a length

Pull Request - State: closed - Opened by thequilo over 5 years ago - 1 comment

#14 - extend DynamicBucketDataset and add methods for bucketing

Pull Request - State: closed - Opened by JanekEbb over 5 years ago - 2 comments

#13 - introduce indexable and delete ShuffleDataset

Pull Request - State: closed - Opened by boeddeker over 5 years ago - 2 comments

#12 - support numpy like concaternate

Pull Request - State: closed - Opened by boeddeker over 5 years ago - 2 comments

#11 - Support numpy-style interface for methods and factory functions.

Issue - State: open - Opened by tglarner over 5 years ago - 1 comment

#10 - Add free-standing function to concatenate datasets

Pull Request - State: closed - Opened by tglarner over 5 years ago - 7 comments