Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / google/airio issues and pull requests
#100 - Minor fix in noam packing.
Pull Request -
State: closed - Opened by copybara-service[bot] 11 months ago
#99 - Lint mods.
Pull Request -
State: closed - Opened by copybara-service[bot] 12 months ago
#98 - Add benchmarks for lazy_dataset_transforms.
Pull Request -
State: closed - Opened by copybara-service[bot] 12 months ago
#97 - Add benchmarks for preprocessors.
Pull Request -
State: closed - Opened by copybara-service[bot] 12 months ago
#96 - Add tokenizer benchmarks.
Pull Request -
State: closed - Opened by copybara-service[bot] 12 months ago
#95 - Add benchmarks for feature converters.
Pull Request -
State: closed - Opened by copybara-service[bot] 12 months ago
#94 - Internal change.
Pull Request -
State: closed - Opened by copybara-service[bot] 12 months ago
#93 - Add benchmarks for dataset_providers components.
Pull Request -
State: closed - Opened by copybara-service[bot] 12 months ago
#92 - Remove json parsing of iterator state in benchmarks after the type change in #79.
Pull Request -
State: closed - Opened by copybara-service[bot] 12 months ago
#91 - Split up dataset providers tests into their respective classes.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#90 - Add a TPU benchmark that reads from file.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#89 - Internal change.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#88 - Add a simple TPU benchmark for WMT on generated data.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#87 - Add AirIO preprocessors corresponding to seqio.EncDecFeatureConverter.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#86 - Implement conventional SeqIO Feature Converters in py/numpy. Part 1.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#85 - Support mixing LazyDatasetIterators in AirIO.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#84 - Minor fix to Mix LazyIter impl.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#83 - Support preprocessing LazyIterDatasets in AirIO.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#82 - Minor clean up of lazy dataset transformations in AirIO.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#81 - Register MixedLazyMapDataset as a lazy map fn.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#80 - [Minor] Fix packing preprocessor name.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#79 - Support lazy datasets in AirIO's PyGrainDatasetIteratorWrapper.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#78 - Replace "feature_converter" in AirIO with lists of preprocessors.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#77 - Expand runtime args functionality in airio.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#76 - Add a LazyDatasetIter impl for packing.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#75 - Add equivalence tests for true-packing (single and multi-bin).
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#74 - Verify equivalence of t5.data and airio noam-packing on a real dataset.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#73 - Add NoamPacker.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#72 - Add json data source and test file.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#71 - Add a Packer protocol.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#70 - Remove padding of packed elements by default.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#69 - Make marker features optional in packing impl.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#68 - Add strict_packing option to packing impl.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#67 - Allow updating runtime_args between preprocessors.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#66 - Add better documentation to packing impl.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#65 - Add a preprocessor class for packing.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#64 - Move get_task_lazy_dataset to Task class.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#63 - Add common preprocessors - trim and pad.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#62 - Internal change.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#61 - Add ArrayRecordDataSource and update test files.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#60 - Add a lazyiter impl for mixing.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#59 - Add a lazydataset implementation for packing.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#58 - Add benchmarks for DatasetIterators.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#57 - Internal change.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#56 - Add benchmarks for TfdsDataSource.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#55 - Internal change.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#54 - Internal change.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#53 - Internal change.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#52 - Add benchmarks for FunctionDataSource.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#51 - Use `jax.tree_util` for handling structures when available and `tree` otherwise.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#50 - Add visualization to WMT notebook via TensorBoard.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#49 - Add descriptions to the Train with WMT notebook.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#48 - Remove examples from the main import to make example imports explicit.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#47 - Replace relative links with absolute links in examples.md.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#46 - Internal change.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#45 - Move example tasks into examples.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#44 - Add a WMT training example and notebook.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#43 - Remove `parents` attribute from `ConcatLazyMapDataset` after it was added to the superclass in https://github.com/google/grain/pull/275.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#42 - Install from grain-nightly in setup.py.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#41 - Point setup.py targets at GH repos for clu, grain, and seqio.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#40 - [LSC] change uses of jax.random.KeyArray and jax.random.PRNGKeyArray to jax.Array
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#39 - [LSC] change uses of jax.random.KeyArray and jax.random.PRNGKeyArray to jax.Array
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#38 - small test cleanup
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
- 1 comment
#37 - Replace reference to seqio in version_path.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#36 - Import version in __init__.py.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#35 - Add version.py to AirIO.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#34 - Add setup.py to AirIO.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#33 - Add support for pygrain-based AirIO in t5x train.py.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#32 - Remove the `sparse` property from `LazyMapDataset` classes after it was removed from Grain in [grain/#270](https://github.com/google/grain/pull/270).
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#31 - Add seqio to pygrain feature converter logic
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#30 - export airio.preprocessors at module level
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#29 - Add get_vocabulary method for AirIO tasks and mixtures
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#28 - Add support for peek() and peek_async() in dataset iterator wrapper
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#27 - Remove use of `grain.TfdsDataSource()`.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#26 - No public description
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
- 1 comment
#25 - Expose airio dataset iterators directly at package level
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#24 - Minor fix for upstream grain changes.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#23 - Support preprocessor args injected at runtime in airio Task and Mixture.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#22 - Implement reproducible stochastic lazy dataset transforms.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#21 - Support mixtures of mixtures in AirIO.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#20 - Implement sharding, shuffling and repeating in AirIO Mixture.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#19 - Move batching out of feature converter
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#18 - Use __getitem__ instead of __iter__ for reproducible stochastic behavior.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#17 - Add shard and concat lazy_dataset transforms.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#16 - Implement AirIO Mixture (part 1)
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#15 - Add helper to convert pygrain Transforms to LazyDatasets.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#14 - Add convenience classes for RandomMap and Filter preprocessors.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#13 - Use grain.Tranformation for preprocessors instead of grain.Operation.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#12 - Create AirIO-specific ShardInfo instead of relying on SeqIO
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#11 - Get rid of setter methods in Task class and make Task immutable again
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#10 - Add TaskBuilder for creating tasks step by step and copying from existing task
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#9 - Clean up dataset providers tests.
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#8 - Fix feature converter to have a full functioning task flow
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#7 - Get rid of seqio to grain converter for feature converter
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#6 - Get rid of _create_task and construct tasks directly
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
#5 - Add sort-of builder pattern to support partial task specs
Pull Request -
State: closed - Opened by copybara-service[bot] about 1 year ago
- 1 comment
#4 - Add notebooks for quickstart and inspection examples.
Pull Request -
State: closed - Opened by copybara-service[bot] over 1 year ago
#3 - Add detail to example descriptions.
Pull Request -
State: closed - Opened by copybara-service[bot] over 1 year ago
#2 - Create test.md
Pull Request -
State: closed - Opened by texasmichelle over 1 year ago
#1 - Internal.
Pull Request -
State: closed - Opened by texasmichelle over 1 year ago