Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / NVIDIA/Megatron-Energon issues and pull requests
#53 - Release 5.1.0
Pull Request -
State: closed - Opened by voegtlel 9 days ago
#52 - Adding a new dataset while training
Issue -
State: open - Opened by Griffintaur 10 days ago
#51 - New dataset joining and pre-indexed joined tar iteration
Pull Request -
State: open - Opened by philipp-fischer 12 days ago
#50 - feat: Use Multi-Storage Client in Energon
Pull Request -
State: open - Opened by shunjiad 15 days ago
#49 - Reduce checkpoint size by not saving the pending shards
Pull Request -
State: closed - Opened by voegtlel 18 days ago
#48 - Improve serialization of EPath objects
Issue -
State: open - Opened by philipp-fischer 18 days ago
#47 - Compute pending worker shards on-the-fly
Issue -
State: open - Opened by philipp-fischer 18 days ago
#46 - Extend docs with example for interleaved data samples
Pull Request -
State: open - Opened by voegtlel 18 days ago
#45 - Rename "prepare()" in metadatasets to "post_initialize()"
Pull Request -
State: open - Opened by philipp-fischer 19 days ago
#44 - Release 5.0.0
Pull Request -
State: closed - Opened by voegtlel 23 days ago
#43 - Cleanup SavableLoader's save and restore state methods
Pull Request -
State: closed - Opened by voegtlel 25 days ago
#42 - Check black, isort and license header
Pull Request -
State: closed - Opened by voegtlel 25 days ago
- 1 comment
#41 - Accurate Metadataset Epoch
Pull Request -
State: closed - Opened by voegtlel 26 days ago
#40 - Change default for gc freeze to True for much higher speed
Pull Request -
State: closed - Opened by voegtlel 26 days ago
#39 - Fixed size formatting when reaching edge case of size > PiB
Pull Request -
State: closed - Opened by nvnbagrov 27 days ago
- 1 comment
#38 - add efficient AV decoding
Pull Request -
State: open - Opened by jon-barker about 1 month ago
#37 - Refactor Docs
Pull Request -
State: closed - Opened by philipp-fischer about 1 month ago
#36 - Refactor worker_config: All datasets should have one
Pull Request -
State: closed - Opened by philipp-fischer 2 months ago
#35 - Image loading in binary format with sample_loader.py in energon v4.0.0
Issue -
State: closed - Opened by dhkim0225 2 months ago
- 4 comments
#34 - Fix warnings and errors in docs. Autodoc working again.
Pull Request -
State: closed - Opened by philipp-fischer 2 months ago
#33 - Fix zero worker determinism with custom task encoder randomness
Pull Request -
State: closed - Opened by philipp-fischer 2 months ago
#32 - Improve distribution of samples to workers when using many datasets
Pull Request -
State: closed - Opened by philipp-fischer 2 months ago
#31 - Fix the implementation of grouped batching
Pull Request -
State: closed - Opened by voegtlel 2 months ago
#30 - Release 4.0.0
Pull Request -
State: closed - Opened by voegtlel 3 months ago
#29 - Replace the dataset type in the dataset.yaml by sample type directly
Pull Request -
State: closed - Opened by voegtlel 3 months ago
#28 - How to support text-only dataset (GPTDataset)?
Issue -
State: closed - Opened by leondada 3 months ago
- 4 comments
#27 - Apply asyn hotfix for a new bugfix release
Pull Request -
State: closed - Opened by philipp-fischer 3 months ago
#26 - Hotfix: After fork, only reset fsspec asyn loop if it has been initialized
Pull Request -
State: closed - Opened by philipp-fischer 3 months ago
#25 - License check as unit test
Issue -
State: closed - Opened by philipp-fischer 3 months ago
- 2 comments
#24 - Docs: Some tutorials need an update
Issue -
State: closed - Opened by philipp-fischer 3 months ago
- 1 comment
#23 - Fix randomness when num_workers=0
Issue -
State: closed - Opened by philipp-fischer 3 months ago
- 1 comment
#22 - Merge develop to main for releasing 3.0.0
Pull Request -
State: closed - Opened by philipp-fischer 4 months ago
#21 - info command
Pull Request -
State: closed - Opened by voegtlel 4 months ago
- 1 comment
#20 - Enable adding of additional data by merging another dataset
Pull Request -
State: closed - Opened by voegtlel 4 months ago
#20 - Enable adding of additional data by merging another dataset
Pull Request -
State: closed - Opened by voegtlel 4 months ago
#19 - Assert that dataset is restorable when using SavableLoader
Issue -
State: open - Opened by philipp-fischer 4 months ago
#18 - Slow-filling buffers
Issue -
State: open - Opened by voegtlel 4 months ago
#17 - Training Schedule / Curriculum
Issue -
State: open - Opened by voegtlel 4 months ago
#16 - Broadcasting Data Loader
Issue -
State: open - Opened by philipp-fischer 4 months ago
#15 - Weighted Samples
Issue -
State: open - Opened by lvoegtle 5 months ago
#14 - Accurate Metadataset Epoch
Issue -
State: closed - Opened by lvoegtle 5 months ago
#13 - Sample Range for Metadataset
Issue -
State: open - Opened by lvoegtle 5 months ago
- 1 comment
#12 - Introduce sequence packing and sample restore
Pull Request -
State: closed - Opened by philipp-fischer 5 months ago
#11 - Allow for reproducible scaling with different micro batch size
Pull Request -
State: closed - Opened by philipp-fischer 5 months ago
#10 - [feature request] support different webdataset format
Issue -
State: closed - Opened by ethanhe42 5 months ago
- 2 comments
#9 - Merge develop to main for release 2.3.0
Pull Request -
State: closed - Opened by philipp-fischer 6 months ago
#8 - Merge develop to main for release
Pull Request -
State: closed - Opened by philipp-fischer 6 months ago
#7 - Fix gc_init_worker for ShardedTensor
Pull Request -
State: closed - Opened by philipp-fischer 6 months ago
#6 - Fix dataloader being stuck iterating samples in a certain condition
Pull Request -
State: closed - Opened by voegtlel 6 months ago
#5 - Slicing batch feature and refactoring for better restore key support
Pull Request -
State: closed - Opened by voegtlel 6 months ago
#4 - Support loading datasets via dict() & update SimilarityInterleaved
Pull Request -
State: closed - Opened by paul-gibbons 7 months ago
#3 - Fix epath with relative usage
Pull Request -
State: closed - Opened by voegtlel 7 months ago
#2 - Feat: Relax checks for restoring a sample
Pull Request -
State: closed - Opened by voegtlel 7 months ago
- 2 comments
#1 - Update README.md
Pull Request -
State: closed - Opened by philipp-fischer 9 months ago