Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / iejMac/clip-video-encode issues and pull requests

#86 - Getting bus error while trying to run example code

Issue - State: open - Opened by vedlettuce 9 months ago

#85 - Use MoVQGAN instead of taming-transformers for tokenization

Pull Request - State: open - Opened by iejMac 11 months ago

#84 - Support nested input format for webdataset

Pull Request - State: closed - Opened by iejMac 11 months ago

#83 - read_shards: generalize and improve

Pull Request - State: closed - Opened by iejMac 12 months ago

#82 - refactor: move code out of cve.py

Pull Request - State: closed - Opened by iejMac 12 months ago

#81 - move things out of clip-video-encode.py

Issue - State: closed - Opened by iejMac 12 months ago - 1 comment

#80 - Improve webdataset code

Issue - State: closed - Opened by iejMac 12 months ago - 2 comments

#79 - Chunk selection modes

Issue - State: open - Opened by iejMac 12 months ago

#78 - clip-video-encode: add target_fps option (video2numpy update)

Pull Request - State: closed - Opened by iejMac about 1 year ago

#77 - clip-video-encode: add VQ-GAN frame tokenization

Pull Request - State: closed - Opened by iejMac about 1 year ago

#76 - remove npz support (no one uses this)

Pull Request - State: closed - Opened by iejMac about 1 year ago

#75 - clip-video-encode: add img_size parameter

Pull Request - State: closed - Opened by imliuruiqi over 1 year ago - 2 comments

#74 - loosen the package version for torch 2.0

Issue - State: open - Opened by imliuruiqi over 1 year ago - 4 comments

#73 - captioning: allow setting params

Pull Request - State: closed - Opened by iejMac over 1 year ago

#72 - ShardWriter: add shard_suffix for external metadata shards

Pull Request - State: closed - Opened by iejMac over 1 year ago

#71 - WebDataset input: pass_through_keys param

Pull Request - State: closed - Opened by iejMac over 1 year ago

#69 - Add CLIP similarity if caption exists + add autocast in FrameMapper

Pull Request - State: closed - Opened by iejMac over 1 year ago - 1 comment

#68 - Add similarity to metadata if caption exists

Pull Request - State: closed - Opened by iejMac over 1 year ago

#67 - Add CoCa captioning

Pull Request - State: closed - Opened by iejMac over 1 year ago

#66 - pass_through_mp4: allow saving mp4 as well

Pull Request - State: closed - Opened by iejMac over 1 year ago

#65 - pass through mp4 in input_format="webdataset"

Issue - State: closed - Opened by iejMac over 1 year ago

#64 - add support for reading WebDataset inputs

Pull Request - State: closed - Opened by danielmend over 1 year ago

#63 - implement reading video2dataset webdataset format

Issue - State: closed - Opened by iejMac over 1 year ago

#62 - clip-video-encode: implement resuming failed runs

Pull Request - State: open - Opened by iejMac almost 2 years ago - 1 comment

#61 - embed the text as well

Issue - State: open - Opened by iejMac almost 2 years ago - 4 comments

#60 - examples: add example of EmbeddingWebDatasetReader usage

Pull Request - State: closed - Opened by danielmend almost 2 years ago

#59 - add example of how to use EmbeddingWebDataset reader with tar files

Issue - State: closed - Opened by iejMac almost 2 years ago

#58 - Questions on Data donwload

Issue - State: closed - Opened by Buzz-Beater almost 2 years ago - 2 comments

#57 - set up resuming for failed runs

Issue - State: open - Opened by iejMac almost 2 years ago - 4 comments

#56 - make chunk size variable (can't use 200 size chunks for H/14 clip)

Issue - State: open - Opened by iejMac almost 2 years ago - 2 comments

#55 - clip-video-encode: fix, take last chunk as well

Pull Request - State: closed - Opened by iejMac almost 2 years ago

#54 - bug fix: each webdataset loses the last 4% of the data

Issue - State: closed - Opened by iejMac almost 2 years ago - 2 comments

#53 - Multi-GPU distribution for models slower than video decoding

Pull Request - State: closed - Opened by iejMac almost 2 years ago

#52 - Fix: Take preprocessing from open_clip + Add sim test

Pull Request - State: closed - Opened by iejMac almost 2 years ago

#51 - change the preprocess so it works with open_clip

Issue - State: closed - Opened by iejMac almost 2 years ago

#50 - multi-gpu distribution

Issue - State: closed - Opened by iejMac almost 2 years ago

#49 - clip-video-encode: shift to open_clip

Pull Request - State: closed - Opened by iejMac almost 2 years ago - 3 comments

#48 - standard process for releasing the best model

Issue - State: closed - Opened by iejMac almost 2 years ago - 1 comment

#47 - cli : replace fire with argparse

Pull Request - State: closed - Opened by AbdullahAlfaraj almost 2 years ago

#46 - README.md, dataset.md + other small updates

Pull Request - State: closed - Opened by iejMac almost 2 years ago

#45 - MultiNode (Slurm) - Allow distributing large datasets creation across multiple Slurm nodes

Pull Request - State: closed - Opened by iejMac almost 2 years ago - 1 comment

#44 - implement multi-node distribution

Issue - State: closed - Opened by iejMac almost 2 years ago

#43 - shift to open_clip

Issue - State: closed - Opened by iejMac almost 2 years ago - 1 comment

#42 - add test for correctness of embeddings

Issue - State: closed - Opened by iejMac about 2 years ago

#41 - update README + examples

Issue - State: closed - Opened by iejMac about 2 years ago

#40 - clip-video-encode: allow setting starting webdataset shard ID for con…

Pull Request - State: closed - Opened by iejMac about 2 years ago - 2 comments

#39 - clip-video-encode: take parquet as input and save metadata

Pull Request - State: closed - Opened by iejMac about 2 years ago - 1 comment

#38 - clip-video-encode: combine video frames into one chunk for more batch…

Pull Request - State: closed - Opened by iejMac about 2 years ago

#37 - writer.py: option to output in WebDataset format

Pull Request - State: closed - Opened by iejMac about 2 years ago

#36 - use argparse in clip-video-encode

Issue - State: closed - Opened by iejMac about 2 years ago - 5 comments

#35 - saving: use fsspec to support other file systems

Pull Request - State: closed - Opened by iejMac about 2 years ago - 3 comments

#34 - Use fsspec to support writing to any file system

Issue - State: closed - Opened by rom1504 about 2 years ago

#33 - LiveNumpyEncoder: improve efficiency

Pull Request - State: closed - Opened by iejMac about 2 years ago

#32 - LiveNumpyEncoder: option to remove files on read

Pull Request - State: closed - Opened by iejMac about 2 years ago

#30 - support for separate multi-node cpu/gpu worker functionality

Issue - State: closed - Opened by iejMac about 2 years ago - 2 comments

#29 - n_workers param

Issue - State: open - Opened by iejMac about 2 years ago - 1 comment

#28 - More output in console from clip-video-encode

Issue - State: open - Opened by iejMac about 2 years ago - 1 comment

#27 - numpy arrays as input format

Issue - State: closed - Opened by iejMac about 2 years ago - 1 comment

#26 - Yuchen : Begin integrating audio extraction into vedio-to-numpy

Pull Request - State: closed - Opened by YuchenHui22314 about 2 years ago

#24 - EmbeddingWebDataset - implement dataset concatenation

Issue - State: open - Opened by iejMac about 2 years ago

#23 - implement video reading using video2numpy

Pull Request - State: closed - Opened by iejMac about 2 years ago

#22 - zero masks don't need to be float64

Issue - State: open - Opened by iejMac about 2 years ago

#21 - EmbeddingWebDatasetReader: add zero masks for standardize_seq_len

Pull Request - State: closed - Opened by iejMac about 2 years ago

#19 - audio support

Issue - State: open - Opened by iejMac about 2 years ago

#18 - Add multiple image encoder support

Issue - State: open - Opened by iejMac about 2 years ago

#17 - Handle different video formats

Issue - State: closed - Opened by iejMac over 2 years ago

#16 - Add example: Thing detector

Pull Request - State: closed - Opened by iejMac over 2 years ago

#15 - EmbeddingWebDatasetReader: create reader for Embedding WebDatasets

Pull Request - State: closed - Opened by iejMac over 2 years ago - 1 comment

#14 - Task Priority Queue

Issue - State: closed - Opened by iejMac over 2 years ago

#13 - Dataset Format: revisions

Pull Request - State: closed - Opened by iejMac over 2 years ago - 2 comments

#12 - Dataset format: revisions

Pull Request - State: closed - Opened by iejMac over 2 years ago

#11 - Put retrieval script somewhere and link it here

Issue - State: open - Opened by rom1504 over 2 years ago

#10 - Put kinectic with right format on hf

Issue - State: closed - Opened by rom1504 over 2 years ago

#9 - Work on dataset.md with output dataset spec

Issue - State: open - Opened by rom1504 over 2 years ago - 4 comments

#8 - video reading bottleneck

Issue - State: closed - Opened by iejMac over 2 years ago - 10 comments

#6 - Revert "Asynchronously Load, Encode, and Save videos for efficiency"

Pull Request - State: closed - Opened by iejMac over 2 years ago

#5 - allow encoding multiple videos to maximize batch size

Pull Request - State: closed - Opened by iejMac over 2 years ago

#4 - Asynchronously Load, Encode, and Save videos for efficiency

Pull Request - State: closed - Opened by iejMac over 2 years ago

#3 - consider supporting streaming / youtube-dl

Issue - State: closed - Opened by rom1504 over 2 years ago - 3 comments

#2 - benchmark performance

Issue - State: closed - Opened by rom1504 over 2 years ago - 3 comments

#1 - improve packaging

Issue - State: closed - Opened by rom1504 over 2 years ago - 1 comment