rom1504/img2dataset issues and pull requests

#436 - Use a Reasonable User Agent

Issue - State: open - Opened by solonovamax 20 days ago - 1 comment

#435 - How to download image files from Laion-5b?

Issue - State: closed - Opened by laolongboy about 1 month ago - 1 comment

#434 - why still add ray.remote to download when use ray as distributer？

Issue - State: open - Opened by caohan25 2 months ago

#433 - --resize_mode "center_crop" fails due to change in albumentations

Issue - State: open - Opened by jonasricker 4 months ago

#432 - albumentations/check_version.py", line 29, in fetch_version_info urllib.error.URLError: <urlopen error [Errno 101] Network is unreachable> ERROR:albumentations.check_version:Error fetching version info

Issue - State: open - Opened by lucasjinreal 4 months ago

#431 - pyarrow.lib.ArrowInvalid: CSV parse error: Expected 1 columns, got 2: https://rmrbcmsonline.peopleapp.com/upload/ueditor/image/20200914/a_490014455258673152.jpg?x-oss ...

Issue - State: open - Opened by lucasjinreal 4 months ago

#430 - I want to know what this means?

Issue - State: open - Opened by jiamingzhang94 4 months ago - 1 comment

#429 - make wandb job name configurable

Pull Request - State: open - Opened by gabrielilharco 5 months ago

#428 - Support read image from local path

Issue - State: open - Opened by thesby 5 months ago - 2 comments

#427 - [DRAFT] feat: allow fixed resize

Pull Request - State: open - Opened by borisdayma 5 months ago

#426 - pyarrow.lib.ArrowInvalid: No match for FieldRef.Name(URL) in sample_id: double

Issue - State: open - Opened by LIUYUANWEI98 6 months ago - 1 comment

#425 - Bump pytest from 8.0.0 to 8.2.0

Pull Request - State: open - Opened by dependabot[bot] 6 months ago
Labels: dependencies

#424 - Bump black from 24.1.1 to 24.4.2

Pull Request - State: open - Opened by dependabot[bot] 6 months ago
Labels: dependencies

#423 - Bump black from 24.1.1 to 24.4.1

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago - 1 comment
Labels: dependencies

#422 - Bump mypy from 1.8.0 to 1.10.0

Pull Request - State: open - Opened by dependabot[bot] 6 months ago
Labels: dependencies

#421 - Decompressing the downloaded tar file is very slow

Issue - State: open - Opened by Nastu-Ho 7 months ago - 2 comments

#420 - Bump black from 24.1.1 to 24.4.0

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago - 1 comment
Labels: dependencies

#419 - s3 paths in url_list are not supported

Issue - State: open - Opened by BennySemyonovAB 7 months ago - 1 comment

#418 - Question about LAION-400M

Issue - State: open - Opened by BIGBALLON 7 months ago

#417 - The success rate when downloading the sbu data set is extremely low at 0

Issue - State: open - Opened by lcj-la 7 months ago - 1 comment

#416 - Fix usage example in README

Pull Request - State: open - Opened by johnbradley 8 months ago

#415 - placekitten.com example in README fails to download images

Issue - State: open - Opened by johnbradley 8 months ago - 1 comment

#414 - Bump black from 24.1.1 to 24.3.0

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#413 - Is the field 'similarity' in Parquet file referring to the cosine similarity of the feature representations of image-text pairs? How is this metric computed?

Issue - State: open - Opened by gobigrassland 8 months ago

#412 - Update fire requirement from <0.6.0,>=0.4.0 to >=0.4.0,<0.7.0

Pull Request - State: open - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#411 - Bump pytest from 8.0.0 to 8.1.1

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#410 - Bump mypy from 1.8.0 to 1.9.0

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#409 - Bump pytest from 8.0.0 to 8.0.2

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#408 - Bump pylint from 3.0.3 to 3.1.0

Pull Request - State: open - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#407 - Why I can't download laion400M dataset?

Issue - State: open - Opened by SomnusQue 9 months ago - 3 comments

#406 - Fix glob pattern when gcs url path has a trailing slash

Pull Request - State: closed - Opened by kafonek 9 months ago - 1 comment

#405 - GCS url_path either not recognized as directory or mangled glob

Issue - State: closed - Opened by kafonek 9 months ago - 1 comment

#404 - Bump pytest from 8.0.0 to 8.0.1

Pull Request - State: closed - Opened by dependabot[bot] 9 months ago - 1 comment
Labels: dependencies

#403 - Bump black from 24.1.1 to 24.2.0

Pull Request - State: closed - Opened by dependabot[bot] 9 months ago - 1 comment
Labels: dependencies

#402 - Download hangs at End

Issue - State: open - Opened by zanussbaum 9 months ago

#401 - laion-coco is not available

Issue - State: open - Opened by vanpersie32 9 months ago

#400 - Low success rate on donwloading laion400m

Issue - State: open - Opened by tchaton 9 months ago - 26 comments

#399 - Bump black from 24.1.0 to 24.1.1

Pull Request - State: closed - Opened by dependabot[bot] 9 months ago
Labels: dependencies

#398 - Bump pytest from 7.4.4 to 8.0.0

Pull Request - State: closed - Opened by dependabot[bot] 9 months ago
Labels: dependencies

#397 - Option to ignore SSL certificate

Pull Request - State: open - Opened by theophilegervet 9 months ago - 1 comment

#396 - Option to ignore SSL certificate

Pull Request - State: closed - Opened by theophilegervet 9 months ago

#395 - Implement mode to retry failed urls of all shards

Issue - State: open - Opened by rom1504 9 months ago - 1 comment

#394 - Bump black from 23.12.1 to 24.1.0

Pull Request - State: closed - Opened by dependabot[bot] 9 months ago
Labels: dependencies

#393 - pyarrow.lib.ArrowInvalid: Empty CSV file

Issue - State: open - Opened by R-Sheldon 10 months ago

#392 - Update pyarrow requirement from <15,>=6.0.1 to >=6.0.1,<16

Pull Request - State: closed - Opened by dependabot[bot] 10 months ago
Labels: dependencies

#391 - cc3m dataset

Issue - State: closed - Opened by lv-0413 10 months ago - 3 comments

#390 - Added new parameter 'compute_key'

Pull Request - State: open - Opened by edwardguil 10 months ago - 3 comments

#389 - Update README.md

Pull Request - State: open - Opened by kshitijkg 10 months ago

#388 - Added incremental mode 'extend'

Pull Request - State: closed - Opened by rom1504 10 months ago - 3 comments