Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / CorentinB/warc issues and pull requests

#55 - Basic DNS fallback

Pull Request - State: closed - Opened by yzqzss 4 months ago - 2 comments

#54 - Correctly closing records when errors occur before sending to channel

Pull Request - State: closed - Opened by NGTmeaty 4 months ago
Labels: bug

#53 - Update default size threshold to 2048 bytes

Pull Request - State: closed - Opened by NGTmeaty 5 months ago
Labels: enhancement

#52 - Fix DNS query string

Pull Request - State: closed - Opened by NGTmeaty 5 months ago

#51 - Stop writing revisit records for 3I42H

Pull Request - State: closed - Opened by NGTmeaty 5 months ago
Labels: enhancement

#50 - Add WARC-Cipher-Suite and WARC-Protocol

Pull Request - State: open - Opened by NGTmeaty 5 months ago

#49 - Add custom DNS resolver

Pull Request - State: closed - Opened by CorentinB 5 months ago
Labels: enhancement

#47 - Add DisableIPv4 & DisableIPv6

Pull Request - State: closed - Opened by CorentinB 5 months ago
Labels: enhancement

#46 - fix: actually verify payload digest when needed.

Pull Request - State: closed - Opened by NGTmeaty 5 months ago

#45 - Remove logrus usage

Pull Request - State: closed - Opened by CorentinB 5 months ago
Labels: enhancement

#44 - Add WARC-Cipher-Suite and WARC-Protocol

Pull Request - State: closed - Opened by NGTmeaty 5 months ago
Labels: enhancement

#43 - Panic on too many open files error, should retry instead

Issue - State: open - Opened by willmhowes 6 months ago - 2 comments

#42 - Use a more up to date UUID library

Pull Request - State: closed - Opened by CorentinB 6 months ago
Labels: enhancement

#41 - ZSTD Dictionary support

Pull Request - State: closed - Opened by NGTmeaty 6 months ago

#40 - Add `WARC-Cipher-Suite` and `WARC-Protocol` WARC headers

Issue - State: open - Opened by NGTmeaty 6 months ago
Labels: enhancement

#39 - Various test improvements

Pull Request - State: closed - Opened by NGTmeaty 6 months ago
Labels: enhancement

#38 - Capture DNS requests

Pull Request - State: closed - Opened by CorentinB 6 months ago
Labels: enhancement

#37 - Support reading more compression formats

Pull Request - State: closed - Opened by yzqzss 7 months ago
Labels: enhancement

#36 - Add dedupe stats

Pull Request - State: closed - Opened by CorentinB 7 months ago

#35 - Add command line utilities

Pull Request - State: closed - Opened by CorentinB 11 months ago

#34 - Add cookie support to CDX request

Pull Request - State: closed - Opened by NGTmeaty about 1 year ago
Labels: bug, enhancement

#33 - Add DNS archiving

Issue - State: closed - Opened by CorentinB over 1 year ago
Labels: enhancement

#32 - DRAFT: Testing improvements

Pull Request - State: closed - Opened by NGTmeaty over 1 year ago

#31 - Improved WARC erroring

Pull Request - State: closed - Opened by NGTmeaty over 1 year ago
Labels: enhancement

#30 - Fix revisit records

Pull Request - State: closed - Opened by CorentinB almost 2 years ago

#29 - Don't write "ERROR" for payload digest in case of error

Pull Request - State: closed - Opened by NGTmeaty about 2 years ago

#28 - Add counter for the total amount of data crawled since startup

Pull Request - State: closed - Opened by CorentinB over 2 years ago

#27 - Fix proxy implementation

Pull Request - State: closed - Opened by CorentinB over 2 years ago - 1 comment

#26 - Update uTLS to the latest version with certificate compression

Pull Request - State: closed - Opened by NGTmeaty over 2 years ago

#25 - Changing our TLS fingerprint

Pull Request - State: closed - Opened by NGTmeaty over 2 years ago
Labels: enhancement

#24 - WARC files with more than one in the pool aren't sequentially number overall

Issue - State: closed - Opened by NGTmeaty over 2 years ago - 1 comment
Labels: enhancement

#23 - Add parallel gzip for payloads over 1MB & parallel WARC writing

Pull Request - State: closed - Opened by CorentinB over 2 years ago

#22 - Add benchmark and calculate Block-Digest on dialer.go

Pull Request - State: closed - Opened by NGTmeaty over 2 years ago - 1 comment
Labels: enhancement

#21 - Move to klauspost/compress/gzip

Pull Request - State: closed - Opened by CorentinB over 2 years ago

#20 - Add a setting to only write to disk

Pull Request - State: closed - Opened by NGTmeaty over 2 years ago
Labels: enhancement

#19 - Add: struct to configure the HTTP client

Pull Request - State: closed - Opened by CorentinB over 2 years ago

#18 - fix: remove nil assignments

Pull Request - State: closed - Opened by fionera over 2 years ago

#17 - feat: Use a pool for spooledTempFile buffers

Pull Request - State: closed - Opened by fionera over 2 years ago

#16 - Add TLS specific things & tempDir

Pull Request - State: closed - Opened by CorentinB over 2 years ago

#14 - Add toggle for verifying HTTP certificates.

Pull Request - State: closed - Opened by NGTmeaty over 2 years ago
Labels: enhancement

#13 - Add error channel

Pull Request - State: closed - Opened by NGTmeaty over 2 years ago

#12 - Remove unused for creating temporary folders

Pull Request - State: closed - Opened by NGTmeaty over 2 years ago

#11 - Ignore CDX errors

Pull Request - State: closed - Opened by NGTmeaty over 2 years ago
Labels: enhancement

#10 - Some minor testing improvements

Pull Request - State: closed - Opened by NGTmeaty over 2 years ago

#9 - Add: goroutine leak detector

Pull Request - State: closed - Opened by CorentinB over 2 years ago

#8 - Memory management fixes

Pull Request - State: closed - Opened by CorentinB over 2 years ago

#7 - Fix memory leak

Pull Request - State: closed - Opened by CorentinB over 2 years ago

#5 - Some small proxy fixes

Pull Request - State: closed - Opened by NGTmeaty almost 3 years ago

#4 - HTTP status code skipping

Pull Request - State: closed - Opened by NGTmeaty almost 3 years ago

#3 - Add: revisit records with local & remote CDX dedupe

Pull Request - State: closed - Opened by CorentinB almost 3 years ago
Labels: enhancement

#2 - Add custom HTTP client writing every requests to WARC files

Pull Request - State: closed - Opened by CorentinB almost 3 years ago

#1 - bzip: fix typo

Pull Request - State: closed - Opened by miku almost 5 years ago - 1 comment