Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / temoto/robotstxt issues and pull requests
#40 - TestAgent and Test (for the same user-agent) gives different results in case of temporary error when fetching the robots.txt file
Issue -
State: open - Opened by masonlouchart about 1 year ago
#39 - Add CodeQL workflow for GitHub code scanning
Pull Request -
State: closed - Opened by lgtm-com[bot] about 2 years ago
- 1 comment
#38 - List allow & disallow
Issue -
State: open - Opened by TheUltimateCookie about 2 years ago
- 2 comments
#37 - Mov to latest go
Pull Request -
State: closed - Opened by DoryGuy about 2 years ago
#36 - Make the `AllowAll` and `DisallowAll` instances public
Pull Request -
State: closed - Opened by thewizardplusplus over 2 years ago
- 5 comments
Labels: waiting-for-feedback
#35 - ci: missed coverage report flags
Pull Request -
State: closed - Opened by temoto over 2 years ago
#34 - Initialize field 'Agent' of struct Group
Pull Request -
State: closed - Opened by JVMerkle over 2 years ago
- 8 comments
#33 - Parser not getting sitemap from robots.txt
Issue -
State: closed - Opened by TheUltimateCookie almost 3 years ago
- 2 comments
Labels: resolution-question
#32 - Yet more files now parse
Pull Request -
State: closed - Opened by DoryGuy about 3 years ago
- 2 comments
#31 - Yet more files now parse
Pull Request -
State: closed - Opened by DoryGuy about 3 years ago
- 1 comment
#30 - Fix defaults to for valid files
Pull Request -
State: closed - Opened by DoryGuy about 3 years ago
- 14 comments
#29 - Use strings.TrimRightFunc instead of strings.TrimRight to omit internal rune comparison function allocation
Pull Request -
State: closed - Opened by moredure over 3 years ago
- 13 comments
#28 - sitemaps?
Issue -
State: closed - Opened by hackermondev over 3 years ago
- 1 comment
#27 - optimize Group.findRule
Pull Request -
State: closed - Opened by moredure almost 4 years ago
- 10 comments
#26 - Expose rules Api
Pull Request -
State: closed - Opened by jakesylvestre about 4 years ago
- 4 comments
#25 - Regexp should match full string
Pull Request -
State: closed - Opened by msama over 4 years ago
- 3 comments
Labels: waiting-for-feedback
#24 - Parse rules for a given user agent
Issue -
State: open - Opened by yields about 5 years ago
- 1 comment
#23 - compatible for https://github.com/google/robotstxt
Issue -
State: closed - Opened by exfly over 5 years ago
- 2 comments
Labels: waiting-for-feedback
#22 - Add support for Crawl-Delay
Issue -
State: closed - Opened by moredure over 5 years ago
- 5 comments
Labels: resolution-question
#21 - Incorrect usage of $ symbols
Issue -
State: closed - Opened by lmas about 6 years ago
- 6 comments
#20 - panic: runtime error: invalid memory address or nil pointer dereference
Issue -
State: closed - Opened by crosscue almost 7 years ago
- 9 comments
#19 - Duplicated user agent groups merge
Pull Request -
State: closed - Opened by sergebezborodov over 7 years ago
- 7 comments
Labels: importance-bug
#18 - uhmaybe
Pull Request -
State: closed - Opened by temoto almost 8 years ago
#17 - Speeding up Parse function
Pull Request -
State: closed - Opened by nielsole almost 8 years ago
- 2 comments
#16 - Change import statement or change package name
Issue -
State: closed - Opened by sudotliu over 8 years ago
- 3 comments
#15 - Different behavior on Google Webmaster Tools robots.txt checker and robotstxt-go
Issue -
State: closed - Opened by uforic over 8 years ago
- 3 comments
#14 - 'Host' directive parsing added. It's often used in Yandex to specify …
Pull Request -
State: closed - Opened by brainm over 9 years ago
- 1 comment
#13 - Removed duplication of code when finding a rule
Pull Request -
State: closed - Opened by ujjwalt almost 10 years ago
- 1 comment
#12 - Crash with unicode symbols
Issue -
State: closed - Opened by vad about 10 years ago
- 2 comments
#11 - removed annoying print line
Pull Request -
State: closed - Opened by ghost over 10 years ago
- 1 comment
#10 - No error is returned by FromResponse() when the file is incorrect
Issue -
State: closed - Opened by alexander-bauer about 12 years ago
- 4 comments
#9 - Separate DNS resolve from connect
Issue -
State: closed - Opened by temoto about 12 years ago
- 1 comment
#8 - Tiny optimization in scanner.go
Pull Request -
State: closed - Opened by mynameisfiber about 12 years ago
- 4 comments
#7 - Fixes #6
Pull Request -
State: closed - Opened by mna about 12 years ago
- 1 comment
#6 - Groups are not handled correctly
Issue -
State: closed - Opened by mna about 12 years ago
- 13 comments
#5 - Reduce memory footprint of multiple logically same RobotsData acquired from different inputs
Issue -
State: open - Opened by temoto about 12 years ago
- 2 comments
#4 - empty disallow is allow
Pull Request -
State: closed - Opened by igrigorik over 13 years ago
- 1 comment
#3 - fix allow rule parsing
Pull Request -
State: closed - Opened by igrigorik over 13 years ago
- 1 comment
#2 - parse non-empty robots.txt
Issue -
State: closed - Opened by temoto over 14 years ago
- 1 comment
#1 - fix '//' formatting in README
Issue -
State: closed - Opened by temoto over 14 years ago
- 1 comment