Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / bopoda/robots-txt-parser issues and pull requests

#68 - Parsing rules is platform dependent

Issue - State: open - Opened by Emosewaj 8 months ago

#67 - Init php.yml for github actions

Pull Request - State: open - Opened by bopoda about 1 year ago

#66 - tests: Get rid of phpunit deprecations, migrate phpunit configuration

Pull Request - State: closed - Opened by bopoda about 1 year ago
Labels: tests

#65 - add supported php 8

Pull Request - State: closed - Opened by tacman about 1 year ago - 1 comment

#64 - remove $ so gitclip works

Pull Request - State: closed - Opened by tacman about 1 year ago - 1 comment

#63 - Wrong boolean value in RobotsTxtValidator.php?

Issue - State: open - Opened by scott8035 over 1 year ago - 1 comment

#62 - Fix Crawl-Delay issue

Pull Request - State: closed - Opened by bopoda over 3 years ago

#61 - Fixed deprecation

Pull Request - State: closed - Opened by lyrixx almost 4 years ago - 1 comment

#60 - Fix deprecation about usort

Issue - State: closed - Opened by lyrixx almost 4 years ago

#59 - Crawl Delay of 0 will get ignored

Issue - State: closed - Opened by offsky almost 4 years ago - 1 comment

#58 - Avoid possible Compilation failed errors when run regexp for isUrlAllow

Pull Request - State: closed - Opened by bopoda over 5 years ago

#57 - Fix travisCI builds

Pull Request - State: closed - Opened by bopoda over 5 years ago

#56 - Fix of not allowed char

Pull Request - State: closed - Opened by phenixiim over 5 years ago - 3 comments

#55 - Added composer.json file and fixed file structure

Pull Request - State: closed - Opened by bopoda about 6 years ago

#54 - Fixed error when a directive is empty

Pull Request - State: closed - Opened by lyrixx about 6 years ago

#53 - Could you publish this package to packagist ?

Issue - State: closed - Opened by lyrixx about 6 years ago - 6 comments

#52 - fix .travis.yml use trusty Ubuntu 14.04

Pull Request - State: closed - Opened by bopoda over 7 years ago

#51 - Resolve Issue #43

Pull Request - State: closed - Opened by LeMoussel almost 8 years ago - 3 comments

#50 - Directive with '+' not handled correctly, escape '+', resolve #48

Pull Request - State: closed - Opened by bopoda almost 8 years ago

#49 - Add test cases according to Google robots.txt tester

Pull Request - State: closed - Opened by bopoda almost 8 years ago

#48 - Directive with '+' not handled correctly

Issue - State: closed - Opened by LeMoussel almost 8 years ago - 1 comment
Labels: bug, RobotsTxtValidator

#47 - Handle list of user-agents

Pull Request - State: closed - Opened by bopoda almost 8 years ago

#46 - Order of precedence for google user agents

Issue - State: closed - Opened by kennylajara almost 8 years ago - 7 comments
Labels: RobotsTxtValidator

#45 - Update README.md (Solve #42)

Pull Request - State: closed - Opened by kennylajara almost 8 years ago - 1 comment

#44 - Add phpunit tests with cases from t1gor/Robots.txt-Parser-Class

Pull Request - State: closed - Opened by bopoda almost 8 years ago

#43 - Problems with iconv()

Issue - State: closed - Opened by LeMoussel almost 8 years ago - 2 comments
Labels: RobotsTxtParser

#42 - Language and version

Issue - State: closed - Opened by kennylajara almost 8 years ago - 3 comments

#41 - Fixing Typo

Pull Request - State: closed - Opened by kennylajara almost 8 years ago - 1 comment

#40 - crowndiamond.org/robots.txt why empty rules parsed?

Issue - State: closed - Opened by bopoda almost 8 years ago - 1 comment
Labels: bug, RobotsTxtParser

#39 - RobotsTxtParser significantly improve performance (~1000x)

Pull Request - State: closed - Opened by bopoda almost 8 years ago

#38 - Rename tests use prefix Test

Pull Request - State: closed - Opened by bopoda almost 8 years ago

#37 - Fix phpunit tests, compatible with different phpunit versions

Pull Request - State: closed - Opened by bopoda almost 8 years ago

#36 - No user agent

Pull Request - State: closed - Opened by LeMoussel almost 8 years ago - 3 comments

#35 - Add tests for invalid encoding robots.txt

Pull Request - State: closed - Opened by bopoda almost 8 years ago

#34 - Rules not handled correctly if dont't find User Agent

Issue - State: closed - Opened by LeMoussel almost 8 years ago

#33 - Resolve iconv() notice error

Pull Request - State: closed - Opened by LeMoussel almost 8 years ago - 1 comment

#32 - Rule: host not handled

Issue - State: closed - Opened by LeMoussel almost 8 years ago - 1 comment

#31 - Get relative url

Pull Request - State: closed - Opened by LeMoussel almost 8 years ago - 1 comment

#30 - isUrlAllow() not handled correctly if no path in Url.

Issue - State: closed - Opened by LeMoussel almost 8 years ago - 1 comment

#29 - Handle noindex directive

Pull Request - State: closed - Opened by LeMoussel almost 8 years ago - 2 comments

#28 - Handle noindex directive

Pull Request - State: closed - Opened by LeMoussel almost 8 years ago

#27 - Rules not handled correctly

Issue - State: closed - Opened by LeMoussel about 8 years ago - 6 comments
Labels: bug

#26 - Rule: noindex not handled

Issue - State: closed - Opened by LeMoussel about 8 years ago - 1 comment

#25 - Remove comments in content

Issue - State: closed - Opened by LeMoussel about 8 years ago - 1 comment

#24 - Check valid content

Issue - State: open - Opened by LeMoussel about 8 years ago - 2 comments
Labels: help wanted

#23 - RobotsTxtParser make values case-sensitive

Pull Request - State: closed - Opened by bopoda about 8 years ago

#22 - add test cases from google specification

Pull Request - State: closed - Opened by bopoda about 8 years ago

#21 - add phpunit tests from google robots examples

Pull Request - State: closed - Opened by bopoda about 8 years ago

#20 - Poor perfomance when parsing large file.

Issue - State: closed - Opened by LeMoussel about 8 years ago - 2 comments

#19 - add 2 tests to check isUrlAllow

Pull Request - State: closed - Opened by bopoda about 8 years ago

#18 - Optimize isUrlAllow()

Pull Request - State: closed - Opened by LeMoussel about 8 years ago - 2 comments
Labels: enhancement

#17 - Some robots.txt files for robustness testing

Issue - State: closed - Opened by LeMoussel about 8 years ago - 1 comment

#16 - Typo on directive

Issue - State: open - Opened by LeMoussel about 8 years ago - 6 comments
Labels: enhancement

#15 - Remove asterisk (*) at the end of path.

Issue - State: open - Opened by LeMoussel about 8 years ago - 3 comments
Labels: enhancement

#14 - IsUrlAllow Google test

Issue - State: closed - Opened by LeMoussel about 8 years ago - 8 comments

#13 - Sorted robots.txt

Issue - State: closed - Opened by LeMoussel about 8 years ago - 2 comments
Labels: help wanted

#12 - Poor performance isUrlAllow() function

Issue - State: closed - Opened by LeMoussel about 8 years ago - 6 comments
Labels: enhancement

#11 - init RobotsTxtValidator with isUrlAllow method and phpunit

Pull Request - State: closed - Opened by bopoda about 8 years ago

#10 - need to have 2 methods (isUrlAllow, isUrlDisallow) to check is url allow or not

Issue - State: closed - Opened by bopoda about 8 years ago - 1 comment
Labels: feature

#9 - Check valid path

Issue - State: open - Opened by LeMoussel about 8 years ago - 6 comments
Labels: enhancement

#8 - Get Url sitemaps: added getSitemaps method. Resolve #7

Pull Request - State: closed - Opened by bopoda about 8 years ago - 3 comments

#7 - Get Url sitemaps

Issue - State: closed - Opened by LeMoussel about 8 years ago - 3 comments
Labels: feature

#6 - Save User-Agent as is without removing whitespaces Fixes #5

Pull Request - State: closed - Opened by bopoda about 8 years ago

#5 - Suppress space in User_Agent

Issue - State: closed - Opened by LeMoussel about 8 years ago - 1 comment
Labels: bug

#4 - improve new line function and add some http tests

Pull Request - State: closed - Opened by bopoda about 10 years ago

#3 - Запоминаем абсолютные пути как есть

Pull Request - State: closed - Opened by bopoda about 10 years ago

#2 - Не обрабатывать громадные файлы robots.txt

Issue - State: closed - Opened by bopoda about 10 years ago - 1 comment
Labels: wontfix, feature