taganaka/polipus issues and pull requests

#72 - Edit regular expression in charge of removing anchor, simply add 'colon'

Pull Request - State: open - Opened by ABrisset about 9 years ago

#71 - Unicode pages does not work anymore on 0.5.0

Issue - State: open - Opened by nengine about 9 years ago - 9 comments

#70 - Propagate user_data values from redis message to fetched pages.

Pull Request - State: closed - Opened by stefanofontanelli about 9 years ago

#69 - Update AUTHORS.md

Pull Request - State: closed - Opened by lepek about 9 years ago

#68 - Issue #67 MongoDB driver ~> 2.0.6 compatible.

Pull Request - State: closed - Opened by lepek over 9 years ago - 2 comments

#67 - Make it work with Mongo 2.x

Issue - State: closed - Opened by lepek over 9 years ago - 2 comments

#66 - Support for headless crawling

Issue - State: open - Opened by sandeepravi over 9 years ago

#65 - [Question] Using MongoDB as 'cache' aside of Redis

Issue - State: closed - Opened by anawolak over 9 years ago

#64 - Check for invalid uri in redirects

Pull Request - State: closed - Opened by pcboy over 9 years ago

#63 - If rethinkdb can't find the db, create it

Pull Request - State: closed - Opened by pcboy over 9 years ago - 2 comments

#62 - added the ability to use list user agents

Pull Request - State: closed - Opened by parallel588 over 9 years ago - 1 comment

#61 - Fixes #40 invalid byte sequence in page#to_absolute

Pull Request - State: closed - Opened by pcboy over 9 years ago - 3 comments

#60 - Revert 59 fix utf8 support

Pull Request - State: closed - Opened by pcboy over 9 years ago - 1 comment

#59 - Fix #58: Support for non UTF-8 pages.

Pull Request - State: closed - Opened by pcboy over 9 years ago - 1 comment

#58 - Support for other charsets than UTF-8

Issue - State: closed - Opened by pcboy over 9 years ago - 1 comment

#57 - Anchor links converted to %23 causing 404 errors

Issue - State: open - Opened by ABrisset over 9 years ago
Labels: bug

#56 - RethinkDB Storage

Pull Request - State: closed - Opened by nofxx over 9 years ago

#55 - RethinkDB Storage

Issue - State: closed - Opened by nofxx almost 10 years ago - 2 comments

#54 - Update gems & organize spec

Pull Request - State: closed - Opened by nofxx almost 10 years ago - 3 comments

#53 - Use svg versions of badges [ci skip]

Pull Request - State: closed - Opened by tmaier about 10 years ago - 1 comment

#52 - Cannot use with mongoid ~> 4.0.0

Issue - State: open - Opened by nengine about 10 years ago - 5 comments
Labels: enhancement

#51 - Fix cookie acceptance when Set-Cookie is nil

Pull Request - State: closed - Opened by Proffard about 10 years ago - 3 comments

#50 - SocketError could mean, domain is gone or no internet connection

Issue - State: open - Opened by tmaier about 10 years ago

#49 - Add support for all redirect status codes

Pull Request - State: closed - Opened by tmaier about 10 years ago - 2 comments

#48 - Cannot install on JRuby 1.7.13. Error with bson_ext-1.9.2

Issue - State: open - Opened by nengine about 10 years ago - 9 comments

#47 - Kill s3 entirely, use Fog, yo!

Issue - State: open - Opened by taganaka about 10 years ago
Labels: enhancement

#46 - [WIP] Plugins architecture proposal

Pull Request - State: open - Opened by taganaka over 10 years ago - 4 comments

#45 - QueueOverflow refactoring

Pull Request - State: closed - Opened by taganaka over 10 years ago - 7 comments

#44 - Fix typo in Cleaner plugin

Pull Request - State: closed - Opened by janpieper over 10 years ago - 2 comments

#43 - Whitelist start urls?

Issue - State: open - Opened by janpieper over 10 years ago - 1 comment
Labels: question

#42 - removing s3 storage from mainstream

Pull Request - State: closed - Opened by taganaka over 10 years ago - 2 comments

#41 - # encoding: UTF-8 for all

Pull Request - State: closed - Opened by taganaka over 10 years ago

#40 - invalid byte sequence in US-ASCII (ArgumentError)

Issue - State: closed - Opened by taganaka over 10 years ago
Labels: bug

#39 - Faster and easier overflow management

Pull Request - State: closed - Opened by taganaka over 10 years ago - 1 comment

#38 - proper initialization of internal_queue

Pull Request - State: closed - Opened by taganaka over 10 years ago - 1 comment

#37 - Refactor Crawler

Pull Request - State: open - Opened by tmaier over 10 years ago - 6 comments

#36 - Fails when response["Set-Cookie"] is nil

Issue - State: closed - Opened by tmaier over 10 years ago - 3 comments
Labels: bug

#35 - rubocop was here

Pull Request - State: closed - Opened by taganaka over 10 years ago - 2 comments

#34 - INT / TERM Signal handling

Pull Request - State: closed - Opened by taganaka over 10 years ago - 1 comment

#33 - Track url added by #add_url

Pull Request - State: open - Opened by tmaier over 10 years ago - 3 comments

#32 - Create CHANGELOG.md

Pull Request - State: closed - Opened by tmaier over 10 years ago - 1 comment

#31 - Add example for error handling. #15 [ci skip]

Pull Request - State: closed - Opened by tmaier over 10 years ago - 5 comments

#30 - Support for robots.txt

Pull Request - State: closed - Opened by taganaka over 10 years ago - 3 comments

#29 - On page error

Pull Request - State: closed - Opened by taganaka over 10 years ago - 10 comments

#28 - Minor changes to AUTHORS, README.rdoc and Gemfile

Pull Request - State: closed - Opened by tmaier over 10 years ago - 2 comments

#27 - Not storable on error

Pull Request - State: closed - Opened by tmaier over 10 years ago - 4 comments

#26 - Better http compression support

Pull Request - State: closed - Opened by taganaka over 10 years ago - 1 comment

#25 - Better rescue

Pull Request - State: closed - Opened by taganaka over 10 years ago - 2 comments

#24 - Add #add_to_queue

Pull Request - State: closed - Opened by tmaier over 10 years ago - 2 comments

#23 - Add referer and depth to Page if HTTP#fetch_pages has an error

Pull Request - State: closed - Opened by tmaier over 10 years ago - 2 comments

#22 - Use #add_url in #takeover to add seed urls

Pull Request - State: closed - Opened by tmaier over 10 years ago - 2 comments

#21 - [WIP] HTTP compression handling

Pull Request - State: closed - Opened by taganaka over 10 years ago - 2 comments

#20 - Gzip decoded body not used anywhere

Issue - State: closed - Opened by tmaier over 10 years ago - 1 comment
Labels: bug

#19 - Show code coverage and results of quality analysis

Issue - State: closed - Opened by tmaier over 10 years ago
Labels: enhancement

#18 - Remove #overflow_adapter. Closes #11

Pull Request - State: closed - Opened by tmaier over 10 years ago

#17 - Minor changes to code style

Pull Request - State: closed - Opened by tmaier over 10 years ago - 1 comment

#16 - Change logging format. Closes #14

Pull Request - State: closed - Opened by tmaier over 10 years ago

#15 - Internet connection lost; Page still stored and processed

Issue - State: closed - Opened by tmaier over 10 years ago - 6 comments
Labels: enhancement

#14 - Change logging format

Issue - State: closed - Opened by tmaier over 10 years ago - 1 comment
Labels: enhancement

#13 - Travis ci

Pull Request - State: closed - Opened by taganaka over 10 years ago

#12 - Robots.txt option

Issue - State: closed - Opened by ABrisset over 10 years ago - 3 comments
Labels: enhancement, question

#11 - #queue_overflow_adapter and #overflow_adapter; Same thing?

Issue - State: closed - Opened by tmaier over 10 years ago - 1 comment

#10 - Incremental Crawling

Issue - State: closed - Opened by nengine over 10 years ago - 3 comments
Labels: enhancement, question

#9 - Thread seems to hang in HTTP Call

Issue - State: open - Opened by hendricius over 10 years ago - 9 comments
Labels: bug

#8 - How to setup in a cluster environment?

Issue - State: closed - Opened by dbuarque over 10 years ago - 2 comments
Labels: question

#7 - URL patching

Issue - State: closed - Opened by nengine over 10 years ago - 5 comments
Labels: question

#6 - RegularExpression To Follow a Link

Issue - State: closed - Opened by nengine over 10 years ago - 1 comment

#5 - Where is the Gem

Issue - State: closed - Opened by nengine almost 11 years ago - 1 comment

#4 - Domain aliases

Pull Request - State: closed - Opened by taganaka almost 11 years ago

#3 - allow following uris with www

Pull Request - State: closed - Opened by hendricius almost 11 years ago - 3 comments

#2 - fix wrong variable on stats reset

Pull Request - State: closed - Opened by hendricius almost 11 years ago

#1 - Dofollow links

Pull Request - State: closed - Opened by hendricius almost 11 years ago - 4 comments

GitHub / taganaka/polipus issues and pull requests