stewartmckee/cobweb issues and pull requests

#69 - Bump sinatra from 1.4.8 to 2.2.3

Pull Request - State: open - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies

#68 - Bump addressable from 2.3.8 to 2.8.1

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#67 - Bump sinatra from 1.4.8 to 2.2.0

Pull Request - State: closed - Opened by dependabot[bot] over 2 years ago - 1 comment
Labels: dependencies

#66 - Bump sidekiq from 3.5.3 to 6.4.0

Pull Request - State: open - Opened by dependabot[bot] almost 3 years ago
Labels: dependencies

#65 - Bump sidekiq from 3.5.3 to 6.2.2

Pull Request - State: closed - Opened by dependabot[bot] about 3 years ago - 1 comment
Labels: dependencies

#64 - Bump nokogiri from 1.8.5 to 1.12.5

Pull Request - State: open - Opened by dependabot[bot] about 3 years ago
Labels: dependencies

#63 - Bump addressable from 2.3.8 to 2.8.0

Pull Request - State: closed - Opened by dependabot[bot] over 3 years ago - 1 comment
Labels: dependencies

#62 - Bump nokogiri from 1.8.5 to 1.11.4

Pull Request - State: closed - Opened by dependabot[bot] over 3 years ago - 1 comment
Labels: dependencies

#61 - Error raised when there's a valid <base> tag in <head>

Issue - State: open - Opened by svenaas about 4 years ago - 3 comments

#60 - Bump rack from 1.6.11 to 2.2.3

Pull Request - State: open - Opened by dependabot[bot] over 4 years ago
Labels: dependencies

#59 - Bump rake from 12.3.0 to 13.0.1

Pull Request - State: open - Opened by dependabot[bot] over 4 years ago
Labels: dependencies

#58 - Bump nokogiri from 1.8.5 to 1.10.8

Pull Request - State: closed - Opened by dependabot[bot] almost 5 years ago - 1 comment
Labels: dependencies

#57 - Bump rack from 1.6.11 to 2.0.8

Pull Request - State: closed - Opened by dependabot[bot] almost 5 years ago - 1 comment
Labels: dependencies

#56 - Bump haml from 4.0.7 to 5.1.2

Pull Request - State: open - Opened by dependabot[bot] about 5 years ago
Labels: dependencies

#55 - Bump nokogiri from 1.8.5 to 1.10.4

Pull Request - State: closed - Opened by dependabot[bot] about 5 years ago - 1 comment
Labels: dependencies

#54 - Feature request: Stop crawl at time

Issue - State: open - Opened by samnissen over 7 years ago - 3 comments

#53 - Falling into Crawl Traps

Issue - State: open - Opened by fuzzygroup over 7 years ago - 10 comments

#52 - undefined method `banner' for main:Object (NoMethodError) on calling from command line

Issue - State: open - Opened by gushonorato over 8 years ago - 1 comment

#51 - documenting response time for page data returned

Pull Request - State: closed - Opened by gushonorato over 8 years ago - 3 comments

#50 - documenting :queue_system option

Pull Request - State: closed - Opened by gushonorato over 8 years ago - 1 comment

#49 - Proxy authentication while parsing url with Net::HTTP

Pull Request - State: open - Opened by suvarnarajkumar over 8 years ago - 2 comments

#48 - Error on first run

Issue - State: closed - Opened by rap2hpoutre almost 9 years ago - 2 comments

#47 - Should depend on slop 3.6.0 or update cobweb bin

Issue - State: open - Opened by mhmaguire almost 9 years ago - 1 comment

#46 - How can I start stop crawling website

Issue - State: open - Opened by qiun almost 9 years ago - 1 comment

#45 - Relative urls are handled proper

Pull Request - State: closed - Opened by peric about 9 years ago - 1 comment

#44 - Cobweb gem causes Rails app to run 10x slower

Issue - State: closed - Opened by SimonBirrell about 9 years ago - 9 comments

#43 - 3309 wf fix riffle on crawl

Pull Request - State: closed - Opened by wflanagan over 9 years ago - 1 comment

#42 - Tidy up README

Pull Request - State: closed - Opened by maxehmookau over 9 years ago - 1 comment

#41 - error while installing cobweb-1.0.28.gem: Invalid argument @ rb_sysopen

Issue - State: closed - Opened by illtellyoulater over 9 years ago - 5 comments

#40 - remove reference to awesome print

Pull Request - State: closed - Opened by pisaacs over 9 years ago - 1 comment

#39 - LoadError with version 1.0.26

Issue - State: closed - Opened by pisaacs over 9 years ago - 2 comments

#38 - Aj meta refreshes

Pull Request - State: closed - Opened by andrejj almost 10 years ago

#37 - Aj meta refreshes

Pull Request - State: closed - Opened by andrejj almost 10 years ago

#36 - Redirect Limit causing crawl to stop

Issue - State: open - Opened by stewartmckee almost 10 years ago

#35 - Binary not installed

Issue - State: closed - Opened by fabn almost 10 years ago - 1 comment

#34 - Code organization

Issue - State: open - Opened by andrejj about 10 years ago - 1 comment

#33 - Change options checking order to skip redis if cache is nil

Pull Request - State: closed - Opened by adrianouno about 10 years ago - 1 comment

#32 - Require namespaced_redis fails. require redis-namespace works.

Pull Request - State: closed - Opened by etagwerker over 10 years ago - 1 comment

#31 - Removed puts which generates a lot of noise.

Pull Request - State: closed - Opened by etagwerker over 10 years ago - 1 comment

#30 - Issue 29: Normalize URLs when storing inbound links

Pull Request - State: closed - Opened by gh2k over 10 years ago - 1 comment

#29 - Inbound links are not normalized when stored

Issue - State: closed - Opened by gh2k over 10 years ago

#28 - Should it be possible to add "depth" in the data hash ?

Issue - State: open - Opened by ABrisset over 10 years ago - 3 comments

#27 - Should be possible to use Ruby's URI implementation instead of Addressable::URI

Issue - State: open - Opened by gh2k over 10 years ago - 3 comments

#26 - `require': cannot load such file -- resque (LoadError)

Issue - State: closed - Opened by NielsKSchjoedt over 10 years ago - 3 comments

#25 - Standalone Crawler gives error for redis

Issue - State: closed - Opened by Shehbaz almost 11 years ago - 6 comments

#24 - Improve connection handling

Issue - State: open - Opened by stewartmckee about 11 years ago

#23 - Update ruby to latest patch level

Pull Request - State: closed - Opened by markprovan about 11 years ago

#22 - Forced UTF-8 codification of request.body so it can be serialised correc...

Pull Request - State: closed - Opened by wuiscmc about 11 years ago

#21 - Encoding problems

Issue - State: closed - Opened by wuiscmc about 11 years ago - 5 comments

#20 - Add missing config options, fix default values and layout

Pull Request - State: closed - Opened by fqxp about 11 years ago

#19 - Thin web-server works slowly

Issue - State: closed - Opened by sunloverz about 11 years ago - 4 comments

#18 - License missing from gemspec

Issue - State: closed - Opened by bf4 over 11 years ago - 2 comments

#17 - Suggestion: Compatibility with Sidekiq

Issue - State: closed - Opened by NebJ almost 12 years ago - 4 comments

#16 - external_urls not treated as external

Issue - State: open - Opened by stewartmckee almost 12 years ago

#15 - Use base url

Pull Request - State: closed - Opened by rojotek about 12 years ago

#14 - I think the gem need to require json when using it standalone

Pull Request - State: closed - Opened by ghost about 12 years ago - 1 comment

#13 - Two improvements for you to look at here - inprogress + updating of setting the queued state

Pull Request - State: closed - Opened by rojotek about 12 years ago - 1 comment

#12 - only try and crawl links on a page 1 time.

Pull Request - State: closed - Opened by rojotek over 12 years ago - 1 comment