scrapy/slybot issues and pull requests

#86 - Deprecate spiderlets

Pull Request - State: closed - Opened by rdowinton almost 10 years ago - 14 comments

#85 - [WIP] Scrapy 0.25+ support

Pull Request - State: closed - Opened by kmike over 10 years ago

#81 - added atom and sitemap link extractors, added attribute for xpath link

Pull Request - State: closed - Opened by kalessin about 11 years ago

#80 - build project item classes separated from templates iteration, in order ...

Pull Request - State: closed - Opened by kalessin about 11 years ago

#79 - allow to override some spider specs using spider arguments

Pull Request - State: closed - Opened by kalessin about 11 years ago - 5 comments

#77 - Remove rendering code from field types, and removed deprecated fieldtype synonyms

Pull Request - State: closed - Opened by kalessin over 11 years ago

#74 - Update index.rst

Pull Request - State: closed - Opened by rvogel over 11 years ago

#73 - Generalization of link extractors (added classes and allow to define through specs) and added support for feed start urls

Pull Request - State: closed - Opened by kalessin over 11 years ago - 7 comments

#72 - Rename sample project 'Plants' to 'SampleProject'

Pull Request - State: closed - Opened by kalessin over 11 years ago

#71 - Show error details when failing to parse project json file

Pull Request - State: closed - Opened by andresp99999 over 11 years ago

#66 - added spiderlets code and docs

Pull Request - State: closed - Opened by kalessin almost 12 years ago

#64 - pass explicit encoding in url processors. Added testcase which motivated the fix.

Pull Request - State: closed - Opened by kalessin almost 12 years ago

#63 - Fix small typo

Pull Request - State: closed - Opened by amferraz almost 12 years ago

#62 - Fix exception when Content-Type is empty and response type is not Html

Pull Request - State: closed - Opened by andresp99999 almost 12 years ago

#61 - avoid exception with responses which has headers with no Content-Type

Pull Request - State: closed - Opened by kalessin almost 12 years ago

#60 - Fix exception when response is not a HTMLResponse and the response Conte...

Pull Request - State: closed - Opened by andresp99999 almost 12 years ago

#59 - Add allowed_domains variable to spider definition

Pull Request - State: closed - Opened by andresp99999 almost 12 years ago - 2 comments

#58 - allow to specify extra meta data on spiders specs, and settings (global

Pull Request - State: closed - Opened by kalessin about 12 years ago - 1 comment

#57 - updated schema validation code in order to work properly with last jsonschema stable version

Pull Request - State: closed - Opened by kalessin about 12 years ago

#56 - Use scrapy._get_inputs to get the form inputs

Pull Request - State: closed - Opened by andresp99999 about 12 years ago

#55 - added missing project.json file

Pull Request - State: closed - Opened by kalessin about 12 years ago

#54 - make spidermanager to load the project specs from the specialized

Pull Request - State: closed - Opened by kalessin about 12 years ago

#53 - variants type must not be changed (_process_extracted_data changed it to

Pull Request - State: closed - Opened by kalessin about 12 years ago

#52 - add support for link extraction from rss files

Pull Request - State: closed - Opened by kalessin about 12 years ago

#50 - added project specs schema validation, using jsonschema library

Pull Request - State: closed - Opened by kalessin about 12 years ago

#49 - a recent fix in scrapely makes a test in slybot to match a template when

Pull Request - State: closed - Opened by kalessin about 12 years ago

#48 - add dont_filter flags in login/generic form associated requests, in

Pull Request - State: closed - Opened by kalessin about 12 years ago

#48 - add dont_filter flags in login/generic form associated requests, in

Pull Request - State: closed - Opened by kalessin about 12 years ago

#47 - added project specs schema validation

Pull Request - State: closed - Opened by kalessin about 12 years ago

#47 - added project specs schema validation

Pull Request - State: closed - Opened by kalessin about 12 years ago

#46 - Add support for 'file' type in generic_form fields

Pull Request - State: closed - Opened by andresp99999 about 12 years ago - 5 comments

#45 - update extractors code to new specs

Pull Request - State: closed - Opened by kalessin about 12 years ago

#44 - remove legacy unused code. 'scrapes' property is not part of spider spec, only templates.

Pull Request - State: closed - Opened by kalessin about 12 years ago

#43 - Add support for named parameters in generic forms.

Pull Request - State: closed - Opened by andresp99999 about 12 years ago

#42 - migrate spider to definitive specifications of items.

Pull Request - State: closed - Opened by kalessin about 12 years ago

#41 - fixed spec examples, removed unneeded keys in root object

Pull Request - State: closed - Opened by kalessin about 12 years ago

#40 - remove old forms code from spider, as it is coupled to an specific UI

Pull Request - State: closed - Opened by kalessin about 12 years ago

#39 - Generic form implementation

Pull Request - State: closed - Opened by andresp99999 about 12 years ago - 10 comments

#38 - add generic form to project specification.

Pull Request - State: closed - Opened by andresp99999 about 12 years ago

#37 - Add project definition for generic form request.

Pull Request - State: closed - Opened by andresp99999 about 12 years ago

#36 - allow spidermanager to instantiate a custom spider class

Pull Request - State: closed - Opened by kalessin about 12 years ago

#35 - added zipfile spider manager, added spider manager test, and move a

Pull Request - State: closed - Opened by kalessin about 12 years ago