scrapy/scrapyd issues and pull requests

#505 - Is there a way to limit of how many spiders of a certain project would run on Scrapyd?

Issue - State: closed - Opened by aaronm137 15 days ago - 1 comment
Labels: type: question

#504 - How to specify the naming convention of log files?

Issue - State: closed - Opened by aaronm137 15 days ago - 1 comment
Labels: type: question

#503 - Are Scrapyd log files created with delays?

Issue - State: closed - Opened by aaronm137 15 days ago - 1 comment
Labels: type: question

#502 - Added confirm dialog in cancel form

Pull Request - State: closed - Opened by Naik-G about 1 month ago - 1 comment

#501 - When I am in Scrapyd deploy，always report an error

Issue - State: closed - Opened by joykerl 5 months ago - 1 comment
Labels: status: invalid

#500 - DA-243 Upgrade to python 3.12

Pull Request - State: closed - Opened by IonascuDenisa 5 months ago

#499 - Add configuration via env vars

Pull Request - State: closed - Opened by fkromer 7 months ago - 1 comment

#498 - Enable configuration of bind_address, http_port, username and password via env vars

Issue - State: closed - Opened by fkromer 7 months ago - 1 comment

#497 - Azure Feed exporter not working

Issue - State: closed - Opened by MathiasIconB 8 months ago - 2 comments
Labels: type: question

#496 - Bad installation steps for "python setup.py install"

Issue - State: closed - Opened by HyperUpscale 9 months ago - 2 comments
Labels: type: question

#495 - transparent list of projects #493

Pull Request - State: closed - Opened by bsekiewicz 9 months ago

#494 - Error on windows when trying to deploy - [WinError 32]

Issue - State: closed - Opened by amartins2imp 10 months ago - 17 comments
Labels: type: bug

#493 - Transparent list of projects

Issue - State: closed - Opened by bsekiewicz 10 months ago - 7 comments
Labels: type: enhancement

#492 - The work of scrapyd with the virtual environments of projects

Issue - State: closed - Opened by WhatIsLowe 10 months ago - 1 comment
Labels: type: question

#491 - Update overview.rst

Pull Request - State: closed - Opened by mouday 11 months ago

#490 - Cannot access environment variables in the spider running under ScrapyD

Issue - State: closed - Opened by iamumairayub 12 months ago - 2 comments
Labels: type: question

#489 - May I ask is there any way use scrpyd to run python script with CrawlerProcess

Issue - State: closed - Opened by xinatcg 12 months ago - 2 comments
Labels: type: question

#488 - Use wheel files for deployment

Issue - State: closed - Opened by majid-vaghari about 1 year ago - 1 comment

#487 - Add `--bind-address` and `--http-port` options (instead of configuration file)

Issue - State: open - Opened by fuqiang-code about 1 year ago - 1 comment
Labels: type: enhancement

#486 - Polish docs

Pull Request - State: closed - Opened by izeye about 1 year ago - 2 comments

#485 - Polish

Pull Request - State: closed - Opened by izeye about 1 year ago - 1 comment

#484 - Adding custom endpoints

Issue - State: closed - Opened by vazkir about 1 year ago - 4 comments
Labels: topic: documentation

#483 - How to pause and resume crawling with scrapyd?

Issue - State: closed - Opened by Akise about 1 year ago - 3 comments
Labels: type: question

#482 - Add x-forwarded-prefix support

Pull Request - State: closed - Opened by jpmckinney about 1 year ago

#481 - proxy prefix for Scrapyd (web interface) templates added

Pull Request - State: closed - Opened by TecIntelli about 1 year ago

#480 - Add reverse proxy support for web interface

Issue - State: closed - Opened by TecIntelli about 1 year ago - 1 comment

#479 - xxx.log can't be found

Issue - State: closed - Opened by hyliush about 1 year ago - 3 comments
Labels: type: question

#478 - Add support for environment variables

Issue - State: closed - Opened by Shleif91 about 1 year ago - 7 comments
Labels: type: question

#477 - [Feature Request] S3 Storage

Issue - State: closed - Opened by mgrist over 1 year ago - 3 comments
Labels: type: question

#476 - feat: Add spiderqueue configuration option

Pull Request - State: closed - Opened by jpmckinney over 1 year ago - 6 comments

#475 - SQLite queue is using all CPU on high frequency poller (<1s)

Issue - State: closed - Opened by pspsdev over 1 year ago - 12 comments
Labels: type: bug

#474 - feat: Log environment and command-line arguments for crawl command

Pull Request - State: closed - Opened by jpmckinney over 1 year ago - 1 comment

#473 - crawl: error: Invalid -s value, use -s NAME=VALUE

Issue - State: closed - Opened by saavedra29 over 1 year ago - 9 comments

#472 - ReadTheDocs build

Issue - State: closed - Opened by jpmckinney over 1 year ago - 2 comments
Labels: topic: documentation

#471 - Scrapy 2.8 support

Pull Request - State: closed - Opened by jpmckinney over 1 year ago - 2 comments

#470 - scrapyd writing logs to console instead of log files in docker container

Issue - State: closed - Opened by blacksteel1288 over 1 year ago - 9 comments
Labels: type: bug

#469 - Replace distutils.version.LooseVersion with packaging.version Version

Pull Request - State: closed - Opened by jpmckinney over 1 year ago - 1 comment

#468 - test: Add integration tests #400

Pull Request - State: closed - Opened by jpmckinney over 1 year ago - 1 comment

#467 - Api job url

Pull Request - State: closed - Opened by mxdev88 over 1 year ago - 3 comments

#466 - High frequency scheduling

Issue - State: closed - Opened by pspsdev over 1 year ago - 1 comment

#465 - add FEEDS support like "curl http://localhost:6800/schedule.json ... -d setting=FEEDS=output.csv"

Issue - State: closed - Opened by armonbc over 1 year ago

#464 - API - add items and logs url to listjobs.json

Issue - State: closed - Opened by mxdev88 over 1 year ago - 3 comments
Labels: type: enhancement

#463 - How to correctly configure CONCURRENT_REQUESTS in a project with multiple spiders

Issue - State: closed - Opened by jxlil over 1 year ago - 1 comment
Labels: type: question

#462 - encoding errors when running a spider via scrapyd

Issue - State: closed - Opened by dedepene over 1 year ago - 2 comments
Labels: type: question

#461 - Update minimum python version in docs

Pull Request - State: closed - Opened by Laerte over 1 year ago - 1 comment

#460 - Add Python 3.11 support

Pull Request - State: closed - Opened by Laerte over 1 year ago - 1 comment

#459 - Drop Python 3.6 support

Pull Request - State: closed - Opened by Laerte over 1 year ago - 2 comments

#458 - Remove `six` package dependency

Pull Request - State: closed - Opened by Laerte over 1 year ago - 2 comments

#457 - Use latest version of Ubuntu

Pull Request - State: closed - Opened by Laerte over 1 year ago - 1 comment

#456 - facing unexpected builtins.TypeError error when running >Scrapyd command .

Issue - State: closed - Opened by usmanabbasi360 over 1 year ago - 6 comments
Labels: type: question

#455 - -

Pull Request - State: closed - Opened by victor7070 almost 2 years ago

#454 - Why not use main?

Issue - State: closed - Opened by dhvcc almost 2 years ago - 3 comments
Labels: type: question

#453 - Persistent scheduling based on CRON

Issue - State: closed - Opened by kanchansapkota27 almost 2 years ago - 4 comments
Labels: type: question

#452 - Use JOBDIR of scrapy

Issue - State: closed - Opened by Schulzjo almost 2 years ago - 2 comments
Labels: type: question

#451 - upload egg file raise an DistributionNotFound exception for requirements package

Issue - State: closed - Opened by radouani1984 almost 2 years ago - 1 comment
Labels: type: question

#449 - fix: PyPI link for Python Version

Pull Request - State: closed - Opened by Laerte about 2 years ago - 2 comments

#448 - Merge

Pull Request - State: closed - Opened by AlexCernov about 2 years ago