Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / rmax/scrapy-redis issues and pull requests

#300 - give redis password support

Pull Request - State: open - Opened by oreader1996 3 months ago - 1 comment

#299 - docs: fix readthedocs

Pull Request - State: closed - Opened by rmax 5 months ago

#298 - maint: precommit format, fixes and update copyright

Pull Request - State: closed - Opened by rmax 5 months ago

#297 - build: use python3.12 as default version

Pull Request - State: closed - Opened by rmax 5 months ago

#296 - bump version to 0.8.0

Pull Request - State: closed - Opened by rmax 5 months ago

#295 - Fix test requirements and simplified tox config

Pull Request - State: closed - Opened by rmax 5 months ago

#294 - fix: Scheduler not compatible with BaseDupeFilter

Pull Request - State: closed - Opened by HairlessVillager 5 months ago

#292 - Removed unused import.

Pull Request - State: closed - Opened by sourcepirate 7 months ago

#291 - Scrapy-redis usage related issues

Issue - State: closed - Opened by Hao1617 7 months ago - 7 comments

#290 - [QUESTION] Is there a way to use response.meta ?

Issue - State: closed - Opened by SteliosGiannatos 9 months ago - 1 comment

#288 - Add Kafka Topic Integration to Scrapy Redis

Issue - State: closed - Opened by hamed21q 11 months ago - 1 comment

#287 - Add metadata to URLs to retrieve from Redis

Issue - State: closed - Opened by tteguayco about 1 year ago - 2 comments
Labels: question

#286 - [spiders] Remove 'spider' argument to ExecutionEngine.crawl

Pull Request - State: closed - Opened by mic1on over 1 year ago - 1 comment

#285 - [Question] Fetch request url from redis fail

Issue - State: open - Opened by KokoTa over 1 year ago - 8 comments

#284 - How does the CrawlSpider work?

Issue - State: open - Opened by Chris8080 over 1 year ago

#283 - Add Type annotations pep-0483

Issue - State: open - Opened by LuckyPigeon over 1 year ago

#282 - [dev] Add Type annotations

Issue - State: closed - Opened by LuckyPigeon over 1 year ago

#281 - [dev] Update GitHub Badge

Pull Request - State: closed - Opened by LuckyPigeon over 1 year ago

#280 - [dev] Add customize fingerprint

Pull Request - State: closed - Opened by LuckyPigeon over 1 year ago - 4 comments

#279 - [DEV] Add GitHub Action badge

Pull Request - State: closed - Opened by LuckyPigeon over 1 year ago

#278 - [rollback] Rollback `request_fingerprint`

Pull Request - State: closed - Opened by LuckyPigeon over 1 year ago - 3 comments

#277 - [update] Update github action

Pull Request - State: closed - Opened by LuckyPigeon over 1 year ago - 5 comments

#276 - [update] tox.ini

Pull Request - State: closed - Opened by LuckyPigeon over 1 year ago

#274 - [dev] Cleanup requirements

Pull Request - State: closed - Opened by LuckyPigeon over 1 year ago

#273 - Is there a planned support for Python3.11?

Issue - State: closed - Opened by lion137 over 1 year ago - 5 comments

#272 - Scrapy 2.8.0 deprecated function scrapy.utils.request.request_fingerprint() warning

Issue - State: closed - Opened by ThanatosDi over 1 year ago - 1 comment
Labels: help wanted

#271 - Playwright?

Issue - State: open - Opened by martmalo over 1 year ago - 2 comments
Labels: question

#270 - fix(sec): upgrade scrapy to 2.6.0

Pull Request - State: closed - Opened by lifefloating over 1 year ago - 1 comment

#269 - [dev] Optimize batch fetch method to boost throughput

Pull Request - State: open - Opened by NiuBlibing almost 2 years ago - 3 comments

#268 - Cleanup requirements

Issue - State: closed - Opened by devfox-se almost 2 years ago - 1 comment
Labels: improvement

#267 - make_request_from_data implementation in RedisMixin

Issue - State: open - Opened by rjbks almost 2 years ago - 2 comments
Labels: question

#266 - 警告： Passing a 'spider' argument to ExecutionEngine.crawl is deprecated

Issue - State: closed - Opened by maintain99 almost 2 years ago - 4 comments
Labels: question

#265 - 日志报警：String request is deprecated

Issue - State: closed - Opened by maintain99 almost 2 years ago

#264 - How to use scrapy-redis if I'm using start_requests() instead of start_urls in my spider?

Issue - State: closed - Opened by ashwinbala99 about 2 years ago - 3 comments
Labels: question

#262 - why I can not see request record in redis

Issue - State: closed - Opened by minikiller about 2 years ago - 2 comments
Labels: question

#261 - [spiders] Remove duplicate check setting types

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#260 - [spiders] remove duplicate check setting types

Issue - State: closed - Opened by LuckyPigeon over 2 years ago

#259 - [settings] Deprecate REDIS_START_URLS_BATCH_SIZE

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#258 - [CI/CD] Fix action build

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#257 - error object has no attribute 'make_requests_from_url'

Issue - State: closed - Opened by zhajingwen over 2 years ago - 2 comments
Labels: question

#256 - Release Patch Version 0.7.3

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago - 1 comment

#255 - [CI/CD] Build GitHub action for cross platform buliding

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago - 1 comment

#254 - [CI/CD] Create templates for issue & pull request

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#253 - [CI/CD] Build macos tox & ci

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#252 - [CI/CD] GitHub action for pytests

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago - 1 comment

#251 - [CI/CD] Build GitHub action for linting checks

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#250 - Scrapy 2.6.1 Unsupport function make_requests_from_url to use

Issue - State: closed - Opened by ihandmine over 2 years ago - 5 comments
Labels: question, improvement, pending

#249 - convert the data from redis from bytes to str

Pull Request - State: closed - Opened by songhao8080 over 2 years ago - 2 comments

#248 - Redis data persistence

Issue - State: open - Opened by MRPTY1 over 2 years ago - 4 comments
Labels: documentation

#247 - [test] Dev tox pylint

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#246 - [style] Fix pylint style

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#245 - [style] Fix pylint style

Issue - State: closed - Opened by LuckyPigeon over 2 years ago
Labels: improvement

#244 - Dev tox matrix

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#243 - [docs] Chinese documentation

Issue - State: open - Opened by LuckyPigeon over 2 years ago
Labels: documentation, help wanted, good first issue

#242 - Is there a way to stop spider check duplicate with redis ?

Issue - State: open - Opened by milkeasd over 2 years ago - 7 comments
Labels: feature, question, improvement

#241 - ImportError: cannot import name 'Iterable' from 'collections'

Issue - State: closed - Opened by milkeasd over 2 years ago - 2 comments
Labels: question

#240 - [dev] Default value for json support data

Pull Request - State: closed - Opened by songhao8080 over 2 years ago - 3 comments

#239 - fix push json

Pull Request - State: closed - Opened by songhao8080 over 2 years ago - 1 comment

#238 - Push json will failed

Issue - State: closed - Opened by songhao8080 over 2 years ago - 1 comment

#237 - [test] Dev tox

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago - 1 comment

#236 - [docs] Update README.md

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#235 - [test] Dev coverage

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#234 - [test] Dev bandit

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#233 - [test] Dev flake8 style

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#232 - Update import scrapy_redis.utils

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#231 - Remove python 2.x support

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#230 - Dev debug pytest

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#229 - [docs] Remove docs $ prefix

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#228 - Dev gh copy on docs

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#227 - Update setup

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago

#226 - Update basic settings

Issue - State: closed - Opened by LuckyPigeon over 2 years ago
Labels: improvement, help wanted, good first issue, pending

#225 - Update .gitignore & LICENSE

Pull Request - State: closed - Opened by LuckyPigeon over 2 years ago
Labels: improvement, help wanted, good first issue, pending

#224 - [docs] Move docs to github Wiki

Issue - State: closed - Opened by LuckyPigeon over 2 years ago
Labels: documentation

#223 - Update support for json data

Pull Request - State: closed - Opened by LuckyPigeon almost 3 years ago

#222 - [IMPROVEMENT] flake8 update

Pull Request - State: closed - Opened by LuckyPigeon almost 3 years ago

#221 - [Docs] Try fix the docs

Pull Request - State: closed - Opened by LuckyPigeon almost 3 years ago

#220 - Refactor max idle time

Pull Request - State: closed - Opened by LuckyPigeon almost 3 years ago

#219 - [FEATURE] Finish TODO tasks

Issue - State: open - Opened by LuckyPigeon almost 3 years ago
Labels: feature, improvement, good first issue

#218 - Remove redundant self at line 79, 82, 89 from spiders.py

Pull Request - State: closed - Opened by LuckyPigeon almost 3 years ago

#217 - [BUG] MySpider' object has no attribute 'settings'

Issue - State: closed - Opened by LuckyPigeon almost 3 years ago
Labels: bug, question

#216 - [IMPROVEMENT] Update support for json data

Issue - State: closed - Opened by LuckyPigeon almost 3 years ago - 1 comment
Labels: bug, improvement, good first issue

#215 - Update collections library before deprecated

Pull Request - State: closed - Opened by LuckyPigeon almost 3 years ago

#214 - [IMPROVEMENT] Update pytest config and related doc

Pull Request - State: closed - Opened by sumit-158 almost 3 years ago - 1 comment

#213 - [IMPROVEMENT] Add template to issues and PRs

Issue - State: closed - Opened by LuckyPigeon almost 3 years ago
Labels: improvement

#212 - [IMPROVEMENT] Update pytest config and related doc

Issue - State: closed - Opened by LuckyPigeon almost 3 years ago - 2 comments
Labels: improvement, help wanted, good first issue

#211 - [IMPROVEMENT] Update collections import method before deprecated

Issue - State: closed - Opened by LuckyPigeon almost 3 years ago
Labels: improvement, help wanted, good first issue

#210 - [IMPROVEMENT] Refactor max_idle_time as an attribute

Issue - State: closed - Opened by LuckyPigeon almost 3 years ago
Labels: improvement

#209 - Update from_crawler's first argument

Pull Request - State: closed - Opened by LuckyPigeon almost 3 years ago

#208 - Flake8 update for files.

Pull Request - State: closed - Opened by LuckyPigeon almost 3 years ago - 1 comment

#207 - [IMPROVEMENT] Flake8 update for files

Issue - State: closed - Opened by LuckyPigeon almost 3 years ago
Labels: improvement

#204 - [WIP] Enhance scrapy-redis

Pull Request - State: closed - Opened by whg517 about 3 years ago - 4 comments

#203 - [RFC]A new journey

Issue - State: open - Opened by whg517 about 3 years ago - 14 comments
Labels: feature

#201 - Refactor max_idle_time as an attribute

Pull Request - State: closed - Opened by laggardkernel over 3 years ago - 4 comments

#178 - AttributeError: Can't pickle local object 'Crawler.__init__.<locals>.<lambda>'

Issue - State: closed - Opened by ycq0125 about 4 years ago - 5 comments
Labels: bug