Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / Python3WebSpider/ProxyPool issues and pull requests

#100 - Docker打包错误

Issue - State: closed - Opened by azwpayne almost 4 years ago - 2 comments
Labels: bug

#99 - add add new Proxy source jiangxianli.py

Pull Request - State: closed - Opened by azwpayne almost 4 years ago

#98 - add new Proxy source

Pull Request - State: closed - Opened by azwpayne almost 4 years ago

#98 - add new Proxy source

Pull Request - State: closed - Opened by azwpayne almost 4 years ago

#97 - docker-compose up 启动失败

Issue - State: closed - Opened by pythonName almost 4 years ago - 4 comments
Labels: bug, help wanted

#96 - 有scrapy爬虫的使用mod吗

Issue - State: open - Opened by ives-nx almost 4 years ago
Labels: bug

#95 - 请问只能支持http代理吗，可以抓取https的代理吗？

Issue - State: open - Opened by biga-bomb almost 4 years ago - 1 comment
Labels: bug

#94 - run.py 运行出错

Issue - State: closed - Opened by 123Mrxiao about 4 years ago - 2 comments
Labels: bug

#94 - run.py 运行出错

Issue - State: closed - Opened by 123Mrxiao about 4 years ago - 2 comments
Labels: bug

#92 - getter引入协程，tester中aiohttp的session优化

Pull Request - State: open - Opened by Hui4401 about 4 years ago - 4 comments

#90 - 关于可配置项中部分配置的疑问

Issue - State: closed - Opened by Hui4401 about 4 years ago - 3 comments

#90 - 关于可配置项中部分配置的疑问

Issue - State: closed - Opened by Hui4401 about 4 years ago - 3 comments

#89 - 在协程中使用同步版的 redis 是否好呢？

Issue - State: closed - Opened by perklet about 4 years ago - 1 comment
Labels: enhancement

#89 - 在协程中使用同步版的 redis 是否好呢？

Issue - State: closed - Opened by perklet about 4 years ago - 1 comment
Labels: enhancement

#88 - docker部署的时候出现Exception~~~

Issue - State: closed - Opened by chenjieup about 4 years ago - 4 comments
Labels: bug

#88 - docker部署的时候出现Exception~~~

Issue - State: closed - Opened by chenjieup about 4 years ago - 4 comments
Labels: bug

#86 - docker-compose up 后不能启动redis，报错如图

Issue - State: closed - Opened by MazzaWill about 4 years ago - 1 comment
Labels: bug

#86 - docker-compose up 后不能启动redis，报错如图

Issue - State: closed - Opened by MazzaWill about 4 years ago - 1 comment
Labels: bug

#84 - 最好能增加ip的地址位置，以国家区分

Issue - State: open - Opened by cnscorpions about 4 years ago - 1 comment
Labels: enhancement, help wanted

#84 - 最好能增加ip的地址位置，以国家区分

Issue - State: open - Opened by cnscorpions about 4 years ago - 1 comment
Labels: enhancement, help wanted

#83 - 厉害

Issue - State: closed - Opened by onefeng about 4 years ago - 1 comment

#83 - 厉害

Issue - State: closed - Opened by onefeng about 4 years ago - 1 comment

#82 - 优化tester处理逻辑

Pull Request - State: closed - Opened by winturn about 4 years ago - 2 comments

#81 - 另一个redis的问题

Issue - State: closed - Opened by winturn about 4 years ago - 1 comment
Labels: bug

#81 - 另一个redis的问题

Issue - State: closed - Opened by winturn about 4 years ago - 1 comment
Labels: bug

#80 - 一个redis的问题

Issue - State: closed - Opened by winturn about 4 years ago - 4 comments
Labels: bug

#80 - 一个redis的问题

Issue - State: closed - Opened by winturn about 4 years ago - 4 comments
Labels: bug

#79 - 建议：getter也使用协程，一个网站一个任务。

Issue - State: open - Opened by winturn about 4 years ago - 1 comment

#79 - 建议：getter也使用协程，一个网站一个任务。

Issue - State: open - Opened by winturn about 4 years ago - 1 comment

#78 - 解决bug: redis有序集合变化后导致顺序重排，以至于重复test

Pull Request - State: closed - Opened by winturn about 4 years ago - 5 comments

#78 - 解决bug: redis有序集合变化后导致顺序重排，以至于重复test

Pull Request - State: closed - Opened by winturn about 4 years ago - 5 comments

#76 - 解决bug：ZhandayeCrawler没有headers属性

Pull Request - State: closed - Opened by winturn about 4 years ago - 1 comment

#76 - 解决bug：ZhandayeCrawler没有headers属性

Pull Request - State: closed - Opened by winturn about 4 years ago - 1 comment

#75 - 增加Redis可选择db

Pull Request - State: closed - Opened by bnightning about 4 years ago - 1 comment

#74 - 增加校验功能：采集到的代理IP是否为匿名代理

Pull Request - State: closed - Opened by AaronJny about 4 years ago - 1 comment

#73 - 检测模块有误？？？？

Issue - State: closed - Opened by hanger23 about 4 years ago - 3 comments
Labels: bug

#72 - Celery

Pull Request - State: closed - Opened by jiangsir404 about 4 years ago

#71 - 请问下用scrapy.request，如果调用代理，用meta带入proxy参数，不能使用

Issue - State: closed - Opened by WanBuJin over 4 years ago - 1 comment
Labels: bug

#70 - 请问这个是什么错误啊？

Issue - State: closed - Opened by ryanwlb over 4 years ago - 1 comment
Labels: bug

#69 - 自带 正向代理服务器么 ？

Issue - State: open - Opened by wikipurse over 4 years ago - 1 comment

#68 - 修复is_valid_proxy函数的bug，add: 站大爷crawler

Pull Request - State: closed - Opened by RocketVV over 4 years ago - 2 comments

#67 - add xiladaili proxy source and add lxml in requirements.txt

Pull Request - State: closed - Opened by linupychiang over 4 years ago - 1 comment

#66 - 代理网页爬虫报错

Issue - State: closed - Opened by RiskySignal over 4 years ago - 2 comments
Labels: bug

#65 - 能否在控制台稳定地关闭代理池

Issue - State: closed - Opened by EMUNES over 4 years ago - 1 comment

#64 - 老哥，多加几个代理源吧，现在一次只能抓十个有用的了。

Issue - State: closed - Opened by shenbushou over 4 years ago - 18 comments

#62 - 代理池项目中setting.py文件相关配置

Issue - State: open - Opened by Yu-Yv over 4 years ago - 1 comment
Labels: bug

#60 - 优化付费代理按需使用的需求

Issue - State: open - Opened by luzihang123 over 4 years ago - 2 comments

#59 - 程序执行不成功

Issue - State: closed - Opened by darksheng over 4 years ago - 7 comments
Labels: bug

#58 - 修复BASE_URL域名导致的retrying模块报错

Pull Request - State: closed - Opened by zyrsss over 4 years ago

#57 - 代码中url错误导致的retrying.RetryError: RetryError[Attempts: 3, Value: None]

Issue - State: closed - Opened by zyrsss over 4 years ago - 2 comments
Labels: bug

#56 - Create LICENSE

Pull Request - State: closed - Opened by Germey over 4 years ago

#55 - 代理获取进程好像死亡了，这是怎么回事

Issue - State: closed - Opened by yanw1011 almost 5 years ago - 1 comment

#54 - 修改example举例

Pull Request - State: closed - Opened by westonZhang almost 5 years ago

#53 - Macbook上碰到https的错误

Issue - State: closed - Opened by dennis-ji almost 5 years ago - 1 comment

#52 - aiohttp 不支持https代理，有办法可以批量测试https代理吗

Issue - State: open - Opened by WalkOnMars almost 5 years ago - 1 comment
Labels: enhancement

#51 - 对爬取ip的代码进行了优化, 正则全部替换成pyquery来提取

Issue - State: closed - Opened by HIT-Owen almost 5 years ago - 1 comment

#50 - 代码看起来太费劲了，必须完全按照你书上来，才走的通

Issue - State: closed - Opened by zxcwolf almost 5 years ago - 4 comments

#49 - redis的有序集合zadd方法变更

Issue - State: closed - Opened by cxapython about 5 years ago - 4 comments

#48 - AttributeError: 'OutStream' object has no attribute 'buffer'

Issue - State: closed - Opened by Heguanlin-rec about 5 years ago - 2 comments

#47 - 无法定时爬取新的代理

Issue - State: closed - Opened by Daniel19960601 about 5 years ago

#46 - 报了这个错误：requests.exceptions.ConnectionError：10054

Issue - State: closed - Opened by Hanoso about 5 years ago - 1 comment

#45 - 项目部署到Linux直接报错了

Issue - State: closed - Opened by jeeshv about 5 years ago - 1 comment

#44 - 在 VS Code 中运行异常 ~ 而且无法关闭

Issue - State: closed - Opened by mirrortan about 5 years ago - 3 comments

#43 - Update for redis3.0 db.py

Pull Request - State: closed - Opened by DemSephiroth about 5 years ago

#42 - 检查并更新代理网站的有效性

Pull Request - State: closed - Opened by Reyetz about 5 years ago

#41 - Proxy pool

Pull Request - State: closed - Opened by MarkShawn2020 about 5 years ago

#40 - http类型的ip测试结果不可用

Issue - State: closed - Opened by thirdcountry over 5 years ago

#39 - 能否获取能够破网的代理

Issue - State: closed - Opened by Crescentz over 5 years ago

#38 - error in db.py: fixed the problem by change line 30 with:

Issue - State: closed - Opened by Clairewr over 5 years ago - 1 comment

#37 - Fix#36

Pull Request - State: closed - Opened by DaYePython over 5 years ago

#36 - 增加对pipenv包管理器的支持

Issue - State: closed - Opened by DaYePython over 5 years ago - 1 comment

#35 - 关于trace back中db.py的问题

Issue - State: closed - Opened by Wade-D over 5 years ago - 1 comment

#34 - 大佬们，为什么我运行run.py之后就没反应了

Issue - State: closed - Opened by zxbzxb180 over 5 years ago - 3 comments

#33 - 创建了 Dockerfile

Pull Request - State: closed - Opened by zefu-lu over 5 years ago - 1 comment

#30 - 是否存在管理redis connectionpool的问题？

Issue - State: closed - Opened by XyLearningProgramming over 5 years ago - 1 comment

#29 - setup.py 里面的console_script

Issue - State: closed - Opened by XyLearningProgramming over 5 years ago

#28 - 爬虫函数可以考虑增加一个直接读文件

Issue - State: closed - Opened by zouzhin over 5 years ago - 1 comment

#27 - 新版redis中zadd改动

Issue - State: closed - Opened by canglan1024 over 5 years ago - 2 comments

#26 - value is not a valid float

Issue - State: closed - Opened by Hoantrbl over 5 years ago - 1 comment

#23 - what/

Issue - State: closed - Opened by 1019wellBegin121 over 5 years ago - 3 comments

#22 - Compatible with redis-py3.x

Pull Request - State: closed - Opened by kingkap over 5 years ago - 1 comment

#21 - 请教这个问题怎么解决？

Issue - State: closed - Opened by liuuuuuuuuuuu over 5 years ago

#20 - 关于redis-py版本问题

Issue - State: closed - Opened by lyh081 over 5 years ago - 4 comments

#19 - 大神：能不能做个docker，环境变化太多了

Issue - State: closed - Opened by disadone over 5 years ago - 4 comments

#18 - zincrby 新的版本redis-py有改动

Issue - State: closed - Opened by duolk over 5 years ago - 1 comment

#17 - 写入时报错

Issue - State: closed - Opened by wjx1018960145 almost 6 years ago - 2 comments