Data

Tools

Indexes

Applications

Experiments

Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / Python3WebSpider/ProxyPool issues and pull requests

#222 - Proxys

Issue - State: open - Opened by GT3Rz 8 months ago

#218 - 请求代理时，返回500错误

Issue - State: open - Opened by wwf1227 over 1 year ago
Labels: bug

#217 - 此项目的代理是否是全局的代理？

Issue - State: closed - Opened by B1ng0OOO over 1 year ago - 3 comments
Labels: bug

#215 - 为什么运行python3 run.py之后啥也没有啊

Issue - State: closed - Opened by Wu88-X over 1 year ago

#214 - docker 运行ProxyPool后，VPS空间被占满了

Issue - State: closed - Opened by zhouyuyu888 almost 2 years ago - 1 comment
Labels: bug

#213 - add sub proxy pool mechanics

Pull Request - State: open - Opened by inVains almost 2 years ago

#211 - add 3 parameter in settings (#210)

Pull Request - State: closed - Opened by inVains almost 2 years ago - 2 comments

#208 - 运行过程中有错误

Issue - State: open - Opened by qrbbqrbb about 2 years ago
Labels: bug

#207 - fix: avoid error on "ip:port:port" format

Pull Request - State: closed - Opened by cesaryuan about 2 years ago

#200 - Proxy

Issue - State: closed - Opened by Luisvelix over 2 years ago

#199 - Proxy, transparente

Issue - State: closed - Opened by MicaelJesushacker over 2 years ago

#100 - Docker打包错误

Issue - State: closed - Opened by azwpayne about 5 years ago - 2 comments
Labels: bug

#99 - add add new Proxy source jiangxianli.py

Pull Request - State: closed - Opened by azwpayne about 5 years ago

#98 - add new Proxy source

Pull Request - State: closed - Opened by azwpayne about 5 years ago

#97 - docker-compose up 启动失败

Issue - State: closed - Opened by pythonName over 5 years ago - 4 comments
Labels: bug, help wanted

#96 - 有scrapy爬虫的使用mod吗

Issue - State: open - Opened by ives-nx over 5 years ago
Labels: bug

#95 - 请问只能支持http代理吗，可以抓取https的代理吗？

Issue - State: open - Opened by biga-bomb over 5 years ago - 1 comment
Labels: bug

#94 - run.py 运行出错

Issue - State: closed - Opened by 123Mrxiao over 5 years ago - 2 comments
Labels: bug

#92 - getter引入协程，tester中aiohttp的session优化

Pull Request - State: open - Opened by Hui4401 over 5 years ago - 4 comments

#90 - 关于可配置项中部分配置的疑问

Issue - State: closed - Opened by Hui4401 over 5 years ago - 3 comments

#89 - 在协程中使用同步版的 redis 是否好呢？

Issue - State: closed - Opened by perklet over 5 years ago - 1 comment
Labels: enhancement

#88 - docker部署的时候出现Exception~~~

Issue - State: closed - Opened by chenjieup over 5 years ago - 4 comments
Labels: bug

#86 - docker-compose up 后不能启动redis，报错如图

Issue - State: closed - Opened by MazzaWill over 5 years ago - 1 comment
Labels: bug

#84 - 最好能增加ip的地址位置，以国家区分

Issue - State: open - Opened by cnscorpions over 5 years ago - 1 comment
Labels: enhancement, help wanted

#83 - 厉害

Issue - State: closed - Opened by onefeng over 5 years ago - 1 comment

#82 - 优化tester处理逻辑

Pull Request - State: closed - Opened by winturn over 5 years ago - 2 comments

#81 - 另一个redis的问题

Issue - State: closed - Opened by winturn over 5 years ago - 1 comment
Labels: bug

#80 - 一个redis的问题

Issue - State: closed - Opened by winturn over 5 years ago - 4 comments
Labels: bug

#79 - 建议：getter也使用协程，一个网站一个任务。

Issue - State: open - Opened by winturn over 5 years ago - 1 comment

#78 - 解决bug: redis有序集合变化后导致顺序重排，以至于重复test

Pull Request - State: closed - Opened by winturn over 5 years ago - 5 comments

#76 - 解决bug：ZhandayeCrawler没有headers属性

Pull Request - State: closed - Opened by winturn over 5 years ago - 1 comment

#75 - 增加Redis可选择db

Pull Request - State: closed - Opened by bnightning over 5 years ago - 1 comment

#74 - 增加校验功能：采集到的代理IP是否为匿名代理

Pull Request - State: closed - Opened by AaronJny over 5 years ago - 1 comment

#73 - 检测模块有误？？？？

Issue - State: closed - Opened by hanger23 over 5 years ago - 3 comments
Labels: bug

#72 - Celery

Pull Request - State: closed - Opened by jiangsir404 over 5 years ago

#71 - 请问下用scrapy.request，如果调用代理，用meta带入proxy参数，不能使用

Issue - State: closed - Opened by WanBuJin over 5 years ago - 1 comment
Labels: bug

#70 - 请问这个是什么错误啊？

Issue - State: closed - Opened by ryanwlb over 5 years ago - 1 comment
Labels: bug

#69 - 自带 正向代理服务器么 ？

Issue - State: open - Opened by wikipurse over 5 years ago - 1 comment

#68 - 修复is_valid_proxy函数的bug，add: 站大爷crawler

Pull Request - State: closed - Opened by RocketVV over 5 years ago - 2 comments

#67 - add xiladaili proxy source and add lxml in requirements.txt

Pull Request - State: closed - Opened by linupychiang over 5 years ago - 1 comment

#66 - 代理网页爬虫报错

Issue - State: closed - Opened by RiskySignal over 5 years ago - 2 comments
Labels: bug

#65 - 能否在控制台稳定地关闭代理池

Issue - State: closed - Opened by EMUNES over 5 years ago - 1 comment

#64 - 老哥，多加几个代理源吧，现在一次只能抓十个有用的了。

Issue - State: closed - Opened by shenbushou over 5 years ago - 18 comments

#62 - 代理池项目中setting.py文件相关配置

Issue - State: open - Opened by Yu-Yv almost 6 years ago - 1 comment
Labels: bug

#60 - 优化付费代理按需使用的需求

Issue - State: open - Opened by luzihang123 almost 6 years ago - 2 comments

#59 - 程序执行不成功

Issue - State: closed - Opened by darksheng almost 6 years ago - 7 comments
Labels: bug

#58 - 修复BASE_URL域名导致的retrying模块报错

Pull Request - State: closed - Opened by zyrsss almost 6 years ago

#57 - 代码中url错误导致的retrying.RetryError: RetryError[Attempts: 3, Value: None]

Issue - State: closed - Opened by zyrsss almost 6 years ago - 2 comments
Labels: bug

#56 - Create LICENSE

Pull Request - State: closed - Opened by Germey almost 6 years ago

#55 - 代理获取进程好像死亡了，这是怎么回事

Issue - State: closed - Opened by yanw1011 about 6 years ago - 1 comment

#54 - 修改example举例

Pull Request - State: closed - Opened by westonZhang about 6 years ago

#53 - Macbook上碰到https的错误

Issue - State: closed - Opened by dennis-ji about 6 years ago - 1 comment

#52 - aiohttp 不支持https代理，有办法可以批量测试https代理吗

Issue - State: open - Opened by WalkOnMars over 6 years ago - 1 comment
Labels: enhancement

#51 - 对爬取ip的代码进行了优化, 正则全部替换成pyquery来提取

Issue - State: closed - Opened by HIT-Owen over 6 years ago - 1 comment

#50 - 代码看起来太费劲了，必须完全按照你书上来，才走的通

Issue - State: closed - Opened by zxcwolf over 6 years ago - 4 comments

#49 - redis的有序集合zadd方法变更

Issue - State: closed - Opened by cxapython over 6 years ago - 4 comments

#48 - AttributeError: 'OutStream' object has no attribute 'buffer'

Issue - State: closed - Opened by Heguanlin-rec over 6 years ago - 2 comments

#47 - 无法定时爬取新的代理

Issue - State: closed - Opened by Daniel19960601 over 6 years ago

#46 - 报了这个错误：requests.exceptions.ConnectionError：10054

Issue - State: closed - Opened by Hanoso over 6 years ago - 1 comment

#45 - 项目部署到Linux直接报错了

Issue - State: closed - Opened by jeeshv over 6 years ago - 1 comment

#44 - 在 VS Code 中运行异常 ~ 而且无法关闭

Issue - State: closed - Opened by mirrortan over 6 years ago - 3 comments

#43 - Update for redis3.0 db.py

Pull Request - State: closed - Opened by DemSephiroth over 6 years ago

#42 - 检查并更新代理网站的有效性

Pull Request - State: closed - Opened by Reyetz over 6 years ago

#41 - Proxy pool

Pull Request - State: closed - Opened by MarkShawn2020 over 6 years ago

#40 - http类型的ip测试结果不可用

Issue - State: closed - Opened by thirdcountry over 6 years ago

#39 - 能否获取能够破网的代理

Issue - State: closed - Opened by Crescentz over 6 years ago

#38 - error in db.py: fixed the problem by change line 30 with:

Issue - State: closed - Opened by Clairewr over 6 years ago - 1 comment

#37 - Fix#36

Pull Request - State: closed - Opened by DaYePython over 6 years ago

#36 - 增加对pipenv包管理器的支持

Issue - State: closed - Opened by DaYePython over 6 years ago - 1 comment

#35 - 关于trace back中db.py的问题

Issue - State: closed - Opened by Wade-D over 6 years ago - 1 comment

#34 - 大佬们，为什么我运行run.py之后就没反应了

Issue - State: closed - Opened by zxbzxb180 over 6 years ago - 3 comments

#33 - 创建了 Dockerfile

Pull Request - State: closed - Opened by zefu-lu almost 7 years ago - 1 comment

#30 - 是否存在管理redis connectionpool的问题？

Issue - State: closed - Opened by XyLearningProgramming almost 7 years ago - 1 comment

#29 - setup.py 里面的console_script

Issue - State: closed - Opened by XyLearningProgramming almost 7 years ago

#28 - 爬虫函数可以考虑增加一个直接读文件

Issue - State: closed - Opened by zouzhin almost 7 years ago - 1 comment

#27 - 新版redis中zadd改动

Issue - State: closed - Opened by canglan1024 almost 7 years ago - 2 comments

#26 - value is not a valid float

Issue - State: closed - Opened by Hoantrbl almost 7 years ago - 1 comment

#25 - 在使用的过程中出出现 AttributeError: 'int' object has no attribute 'items'

Issue - State: closed - Opened by Duchongc almost 7 years ago - 19 comments

#24 - 请问 AttributeError: type object 'URL' has no attribute 'build' 这个怎么解决

Issue - State: closed - Opened by HPudge almost 7 years ago - 1 comment

#23 - what/

Issue - State: closed - Opened by 1019wellBegin121 almost 7 years ago - 3 comments

#22 - Compatible with redis-py3.x

Pull Request - State: closed - Opened by kingkap about 7 years ago - 1 comment

#21 - 请教这个问题怎么解决？

Issue - State: closed - Opened by liuuuuuuuuuuu about 7 years ago

#20 - 关于redis-py版本问题

Issue - State: closed - Opened by lyh081 about 7 years ago - 4 comments

#19 - 大神：能不能做个docker，环境变化太多了

Issue - State: closed - Opened by disadone about 7 years ago - 4 comments

#18 - zincrby 新的版本redis-py有改动

Issue - State: closed - Opened by duolk about 7 years ago - 1 comment

#17 - 写入时报错

Issue - State: closed - Opened by wjx1018960145 about 7 years ago - 2 comments

#16 - requirements.txt中的 redis版本有限制

Issue - State: closed - Opened by SZFsir about 7 years ago - 6 comments