Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / nghuyong/WeiboSpider issues and pull requests

#124 - 请问代理ip这里怎么弄

Issue - State: closed - Opened by angolin22 almost 5 years ago - 20 comments

#100 - 如何在Middlewares中实现动态获取IP

Issue - State: closed - Opened by CharesFang about 5 years ago - 2 comments

#99 - 关于爬取失败和恢复的问题

Issue - State: closed - Opened by CharesFang about 5 years ago - 2 comments

#97 - 关于IP代理池的问题

Issue - State: closed - Opened by 854350999 about 5 years ago - 2 comments

#96 - mongo数据库的问题

Issue - State: closed - Opened by 854350999 about 5 years ago - 2 comments

#95 - 确定可行吗？

Issue - State: closed - Opened by ZQbd about 5 years ago - 1 comment

#94 - 账号池+分布式 运行问题

Issue - State: closed - Opened by 2655398311 about 5 years ago - 3 comments

#93 - 并行问题

Issue - State: closed - Opened by 2655398311 about 5 years ago - 2 comments

#92 - 微博418

Issue - State: closed - Opened by 2655398311 about 5 years ago - 10 comments

#91 - 爬虫什么时候会停

Issue - State: closed - Opened by 2655398311 about 5 years ago - 4 comments

#90 - 粉丝问题

Issue - State: closed - Opened by 2655398311 about 5 years ago - 4 comments

#89 - 19年8月cookie问题

Issue - State: closed - Opened by DQmyth over 5 years ago - 2 comments

#88 - 获取更多的关注人

Issue - State: closed - Opened by sjpmpzx over 5 years ago - 4 comments

#87 - 请教search分支无法爬到数据

Issue - State: closed - Opened by Ryan0lb over 5 years ago - 1 comment

#86 - 请教一下search分支import本地包的报错

Issue - State: closed - Opened by Ryan0lb over 5 years ago

#85 - 请教Search分支如何修改关键字

Issue - State: closed - Opened by Ryan0lb over 5 years ago - 1 comment

#84 - 构建帐号池失败

Issue - State: closed - Opened by zezhishao over 5 years ago - 3 comments

#83 - mongodb中没有数据存储

Issue - State: closed - Opened by Ryan0lb over 5 years ago - 5 comments

#82 - Scrapy被反爬虫了

Issue - State: closed - Opened by xhlgogo over 5 years ago - 2 comments

#81 - 你好，爬取的微博评论数据不全

Issue - State: closed - Opened by ALMA6 over 5 years ago - 1 comment

#80 - 爬不到任何数据 空跑

Issue - State: closed - Opened by PeiyuXu over 5 years ago - 2 comments

#79 - 表情符号字段在哪

Issue - State: closed - Opened by InterFisher over 5 years ago - 5 comments

#78 - 关键词检索

Issue - State: closed - Opened by rrsun over 5 years ago - 2 comments

#77 - 请问下现在有爬取转发和转发层级的方法吗？谢谢！

Issue - State: closed - Opened by HUANGZHIHAO1994 over 5 years ago - 1 comment

#75 - 无法加载sina.items模块

Issue - State: closed - Opened by ALAYLM over 5 years ago - 2 comments

#74 - 模拟登陆一直弹图文验证码，是不是小号和代理ip有问题？

Issue - State: closed - Opened by shimachao over 5 years ago - 1 comment

#73 - 在search版本中总是出错

Issue - State: closed - Opened by ztt07 over 5 years ago - 1 comment

#72 - Scrapy中Item的作用

Issue - State: closed - Opened by bjjdkp over 5 years ago - 1 comment

#71 - 关于代理IP作者有什么推荐的

Issue - State: closed - Opened by LiuBaoxi over 5 years ago - 9 comments

#70 - 粉丝限制爬取了

Issue - State: closed - Opened by liumingli1 over 5 years ago - 1 comment

#69 - 关于存储cookies

Issue - State: closed - Opened by pyh007 over 5 years ago - 1 comment

#68 - 关于数据库的使用

Issue - State: closed - Opened by pyh007 over 5 years ago - 1 comment

#67 - weibo.cn和weibo.com的区别

Issue - State: closed - Opened by pyh007 over 5 years ago - 1 comment

#66 - 多账号登录问题

Issue - State: closed - Opened by iamxiaojianzheng over 5 years ago - 1 comment

#65 - help

Issue - State: closed - Opened by rainbow979 over 5 years ago - 1 comment

#64 - 关于大量账号和ip问题

Issue - State: closed - Opened by fanyao1983 over 5 years ago - 2 comments

#63 - content bug

Issue - State: closed - Opened by caolusg over 5 years ago - 3 comments

#62 - 模拟登陆有问题

Issue - State: closed - Opened by shimachao over 5 years ago - 1 comment

#61 - 请问有没有搜索指定博主所有微博的代码

Issue - State: closed - Opened by caolusg over 5 years ago - 1 comment

#60 - weibo.cn和weibo.com的cookie可以共用吗？

Issue - State: closed - Opened by shimachao over 5 years ago - 1 comment

#59 - list index out of range

Issue - State: closed - Opened by broholens over 5 years ago - 2 comments

#58 - 关于获取状态码的问题

Issue - State: closed - Opened by gybuay over 5 years ago - 1 comment

#57 - 下载中间件

Issue - State: closed - Opened by FrankYang3110 over 5 years ago - 1 comment

#56 - 希望能获取微博图片和视频url，能下载最好

Issue - State: closed - Opened by hphhhphh over 5 years ago - 2 comments

#55 - 转发的微博里原始内容不会被抓取下来吗？

Issue - State: closed - Opened by zongjingyao over 5 years ago - 1 comment

#54 - 爬取文本不全，表情 后面的文本会丢失。

Issue - State: closed - Opened by Qiegaocode over 5 years ago - 10 comments

#53 - 如何在这个代码的基础上加入IP池？

Issue - State: closed - Opened by Qiegaocode over 5 years ago - 1 comment

#52 - 爬取带链接表情的微博内容时会丢弃img标签后的内容

Issue - State: closed - Opened by gybuay over 5 years ago - 1 comment

#51 - 如何实时抓取微博内容

Issue - State: closed - Opened by Qiegaocode over 5 years ago - 1 comment

#50 - 无法获取cookies

Issue - State: closed - Opened by acehinnnqru over 5 years ago - 5 comments

#49 - IP池的加入

Issue - State: closed - Opened by leisun123 over 5 years ago - 1 comment

#48 - Add a interactive way to login

Pull Request - State: closed - Opened by valar000 over 5 years ago

#47 - ip 被封了!!!请更换ip,或者停止程序...

Issue - State: closed - Opened by buwanglsc over 5 years ago - 1 comment

#46 - 如何获取微博中@的人的信息

Issue - State: closed - Opened by XiaoXE over 5 years ago - 2 comments

#45 - 账号池+分布式分支的爬虫工具不能用了吗

Issue - State: closed - Opened by Bingogogogogo over 5 years ago - 2 comments

#44 - AttributeError: 'NoneType' object has no attribute 'xpath'

Issue - State: closed - Opened by damonj over 5 years ago - 2 comments

#43 - 单机版今天出现连接失败

Issue - State: closed - Opened by LiuBaoxi over 5 years ago - 1 comment

#42 - 单条微博内容你抓全了吗

Issue - State: closed - Opened by mkx-python over 5 years ago - 3 comments

#41 - 爬取数据不全

Issue - State: closed - Opened by OHKUE over 5 years ago - 2 comments

#40 - 第一个字符丢失

Issue - State: closed - Opened by QishengLi over 5 years ago - 2 comments

#39 - 貌似现在有两个问题

Issue - State: closed - Opened by LiuBaoxi over 5 years ago - 1 comment

#38 - 请问微博的地理位置信息如何获取

Issue - State: closed - Opened by Tritonl almost 6 years ago - 1 comment

#37 - 爬出来的文字是乱码或者？？

Issue - State: closed - Opened by DreamSki almost 6 years ago

#36 - https://www.weibo.com/6040505795/Gea9qoNl9?type=comment#_rnd1549178402411

Issue - State: closed - Opened by caolusg almost 6 years ago - 1 comment

#35 - 有没有办法查询当前还有多少个链接没有爬完？

Issue - State: closed - Opened by caolusg almost 6 years ago - 1 comment

#34 - https://weibo.com/1631641650/H7cTe8otL

Issue - State: closed - Opened by caolusg almost 6 years ago - 1 comment

#33 - 可否分享一下构建ip池的代码和步骤

Issue - State: closed - Opened by caolusg almost 6 years ago - 8 comments

#32 - 账号池的方法已经完全没法用了。前几天还可以

Issue - State: closed - Opened by caolusg almost 6 years ago - 2 comments

#30 - 好像表情以及表情之后的文字都被丢弃了。

Issue - State: closed - Opened by caolusg almost 6 years ago - 1 comment

#29 - 有没无差别爬取的代码？

Issue - State: closed - Opened by caolusg almost 6 years ago - 1 comment

#28 - 验证码变为点击验证

Issue - State: closed - Opened by FontTian almost 6 years ago - 4 comments

#27 - 为什么每次只能抓到21条微博啊

Issue - State: closed - Opened by gao0210 almost 6 years ago - 1 comment

#25 - wap站好像开始封IP了

Issue - State: closed - Opened by joelYing almost 6 years ago - 4 comments

#24 - weibo.cn无法登陆获取cookie

Issue - State: closed - Opened by SmilePoorCat almost 6 years ago - 1 comment

#23 - 能否通过表的界面查看爬取的数据？

Issue - State: closed - Opened by Lizzy-Yue almost 6 years ago - 1 comment

#22 - 请问创建账号池以后怎么连接爬虫？

Issue - State: closed - Opened by ZhangFanglue almost 6 years ago - 1 comment

#21 - 微博限制能看到的关注数量为5页

Issue - State: closed - Opened by linzizhan almost 6 years ago - 3 comments

#20 - 抓取到的关注和粉丝数量不一致是为什么呢？

Issue - State: closed - Opened by xinosaur almost 6 years ago - 8 comments

#19 - Request里的dont_filter=True有什么作用？

Issue - State: closed - Opened by douyadaydayup almost 6 years ago - 1 comment

#18 - 请问我抓取的comment为什么为空？代码没改过

Issue - State: closed - Opened by ghost almost 6 years ago - 3 comments

#16 - redis 报错

Issue - State: closed - Opened by DanerHeart almost 6 years ago - 1 comment

#14 - Weibo_spider报错

Issue - State: closed - Opened by DennisYuu almost 6 years ago - 1 comment

#13 - 抓取不到所有的微博内容

Issue - State: closed - Opened by DanerHeart almost 6 years ago - 14 comments

#12 - MongoDB数据库需要自己建表吗？

Issue - State: closed - Opened by WDevin about 6 years ago - 4 comments

#11 - 分布式千万级中mongodb性能插入能撑住吗？

Issue - State: closed - Opened by wmy1334 about 6 years ago - 3 comments

#10 - 示例代码simple中，应该不止抓取人民日报和新华社吧

Issue - State: closed - Opened by DanerHeart about 6 years ago - 4 comments

#9 - 没遇到验证码的情况是不是不能获取到cookie？

Issue - State: closed - Opened by Jiayi-Fang96 about 6 years ago - 8 comments

#8 - Exception: 当前账号池为空

Issue - State: closed - Opened by hinanmu about 6 years ago - 1 comment

#7 - 验证码位置 326 486 438 598 'NoneType' object is not subscriptable

Issue - State: closed - Opened by Mrrrrr10 about 6 years ago - 1 comment

#6 - 獲取不到微博內容

Issue - State: closed - Opened by loksum about 6 years ago - 3 comments

#5 - Senior

Pull Request - State: closed - Opened by tslmy about 6 years ago

#4 - Don't panic when no account is marked useable

Pull Request - State: closed - Opened by tslmy about 6 years ago - 1 comment

#2 - 登陆cookie的没有用宫格验证吧？

Issue - State: closed - Opened by qgking about 6 years ago - 1 comment