Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / dataabc/weiboSpider issues and pull requests
#638 - Fix BrowserCookieError in new browser versions and Linux server
Pull Request -
State: closed - Opened by RaoulBott 14 days ago
- 2 comments
#637 - 已经在 config.json 手动填入了 cookie 字段,还是报错 browser_cookie3.BrowserCookieError
Issue -
State: closed - Opened by RaoulBott 15 days ago
- 1 comment
Labels: bug
#636 - 爬到第111条微博时自动停止程序
Issue -
State: open - Opened by biejingaoguai 15 days ago
- 1 comment
Labels: failed
#635 - 配置好json后,用pycharm运行Python3 -m weibo_spider没有报错也没有任何输出
Issue -
State: open - Opened by biejingaoguai 15 days ago
- 11 comments
Labels: failed
#634 - 微博live图下载到本地是静态图片不是视频
Issue -
State: open - Opened by SameForYou 20 days ago
- 1 comment
Labels: bug
#633 - 希望增加一个出现'NoneType' object报错以后过几分钟自动重新运行的功能
Issue -
State: open - Opened by jackma64 about 1 month ago
- 1 comment
Labels: feature
#632 - 新版本google 浏览器,cookie获取出现错误
Issue -
State: open - Opened by WANGYE-2012 about 1 month ago
- 2 comments
Labels: feature
#631 - Readme 修改建议
Issue -
State: closed - Opened by Evifly about 1 month ago
- 1 comment
Labels: feature
#630 - 文档中部分图片链接失效
Issue -
State: closed - Opened by songzy12 about 2 months ago
- 2 comments
Labels: bug
#629 - 是否可以爬取微博群的成员信息
Issue -
State: open - Opened by fushengss about 2 months ago
- 2 comments
Labels: feature
#628 - Update FAQ.md
Pull Request -
State: closed - Opened by lycstar about 2 months ago
- 1 comment
#627 - Use the pypi index version of browser_cookie3 in requirements.txt
Pull Request -
State: closed - Opened by songzy12 about 2 months ago
- 1 comment
#626 - 运行一会下载了89条数据后,weibo.cn就访问不了。是被反爬策略禁止了吗?
Issue -
State: open - Opened by dahai001 about 2 months ago
- 1 comment
Labels: failed
#625 - File "D:\Ancaonda\Lib\site-packages\scrapy\core\spidermw.py", line 104, in process_sync for r in iterable: File "D:\Python Project\weibo-search-master\weibo\spiders\search.py", line 241, in parse_by_hour_province for weibo in self.parse_weibo(response): File "D:\Python Project\weibo-search-master\weibo\spiders\search.py", line 537, in parse_weibo weibo["ip"] = self.get_ip(bid) ~~~~~^^^^^^ File "D:\Ancaonda\Lib\site-packages\scrapy\item.py", line 85, in __setitem__ raise KeyError(f"{self.__class__.__name__} does not support field: {key}") KeyError: 'WeiboItem does not support field: ip'
Issue -
State: open - Opened by ycwang806 2 months ago
Labels: bug
#624 - WeiboItem does not support field: ip
Issue -
State: open - Opened by ycwang806 2 months ago
Labels: failed
#623 - 你好,我在setting.py中设置WEIBO_TYPE = 0,就运行不了,爬取不了数据是为什么。并且设置WEIBO_TYPE=2或者1的时候爬取不到头条url和发布位置和reweet_id是为什么# 要搜索的微博类型,0代表搜索全部微博,1代表搜索全部原创微博,2代表热门微博,3代表关注人微博,4代表认证用户微博,5代表媒体微博,6代表观点微博
Issue -
State: open - Opened by sansan303 2 months ago
- 3 comments
Labels: failed
#622 - 安装依赖出现问题
Issue -
State: open - Opened by Rexreak 2 months ago
- 1 comment
Labels: failed
#621 - 执行browser_cookie3.chrome(domain_name='weibo.cn')获取cookie报错, 没有权限
Issue -
State: closed - Opened by tzk007 2 months ago
- 2 comments
Labels: failed
#620 - 程序无法运行
Issue -
State: closed - Opened by cppchill 2 months ago
Labels: failed
#619 - 怎么解析cookie失败
Issue -
State: closed - Opened by asuka1715 2 months ago
- 5 comments
Labels: failed
#618 - 爬取视频失败
Issue -
State: open - Opened by cqc01 2 months ago
- 1 comment
Labels: failed
#617 - 爬取近x天或近x条的功能
Issue -
State: open - Opened by Takigawamiu 2 months ago
- 1 comment
Labels: feature
#616 - update: improved retrieval of cookies workflow
Pull Request -
State: closed - Opened by ahuangg 3 months ago
- 4 comments
#615 - fix: updated comment parser to align with test
Pull Request -
State: closed - Opened by ahuangg 3 months ago
#615 - fix: updated comment parser to align with test
Pull Request -
State: closed - Opened by ahuangg 3 months ago
#614 - feat: automated cookie grabbing for config.json (must be logged in on chrome)
Pull Request -
State: closed - Opened by ahuangg 3 months ago
- 1 comment
#614 - feat: automated cookie grabbing for config.json (must be logged in on chrome)
Pull Request -
State: closed - Opened by ahuangg 3 months ago
- 2 comments
#613 - 请问一下这个spider和那个crawler有什么区别啊?哪个比较好用?
Issue -
State: open - Opened by raymond8023 3 months ago
- 1 comment
#613 - 请问一下这个spider和那个crawler有什么区别啊?哪个比较好用?
Issue -
State: open - Opened by raymond8023 3 months ago
- 1 comment
#612 - 请问可以获取到某条微博的视频播放量数据吗?
Issue -
State: open - Opened by viyiY2K 3 months ago
- 3 comments
Labels: feature
#612 - 请问可以获取到某条微博的视频播放量数据吗?
Issue -
State: open - Opened by viyiY2K 3 months ago
- 2 comments
Labels: feature
#611 - cannot import name 'etree' from 'lxml'
Issue -
State: open - Opened by Ehcochwy 3 months ago
- 2 comments
Labels: bug
#610 - 简化cookie的获取教程
Issue -
State: open - Opened by Zemelee 3 months ago
- 2 comments
Labels: feature
#609 - end_date 设置为 now 无法正常爬取所有微博
Issue -
State: open - Opened by cinyearchan 3 months ago
- 2 comments
Labels: failed
#608 - 命令行模块化运行代码 python -m weibo_spider 参数问题
Issue -
State: closed - Opened by Znull-1220 4 months ago
- 2 comments
#607 - 某个微博id无法抓取到全部微博
Issue -
State: open - Opened by wyslmt 4 months ago
- 8 comments
Labels: bug
#606 - 能否获取某个地区的签到信息
Issue -
State: open - Opened by beautifulxu 4 months ago
- 1 comment
Labels: feature
#605 - 对微博进行评论爬取,文件comment_spider
Pull Request -
State: open - Opened by dream-xa 4 months ago
#604 - 报错indexerror
Issue -
State: open - Opened by Elena-zhan 5 months ago
- 3 comments
Labels: failed
#603 - 爬取大量微博内容如何解除限速
Issue -
State: open - Opened by bareawayme 5 months ago
- 1 comment
Labels: failed
#602 - line 1: b'ID C_5074630370399522 already defined' (line 1)
Issue -
State: open - Opened by cinyearchan 6 months ago
- 1 comment
Labels: failed
#601 - 指定用户2011年8月4号之前的微博内容爬取失败
Issue -
State: open - Opened by cinyearchan 6 months ago
- 2 comments
Labels: failed
#600 - 关于微博爬虫对于“网页链接”的爬取
Issue -
State: open - Opened by mTommy777 6 months ago
- 4 comments
Labels: feature
#599 - 运行出错
Issue -
State: open - Opened by yinqinghe 7 months ago
- 3 comments
Labels: failed
#598 - 在为特定用户加入独立since date时爬取失败
Issue -
State: open - Opened by abcabcaaaB 7 months ago
- 2 comments
Labels: bug
#597 - 右上角的微博视频号水印能不能找到无水印的视频链接
Issue -
State: open - Opened by yanghouqing 7 months ago
- 3 comments
#596 - 抓取一批账号信息,账号信息还没有抓取结束,但程序运行到一半就会报错,报错之后的数据抓取全部丢失,稳定复现,请问如何解决
Issue -
State: open - Opened by tonymao51 7 months ago
- 3 comments
Labels: failed
#595 - 抓取不全自动停止
Issue -
State: closed - Opened by Tan-Haoyi 7 months ago
- 3 comments
Labels: failed
#594 - 无法安装环境lxml4.9.1
Issue -
State: open - Opened by oliverance 8 months ago
- 7 comments
Labels: failed
#593 - 运行出错,无法连接
Issue -
State: open - Opened by alexhill2020 8 months ago
- 2 comments
Labels: failed
#592 - 想请教一下原始图片url怎么利用
Issue -
State: open - Opened by zbbb31 8 months ago
- 1 comment
#591 - 能否增加抓取精选评论数
Issue -
State: open - Opened by wangy408 8 months ago
- 1 comment
Labels: feature
#590 - 我是小白,请问怎么爬取微博全网内容,关键词怎么设置
Issue -
State: open - Opened by Redxhh 8 months ago
- 4 comments
Labels: feature
#589 - 部分ID爬取错误
Issue -
State: open - Opened by ciiio 9 months ago
- 1 comment
Labels: failed
#588 - 爬取用户信息时报错List out of range 但是爬取微博时正常
Issue -
State: open - Opened by YiCheng996 9 months ago
- 3 comments
Labels: failed
#587 - 请问怎么保存视频页面链接
Issue -
State: closed - Opened by SingleRottenChips 9 months ago
- 5 comments
#586 - 无法使用'NoneType' object has no attribute 'nickname',尝试过更换COOKIE
Issue -
State: closed - Opened by YiCheng996 9 months ago
- 3 comments
Labels: failed
#585 - build(deps): bump requests from 2.31.0 to 2.32.0
Pull Request -
State: closed - Opened by dependabot[bot] 9 months ago
Labels: dependencies
#584 - 关于获取到的粉丝数
Issue -
State: open - Opened by PayneXie 9 months ago
- 2 comments
Labels: feature
#583 - 解决 'NoneType' object has no attribute 'xpath'
Pull Request -
State: closed - Opened by zangwill 9 months ago
- 1 comment
#582 - 程序运行__main___出错
Issue -
State: closed - Opened by NocTurn294 10 months ago
- 7 comments
Labels: failed
#581 - 如果只想要微博用户的个人信息,如性别,生日等,但不想要其微博信息,需要怎么做啊?
Issue -
State: open - Opened by Azi-Zoey 10 months ago
- 1 comment
Labels: feature
#580 - build(deps): bump tqdm from 4.46.1 to 4.66.3
Pull Request -
State: closed - Opened by dependabot[bot] 10 months ago
Labels: dependencies
#579 - 报错During handling of the above exception, another exception occurred
Issue -
State: open - Opened by cqc01 10 months ago
- 1 comment
Labels: bug
#578 - 随机等待时长已经加到非常长了,但还是会在相似的页数被封禁
Issue -
State: open - Opened by EthanNCai 10 months ago
- 5 comments
Labels: failed
#577 - issues_feature_post_api_576 实现通过POST方式将数据推送到自定义接口
Pull Request -
State: closed - Opened by myshero 10 months ago
- 4 comments
#576 - 通过POST方式将数据推送到自定义接口
Issue -
State: closed - Opened by myshero 10 months ago
- 1 comment
Labels: feature
#575 - issues_bug_574 无法匹配获取微博长文,尝试修复
Pull Request -
State: closed - Opened by myshero 10 months ago
- 1 comment
#574 - 微博长文“展开”更多,无法获取完整长文内容
Issue -
State: closed - Opened by myshero 10 months ago
- 2 comments
Labels: bug
#573 - 报错一大堆
Issue -
State: open - Opened by MrTurtlelovel 10 months ago
- 3 comments
Labels: failed
#572 - nickname报错
Issue -
State: open - Opened by hanshenmesenaa 10 months ago
- 3 comments
Labels: failed
#571 - 关于main函数调用
Issue -
State: open - Opened by uichuan47 10 months ago
- 1 comment
#570 - 视频爬取失败
Issue -
State: open - Opened by asdqwe21212 10 months ago
- 3 comments
#569 - 视频播放量
Issue -
State: open - Opened by asdqwe21212 10 months ago
- 1 comment
Labels: feature
#568 - 无法运行
Issue -
State: closed - Opened by lcj12414 11 months ago
- 7 comments
Labels: failed
#567 - (unknown location)
Issue -
State: open - Opened by xwenr 11 months ago
- 1 comment
Labels: failed
#566 - 爬虫程序只爬取部分时间段的微博,并不是我设置的时间
Issue -
State: open - Opened by Fakesneaker 11 months ago
- 5 comments
Labels: failed
#565 - 为什么我写入csv的时候有时是乱码
Issue -
State: open - Opened by meisaikuangbiao 11 months ago
- 2 comments
Labels: failed
#564 - 无法使用了
Issue -
State: open - Opened by PIPPIJIA 11 months ago
- 2 comments
Labels: failed
#563 - 打包部署的问题
Issue -
State: closed - Opened by Answergeng 11 months ago
- 1 comment
#562 - 我想请问就是这个'X-Xsrf-Token': 'a62fb7'过期导致不能获得评论,还是说这个代码本来就是运行不通的
Issue -
State: open - Opened by markhome1 12 months ago
- 1 comment
#561 - 当前账号没有浏览该视频的权限
Issue -
State: closed - Opened by Liao-Ke 12 months ago
Labels: bug
#560 - 如果该UID没有新的内容,会重复在csv和txt文件中记录重复的title
Issue -
State: open - Opened by YouZhengChuan about 1 year ago
- 1 comment
Labels: feature
#559 - 配置了mysql,但是似乎没有创建任何database,也没有写任何数据到mysql
Issue -
State: closed - Opened by YouZhengChuan about 1 year ago
- 1 comment
Labels: bug
#558 - 可以添加一个获取阅读量选项吗?
Issue -
State: open - Opened by wp-x about 1 year ago
- 2 comments
Labels: feature
#557 - cookie错误或已过期,请按照README中方法重新获取
Issue -
State: closed - Opened by yangCHEN121520 about 1 year ago
- 1 comment
Labels: failed
#556 - 爬到1百多页还没有全部爬完时程序会自动结束
Issue -
State: open - Opened by lihaojiey about 1 year ago
- 2 comments
Labels: wontfix, failed
#555 - 通过用户 ID 删除图像链接
Issue -
State: open - Opened by codehelloworld22 about 1 year ago
- 3 comments
Labels: feature
#554 - 请问能否增加爬自己微博的阅读数
Issue -
State: open - Opened by blacksh1982 about 1 year ago
- 5 comments
Labels: wontfix, feature
#553 - 超话名人动态
Issue -
State: closed - Opened by Philae994 about 1 year ago
- 2 comments
Labels: feature
#552 - 可以爬访客记录吗?
Issue -
State: open - Opened by wuliqiangqiang about 1 year ago
- 2 comments
Labels: wontfix
#551 - cookie错误或已过期,请按照README中方法重新获取
Issue -
State: closed - Opened by ttZhang0512 about 1 year ago
- 4 comments
Labels: failed
#550 - 修复无法获取全文BUG
Pull Request -
State: closed - Opened by xiaocai3587 about 1 year ago
#549 - 请求商务推广合作
Issue -
State: open - Opened by fly7632785 about 1 year ago
- 3 comments
Labels: wontfix
#548 - 运行spider.py ,提示ImportError: attempted relative import with no known parent package,是为什么呢
Issue -
State: open - Opened by linzz03 about 1 year ago
- 2 comments
Labels: wontfix, failed
#547 - 我是小白,想问一下我下载了代码zip之后怎么用啊?
Issue -
State: open - Opened by linzz03 about 1 year ago
- 3 comments
Labels: wontfix
#546 - 我是小白,想问一下我下载了代码zip之后怎么用啊?
Issue -
State: open - Opened by linzz03 about 1 year ago
- 2 comments
Labels: wontfix
#545 - 更改page range后无法爬取微博
Issue -
State: closed - Opened by kadima221 over 1 year ago
- 1 comment
Labels: failed
#544 - 爬取微博时只获取了前几页内容就自动停止了,提示'NoneType' object has no attribute 'xpath'
Issue -
State: open - Opened by shiverwang76 over 1 year ago
- 3 comments
Labels: wontfix, failed
#543 - 'NoneType' object has no attribute 'xpath'报错
Issue -
State: open - Opened by astarrrr over 1 year ago
- 6 comments
Labels: failed