Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / nghuyong/WeiboSpider issues and pull requests

#343 - 成片的Crawled (200)

Issue - State: open - Opened by Macedonialapadian about 2 months ago

#342 - 302代码的问题

Issue - State: open - Opened by AAerQG 3 months ago - 2 comments

#341 - 能否按照超话主题进行爬取

Issue - State: open - Opened by Juice113 4 months ago

#340 - 微博评论采集无法采集评论的图片

Issue - State: open - Opened by Charimanhua 4 months ago

#339 - python run_spider.py user 完全没有反应

Issue - State: open - Opened by xyeah888 4 months ago - 1 comment

#338 - 运行comment报错

Issue - State: open - Opened by melon0918 4 months ago - 1 comment

#337 - 请求用于论文

Issue - State: open - Opened by pxaklbe 4 months ago

#336 - 爬取粉丝数，有严重问题。

Issue - State: open - Opened by Edward-WZ 5 months ago

#335 - 无法获取二级评论

Issue - State: open - Opened by FontTian 6 months ago - 2 comments

#334 - 感谢博主

Issue - State: open - Opened by Edward-WZ 6 months ago

#333 - 运行comment时报错

Issue - State: open - Opened by KINGJIJI0115 6 months ago

#332 - 问下这个应该安装哪个库啊

Issue - State: closed - Opened by KINGJIJI0115 6 months ago - 1 comment

#330 - 抓取转发关系出错

Issue - State: open - Opened by Mar2812 7 months ago - 1 comment

#329 - 如何控制抓取评论的数量？

Issue - State: open - Opened by tomriddle1234 7 months ago - 3 comments

#328 - 对于有位置的微博， geo字段会呈现数据吗？

Issue - State: closed - Opened by Godmyhave 7 months ago - 1 comment

#325 - 请问评论可以溯源嘛

Issue - State: open - Opened by Psyhang 7 months ago - 1 comment

#324 - 写入jsonl文件的代码在哪个位置？

Issue - State: closed - Opened by Juice113 7 months ago - 2 comments

#323 - 如何把对应推文的图片jpg下载下来？

Issue - State: closed - Opened by Juice113 7 months ago - 2 comments

#321 - 爬取微博热门分类下的博文

Issue - State: closed - Opened by dpbqlo 8 months ago

#318 - python3 run_spider.py user 出现问题

Issue - State: open - Opened by innerbboy 9 months ago - 5 comments

#317 - 爬取单个用户的微博不能超过50页。

Issue - State: closed - Opened by mamingsuper 10 months ago - 5 comments

#316 - 百度网盘的数据集分享链接失效了~

Issue - State: closed - Opened by iDestro 10 months ago

#315 - 爬取信息问题

Issue - State: closed - Opened by buzhihuoyefeng 10 months ago - 1 comment

#314 - 溯源问题

Issue - State: closed - Opened by freeze-l 11 months ago - 2 comments

#313 - 请问抓自己微博的时候能否增加抓阅读数这个字段？

Issue - State: closed - Opened by blacksh1982 11 months ago - 1 comment

#311 - 按指示git clone时报错

Issue - State: closed - Opened by xiongot 11 months ago - 2 comments

#310 - 写完不测试的吗

Issue - State: closed - Opened by kusen-alpha 11 months ago - 3 comments

#309 - 可以爬访客记录吗？

Issue - State: closed - Opened by wuliqiangqiang 11 months ago - 5 comments

#308 - 用户微博指定时间段下载

Issue - State: closed - Opened by mamingsuper 11 months ago - 3 comments

#307 - Bump scrapy from 2.5.1 to 2.10.1

Pull Request - State: open - Opened by dependabot[bot] about 1 year ago
Labels: dependencies

#306 - 关于数据量的问题

Issue - State: closed - Opened by Rocket-bw about 1 year ago - 1 comment

#305 - 新的爬虫报错了，geo字段是null

Issue - State: closed - Opened by irwinai about 1 year ago - 2 comments

#304 - [scrapy.core.engine] DEBUG: Crawled (200)

Issue - State: closed - Opened by Redstonee123 about 1 year ago - 1 comment

#302 - 请问有办法爬取2级评论吗？

Issue - State: closed - Opened by wyycommu about 1 year ago - 6 comments

#301 - 基于tweet_by_user_id输出结果没有用户user_id字段，如何解决？

Issue - State: closed - Opened by chenjinalei about 1 year ago - 3 comments

#300 - 运行结束后output文件夹为空

Issue - State: closed - Opened by fairyyin1 about 1 year ago - 1 comment

#299 - 请问一下这是什么问题

Issue - State: closed - Opened by haobosang about 1 year ago - 1 comment

#298 - 字段信息

Issue - State: closed - Opened by mamingsuper about 1 year ago - 1 comment

#297 - KeyError: 'geo'

Issue - State: closed - Opened by treedom over 1 year ago - 1 comment

#296 - 关于根据关键字检索的问题

Issue - State: closed - Opened by freeze-l over 1 year ago - 1 comment

#295 - 可以支持基于m.weibo的爬虫吗

Issue - State: closed - Opened by haobosang over 1 year ago - 1 comment

#294 - 收到风呢

Pull Request - State: closed - Opened by nghuyong over 1 year ago

#293 - 这个模块要怎么搞啊

Issue - State: closed - Opened by 75slll over 1 year ago - 1 comment

#292 - Repost issue

Issue - State: closed - Opened by JunchengGuo over 1 year ago - 6 comments

#290 - scrapy出现问题

Issue - State: closed - Opened by twilight1024 over 1 year ago - 1 comment

#289 - Update README.md

Pull Request - State: closed - Opened by 46319943 over 1 year ago - 1 comment

#288 - 运行run_spider时出现问题

Issue - State: closed - Opened by xiaolan-blue over 1 year ago - 1 comment

#287 - 用户博文爬取可以设置时间范围筛选吗？

Issue - State: closed - Opened by wyycommu over 1 year ago - 1 comment

#286 - 大佬，请问可以安排一个断点续爬功能吗？

Issue - State: closed - Opened by bingo6666 over 1 year ago - 1 comment

#284 - [Bug Report] 关键词搜索，每次搜会爬到一堆无关的内容

Issue - State: closed - Opened by yuzhangsjtu over 1 year ago - 4 comments

#283 - ip代理设置以及数据量

Issue - State: closed - Opened by Rocket-bw over 1 year ago - 3 comments

#282 - 输出结果为json要这么设置？

Issue - State: closed - Opened by shuangxi2006 over 1 year ago - 1 comment

#281 - [Bug Report] parse_tweet_info can't extract source properly.

Issue - State: closed - Opened by pyvadev over 1 year ago - 1 comment

#280 - [Bug Report] longTextContent get error

Issue - State: closed - Opened by pyvadev over 1 year ago - 1 comment

#279 - [Bug Report] Video url extract failed

Issue - State: closed - Opened by pyvadev over 1 year ago

#278 - [ADD] add .gitignore and cookie pool feature.

Pull Request - State: closed - Opened by pyvadev over 1 year ago

#277 - fix search.py mblogid extract reg.

Pull Request - State: closed - Opened by pyvadev over 1 year ago

#275 - 求助大佬，这个可以打破200页微博数量限制吗

Issue - State: closed - Opened by twilight1024 over 1 year ago - 3 comments

#274 - 大佬可以设置爬取发布时间范围的配置吗

Issue - State: closed - Opened by zhouyt168 over 1 year ago - 3 comments
Labels: enhancement

#273 - IP筛选

Issue - State: closed - Opened by ZozoQa over 1 year ago - 2 comments

#272 - 有tweet id，想爬取单条微博内容。

Issue - State: closed - Opened by YIDAMU over 1 year ago - 3 comments
Labels: enhancement

#271 - Feat wyp

Pull Request - State: closed - Opened by hotWater-me over 1 year ago

#270 - 请问如何将微博发布地区确定在市级行政单位？

Issue - State: closed - Opened by DuanJiaHao914 over 1 year ago - 1 comment

#269 - 最多爬取50页就停下了

Issue - State: closed - Opened by wSatoru over 1 year ago - 1 comment

#268 - 请问代理目前还能用嘛？

Issue - State: closed - Opened by BNDSllx over 1 year ago - 2 comments

#266 - 不能爬取单用户的所有历史微博

Issue - State: closed - Opened by shaoyaoqian almost 2 years ago - 1 comment

#265 - fix regex bug

Pull Request - State: closed - Opened by LvehaoShen almost 2 years ago

#264 - 基于关键词的微博检索无法正常使用

Issue - State: closed - Opened by LvehaoShen almost 2 years ago - 2 comments

#263 - 请问一下，通过pic_urls保存图片403该怎么解决

Issue - State: closed - Opened by a824899245 almost 2 years ago - 2 comments

#261 - 向大佬表示感谢

Issue - State: closed - Opened by huifeng-kooboo almost 2 years ago - 1 comment

#260 - 评论的回复

Issue - State: closed - Opened by Erinwww almost 2 years ago - 2 comments

#258 - ModuleNotFoundError: No module named 'spiders'

Issue - State: closed - Opened by effock about 2 years ago - 6 comments

#257 - weibo.com关键字搜索只显示50页

Issue - State: closed - Opened by guanguxiansheng about 2 years ago - 4 comments
Labels: enhancement

#256 - 微博过长的话只能截取前半部分

Issue - State: closed - Opened by stevaon about 2 years ago - 2 comments
Labels: enhancement

#255 - 关于配置

Issue - State: closed - Opened by Alpenl about 2 years ago - 6 comments
Labels: enhancement

#254 - OSError: [Errno 22] Invalid argument

Issue - State: closed - Opened by Gillian1998457 about 2 years ago - 2 comments

#253 - 请问能不能实现按关键词爬取微博以及评论

Issue - State: closed - Opened by DYH-Devil about 2 years ago - 2 comments

#252 - can not get all fans list

Issue - State: closed - Opened by Misaka-Mikoto-Tech about 2 years ago - 1 comment

#251 - 如何进行关键词爬取

Issue - State: closed - Opened by cauzp about 2 years ago - 1 comment

#250 - add proxy function

Pull Request - State: closed - Opened by XuanlongQ about 2 years ago - 2 comments

#244 - 一级评论还是全部评论

Issue - State: closed - Opened by lzy318 over 2 years ago - 1 comment

#240 - 基于关键词的搜索用不了了吗？

Issue - State: closed - Opened by chenslcool over 2 years ago - 2 comments

#234 - 建议更改 获取微博原始图片url

Issue - State: closed - Opened by Wenswell about 3 years ago - 2 comments

#224 - 抓取包含关键词的微博出错

Issue - State: closed - Opened by Slian22 over 3 years ago - 5 comments

#139 - 微博免验证码小号购买途径[实时更新]

Issue - State: closed - Opened by nghuyong over 4 years ago - 41 comments