owner888/phpspider issues and pull requests

#170 - Update phpspider.php

Pull Request - State: closed - Opened by zbuse 2 months ago

#169 - PHP8运行官网demo报错

Issue - State: open - Opened by mouday over 2 years ago - 1 comment

#168 - 修复7.4.16版本报错bug--修复打个tag

Issue - State: open - Opened by holla-shiqiang over 2 years ago

#167 - 能不能内容也先点击一个动作，余下全文，然后再开始采集？

Issue - State: open - Opened by kavt over 2 years ago

#166 - 关于分页采集怎么搞都不对

Issue - State: open - Opened by kavt over 2 years ago - 2 comments

#165 - tp5 默认会写入一下报错到日志里面

Issue - State: open - Opened by know-that over 2 years ago - 2 comments

#164 - 关于attached_url的bug

Issue - State: open - Opened by yingzheng1980 over 2 years ago - 5 comments

#163 - 用js渲染数据的页面可以抓去吗？类似vue作为前段的

Issue - State: open - Opened by 262022334 over 2 years ago - 1 comment

#162 - 在用回调函数on_list_page去获得列表页数据时候，无法真正add_url

Issue - State: open - Opened by qizhenchao almost 3 years ago - 2 comments

#161 - 修复不兼容php8语法导致的错误

Pull Request - State: closed - Opened by Levi-Xia-github about 3 years ago

#160 - 关于知乎用户数据的爬虫我确实想过一个用途

Issue - State: open - Opened by Wildwizard404 over 3 years ago

#159 - 高版本PHP已废弃这种 $s0{0} 写法，请使用$s0[0]

Issue - State: open - Opened by twomiao almost 4 years ago - 2 comments

#158 - 如果知道动态网页的加载API并且也可以请求到json的数据，怎么能通过接口嵌入到框架里进一步抓取

Issue - State: open - Opened by smil4ever almost 4 years ago - 1 comment

#157 - 最新的知乎应该怎么爬

Issue - State: open - Opened by terranZY almost 4 years ago

#156 - 有遇到这个问题的吗？

Issue - State: open - Opened by 874033044 almost 4 years ago - 1 comment

#155 - 修复开启多任务未配置queue_config参数导致的错误

Pull Request - State: closed - Opened by kayw-geek over 4 years ago - 1 comment

#154 - 发现一个过时函数 & 一个 bug

Issue - State: closed - Opened by TianLanSky over 4 years ago - 3 comments

#153 - redis、mysql 执行长都出现了超时的情况

Issue - State: closed - Opened by test-lin over 4 years ago

#152 - 文档里的某个xpath不起作用

Issue - State: open - Opened by kekeyumuku over 4 years ago - 3 comments

#151 - 建议用swoole

Issue - State: closed - Opened by wo642436249 almost 5 years ago - 1 comment

#150 - [error] Domain of scan_urls ("https://bbs.zhibo8.cc/forum/list/?fid=62") does not match the domains of the domain name

Issue - State: closed - Opened by Jack-Z-png almost 5 years ago

#149 - 我在windows环境下运行了demo下的马蜂窝

Issue - State: open - Opened by 13723777644 about 5 years ago - 2 comments

#148 - 验证码识别问题

Issue - State: open - Opened by GMYXDS about 5 years ago - 1 comment

#147 - 页面数据超过3M爬虫不处理有什么解决办法吗？

Issue - State: open - Opened by lintingweiHS over 5 years ago - 1 comment

#146 - 爬虫返回空，itemID为别的都可以唯独4不行

Issue - State: closed - Opened by lintingweiHS over 5 years ago

#145 - 文档里面写支持 jsonpath，实际上代码里面没有实现？

Issue - State: closed - Opened by qiang-yu over 5 years ago - 1 comment

#144 - 你好请问怎么获取a标签的href属性呢已经看了文档 a@href了

Issue - State: open - Opened by generalbao over 5 years ago - 1 comment

#143 - 爬取速度好慢是不是被限速之类了呢？

Issue - State: open - Opened by woodzeng over 5 years ago - 2 comments

#142 - 大师你好怎么判断是否抓取完毕了？

Issue - State: open - Opened by MissAlang over 5 years ago - 6 comments

#141 - 爬取不同域名content_url_regexes怎么填写呢

Issue - State: open - Opened by ShareDo9 over 5 years ago

#140 - 以后能不能支持爬JS动态渲染的网址啊比如调用PhantomJS

Issue - State: open - Opened by kuniao almost 6 years ago

#139 - 回调函数on_start的一些问题

Issue - State: open - Opened by ghost almost 6 years ago

#138 - 抓取的页面中某个必须的field不存在,怎么把队列中的当前url去除

Issue - State: closed - Opened by zklknight almost 6 years ago

#137 - tasknum多任务报错,之前没错

Issue - State: closed - Opened by zklknight almost 6 years ago

#136 - 有没有类似python里PhantomJs的采集方式

Issue - State: closed - Opened by zklknight almost 6 years ago - 2 comments

#135 - 是用demo中的qiushibaike.php,无法导出csv或者sql

Issue - State: closed - Opened by adminspaceplatform almost 6 years ago - 2 comments

#134 - 自定义发现内容页URL的匹配规则

Pull Request - State: closed - Opened by woodylan almost 6 years ago

#133 - 自定义发现内容页的匹配规则

Pull Request - State: closed - Opened by woodylan almost 6 years ago

#132 - queue_rpush 方法去重了，add_url 重试是无法进入队列的……

Issue - State: open - Opened by keefe-wu almost 6 years ago - 1 comment

#131 - 这个项目是不是凉了，没人了吗【已回复,作者在维护】

Issue - State: open - Opened by rustxj almost 6 years ago - 3 comments

#130 - on_scan_page 和 on_list_page回调函数

Issue - State: open - Opened by security00 about 6 years ago - 1 comment

#129 - 我在on_fetch_url回调函数中，将当前页面抽取到url加入爬虫队列，发现这个url没有加入

Issue - State: open - Opened by beydeng about 6 years ago - 1 comment

#128 - 模拟登陆问题

Issue - State: open - Opened by crazyYG about 6 years ago

#127 - 这个判断是不是不对啊

Issue - State: closed - Opened by xchl about 6 years ago

#126 - 网址url没有去重,每次启动都会新建数据?

Issue - State: closed - Opened by lirko about 6 years ago

#125 - 内存溢出的问题

Issue - State: open - Opened by 8782230 over 6 years ago - 1 comment

#124 - 无法获取到列表页面的内容

Issue - State: open - Opened by HelplessMan over 6 years ago - 1 comment

#123 - 建议在get_urls方法增加钩子，方便添加额外的地址识别方法

Issue - State: open - Opened by baopaul over 6 years ago

#122 - db::init_mysql()找不到

Issue - State: closed - Opened by shohanshohan over 6 years ago - 1 comment

#121 - 在数据保存到数据库后，没有回调了吗？我想在这条数据保存到数据库后，引用它的ID，插入其它表

Issue - State: open - Opened by baopaul over 6 years ago - 1 comment

#120 - 正则匹配失效？

Issue - State: open - Opened by GENG824 over 6 years ago

#119 - 使用阿里云RDS配置提示:You not set a config array for connect!

Issue - State: closed - Opened by kingleoric over 6 years ago - 3 comments

#118 - fix check_cache $save_running_status

Pull Request - State: closed - Opened by awebc over 6 years ago - 1 comment

#117 - 请问如何处理重定向？

Issue - State: open - Opened by kingleoric over 6 years ago - 3 comments

#116 - 最新版本 public function check_cache() { if (!self::$use_redis) 删除了 || self::$save_running_state 导致所有任务都要STDIN输入Y/N,crontab下就有问题了

Issue - State: closed - Opened by awebc over 6 years ago

#115 - mysql能不能用pdo链接啊

Issue - State: open - Opened by u0mo5 over 6 years ago - 1 comment

#114 - selector返回 bool(false)?

Issue - State: closed - Opened by kingleoric over 6 years ago - 1 comment

#113 - repeated字段问题

Issue - State: open - Opened by 838514984 over 6 years ago

#112 - required用法有问题

Issue - State: open - Opened by jourdon over 6 years ago - 2 comments

#111 - a的地址相对路径问题

Issue - State: closed - Opened by 838514984 over 6 years ago - 8 comments

#110 - css selector只能提取出一条记录

Issue - State: closed - Opened by kingleoric over 6 years ago - 1 comment

#109 - 运行DEMO的时候提示[error] Export data to a database need Mysql support, unable to load mysqli extension

Issue - State: open - Opened by xmso over 6 years ago - 2 comments

#108 - 求助：为什么运行一段时间后就会停止运行了，但是还没有爬取完

Issue - State: closed - Opened by 838514984 over 6 years ago

#107 - 求助：log有find list page但是不走on_list_page回调

Issue - State: closed - Opened by 838514984 over 6 years ago - 2 comments

#106 - 可以提供一个离线文档吗

Issue - State: closed - Opened by 838514984 over 6 years ago - 6 comments

#105 - 碰到百度广告的js，只能抓取到js，内容则抓不到

Issue - State: open - Opened by a450153829 over 6 years ago - 1 comment

#104 - selector没法精确选取，不管是css还是xpath

Issue - State: open - Opened by tianles almost 7 years ago - 2 comments

#103 - 请问怎么抓取API的数据？

Issue - State: open - Opened by tianles almost 7 years ago - 3 comments

#102 - https://doc.phpspider.org/ 打开没内容显示了啊

Issue - State: open - Opened by hkui almost 7 years ago - 2 comments

#101 - 修复configs——之field 无效问题

Pull Request - State: open - Opened by tianakong almost 7 years ago - 1 comment

#100 - 如何在Android手机上运行phpspider

Issue - State: open - Opened by ljk99 almost 7 years ago - 2 comments

#99 - 2.1.3代理有问题，2.0.7没问题

Issue - State: open - Opened by eric4048 almost 7 years ago - 3 comments

#98 - 建议增加一个 on_before_download_page

Issue - State: open - Opened by xtremforce almost 7 years ago - 3 comments

#97 - 怎样定时爬取？

Issue - State: open - Opened by xtremforce almost 7 years ago - 1 comment

#96 - 有些内容页有分页、有些内容页没分页各位大佬是怎么写规则的?

Issue - State: closed - Opened by shuyabin almost 7 years ago - 1 comment

#95 - 多服务器采集.

Issue - State: open - Opened by shuyabin about 7 years ago - 1 comment

#94 - 想问下买了个阿布云的代理的问题

Issue - State: closed - Opened by neciszhang about 7 years ago - 1 comment

#93 - 验证码问题

Issue - State: open - Opened by sui28456049 about 7 years ago - 1 comment

#92 - 作者demo都运行不起来，为什么你不改呢？

Issue - State: open - Opened by chengfan2017 about 7 years ago - 6 comments

#91 - 修改 db.php中的 autocommit($mode = false)中的bug

Issue - State: open - Opened by fzh369 about 7 years ago - 1 comment

#90 - Update db.php

Pull Request - State: open - Opened by fzh369 about 7 years ago - 2 comments

#89 - 有没有计划添加协程进去

Issue - State: open - Opened by xinshengsiyu about 7 years ago - 1 comment

#88 - 抓取纯json数据的接口正则无效

Issue - State: open - Opened by tanguanglian about 7 years ago

#87 - 文档打不开

Issue - State: open - Opened by hbbdsqd about 7 years ago

#86 - 多任务无法执行起来是怎么回事?

Issue - State: open - Opened by xujinhui2015 about 7 years ago

#85 - phpspider.php 1848行有问题

Issue - State: open - Opened by yogihwang about 7 years ago

#84 - [发现Redis中有采集数据, 是否继续执行, 不继续则清空Redis数据重新采集]这里好像不能清理啊

Issue - State: closed - Opened by ieliwb over 7 years ago - 2 comments

#82 - css选择器是不是不行

Issue - State: open - Opened by valiner over 7 years ago - 4 comments

#67 - php版本为7.1.7，导出为csv文件时路径出错。

Issue - State: closed - Opened by serenehaly over 7 years ago - 1 comment

#65 - 修复selector::$dom_auth问题

Pull Request - State: closed - Opened by liesauer over 7 years ago - 1 comment

#56 - 当field有子项的时候，有些问题

Issue - State: open - Opened by iamMarkchu almost 8 years ago - 1 comment

#55 - 可以只采集列表页的数据吗？

Issue - State: open - Opened by a362642675 almost 8 years ago - 2 comments

#51 - 爬取蚂蜂窝数据出问题

Issue - State: open - Opened by callmeYe almost 8 years ago - 2 comments

GitHub / owner888/phpspider issues and pull requests