Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / spatie/crawler issues and pull requests

#475 - Max crawl depth not working

Issue - State: open - Opened by sasa-andjelic-nqode 2 months ago

#472 - CrawlUrl getId access before initialization

Issue - State: closed - Opened by Redominus 3 months ago

#467 - Check original URL against depth tree when visited link is a redirect

Pull Request - State: closed - Opened by superpenguin612 5 months ago - 5 comments

#466 - Using a maximum depth prevents redirected links from being crawled

Issue - State: closed - Opened by superpenguin612 5 months ago - 1 comment

#465 - Cookies in clientOptions

Issue - State: closed - Opened by davidgeisler1998 8 months ago - 2 comments

#462 - Add request factory

Pull Request - State: closed - Opened by asbiin 9 months ago - 2 comments

#461 - Add Laravel/Illuminate 11 Support

Pull Request - State: closed - Opened by Jubeki 9 months ago - 4 comments

#460 - Fix wording in documentation

Pull Request - State: closed - Opened by adamtomat 10 months ago - 1 comment

#458 - feat: custom link parser

Pull Request - State: closed - Opened by Velka-DEV 11 months ago - 4 comments

#456 - Allow Symfony 7.x

Pull Request - State: closed - Opened by thecaliskan 11 months ago - 1 comment

#453 - Cannot install under php 8.1.2

Issue - State: closed - Opened by maverickchangithub about 1 year ago

#452 - Fix return type

Pull Request - State: closed - Opened by riesjart about 1 year ago - 1 comment

#451 - Fix for crawler stopping issue

Pull Request - State: closed - Opened by buismaarten about 1 year ago - 7 comments

#449 - Define only needed methods in observer implementation

Pull Request - State: closed - Opened by buismaarten about 1 year ago - 1 comment

#447 - Depth tree structure

Issue - State: closed - Opened by Xaelp about 1 year ago - 1 comment

#446 - Update dependencies

Pull Request - State: closed - Opened by koertho about 1 year ago

#445 - Check if rel attribute contains nofollow

Pull Request - State: closed - Opened by robbinbenard over 1 year ago - 1 comment

#444 - Add link text

Pull Request - State: closed - Opened by freekmurze over 1 year ago

#442 - Crawler simply stops

Issue - State: closed - Opened by mrtnmueller over 1 year ago

#440 - Modify URLs before crawl

Pull Request - State: closed - Opened by codealfa almost 2 years ago - 5 comments
Labels: revisit for next major version

#437 - Add PHP 8.2 Support

Pull Request - State: closed - Opened by patinthehat almost 2 years ago - 1 comment

#434 - Call to undefined method GuzzleHttp\Client::getConfig()

Issue - State: closed - Opened by tommusrhodus about 2 years ago - 1 comment

#432 - Make setParseableMimeTypes prevent URLs from being crawled

Pull Request - State: closed - Opened by arturzealves about 2 years ago - 3 comments

#429 - Custom/extendable `CrawlUrl`

Issue - State: closed - Opened by rudiedirkx about 2 years ago

#428 - `CrawlObserver` and `CrawlProfile` interfaces

Issue - State: closed - Opened by rudiedirkx about 2 years ago

#426 - Network.getAllCookies

Issue - State: closed - Opened by futureweb over 2 years ago - 3 comments

#423 - Extract link text

Issue - State: closed - Opened by simonschaufi over 2 years ago

#422 - Follow all redirects, including HTML meta and Javascript

Issue - State: closed - Opened by rzb over 2 years ago

#421 - Fix Puppeteer installation instructions link

Pull Request - State: closed - Opened by DvDty over 2 years ago - 1 comment

#418 - Request Type

Issue - State: closed - Opened by Dr-Maspix over 2 years ago

#417 - Update .gitattributes

Pull Request - State: closed - Opened by angeljqv over 2 years ago - 1 comment

#402 - Add the ability to change the default baseUrl scheme

Pull Request - State: closed - Opened by arnissolle over 2 years ago - 1 comment

#401 - Feat/convert phpunit tests to pest

Pull Request - State: closed - Opened by mansoorkhan96 over 2 years ago - 1 comment

#399 - setConcurrency not working if using browsershoot

Issue - State: closed - Opened by lenusch over 2 years ago

#397 - Maximum depth not working in subsequent request

Issue - State: closed - Opened by dacdam over 2 years ago - 3 comments

#396 - Fix issue #395

Pull Request - State: closed - Opened by Elysiome over 2 years ago - 1 comment

#392 - Keep only guzzlehttp/psr7 v2.0

Pull Request - State: closed - Opened by flangofas about 3 years ago - 3 comments

#391 - Replace stream_for with Utils::streamFor

Pull Request - State: closed - Opened by NicolasMica about 3 years ago - 1 comment

#388 - Update CrawlRequestFailed.php

Pull Request - State: closed - Opened by asefsoft about 3 years ago - 1 comment

#387 - Browsershot timeout unhandled

Issue - State: closed - Opened by MichaelNino about 3 years ago - 1 comment

#384 - Very poor documentation.

Issue - State: closed - Opened by bohdanbaida about 3 years ago

#382 - ConnectException's message is not transfered to crawlFailed

Issue - State: closed - Opened by jszczypk about 3 years ago

#380 - Honeypot

Issue - State: closed - Opened by mitmelon about 3 years ago - 4 comments

#379 - [v7.0.2] Undefined method stream_for

Issue - State: closed - Opened by flangofas about 3 years ago - 1 comment

#378 - http referer of the crawled url

Issue - State: closed - Opened by aimagician about 3 years ago - 2 comments

#377 - Laravel and Vapor

Issue - State: closed - Opened by Andrew-Hike about 3 years ago - 1 comment

#376 - Best way to limit similar urls

Issue - State: closed - Opened by aaronbauman about 3 years ago - 2 comments

#375 - Test against php 8.1

Pull Request - State: closed - Opened by sergiy-petrov about 3 years ago - 1 comment

#374 - Can't install with Laravel 8.57

Issue - State: closed - Opened by morawcik about 3 years ago - 6 comments

#373 - Update README.md

Pull Request - State: closed - Opened by mansoorkhan96 over 3 years ago

#371 - change response type hint

Pull Request - State: closed - Opened by scrlkx over 3 years ago - 1 comment

#369 - Binary files are parsed, ignoring setParseableMimeTypes

Issue - State: closed - Opened by jespejoh over 3 years ago - 2 comments

#368 - Added laravel application as exemple of using laravel model as queue

Pull Request - State: closed - Opened by insign over 3 years ago - 1 comment

#366 - Error install with laravel 6.x

Issue - State: closed - Opened by caocanhlinh over 3 years ago

#365 - V7

Pull Request - State: closed - Opened by freekmurze over 3 years ago

#364 - Add PHP 8-only Support (v7)

Pull Request - State: closed - Opened by patinthehat over 3 years ago - 1 comment

#361 - Redirect URLs including info similar to cURL

Issue - State: closed - Opened by RobertEcker over 3 years ago

#358 - Bugfix: infinite loops when a CrawlProfile prevents crawling

Pull Request - State: closed - Opened by mattiasgeniar over 3 years ago - 1 comment

#357 - Crawl stops when 1st page is a redirection

Issue - State: closed - Opened by flmommens over 3 years ago - 1 comment

#355 - How can I get the response body from crawled?

Issue - State: closed - Opened by vFire over 3 years ago

#354 - How Can I get the status code of each response

Issue - State: closed - Opened by vFire almost 4 years ago - 1 comment

#353 - "The promise was rejected" Exception

Issue - State: closed - Opened by flmommens almost 4 years ago - 10 comments

#352 - setParseableMimeTypes() not working

Issue - State: closed - Opened by flmommens almost 4 years ago - 5 comments

#351 - cURL error 28: Operation timed

Issue - State: closed - Opened by flmommens almost 4 years ago - 1 comment

#346 - Improve PHPunit fixture

Pull Request - State: closed - Opened by peter279k almost 4 years ago

#345 - Fix support for PHP 8.0 in v5

Pull Request - State: closed - Opened by Bapawe almost 4 years ago - 1 comment

#344 - Update run-tests.yml

Pull Request - State: closed - Opened by Bapawe almost 4 years ago - 3 comments

#343 - Fix support for PHP 8.0 in v4

Pull Request - State: closed - Opened by Bapawe almost 4 years ago - 1 comment

#342 - Allow HTML response transformations prior to DOM parser execution

Pull Request - State: closed - Opened by pajoda almost 4 years ago - 1 comment

#341 - Undefined method setCurrentCrawlLimit

Issue - State: closed - Opened by QuantBits almost 4 years ago

#340 - Crawler processes out of scope page after redirect

Issue - State: closed - Opened by spekulatius almost 4 years ago - 2 comments

#339 - Not install package in framwork yii3

Issue - State: closed - Opened by sanchezzzhak almost 4 years ago - 1 comment

#338 - test

Pull Request - State: closed - Opened by emreakay almost 4 years ago

#337 - v6

Pull Request - State: closed - Opened by freekmurze almost 4 years ago

#336 - how to know when a link is found for the second/third... time?

Issue - State: closed - Opened by bobemoe about 4 years ago - 3 comments
Labels: revisit for next major version

#335 - Modify html before DomCrawler

Issue - State: closed - Opened by posipa about 4 years ago - 3 comments

#334 - Support for PHP 8.0

Pull Request - State: closed - Opened by pascalbaljet about 4 years ago - 7 comments

#333 - Support for symfony v4?

Issue - State: closed - Opened by Defcon0 about 4 years ago - 6 comments

#331 - Allow for chunked crawls by not running the queue empty (fixes #325)

Pull Request - State: closed - Opened by spekulatius about 4 years ago - 32 comments

#330 - Fixing namespace in README and reference to CollectionCrawlQueue

Pull Request - State: closed - Opened by spekulatius about 4 years ago - 2 comments

#329 - Readme: Fix wrong namespace for CrawlObserver

Pull Request - State: closed - Opened by bjoernhasse about 4 years ago - 1 comment

#328 - Crawl with php

Issue - State: closed - Opened by aditya3008 about 4 years ago

#326 - Tweak variable naming in ArrayCrawlQueue

Pull Request - State: closed - Opened by spekulatius about 4 years ago - 2 comments

#325 - Crawling larger sites

Issue - State: closed - Opened by spekulatius about 4 years ago - 7 comments

#324 - Browsershot exceptions unhandled

Issue - State: closed - Opened by kmcluckie about 4 years ago - 7 comments

#323 - Updating list of Queue options

Pull Request - State: closed - Opened by spekulatius about 4 years ago - 2 comments

#322 - SSL Problem

Issue - State: closed - Opened by Tomut0 about 4 years ago

#321 - Fix incorrect CrawlProfile namespace in readme

Pull Request - State: closed - Opened by kmcluckie about 4 years ago - 1 comment

#320 - Apply fixes from StyleCI

Pull Request - State: closed - Opened by freekmurze about 4 years ago

#319 - Apply fixes from StyleCI

Pull Request - State: closed - Opened by freekmurze about 4 years ago

#318 - v5

Pull Request - State: closed - Opened by freekmurze about 4 years ago

#317 - v5

Pull Request - State: closed - Opened by freekmurze about 4 years ago