Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / yujiosaka/headless-chrome-crawler issues and pull requests

#390 - correct allowedDomains filtering when crawling

Pull Request - State: closed - Opened by rom3r4 over 1 year ago

#389 - Update packages; e2e test

Pull Request - State: closed - Opened by rom3r4 over 1 year ago

#388 - merge fork repositories onto this one

Pull Request - State: closed - Opened by rom3r4 over 1 year ago

#387 - fix RedisCache

Pull Request - State: open - Opened by milahu almost 2 years ago

#386 - Proxy not working --proxy-server

Issue - State: open - Opened by byposeidon over 2 years ago

#385 - Can some one guide me how to use proxy ips with this?

Issue - State: closed - Opened by iamprageeth over 2 years ago - 1 comment

#384 - How can i make customCrawl click on specific elements?

Issue - State: open - Opened by michaelpapesch over 2 years ago - 1 comment

#383 - [bug]hang ..........

Issue - State: closed - Opened by hktalent over 2 years ago

#382 - i get a JSHandle@node string instead of a ElementHandle object

Issue - State: open - Opened by jriffs almost 3 years ago

#380 - Update dependency version; Ignore pdf link to avoid crash

Pull Request - State: open - Opened by mypchas6fans about 3 years ago

#379 - Bump Puppeteer version

Pull Request - State: open - Opened by negrusti over 3 years ago - 1 comment

#378 - Provide auth to page when using proxy

Issue - State: open - Opened by tsrdatatech over 3 years ago

#377 - Is there a way to scroll?

Issue - State: open - Opened by menloai almost 4 years ago - 4 comments

#376 - Crawling site with maxDepth > 2 causes hang

Issue - State: open - Opened by TheTFo almost 4 years ago - 3 comments

#375 - Protocol error: Connection closed. Most likely the page has been closed.

Issue - State: closed - Opened by redhotchili almost 4 years ago - 1 comment

#374 - fix: πŸ”’ update dependencies to fix vulnerabilities:

Pull Request - State: closed - Opened by anton-k-git about 4 years ago

#374 - fix: πŸ”’ update dependencies to fix vulnerabilities:

Pull Request - State: closed - Opened by anton-k-git about 4 years ago

#373 - Are links with empty href ignored? (button links handled by page js)

Issue - State: open - Opened by YuriGor about 4 years ago - 1 comment

#372 - Develop

Pull Request - State: closed - Opened by peter-edgescan about 4 years ago

#372 - Develop

Pull Request - State: closed - Opened by peter-edgescan about 4 years ago

#371 - Can Update Puppeteer version to 5.2.1

Issue - State: closed - Opened by shangdev about 4 years ago

#371 - Can Update Puppeteer version to 5.2.1

Issue - State: closed - Opened by shangdev about 4 years ago

#370 - Updated customCrawl method to expose

Pull Request - State: closed - Opened by framirezsandino over 4 years ago

#369 - how set append?

Issue - State: closed - Opened by hktalent over 4 years ago

#368 - how overwrite cache set function?

Issue - State: closed - Opened by hktalent over 4 years ago

#368 - how overwrite cache set function?

Issue - State: closed - Opened by hktalent over 4 years ago

#367 - how disabled "UnhandledPromiseRejectionWarning: Error: Protocol error"

Issue - State: closed - Opened by hktalent over 4 years ago - 1 comment

#366 - Update dependancies to remove vulnerabilities detected by sync

Pull Request - State: closed - Opened by kuccello over 4 years ago

#365 - Disable loading images

Issue - State: closed - Opened by Lusitaniae over 4 years ago - 2 comments

#364 - Get current URL in customCrawl()

Issue - State: open - Opened by popstas over 4 years ago - 3 comments
Labels: feature

#363 - Update redis to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] over 4 years ago - 2 comments
Labels: greenkeeper

#362 - Save HTML and CSS instead of screenshot?

Issue - State: closed - Opened by marioliu almost 5 years ago - 3 comments

#361 - Too many branches

Issue - State: closed - Opened by 00000o1 almost 5 years ago - 1 comment

#361 - Too many branches

Issue - State: closed - Opened by 00000o1 almost 5 years ago - 1 comment

#360 - Check for a non-null document before looking for links

Pull Request - State: open - Opened by dancodes almost 5 years ago

#360 - Check for a non-null document before looking for links

Pull Request - State: open - Opened by dancodes almost 5 years ago

#359 - Is this project still active?

Issue - State: closed - Opened by laoshaw almost 5 years ago - 2 comments

#359 - Is this project still active?

Issue - State: closed - Opened by laoshaw almost 5 years ago - 2 comments

#358 - UnhandledPromiseRejectionWarning: Error: socket hang up

Issue - State: closed - Opened by hubitor almost 5 years ago - 3 comments

#356 - Can someone create an extension for me? Please

Issue - State: closed - Opened by Gasha0 about 5 years ago - 1 comment

#355 - Question: Handling of pdf files

Issue - State: open - Opened by eladbitton about 5 years ago - 1 comment
Labels: bug

#355 - Question: Handling of pdf files

Issue - State: open - Opened by eladbitton about 5 years ago - 1 comment
Labels: bug

#354 - crawler.response becomes null when connecting to specific chrome instance

Issue - State: closed - Opened by carlkentor about 5 years ago - 3 comments
Labels: bug

#354 - crawler.response becomes null when connecting to specific chrome instance

Issue - State: closed - Opened by carlkentor about 5 years ago - 3 comments
Labels: bug

#353 - Update commitlint to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] over 5 years ago - 3 comments
Labels: greenkeeper

#352 - Workaround for exposeFunction issue

Pull Request - State: closed - Opened by maartenvantjonger over 5 years ago - 2 comments

#350 - Security Vulnerability - Upgrade puppeteer version

Issue - State: closed - Opened by flyingUnderTheRadar over 5 years ago - 2 comments

#349 - WebSocket is not open when 'maxrequestreached' event is reached

Issue - State: open - Opened by LeMoussel over 5 years ago - 1 comment
Labels: bug

#348 - WebSocket is not open

Issue - State: closed - Opened by mike-aungsan over 5 years ago - 6 comments

#348 - WebSocket is not open

Issue - State: closed - Opened by mike-aungsan over 5 years ago - 6 comments

#347 - Update eslint-plugin-import to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] over 5 years ago - 10 comments
Labels: greenkeeper

#347 - Update eslint-plugin-import to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] over 5 years ago - 10 comments
Labels: greenkeeper

#346 - Update jquery to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] over 5 years ago - 3 comments
Labels: greenkeeper

#346 - Update jquery to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] over 5 years ago - 3 comments
Labels: greenkeeper

#345 - Is it possible to use puppeteer-core to decrease install size?

Issue - State: closed - Opened by riccardogiorato over 5 years ago - 4 comments

#345 - Is it possible to use puppeteer-core to decrease install size?

Issue - State: closed - Opened by riccardogiorato over 5 years ago - 4 comments

#344 - Error: Protocol error (Target.closeTarget): Target closed.

Issue - State: open - Opened by yeekit-jewel over 5 years ago - 3 comments
Labels: bug

#343 - Pages with 403 errors not throwing errors

Issue - State: open - Opened by mrispoli24 over 5 years ago - 1 comment
Labels: feature

#342 - Adding args flags on launch for Heroku usage

Issue - State: closed - Opened by mrispoli24 over 5 years ago

#342 - Adding args flags on launch for Heroku usage

Issue - State: closed - Opened by mrispoli24 over 5 years ago

#341 - Update eslint to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] over 5 years ago - 21 comments
Labels: greenkeeper

#341 - Update eslint to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] over 5 years ago - 21 comments
Labels: greenkeeper

#340 - Update request-promise to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] over 5 years ago - 2 comments
Labels: greenkeeper

#339 - Security vulnerability for lodash

Issue - State: closed - Opened by kkotamr over 5 years ago

#339 - Security vulnerability for lodash

Issue - State: closed - Opened by kkotamr over 5 years ago

#338 - Crawl stops on non-www URLs

Issue - State: open - Opened by cosmiXs almost 6 years ago - 5 comments
Labels: bug

#338 - Crawl stops on non-www URLs

Issue - State: open - Opened by cosmiXs almost 6 years ago - 5 comments
Labels: bug

#337 - Dynamically named screenshots

Issue - State: closed - Opened by Zsoltbenyey almost 6 years ago - 13 comments

#336 - How to handle the timeout error?

Issue - State: open - Opened by gajus almost 6 years ago - 2 comments
Labels: feature

#336 - How to handle the timeout error?

Issue - State: open - Opened by gajus almost 6 years ago - 2 comments
Labels: feature

#335 - Load Page Images

Issue - State: closed - Opened by amerlin almost 6 years ago - 1 comment

#335 - Load Page Images

Issue - State: closed - Opened by amerlin almost 6 years ago - 1 comment

#333 - Headless-Chrome-Crawler, gives different Url results for different runs

Issue - State: closed - Opened by SriGitHubSri almost 6 years ago - 1 comment

#333 - Headless-Chrome-Crawler, gives different Url results for different runs

Issue - State: closed - Opened by SriGitHubSri almost 6 years ago - 1 comment

#332 - crawling website with hashes in url

Issue - State: closed - Opened by jlvdh almost 6 years ago - 2 comments

#331 - Update mime to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] almost 6 years ago - 6 comments
Labels: greenkeeper

#330 - Can some one supply more complex example？

Issue - State: closed - Opened by inevity almost 6 years ago - 1 comment

#330 - Can some one supply more complex example？

Issue - State: closed - Opened by inevity almost 6 years ago - 1 comment

#329 - Update robots-parser to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] almost 6 years ago
Labels: greenkeeper

#328 - chore: yarn upgrade

Pull Request - State: closed - Opened by khrisrichardson about 6 years ago

#328 - chore: yarn upgrade

Pull Request - State: closed - Opened by khrisrichardson about 6 years ago

#327 - fix greenkeeper

Pull Request - State: closed - Opened by khrisrichardson about 6 years ago - 1 comment

#327 - fix greenkeeper

Pull Request - State: closed - Opened by khrisrichardson about 6 years ago - 1 comment

#326 - How to broad crawl?

Issue - State: closed - Opened by matheuschimelli about 6 years ago - 11 comments

#325 - Crawling not working when maxConcurrency is not 1

Issue - State: closed - Opened by simlevesque about 6 years ago - 2 comments

#325 - Crawling not working when maxConcurrency is not 1

Issue - State: closed - Opened by simlevesque about 6 years ago - 2 comments

#324 - feat: added support for "evaluatePageArgs" #306

Pull Request - State: closed - Opened by tomothumb about 6 years ago

#324 - feat: added support for "evaluatePageArgs" #306

Pull Request - State: closed - Opened by tomothumb about 6 years ago

#323 - Update @types/debug to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] about 6 years ago - 6 comments
Labels: greenkeeper

#323 - Update @types/debug to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] about 6 years ago - 6 comments
Labels: greenkeeper

#322 - Update husky to the latest version πŸš€

Pull Request - State: closed - Opened by greenkeeper[bot] about 6 years ago - 42 comments
Labels: greenkeeper

#321 - Shuffle queue

Issue - State: closed - Opened by davidebaldini about 6 years ago - 3 comments

#321 - Shuffle queue

Issue - State: closed - Opened by davidebaldini about 6 years ago - 3 comments

#319 - Suggestion: crawl results can be saved as sitemap.xml

Issue - State: closed - Opened by kamanwu-oicr about 6 years ago - 4 comments