Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / NikolaiT/se-scraper issues and pull requests

#100 - Google scholar support

Issue - State: open - Opened by zedthegreat 11 months ago

#99 - Bump flat and mocha

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#98 - Bump express from 4.17.1 to 4.17.3

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#97 - Bump qs and express

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#96 - Bump got from 9.6.0 to 11.8.5

Pull Request - State: open - Opened by dependabot[bot] over 2 years ago
Labels: dependencies

#95 - Feat/add custom url

Pull Request - State: open - Opened by kazerlelutin almost 3 years ago

#94 - Bump async from 2.6.3 to 2.6.4

Pull Request - State: open - Opened by dependabot[bot] almost 3 years ago
Labels: dependencies

#93 - Bump pathval from 1.1.0 to 1.1.1

Pull Request - State: open - Opened by dependabot[bot] about 3 years ago
Labels: dependencies

#91 - Bump merge-deep from 3.0.2 to 3.0.3

Pull Request - State: open - Opened by dependabot[bot] over 3 years ago
Labels: dependencies

#90 - Bump lodash from 4.17.14 to 4.17.21

Pull Request - State: open - Opened by dependabot[bot] almost 4 years ago
Labels: dependencies

#89 - Bump ua-parser-js from 0.7.21 to 0.7.24

Pull Request - State: open - Opened by dependabot[bot] almost 4 years ago
Labels: dependencies

#88 - Bump underscore from 1.9.1 to 1.13.1

Pull Request - State: open - Opened by dependabot[bot] almost 4 years ago
Labels: dependencies

#87 - Bump y18n from 4.0.0 to 4.0.1

Pull Request - State: open - Opened by dependabot[bot] almost 4 years ago
Labels: dependencies

#86 - google scraper doesn't return any results

Issue - State: open - Opened by najibmargae almost 4 years ago - 1 comment

#85 - Concurrency in container

Issue - State: open - Opened by UmutAlihan about 4 years ago

#84 - 30000 ms

Issue - State: closed - Opened by ahmed-akram about 4 years ago

#83 - Google Search Engine doesn't return any ads

Issue - State: open - Opened by pankajjha over 4 years ago - 3 comments

#82 - fix query selectors for google organic results

Pull Request - State: open - Opened by przemek-nowicki over 4 years ago

#81 - Scraping in google returns no results (chinese queries)

Issue - State: open - Opened by richardzhu64 over 4 years ago - 5 comments

#80 - Bump lodash from 4.17.14 to 4.17.19

Pull Request - State: closed - Opened by dependabot[bot] over 4 years ago - 1 comment
Labels: dependencies

#78 - why page.setCacheEnabled not work

Issue - State: closed - Opened by leadscloud over 4 years ago - 2 comments

#77 - Fix/inner text on undefined

Pull Request - State: open - Opened by HugoPoi over 4 years ago

#76 - Parse multiple local html files instead of keywords

Issue - State: open - Opened by pankajjha-cd over 4 years ago - 1 comment

#75 - trying to run docker, can't open docker-entrypoint

Issue - State: closed - Opened by ryx2 over 4 years ago - 2 comments

#74 - Quickstart not run

Issue - State: closed - Opened by vuvanquy1998 almost 5 years ago - 1 comment

#73 - [Question] What is the `right_info` in google SERP ?

Issue - State: open - Opened by thangng48 almost 5 years ago

#72 - Browser Language

Issue - State: closed - Opened by gregghawes almost 5 years ago - 3 comments

#71 - "start" setting not working as intended.

Issue - State: open - Opened by scottie almost 5 years ago

#70 - Feat/keep html on error

Pull Request - State: open - Opened by HugoPoi almost 5 years ago

#69 - Throw error object with more information when error connecting to proxy

Issue - State: open - Opened by piyu-sh almost 5 years ago - 1 comment

#68 - Ref A/B/C Error when running headless?

Issue - State: open - Opened by GeorgeWillaman almost 5 years ago

#66 - Feature Request: Option to pass Puppeteer executable path

Issue - State: open - Opened by mabc224 about 5 years ago

#65 - Google Image is changing

Issue - State: open - Opened by topikuning about 5 years ago

#64 - Examples require statements

Issue - State: open - Opened by bpw1621 about 5 years ago

#63 - Is there a way to use auth with proxy?

Issue - State: open - Opened by jaekunchoi about 5 years ago - 2 comments

#62 - Take screenshot before modifying HTML

Pull Request - State: closed - Opened by aularon about 5 years ago

#61 - Refactor/use original puppeteer cluster

Pull Request - State: closed - Opened by HugoPoi about 5 years ago - 2 comments

#59 - Refactor logging

Pull Request - State: closed - Opened by HugoPoi about 5 years ago

#58 - refactor(proxy): remove proxy option not working replace by proxies

Pull Request - State: closed - Opened by HugoPoi about 5 years ago

#57 - Unable to enable google's

Issue - State: open - Opened by nklapste about 5 years ago

#56 - Publish puppeteer cluster fork

Issue - State: closed - Opened by HugoPoi about 5 years ago

#55 - Error: Cannot find module './puppeteer-cluster/dist/index.js'

Issue - State: open - Opened by ortizjavi about 5 years ago - 1 comment

#54 - Duckduckgo wait_for_results selector doesn't work in case of no results

Issue - State: open - Opened by PinkSheep about 5 years ago - 1 comment

#53 - Dockerfile

Issue - State: open - Opened by LevavasseurYann about 5 years ago

#52 - Added post install script to build the puppeteer-cluster, and also ad…

Pull Request - State: closed - Opened by kujaomega about 5 years ago

#51 - Error: Proxy output ip <proxy-ip> does not match with provided one

Issue - State: open - Opened by ceylanb over 5 years ago - 2 comments

#50 - Docker image not working at download and a build

Issue - State: closed - Opened by QuentinAdt over 5 years ago - 1 comment

#49 - The browser does not start in docker

Issue - State: closed - Opened by lingharto over 5 years ago - 1 comment

#48 - STANDARD_TIMEOUT too low

Issue - State: closed - Opened by raigorx over 5 years ago - 1 comment

#47 - Scrape "People also ask" from search engines

Issue - State: open - Opened by handsomezebra over 5 years ago - 1 comment

#46 - Trouble with offsetting search results

Issue - State: closed - Opened by cmaycumber over 5 years ago

#45 - add process supervisor for starting server.js

Pull Request - State: closed - Opened by slotix over 5 years ago

#44 - Get number of results from Google News

Issue - State: open - Opened by mayankgautam over 5 years ago

#43 - Is possible remove filetype:pdf and get only links?

Issue - State: closed - Opened by jariojose over 5 years ago - 1 comment

#42 - Clean integration tests with mocha

Pull Request - State: closed - Opened by HugoPoi over 5 years ago - 1 comment

#41 - Fix broken Google News selectors, fixes #40

Pull Request - State: closed - Opened by victor9000 over 5 years ago

#40 - google_news and google_news_old return empty result set

Issue - State: closed - Opened by slotix over 5 years ago - 1 comment

#39 - Formatting Scraper Results

Issue - State: open - Opened by mattjonesseo over 5 years ago - 1 comment

#38 - Help wanted

Issue - State: closed - Opened by NikolaiT over 5 years ago - 3 comments
Labels: help wanted, good first issue

#37 - incomplete dataset is returned if puppeteer_cluster_config -> maxConcurrency > 1

Issue - State: closed - Opened by slotix over 5 years ago - 2 comments

#36 - Set different geolocation for every request

Issue - State: open - Opened by mpassion over 5 years ago - 2 comments
Labels: bug

#35 - Results from google maps = undefined

Issue - State: closed - Opened by c-o-x over 5 years ago - 4 comments

#34 - Can I pass in an array instead of a file when using multiple proxy?

Issue - State: closed - Opened by mxmaxi007 over 5 years ago - 1 comment

#33 - Add html output option

Pull Request - State: closed - Opened by HugoPoi over 5 years ago - 1 comment

#32 - Google results capture extra text

Issue - State: closed - Opened by GoldenZero over 5 years ago - 1 comment

#31 - Browser Disconnect after crash

Issue - State: closed - Opened by naqushab over 5 years ago - 7 comments
Labels: bug

#30 - Modularize scraper modules

Issue - State: closed - Opened by tobiasmuehl over 5 years ago - 2 comments
Labels: enhancement

#29 - Why puppeteer instead of just curl?

Issue - State: closed - Opened by lcjury over 5 years ago - 1 comment

#28 - custom results selector

Issue - State: closed - Opened by ayhid over 5 years ago - 4 comments

#27 - Rotating proxy avaible ?

Issue - State: open - Opened by Hubson93 over 5 years ago - 8 comments
Labels: help wanted

#26 - Noob Question. Best way to restart search after crash..

Issue - State: closed - Opened by JoshCourt over 5 years ago - 1 comment

#25 - random_user_agent: true --> was wrong, no random

Issue - State: closed - Opened by yehchge over 5 years ago - 1 comment

#24 - Regex for keywords?

Issue - State: closed - Opened by SimonSays909 over 5 years ago - 1 comment

#23 - can we scrape data only for specific a time period and specfic locations?

Issue - State: closed - Opened by mittalsarthak over 5 years ago - 1 comment
Labels: enhancement, good first issue

#22 - How i can use only proxy?

Issue - State: closed - Opened by deniro21 almost 6 years ago - 1 comment

#21 - build docker image

Pull Request - State: closed - Opened by slotix almost 6 years ago - 1 comment

#20 - Docker support

Issue - State: closed - Opened by slotix almost 6 years ago - 10 comments

#19 - Safe per IP Google limits?

Issue - State: open - Opened by sf-steve almost 6 years ago - 3 comments
Labels: good first issue, question

#18 - Unable to use with authenticated proxy

Issue - State: closed - Opened by NSpehler almost 6 years ago - 4 comments

#17 - Add html output only function

Pull Request - State: closed - Opened by ghost almost 6 years ago

#16 - Errors installing on Raspbian Stretch Lite (2018-11-13)

Issue - State: closed - Opened by dr3x almost 6 years ago - 2 comments

#15 - Install Fail Unable to launch browser for worker, error message: Failed to launch chrome!

Issue - State: closed - Opened by neotokio almost 6 years ago - 5 comments
Labels: bug

#14 - Missing submodule files and package.json missing some dependencies

Issue - State: closed - Opened by HugoPoi almost 6 years ago - 6 comments

#13 - google_news_old settings

Issue - State: closed - Opened by kederrac almost 6 years ago - 1 comment

#12 - run multiple search engines and execute all promises before other action

Issue - State: closed - Opened by kederrac almost 6 years ago - 2 comments

#11 - Baidu wrong

Issue - State: closed - Opened by lisinaner almost 6 years ago - 2 comments

#10 - Speech to text recognition

Issue - State: closed - Opened by shadaxv almost 6 years ago - 1 comment

#9 - A bit more help for total noobs

Issue - State: closed - Opened by sdspieg almost 6 years ago - 1 comment

#8 - Create LICENSE

Pull Request - State: closed - Opened by NikolaiT about 6 years ago

#7 - Create CODE_OF_CONDUCT.md

Pull Request - State: closed - Opened by NikolaiT about 6 years ago

#6 - json output error

Issue - State: closed - Opened by indiclinguist about 6 years ago - 2 comments

#5 - Scraping with multiple Search Engines? [Question]

Issue - State: closed - Opened by hubitor about 6 years ago - 1 comment

#4 - ... detected the scraping. Aborting.

Issue - State: closed - Opened by indiclinguist about 6 years ago - 5 comments

#3 - using a keyword file

Issue - State: closed - Opened by indiclinguist about 6 years ago - 1 comment

#2 - Limit the number of search result

Issue - State: closed - Opened by NathanFSavoie about 6 years ago - 1 comment

#1 - Hey everyone.

Issue - State: open - Opened by NikolaiT about 6 years ago - 15 comments
Labels: help wanted, question