Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / gocolly/colly issues and pull requests

#825 - Why the latest version was released on 2020?

Issue - State: open - Opened by liuyi 24 days ago

#824 - [Possible bug] colly returns 403, but http.Get returns 200

Issue - State: closed - Opened by ir2718 about 2 months ago - 1 comment

#823 - 链接访问出错, 无法再次访问

Issue - State: closed - Opened by kaylee595 about 2 months ago - 1 comment

#822 - Multipart body should not be `map[string][]byte`

Issue - State: open - Opened by abiriadev 2 months ago

#821 - Respect robots.txt by default

Pull Request - State: open - Opened by jstmrby 3 months ago

#819 - Don't pass unused parameters in fetch method

Pull Request - State: open - Opened by roarc0 4 months ago

#818 - Add wikipedia example

Pull Request - State: open - Opened by sarahegler 4 months ago

#817 - New release?

Issue - State: open - Opened by melroy89 4 months ago - 3 comments

#816 - Expand GitHub Actions

Pull Request - State: open - Opened by amarcum 4 months ago - 4 comments

#815 - robotsMap memory continues to grow

Issue - State: open - Opened by ZigHuang 5 months ago - 1 comment

#814 - Can't provide duplicate key values when POSTing form data

Issue - State: open - Opened by ngc 5 months ago

#813 - Bump golang.org/x/net from 0.17.0 to 0.23.0

Pull Request - State: open - Opened by dependabot[bot] 5 months ago
Labels: dependencies

#812 - fix : retry redirect to AlreadyVisitedUrl will loop error

Pull Request - State: open - Opened by Shinku-Chen 6 months ago

#811 - Fix more cases of pages redirecting to themselves

Pull Request - State: open - Opened by WGH- 6 months ago - 4 comments

#810 - Test on Go 1.22, drop old versions

Pull Request - State: closed - Opened by WGH- 6 months ago

#809 - scrapper -> scraper Update README.md

Pull Request - State: closed - Opened by ideabrian 6 months ago

#808 - Implement content sniffing for HTML parsing

Pull Request - State: closed - Opened by WGH- 6 months ago - 1 comment

#807 - Bump google.golang.org/protobuf from 1.24.0 to 1.33.0

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago - 1 comment
Labels: dependencies

#806 - Error trying to conditionally set up proxy function

Issue - State: closed - Opened by sstehniy 8 months ago - 1 comment

#805 - retry redirect to AlreadyVisitedUrl will loop error

Issue - State: open - Opened by Shinku-Chen 8 months ago - 1 comment

#804 - Add HTTPDriver interface and chromedp implementation

Pull Request - State: closed - Opened by markwinter 8 months ago

#803 - Support BFS search .

Issue - State: open - Opened by summerlove66 9 months ago

#802 - Weird async behaviour - duplicates in responses

Issue - State: open - Opened by AlexS778 9 months ago - 1 comment

#801 - Post Login not persist session

Issue - State: open - Opened by IgorDePaula 9 months ago - 1 comment

#800 - Allow access to unsanitized file name

Pull Request - State: open - Opened by j0hax 9 months ago - 1 comment

#799 - how to by pass c.OnError

Issue - State: open - Opened by quangnx99 9 months ago - 3 comments

#798 - How to handle selector not found?

Issue - State: open - Opened by pl33x 9 months ago

#797 - Using async wisely

Pull Request - State: open - Opened by VerusK 9 months ago

#796 - Duplicated requests

Issue - State: closed - Opened by riklus 10 months ago - 1 comment

#795 - Next release - When?

Issue - State: open - Opened by Nordalf 10 months ago

#794 - Fix Bug: retry scrape will lost POST requestData

Pull Request - State: closed - Opened by Shinku-Chen 10 months ago - 4 comments

#793 - Update User-Agent strings for Firefox/Opera/Chrome/Edge

Pull Request - State: open - Opened by mtskg 11 months ago

#792 - Fix attempt to read gzip content from responses that cannot contain content

Pull Request - State: closed - Opened by seedifferently 11 months ago - 4 comments

#791 - Remove dead links in README.md

Pull Request - State: closed - Opened by Dim-P 11 months ago

#790 - handleOnXML tries to parse`.xlsx` files

Issue - State: open - Opened by theseanything 12 months ago - 2 comments
Labels: bug

#789 - Bump golang.org/x/net from 0.7.0 to 0.17.0

Pull Request - State: closed - Opened by dependabot[bot] 12 months ago - 1 comment
Labels: dependencies

#788 - Encoding detection fix

Pull Request - State: open - Opened by blagoySimandov 12 months ago

#787 - Encoding detection fix

Pull Request - State: closed - Opened by blagoySimandov 12 months ago

#786 - put accept header before OnRequest

Pull Request - State: closed - Opened by k4lizen 12 months ago - 5 comments

#785 - Replaced deprecated io/ioutil package with proper implementations of …

Pull Request - State: closed - Opened by zachary-walters 12 months ago - 1 comment

#784 - TLS Client support - bypass 403 Forbidden errors on sites like StockX, Indeed, etc!

Pull Request - State: open - Opened by cullenwatson about 1 year ago - 2 comments

#783 - Cannot send request with no Accept header

Issue - State: closed - Opened by k4lizen about 1 year ago - 1 comment

#782 - support for Request option model

Pull Request - State: open - Opened by lingdor about 1 year ago - 1 comment

#781 - support error in context of response

Pull Request - State: open - Opened by lingdor about 1 year ago - 1 comment

#780 - support for Request option model

Pull Request - State: closed - Opened by lingdor about 1 year ago

#779 - support for Request option model

Pull Request - State: closed - Opened by lingdor about 1 year ago

#778 - request chan error

Issue - State: open - Opened by JBossBC about 1 year ago - 1 comment

#777 - HTML encoding is not autodetected properly

Issue - State: open - Opened by Dinver about 1 year ago - 6 comments
Labels: bug

#776 - Is there a way spider for "https://netbanking.hdfcbank.com/netbanking" with my owner account?

Issue - State: closed - Opened by zhucan about 1 year ago - 1 comment
Labels: question

#775 - Added start for login method

Pull Request - State: closed - Opened by Yuki-known about 1 year ago

#774 - Queue Depth functionality + Panic with Async

Pull Request - State: open - Opened by KristinnVikar about 1 year ago

#773 - Different MaxDepth on AllowedDomains and others ?

Issue - State: closed - Opened by Tazeg over 1 year ago - 3 comments
Labels: question

#772 - Add mtnmunuklu/lescatit to the list of projects using Colly

Pull Request - State: open - Opened by mtnmunuklu over 1 year ago

#771 - Fix data races

Pull Request - State: closed - Opened by WGH- over 1 year ago

#770 - I have a request that I don't know how to make using Colly.

Issue - State: closed - Opened by yuzhiyizhan over 1 year ago - 1 comment
Labels: question

#769 - Misleading Request.Depth documentation

Issue - State: open - Opened by WGH- over 1 year ago - 1 comment

#768 - SIGSEG on local files

Issue - State: closed - Opened by mlunax over 1 year ago - 1 comment
Labels: question

#767 - Fetching data that is not coming in curl output

Issue - State: closed - Opened by aman556 over 1 year ago - 1 comment
Labels: question

#766 - Refactor existing caching mechanism into pluggable system

Pull Request - State: open - Opened by unjello over 1 year ago - 2 comments

#765 - Update User-Agent strings for 2023

Pull Request - State: closed - Opened by guessi over 1 year ago - 10 comments

#764 - Colly has vulnerabilities with medium criticality

Issue - State: open - Opened by m-carneiro over 1 year ago - 4 comments

#762 - User Agent update and Edge Browser UA addition

Issue - State: closed - Opened by samirsss over 1 year ago - 3 comments

#761 - XMLElement.Attr causes runtime error

Issue - State: closed - Opened by unjello over 1 year ago - 1 comment

#760 - fix(sec): upgrade golang.org/x/net to 0.7.0

Pull Request - State: closed - Opened by chncaption over 1 year ago - 1 comment

#759 - Proxies are not rotated

Issue - State: open - Opened by regnull over 1 year ago - 1 comment

#758 - Styling in the documentation looks broken

Issue - State: open - Opened by deshetti over 1 year ago - 2 comments

#757 - Added new repo

Pull Request - State: closed - Opened by Xatta-Trone over 1 year ago

#756 - Bump golang.org/x/net from 0.0.0-20220114011407-0dd24b26b47d to 0.7.0

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago
Labels: dependencies

#755 - fixed fixCharset ignore not enough bug

Pull Request - State: open - Opened by lorentz-wu over 1 year ago

#754 - Ignore certain MIME types in fixCharset is not enough

Issue - State: open - Opened by lorentz-wu over 1 year ago

#753 - DOM.SetText not modifying the text content of an element

Issue - State: closed - Opened by mauserzjeh over 1 year ago - 3 comments
Labels: question

#752 - How long does colly's cache last?

Issue - State: closed - Opened by Caixetadev over 1 year ago - 2 comments

#751 - Support for Brotli

Issue - State: open - Opened by todd-bush over 1 year ago - 2 comments
Labels: enhancement

#750 - How to crawl a single page of vue or react?

Issue - State: open - Opened by castaway33 over 1 year ago - 2 comments

#749 - Update CI configuration

Pull Request - State: closed - Opened by WGH- over 1 year ago

#748 - fix: enable select current element for struct slice unmarshal

Pull Request - State: open - Opened by xzvwang over 1 year ago

#747 - Add Features urljoin

Issue - State: open - Opened by yuzhiyizhan over 1 year ago

#746 - Don't decompress gzip if data doesn't look like gzip

Pull Request - State: open - Opened by WGH- over 1 year ago - 2 comments

#745 - Attempting to fetch nonexisting /sitemap.xml.gz results in "gzip: invalid header"

Issue - State: open - Opened by WGH- over 1 year ago - 1 comment
Labels: bug

#744 - Using cookies

Issue - State: closed - Opened by redoceD over 1 year ago

#743 - How can I skip "Checking if the site connection is secure" by CloudFlare

Issue - State: open - Opened by jazzmr1996 almost 2 years ago - 1 comment

#742 - Option not to pass Request Context to the Next Request

Issue - State: open - Opened by sundarv85 almost 2 years ago

#741 - TLS Error on Robots.txt is not handled in OnError

Issue - State: open - Opened by sundarv85 almost 2 years ago - 1 comment
Labels: enhancement

#740 - queue AddRequest will stuck if queue.Run() loop end

Issue - State: open - Opened by lrobot almost 2 years ago
Labels: bug

#739 - a question about queue.AddURL

Issue - State: open - Opened by Shawn-fung almost 2 years ago

#738 - bug：ncorrect handling of charset

Issue - State: closed - Opened by hktalent almost 2 years ago - 1 comment

#737 - doc: add missing @ to install module

Pull Request - State: closed - Opened by Antonio-Costa00 almost 2 years ago - 1 comment

#736 - fix some typos

Pull Request - State: closed - Opened by cuishuang almost 2 years ago

#735 - add Child return html Dom

Pull Request - State: closed - Opened by hktalent almost 2 years ago - 1 comment

#734 - add cache only && optmize huge amount cache index

Pull Request - State: open - Opened by linkec almost 2 years ago

#732 - Dynamic Pages Support?

Issue - State: closed - Opened by kapiljhajhria almost 2 years ago - 2 comments

#731 - Wait for ASPX to load?

Issue - State: closed - Opened by DAMACANER almost 2 years ago

#729 - Support default callbacks

Issue - State: closed - Opened by mortymacs about 2 years ago - 7 comments
Labels: enhancement

#728 - Is this repository still under maintenance?

Issue - State: open - Opened by axiangcoding about 2 years ago - 7 comments

#726 - Intall gocolly on raspberry - raspbian

Issue - State: closed - Opened by gilles0606 about 2 years ago - 4 comments