Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / monperrus/crawler-user-agents issues and pull requests

#392 - Added MicrosoftPreview

Pull Request - State: closed - Opened by chrisrhut 8 days ago - 1 comment

#391 - User-Agent for Lemmy crawler

Pull Request - State: closed - Opened by jpjacobpadilla 8 days ago

#390 - Added Uptime Kuma User-Agent

Pull Request - State: closed - Opened by jpjacobpadilla 9 days ago - 4 comments

#389 - Added Lemmy User-Agent

Pull Request - State: closed - Opened by jpjacobpadilla 9 days ago

#388 - Added HTTP Banner Detection User-Agent

Pull Request - State: closed - Opened by jpjacobpadilla 9 days ago - 1 comment

#387 - Added SummalyBot User-Agent

Pull Request - State: closed - Opened by jpjacobpadilla 9 days ago - 4 comments

#386 - Six New Web-Crawler User-Agents

Issue - State: closed - Opened by jpjacobpadilla 10 days ago - 2 comments

#385 - Added Hydrozen.io to the list

Pull Request - State: closed - Opened by raghuchinnannan 17 days ago - 3 comments

#384 - Disappeared reference URLs

Issue - State: open - Opened by monperrus about 1 month ago - 1 comment

#383 - fix: remove incorrect domain names

Pull Request - State: closed - Opened by fch89 about 1 month ago - 1 comment

#382 - feat: make case sensitivity optional

Pull Request - State: closed - Opened by jurasans 2 months ago - 1 comment

#381 - is_crawler in python is case sensitive now.

Issue - State: closed - Opened by jurasans 2 months ago - 1 comment

#380 - feat: Added additional Clouflare UAs

Pull Request - State: closed - Opened by JSchlarb 2 months ago - 1 comment

#379 - seoscanners.net ->This domain name is no longer normal.

Issue - State: closed - Opened by fch89 2 months ago - 2 comments

#378 - Add CookieHubScan

Pull Request - State: closed - Opened by ahukkanen 3 months ago

#377 - Added user agents from Apify / crawlee-python fingerprint dataset

Pull Request - State: closed - Opened by brentclark 4 months ago - 7 comments

#376 - Add KeybaseBot

Pull Request - State: closed - Opened by starius 4 months ago

#375 - Update crawler-user-agents.json with AcademicBotRTU

Pull Request - State: closed - Opened by omitech 4 months ago - 2 comments

#374 - Disambiguate http clients from crawlers/bots

Issue - State: open - Opened by srstsavage 5 months ago - 2 comments

#373 - Add facebookcatalog, meta-externalagent, and meta-externalfetcher

Pull Request - State: closed - Opened by srstsavage 5 months ago - 1 comment

#372 - Add OpenAI Search Bot

Pull Request - State: closed - Opened by elisa-luo 5 months ago - 1 comment

#370 - Consider adding `.mjs` export

Issue - State: open - Opened by DamianGlowala 5 months ago - 1 comment

#369 - feat: Add `id` field to each item

Pull Request - State: closed - Opened by blaine-arcjet 6 months ago - 2 comments

#368 - Improve Python usage harness

Pull Request - State: closed - Opened by jribbens 6 months ago - 4 comments

#367 - chore: Update some links & instances

Pull Request - State: closed - Opened by blaine-arcjet 6 months ago - 1 comment

#366 - Request for new instances

Issue - State: open - Opened by petrospap 6 months ago - 1 comment

#365 - chore: Normalize formatting of the JSON file

Pull Request - State: closed - Opened by blaine-arcjet 6 months ago - 4 comments

#364 - chore: Combine seekport rules

Pull Request - State: closed - Opened by blaine-arcjet 6 months ago

#363 - feat: Add Vercelbot and vercel-screenshot user-agents

Pull Request - State: closed - Opened by blaine-arcjet 6 months ago - 1 comment

#362 - Add Chrome-Lighthouse instance

Pull Request - State: closed - Opened by acrollet 6 months ago - 1 comment

#361 - Misidentified user-agents as bots

Issue - State: closed - Opened by sagrawal31 7 months ago - 4 comments

#360 - Few Google bots are not considered

Issue - State: open - Opened by sagrawal31 7 months ago - 1 comment

#359 - patterns json: add support for GroupMe bot

Pull Request - State: closed - Opened by bentsi 9 months ago - 2 comments

#358 - Adding Monsidobot and removing whitespace

Pull Request - State: closed - Opened by theodorec2 9 months ago - 1 comment

#357 - Add and use `requirements.txt`

Pull Request - State: closed - Opened by ericcornelissen 10 months ago - 1 comment

#356 - Fix pattern of Nutch crawler

Pull Request - State: closed - Opened by haumacher 10 months ago - 1 comment

#355 - Add ChatGPT-User - another bot from openai.com

Pull Request - State: closed - Opened by haumacher 10 months ago

#354 - Add ClaudeBot

Pull Request - State: closed - Opened by haumacher 10 months ago

#353 - golang: speedup using TRIE

Pull Request - State: closed - Opened by starius 11 months ago - 10 comments

#352 - Bump tough-cookie and pacote

Pull Request - State: closed - Opened by dependabot[bot] 11 months ago
Labels: dependencies

#351 - Add npm dependencies with lockfile

Pull Request - State: closed - Opened by ericcornelissen 11 months ago - 4 comments

#350 - Suggestion: test against false positives

Issue - State: closed - Opened by starius 11 months ago - 2 comments

#349 - add date validation

Pull Request - State: closed - Opened by monperrus 11 months ago

#349 - add date validation

Pull Request - State: closed - Opened by monperrus 11 months ago

#348 - Add Golang package

Pull Request - State: closed - Opened by starius 11 months ago - 10 comments

#346 - Update BuiltWith

Pull Request - State: closed - Opened by VoidMonk 11 months ago - 1 comment

#346 - Update BuiltWith

Pull Request - State: closed - Opened by VoidMonk 11 months ago - 1 comment

#345 - Add Audisto Crawler and PerplexityBot

Pull Request - State: closed - Opened by VoidMonk 11 months ago - 1 comment

#344 - Add GeedoBot

Pull Request - State: closed - Opened by abushyk about 1 year ago - 1 comment

#343 - Add BuiltWith bot

Pull Request - State: closed - Opened by flopana about 1 year ago - 1 comment

#342 - port CI to GithubActions

Issue - State: closed - Opened by monperrus about 1 year ago - 4 comments

#341 - Add Expanse and InternetMeasurement crawler

Pull Request - State: closed - Opened by flopana about 1 year ago - 1 comment

#340 - Add PhxBot and ImagesiftBot

Pull Request - State: closed - Opened by dspinellis about 1 year ago - 1 comment

#339 - Add AI agents

Issue - State: open - Opened by httpjamesm about 1 year ago - 1 comment

#338 - Escape dots in patterns

Pull Request - State: closed - Opened by giuscris about 1 year ago - 5 comments

#337 - Fix for SeznamBot detection

Pull Request - State: closed - Opened by synhershko over 1 year ago - 1 comment

#336 - Add DataForSeoBot

Pull Request - State: closed - Opened by abushyk over 1 year ago - 1 comment

#335 - added WordPress crawler

Pull Request - State: closed - Opened by petrokrupenia over 1 year ago - 8 comments

#334 - Add WordPress Bot/Crawler

Issue - State: closed - Opened by petrokrupenia over 1 year ago - 2 comments

#333 - Merge all yandex bots together

Pull Request - State: closed - Opened by fekir over 1 year ago - 1 comment

#332 - Add multiple bots found in the logs

Pull Request - State: closed - Opened by fekir over 1 year ago - 7 comments

#331 - Add Nicecrawler

Pull Request - State: closed - Opened by fekir over 1 year ago - 1 comment

#330 - Add Marginalia and YouBot

Pull Request - State: closed - Opened by dspinellis over 1 year ago - 1 comment

#328 - Add StractBot

Pull Request - State: closed - Opened by dspinellis over 1 year ago - 1 comment

#327 - Add patent crawler

Pull Request - State: closed - Opened by dspinellis over 1 year ago

#327 - Add patent crawler

Pull Request - State: closed - Opened by dspinellis over 1 year ago

#326 - Add WellKnownBot

Pull Request - State: closed - Opened by dspinellis over 1 year ago - 1 comment

#325 - add linespider

Pull Request - State: closed - Opened by monperrus over 1 year ago

#324 - miove CI to 3.11

Pull Request - State: closed - Opened by monperrus over 1 year ago

#323 - Add DataForSeoBot

Pull Request - State: closed - Opened by dspinellis over 1 year ago

#322 - Add current Turnitin instance

Pull Request - State: closed - Opened by dspinellis over 1 year ago - 3 comments

#321 - Add current AwarioBot instance

Pull Request - State: closed - Opened by dspinellis over 1 year ago - 1 comment

#319 - Add GPTBot

Issue - State: closed - Opened by arch1v1st over 1 year ago - 1 comment

#318 - add google bots (Google-InspectionTool, Storebot-Google, GoogleOther)

Pull Request - State: closed - Opened by davgur over 1 year ago - 1 comment

#317 - Add Vk bot pattern (OdklBot)

Pull Request - State: closed - Opened by robinki over 1 year ago - 1 comment

#316 - Add Steam bot (SteamChatURLLookup)

Pull Request - State: closed - Opened by robinki over 1 year ago - 1 comment

#315 - fix: Fixed the path in main.php

Pull Request - State: closed - Opened by vanushwashere almost 2 years ago - 1 comment

#314 - Fix an invalid pattern

Pull Request - State: closed - Opened by sidvishnoi almost 2 years ago - 1 comment

#313 - Added composer.json and main.php

Pull Request - State: closed - Opened by vanushwashere almost 2 years ago - 4 comments

#312 - Please also register this on packagist.org to use it via Composer

Issue - State: closed - Opened by vanushwashere almost 2 years ago - 5 comments

#311 - Add Google-Read-Aloud

Pull Request - State: closed - Opened by ictran about 2 years ago - 1 comment

#310 - Add linespider

Issue - State: closed - Opened by Almenon about 2 years ago - 3 comments

#309 - Update crawler-user-agents.json

Pull Request - State: closed - Opened by monperrus about 2 years ago

#308 - Add Dynatrace / RuxitSynthetic into the list

Issue - State: closed - Opened by matej-c about 2 years ago

#307 - Consider add Google-Read-Aloud to the bot list

Issue - State: closed - Opened by ictran about 2 years ago - 1 comment

#306 - Add Line chat crawler.

Pull Request - State: closed - Opened by aduros about 2 years ago - 2 comments

#305 - Added Better Uptime Bot

Pull Request - State: closed - Opened by noctivityinc over 2 years ago - 1 comment

#304 - Added CriteoBot

Pull Request - State: closed - Opened by noctivityinc over 2 years ago - 2 comments

#303 - Added Snap URL Preview Service

Pull Request - State: closed - Opened by noctivityinc over 2 years ago

#302 - Fix bingbot sermrush

Pull Request - State: closed - Opened by synhershko over 2 years ago

#301 - Add Feedbin

Pull Request - State: closed - Opened by synhershko over 2 years ago

#300 - Add curebot

Pull Request - State: closed - Opened by synhershko over 2 years ago - 1 comment

#299 - doc: fix php usage example

Pull Request - State: closed - Opened by Gavrisimo over 2 years ago - 1 comment

#298 - Add `SeekportBot`

Pull Request - State: closed - Opened by IceQ1337 over 2 years ago - 1 comment

#297 - Add `FreshpingBot`

Pull Request - State: closed - Opened by IceQ1337 over 2 years ago - 1 comment

#296 - Add `Uptime-Kuma`

Pull Request - State: closed - Opened by IceQ1337 over 2 years ago - 3 comments

#295 - Add seostar

Pull Request - State: closed - Opened by theduke over 2 years ago