Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / apify/crawlee-python issues and pull requests

#513 - feat: add HTTP/2 support for HTTPX client

Pull Request - State: closed - Opened by vdusek 2 months ago
Labels: t-tooling, tested

#512 - Add HTTP/2 support for HTTPX client

Issue - State: closed - Opened by vdusek 2 months ago
Labels: enhancement, t-tooling

#511 - Optionally include Apify integration in project bootstrapping

Issue - State: open - Opened by janbuchar 2 months ago
Labels: enhancement, t-tooling

#510 - Sync templates to apify/actor-templates on update

Issue - State: open - Opened by janbuchar 2 months ago - 3 comments
Labels: t-tooling, infrastructure

#509 - Templates should contain a `main.py` file used from `__main__.py`

Issue - State: open - Opened by janbuchar 2 months ago
Labels: enhancement, t-tooling

#508 - fix: Correctly handle log level configuration

Pull Request - State: closed - Opened by janbuchar 2 months ago
Labels: t-tooling, adhoc

#507 - docs: add intercom messenger

Pull Request - State: closed - Opened by webrdaniel 2 months ago
Labels: t-web

#504 - refactor: simplify type of request(s) args

Pull Request - State: closed - Opened by vdusek 2 months ago
Labels: t-tooling, adhoc, tested

#503 - How to stop crawling a web site when a goal is reached

Issue - State: closed - Opened by sebpiq 2 months ago - 2 comments
Labels: t-tooling

#502 - feat: Memory usage limit configuration via environment variables

Pull Request - State: closed - Opened by janbuchar 2 months ago
Labels: t-tooling, tested

#501 - fix: expose basic crawling context

Pull Request - State: closed - Opened by vdusek 2 months ago
Labels: t-tooling, adhoc

#500 - chore: Do not install poetry in install-dev make target

Pull Request - State: closed - Opened by janbuchar 2 months ago - 1 comment
Labels: t-tooling, adhoc

#499 - fix: Deduplicate requests by unique key before submitting them to the queue

Pull Request - State: closed - Opened by janbuchar 2 months ago
Labels: t-tooling, adhoc

#498 - fix: http clients detect 4xx as errors by default

Pull Request - State: closed - Opened by vdusek 2 months ago - 5 comments
Labels: t-tooling, tested

#497 - Make sure that detection of available memory is consistent with JS Crawlee

Issue - State: open - Opened by janbuchar 2 months ago
Labels: t-tooling

#496 - Throw an exception when we receive a 4xx status code

Issue - State: closed - Opened by janbuchar 2 months ago
Labels: bug, t-tooling

#495 - `CurlImpersonateHttpClient` warning on Windows

Issue - State: open - Opened by janbuchar 2 months ago
Labels: bug, t-tooling

#493 - Not returning any additional links from menu crawl

Issue - State: closed - Opened by Firelord710 2 months ago
Labels: bug, t-tooling

#490 - fix: JSON handling with Parsel

Pull Request - State: closed - Opened by janbuchar 3 months ago - 1 comment
Labels: t-tooling, tested

#488 - Cannot use CSS on a Selector of type 'json' ( ParselCrawler )

Issue - State: closed - Opened by Ehsan-U 3 months ago - 1 comment
Labels: t-tooling

#487 - How to run the crawler?

Issue - State: closed - Opened by Ehsan-U 3 months ago - 1 comment
Labels: t-tooling

#486 - Crawlee has empty response on some URLs

Issue - State: closed - Opened by MrTyton 3 months ago - 8 comments
Labels: bug, t-tooling

#485 - fix: field alias in `BatchRequestsOperationResponse`

Pull Request - State: closed - Opened by janbuchar 3 months ago
Labels: t-tooling, adhoc

#484 - Using proxy with playwright+chromium causes a crash

Issue - State: closed - Opened by janbuchar 3 months ago - 1 comment
Labels: bug, t-tooling

#483 - chore(deps): Relax pyee dependency version constraint

Pull Request - State: closed - Opened by janbuchar 3 months ago
Labels: t-tooling, adhoc

#482 - docs: Deployment guide

Pull Request - State: closed - Opened by janbuchar 3 months ago - 2 comments
Labels: t-tooling, adhoc

#481 - Create a new guide about how to not get blocked

Issue - State: open - Opened by vdusek 3 months ago - 4 comments
Labels: documentation, t-tooling, hacktoberfest

#480 - Create a new guide for session management

Issue - State: open - Opened by vdusek 3 months ago - 2 comments
Labels: documentation, t-tooling

#479 - Create a new guide for result storages (`Dataset`, `KeyValueStore`)

Issue - State: open - Opened by vdusek 3 months ago - 9 comments
Labels: documentation, t-tooling, hacktoberfest

#478 - Create a new guide for request storages (`RequestQueue`, `RequestList`)

Issue - State: closed - Opened by vdusek 3 months ago
Labels: documentation, t-tooling

#477 - Create a new guide for `PlaywrightCrawler` and `BrowserPool`

Issue - State: open - Opened by vdusek 3 months ago - 2 comments
Labels: documentation, t-tooling

#476 - Create a new guide for scaling the crawlers

Issue - State: closed - Opened by vdusek 3 months ago - 5 comments
Labels: documentation, t-tooling, hacktoberfest

#475 - Create a new guide for crawling features

Issue - State: open - Opened by vdusek 3 months ago
Labels: documentation, t-tooling

#474 - chore(deps): Relax Playwright version constraint

Pull Request - State: closed - Opened by janbuchar 3 months ago - 5 comments
Labels: t-tooling, adhoc

#473 - feat: curl http client selects chrome impersonation by default

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: enhancement, t-tooling, adhoc

#472 - chore: remove upper version boundary of deps

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: t-tooling, adhoc

#471 - ci: fix update new issue trigger

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: t-tooling, adhoc

#470 - chore: update phony in makefile

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: t-tooling, adhoc

#469 - Check CI status on `master` branch in release workflow

Issue - State: open - Opened by janbuchar 3 months ago - 5 comments
Labels: enhancement, t-tooling

#468 - Improve changelog formatting

Issue - State: closed - Opened by B4nan 3 months ago - 10 comments
Labels: t-tooling, hacktoberfest

#467 - chore: update project links & repository references

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: t-tooling, adhoc, tested

#466 - ci: Skip running code checks on release

Pull Request - State: closed - Opened by janbuchar 3 months ago - 3 comments
Labels: t-tooling, adhoc

#465 - docs: improve docstrings of storages

Pull Request - State: closed - Opened by vdusek 3 months ago - 1 comment
Labels: t-tooling

#464 - docs: add upgrading guide to v03

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: documentation, t-tooling, adhoc

#463 - fix: Add missing __all__ to top-level __init__.py file

Pull Request - State: closed - Opened by janbuchar 3 months ago
Labels: t-tooling, adhoc

#462 - docs: unpin Docusaurus version, fix build

Pull Request - State: closed - Opened by barjin 3 months ago
Labels: t-tooling, adhoc

#461 - refactor: storage-related models are in base storage client

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: t-tooling, adhoc, debt

#460 - Implement max crawl depth

Issue - State: open - Opened by vdusek 3 months ago - 2 comments
Labels: enhancement, t-tooling, hacktoberfest

#459 - chore(deps): lock file maintenance

Pull Request - State: closed - Opened by renovate[bot] 3 months ago

#458 - fix: Typo in ProlongRequestLockResponse

Pull Request - State: closed - Opened by janbuchar 3 months ago
Labels: t-tooling, adhoc

#457 - docs: move code samples to separate files

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: documentation, t-tooling, adhoc

#456 - refactor!: declare private and public interface

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: t-tooling, adhoc, debt

#455 - Improve error handling in `Dataset._get_data_internal()`

Issue - State: open - Opened by vdusek 12 months ago
Labels: t-tooling, debt

#454 - ci: Do not skip breaking commits in changelog

Pull Request - State: closed - Opened by janbuchar 3 months ago
Labels: t-tooling, adhoc

#453 - feat: add support for filling a web form

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: t-tooling

#452 - chore: regenerate lockfile (yarn@v4)

Pull Request - State: closed - Opened by barjin 3 months ago
Labels: t-tooling, adhoc

#451 - chore(deps): update docusaurus monorepo to v3.5.2

Pull Request - State: closed - Opened by renovate[bot] 3 months ago - 1 comment

#450 - chore: pin Docusaurus version

Pull Request - State: closed - Opened by barjin 3 months ago
Labels: t-tooling, adhoc

#449 - docs: add links to API doc in suitable places

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: t-tooling

#447 - chore: reschedule renovate bot

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: t-tooling, adhoc

#446 - chore(deps): update dependency setuptools to v73

Pull Request - State: closed - Opened by renovate[bot] 3 months ago

#445 - docs: remove-webinar

Pull Request - State: closed - Opened by souravjain540 3 months ago

#444 - chore(deps): update typescript-eslint monorepo to v8.2.0

Pull Request - State: closed - Opened by renovate[bot] 3 months ago

#443 - fix: double incrementation of `item_count`

Pull Request - State: closed - Opened by cadlagtrader 3 months ago
Labels: t-tooling

#442 - item_count double incremented when reloading dataset

Issue - State: closed - Opened by cadlagtrader 3 months ago - 1 comment
Labels: bug, t-tooling

#440 - chore: update ruff to 0.6

Pull Request - State: closed - Opened by vdusek 3 months ago
Labels: t-tooling, adhoc, tested

#438 - Continious scraping request

Issue - State: closed - Opened by marisancans 3 months ago - 1 comment
Labels: t-tooling

#435 - chore(deps): update dependency ruff to ~0.6.0 - autoclosed

Pull Request - State: closed - Opened by renovate[bot] 3 months ago

#431 - fix: Relative URLS supports & If not a URL, pass #417

Pull Request - State: closed - Opened by black7375 3 months ago - 5 comments
Labels: t-tooling

#429 - refactor!: RequestQueue and service management rehaul

Pull Request - State: closed - Opened by janbuchar 3 months ago
Labels: t-tooling, tested

#427 - Add support for `preNavigationHooks` in Playwright

Issue - State: open - Opened by viewv 3 months ago - 8 comments
Labels: enhancement, t-tooling, hacktoberfest

#426 - chore(deps): update typescript-eslint monorepo to v8.1.0

Pull Request - State: closed - Opened by renovate[bot] 3 months ago

#423 - Request queue v2 support

Issue - State: closed - Opened by drobnikj over 1 year ago - 1 comment
Labels: enhancement, t-tooling

#422 - chore(deps): update docusaurus monorepo to v3.5.2

Pull Request - State: closed - Opened by renovate[bot] 3 months ago

#417 - URL Validation edge case - Protocol/Scheme relative URLs

Issue - State: closed - Opened by aka-Ani 3 months ago - 12 comments
Labels: bug, t-tooling

#414 - Feature Request: Add More Options to Crawlee CLI for Crawler Creation

Issue - State: open - Opened by siddiqkaithodu 3 months ago
Labels: enhancement, t-tooling

#410 - feat: support custom profile in playwright

Pull Request - State: closed - Opened by sherpya 3 months ago - 8 comments
Labels: t-tooling

#402 - Add header generator and integrate it into HTTPX client

Issue - State: closed - Opened by vdusek 3 months ago - 4 comments
Labels: enhancement, t-tooling

#401 - Mask Playwright's "headless" headers

Issue - State: closed - Opened by vdusek 3 months ago
Labels: enhancement, t-tooling

#399 - support for launching with user provided profile

Issue - State: open - Opened by sherpya 3 months ago
Labels: enhancement, t-tooling

#379 - Improve saving-data guide

Issue - State: open - Opened by janbuchar 4 months ago - 2 comments
Labels: documentation, t-tooling

#369 - how can I disable cache completely ?

Issue - State: open - Opened by 1hachem 4 months ago - 5 comments
Labels: bug, t-tooling

#355 - Document the difference between `add_requests` and `enqueue_links` context_helpers

Issue - State: closed - Opened by janbuchar 4 months ago
Labels: documentation, t-tooling

#350 - Reconsider crawler inheritance

Issue - State: open - Opened by janbuchar 4 months ago - 5 comments
Labels: t-tooling, solutioning

#324 - API reference rendering is broken

Issue - State: open - Opened by vdusek 4 months ago - 8 comments
Labels: bug, documentation, t-tooling

#317 - Automatically install dependencies after bootstrapping a project via CLI

Issue - State: open - Opened by janbuchar 4 months ago - 4 comments
Labels: enhancement, t-tooling

#305 - Document how to use POST requests

Issue - State: closed - Opened by vdusek 4 months ago - 2 comments
Labels: documentation, t-tooling

#304 - Improve API docs of public components

Issue - State: open - Opened by vdusek 4 months ago - 8 comments
Labels: documentation, t-tooling, hacktoberfest

#295 - HTTP API for Spider

Issue - State: closed - Opened by Ehsan-U 4 months ago - 1 comment
Labels: enhancement, t-tooling

#266 - Final doc & readme polishing

Issue - State: closed - Opened by vdusek 5 months ago
Labels: documentation, t-tooling

#263 - Add doc section guides

Issue - State: closed - Opened by vdusek 5 months ago - 1 comment
Labels: documentation, t-tooling

#203 - Request fetching from `RequestQueue` is sometimes very slow

Issue - State: closed - Opened by vdusek 5 months ago - 1 comment
Labels: bug, t-tooling

#178 - Improve the deduplication of requests

Issue - State: closed - Opened by vdusek 5 months ago - 3 comments
Labels: t-tooling, solutioning

#174 - Simplify code in `RequestQueue._ensure_head_is_non_empty`

Issue - State: closed - Opened by vdusek 12 months ago
Labels: t-tooling, debt

#167 - ci: Use a local httpbin instance for tests

Pull Request - State: open - Opened by janbuchar 6 months ago - 1 comment
Labels: t-tooling, tested

#146 - Use `local_storage_dir` instead of `crawlee_local_storage_dir` and rm relevant type ignores

Issue - State: open - Opened by vdusek 6 months ago - 2 comments
Labels: t-tooling

#96 - BasicCrawler status logging

Issue - State: open - Opened by janbuchar 7 months ago
Labels: t-tooling