Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / apify/crawlee-python issues and pull requests

#627 - How to block media ?

Issue - State: open - Opened by zhk0603 18 days ago - 1 comment
Labels: t-tooling

#626 - Integrate a spell checker for documentation

Issue - State: open - Opened by vdusek 18 days ago
Labels: documentation, t-tooling

#625 - Make identifiers clickable in the rendered API docs

Issue - State: open - Opened by vdusek 18 days ago
Labels: documentation, t-tooling

#624 - docs: improve API docs of all crawlers

Pull Request - State: closed - Opened by vdusek 22 days ago
Labels: documentation, t-tooling

#623 - chore: change ValueError to warning in RQClient for ID mismatch

Pull Request - State: closed - Opened by vdusek 22 days ago
Labels: t-tooling, adhoc

#622 - feat: Pass extra configuration to json.dump()

Pull Request - State: open - Opened by Rutam21 22 days ago - 1 comment

#621 - feat: Add `always_enqueue` option to bypass URL deduplication

Pull Request - State: open - Opened by Rutam21 22 days ago - 1 comment

#620 - chore: update dev deps

Pull Request - State: closed - Opened by vdusek 22 days ago
Labels: t-tooling, adhoc

#619 - fix: Default ProxyInfo port if httpx.URL port is None

Pull Request - State: open - Opened by steffansafey 23 days ago

#618 - Unable to use proxy with port 80 or 443 with Playwright

Issue - State: open - Opened by steffansafey 23 days ago
Labels: t-tooling

#617 - docs: Use renderable docs format for data structures

Pull Request - State: closed - Opened by vdusek 23 days ago
Labels: t-tooling

#616 - Update docstring format for Pydantic models, data classes, and type dicts

Issue - State: closed - Opened by vdusek 23 days ago
Labels: bug, documentation, t-tooling

#615 - What to do with the request query params field?

Issue - State: open - Opened by vdusek 23 days ago - 1 comment
Labels: t-tooling

#614 - fix: use strip in headers normalization

Pull Request - State: closed - Opened by vdusek 24 days ago
Labels: bug, t-tooling, adhoc, tested

#613 - docs: Refactor `HttpCrawler` to conform to Google-style docstring guide

Pull Request - State: closed - Opened by belloibrahv 25 days ago - 2 comments

#612 - docs: Update http crawler docs

Pull Request - State: closed - Opened by belloibrahv 25 days ago

#611 - Introducing Crawlee Python Guru on Gurubase.io

Pull Request - State: closed - Opened by kursataktas 25 days ago - 1 comment

#610 - ci: Fix pre-release and release workflows

Pull Request - State: closed - Opened by janbuchar 25 days ago
Labels: t-tooling, adhoc

#609 - feat!: Add headers in unique key computation

Pull Request - State: closed - Opened by Prathamesh010 26 days ago - 4 comments

#607 - docs: try to fix the CI documentation build

Pull Request - State: closed - Opened by barjin 26 days ago
Labels: t-tooling, adhoc

#606 - docs: improve autogenerated API docs

Pull Request - State: closed - Opened by barjin 26 days ago
Labels: documentation, t-tooling

#604 - refactor: Improved Beautiful Crawler Class

Pull Request - State: closed - Opened by HarshMN2345 27 days ago - 2 comments

#603 - Architecture overview

Issue - State: open - Opened by honzajavorek 28 days ago
Labels: documentation, t-tooling

#602 - feat: Add support for `pre_navigation_hooks` in PlaywrightCrawler

Pull Request - State: open - Opened by Yashwanth-Chandrakumar 29 days ago - 4 comments

#600 - Create avoid_block.md

Pull Request - State: closed - Opened by SPIDEYGUY1617 about 1 month ago

#599 - chore: don't add contributors as link to the changelog

Pull Request - State: closed - Opened by orhun about 1 month ago - 2 comments

#598 - Deprecated variables in git_cliff_core::changelog

Issue - State: closed - Opened by Telomelonia about 1 month ago
Labels: t-tooling

#597 - ci: Use the release-metadata action

Pull Request - State: closed - Opened by janbuchar about 1 month ago - 1 comment
Labels: t-tooling, adhoc

#596 - Standby python actor throws when accessing the Actor.config object

Issue - State: closed - Opened by oklinov about 1 month ago - 2 comments
Labels: bug, t-tooling

#595 - chore: fix doc commands in Makefile

Pull Request - State: closed - Opened by vdusek about 1 month ago
Labels: t-tooling, adhoc, infrastructure

#594 - ci: fix build and deploy docs workflow

Pull Request - State: closed - Opened by vdusek about 1 month ago
Labels: t-tooling, adhoc, infrastructure

#593 - ci: use shared workflows and refactor them

Pull Request - State: closed - Opened by vdusek about 1 month ago
Labels: t-tooling, adhoc, infrastructure

#592 - ci: Render contributors in CHANGELOG.md

Pull Request - State: closed - Opened by Telomelonia about 1 month ago - 8 comments

#591 - ci: rm unused pipeline

Pull Request - State: closed - Opened by vdusek about 1 month ago
Labels: t-tooling, adhoc, infrastructure

#590 - feat: Include whitelisted HTTP headers in extended_unique_key computation.

Pull Request - State: closed - Opened by AkhilProto about 1 month ago - 11 comments

#588 - Added the always-enqueue paramter to bypass deduplication

Pull Request - State: closed - Opened by shivansh-bhatnagar18 about 1 month ago

#587 - docs: added guide for result storages (Dataset, KeyValueStore)

Pull Request - State: open - Opened by Manish-k723 about 1 month ago - 5 comments

#586 - docs: Guide for scaling the crawlers

Pull Request - State: closed - Opened by akshay11298 about 1 month ago - 4 comments

#585 - docs: Added [Dataset, Keystore] documentation

Pull Request - State: open - Opened by saymedgm about 1 month ago - 2 comments

#584 - feat: Key-value store context helpers

Pull Request - State: closed - Opened by janbuchar about 1 month ago - 1 comment
Labels: t-tooling, adhoc, tested

#583 - ci: fix python version reference in pipx install

Pull Request - State: closed - Opened by vdusek about 1 month ago
Labels: bug, t-tooling, adhoc, infrastructure

#582 - ci: use python version instead of executable path

Pull Request - State: closed - Opened by vdusek about 1 month ago - 1 comment
Labels: t-tooling, adhoc, infrastructure

#581 - fix: Workaround for JSON value typing problems

Pull Request - State: closed - Opened by janbuchar about 1 month ago - 3 comments
Labels: t-tooling

#580 - feat: Split and added extra configuration to export_data function

Pull Request - State: open - Opened by deshansh about 1 month ago

#579 - ci: install Poetry to setup-python environment

Pull Request - State: closed - Opened by vdusek about 1 month ago
Labels: bug, t-tooling, adhoc, infrastructure

#578 - chore(deps): update dependency typescript to v5.6.2

Pull Request - State: closed - Opened by renovate[bot] about 1 month ago

#577 - chore(deps): update dependency eslint-plugin-react to v7.37.1

Pull Request - State: closed - Opened by renovate[bot] about 1 month ago

#576 - docs: Added documentation on how to Avoid getting blocked

Pull Request - State: open - Opened by MostlyKIGuess about 1 month ago - 4 comments
Labels: t-tooling

#574 - docs: Added documentation on how to Avoid getting blocked

Pull Request - State: closed - Opened by MostlyKIGuess about 1 month ago

#572 - feat: Added get_public_url method to KeyValueStore

Pull Request - State: closed - Opened by akshay11298 about 1 month ago - 10 comments
Labels: t-tooling

#571 - Max depth feature

Pull Request - State: open - Opened by akash47angadi about 1 month ago - 1 comment
Labels: t-tooling

#570 - feat: Add maximum crawl depth feature

Pull Request - State: closed - Opened by akash47angadi about 1 month ago

#569 - docs: Add guide on how to avoid getting blocked

Pull Request - State: closed - Opened by akash47angadi about 1 month ago - 1 comment

#568 - feat: Add maximum crawl depth feature

Pull Request - State: closed - Opened by akash47angadi about 1 month ago - 1 comment

#567 - feat: Added get_public_url method to KeyValueStore

Pull Request - State: closed - Opened by naaa760 about 1 month ago - 4 comments
Labels: t-tooling

#566 - chore: set pytest-asyncio loop scope to function

Pull Request - State: closed - Opened by vdusek about 1 month ago
Labels: t-tooling, adhoc

#565 - docs: homepage changes

Pull Request - State: open - Opened by souravjain540 about 1 month ago - 2 comments
Labels: t-tooling

#564 - docs: Improved API documentation for BasicCrawler class

Pull Request - State: closed - Opened by belloibrahv about 1 month ago - 8 comments
Labels: t-tooling

#563 - Correct / recommended way of using `user_data`

Issue - State: closed - Opened by tlinhart about 2 months ago - 4 comments
Labels: bug, t-tooling

#562 - fix: Add equality check to UserData model

Pull Request - State: closed - Opened by janbuchar about 2 months ago
Labels: t-tooling, adhoc

#561 - Expose possible event types from `crawlee._events`

Issue - State: open - Opened by janbuchar about 2 months ago
Labels: t-tooling, debt

#560 - Unable to execute POST request with JSON payload

Issue - State: closed - Opened by Mantisus about 2 months ago - 2 comments
Labels: bug, t-tooling

#559 - fix: do not persist storage when disabled

Pull Request - State: open - Opened by vdusek about 2 months ago
Labels: t-tooling, tested

#558 - chore: remove unit tests from pre-commit config

Pull Request - State: closed - Opened by vdusek about 2 months ago
Labels: t-tooling, adhoc, infrastructure

#557 - fix: call `error_handler` for `SessionError`

Pull Request - State: closed - Opened by vdusek about 2 months ago
Labels: t-tooling, tested

#556 - fix: extend from `IntEnum` in `RequestState` to fix serialization

Pull Request - State: closed - Opened by vdusek about 2 months ago - 9 comments
Labels: t-tooling, tested

#555 - Crawlee for Python Hacktoberfest 2024 🧡 🐍

Issue - State: open - Opened by souravjain540 about 2 months ago - 1 comment
Labels: t-tooling, hacktoberfest

#553 - chore(deps): update dependency pytest-asyncio to ~0.24.0

Pull Request - State: closed - Opened by renovate[bot] about 2 months ago

#552 - chore(deps): update dependency eslint-plugin-react to v7.37.0

Pull Request - State: closed - Opened by renovate[bot] about 2 months ago

#551 - Failing pydantic validation on request_dict

Issue - State: closed - Opened by cadlagtrader about 2 months ago - 2 comments
Labels: bug, t-tooling

#550 - Memory is critically overloaded WARNING

Issue - State: closed - Opened by stephenleo about 2 months ago
Labels: t-tooling

#549 - Add init script for Playwright browser context

Issue - State: open - Opened by vdusek about 2 months ago
Labels: enhancement, t-tooling

#548 - Include whitelisted HTTP headers in the `extended_unique_key` computation

Issue - State: closed - Opened by vdusek about 2 months ago - 2 comments
Labels: enhancement, t-tooling, hacktoberfest

#547 - Add `always_enqueue` option to `Request` for bypassing deduplication

Issue - State: open - Opened by vdusek about 2 months ago - 4 comments
Labels: enhancement, t-tooling, hacktoberfest

#546 - Error handler is not called for session errors

Issue - State: closed - Opened by janbuchar about 2 months ago
Labels: bug, t-tooling

#545 - feat: mask Playwright's "headless" headers

Pull Request - State: closed - Opened by vdusek about 2 months ago - 1 comment
Labels: t-tooling, tested

#544 - feat: add new model for `HttpHeaders`

Pull Request - State: closed - Opened by vdusek about 2 months ago
Labels: t-tooling, adhoc, debt, tested

#543 - fix: adopt new version of curl-cffi

Pull Request - State: closed - Opened by vdusek about 2 months ago - 2 comments
Labels: bug, t-tooling, adhoc, tested

#542 - fix!: merge payload and data fields of Request

Pull Request - State: closed - Opened by vdusek about 2 months ago - 8 comments
Labels: t-tooling, tested

#541 - Clear storage cache automatically or make it possible

Issue - State: closed - Opened by tlinhart about 2 months ago - 2 comments
Labels: t-tooling

#540 - fix: Improve `Request.user_data` serialization

Pull Request - State: closed - Opened by janbuchar about 2 months ago - 3 comments
Labels: t-tooling, tested

#539 - Crawler doesn't respect `configuration` argument

Issue - State: open - Opened by tlinhart about 2 months ago - 1 comment
Labels: bug, t-tooling

#538 - feat: Improved project bootstrapping

Pull Request - State: open - Opened by janbuchar about 2 months ago - 4 comments
Labels: t-tooling, tested

#536 - Can Crawlee use Redis to build a distributed crawler?

Issue - State: closed - Opened by oldsiks about 2 months ago
Labels: t-tooling

#534 - docs: improve docstring of Request class

Pull Request - State: closed - Opened by vdusek about 2 months ago
Labels: documentation, t-tooling, adhoc

#533 - fix: use explicitly UTF-8 encoding in local storage

Pull Request - State: closed - Opened by vdusek about 2 months ago
Labels: t-tooling

#532 - Example code beautifulsoup_crawler.py not working on Windows due to encoding assumptions.

Issue - State: closed - Opened by Pijukatel about 2 months ago - 1 comment
Labels: bug, t-tooling

#530 - feat: add header generator and integrate it into HTTPX client

Pull Request - State: closed - Opened by vdusek 2 months ago
Labels: t-tooling, tested

#529 - ci: allow beta releases for chore commits

Pull Request - State: closed - Opened by vdusek 2 months ago - 2 comments
Labels: bug, t-tooling, adhoc

#528 - chore(deps): update dependency filelock to ~3.16.0

Pull Request - State: closed - Opened by renovate[bot] 2 months ago

#526 - Implement/document a way how to pass extra configuration to json.dump()

Issue - State: open - Opened by honzajavorek 2 months ago - 7 comments
Labels: enhancement, t-tooling, hacktoberfest

#525 - Implement/document a way how to pass custom information to handlers

Issue - State: closed - Opened by honzajavorek 2 months ago
Labels: t-tooling

#524 - Implement/document a way how to pass information between handlers

Issue - State: closed - Opened by honzajavorek 2 months ago - 20 comments
Labels: documentation, t-tooling

#521 - docs: add request storage guide

Pull Request - State: closed - Opened by vdusek 2 months ago
Labels: t-tooling

#516 - How to get the content of an iframe?

Issue - State: open - Opened by thalesfsp 2 months ago
Labels: t-tooling

#515 - feat: expose extended unique key when creating a new Request

Pull Request - State: open - Opened by vdusek 2 months ago
Labels: enhancement, t-tooling, adhoc, tested

#514 - Implement `KeyValueStore.get_public_url`

Issue - State: closed - Opened by janbuchar 2 months ago - 3 comments
Labels: enhancement, t-tooling, hacktoberfest