apify/crawlee-python issues and pull requests

#95 - Batched request addition in `RequestQueue`

Issue - State: closed - Opened by janbuchar 7 months ago - 1 comment
Labels: enhancement, t-tooling

#94 - Remove `json_` and `order_no` from `Request`

Issue - State: open - Opened by janbuchar 7 months ago - 2 comments
Labels: t-tooling, debt

#93 - chore: automatically sort dependencies in pyproject.toml

Pull Request - State: closed - Opened by janbuchar 7 months ago - 1 comment
Labels: adhoc

#92 - Separate `MemoryStorageClient` and `FilesystemStorageClient`

Issue - State: open - Opened by vdusek 8 months ago
Labels: enhancement, t-tooling

#91 - Add base storage client and resource subclients

Issue - State: closed - Opened by vdusek 8 months ago - 2 comments
Labels: enhancement, t-tooling

#90 - Add `BaseStorageClient` and update dirs structure

Pull Request - State: closed - Opened by vdusek 8 months ago
Labels: t-tooling, adhoc, tested

#89 - Add `ByteSize` class

Pull Request - State: closed - Opened by vdusek 8 months ago
Labels: t-tooling, tested

#88 - Fix docstring in `MemoryInfo` class

Pull Request - State: closed - Opened by vdusek 8 months ago
Labels: t-tooling, adhoc

#87 - Implement auto-purging of storages

Issue - State: closed - Opened by B4nan 8 months ago - 1 comment
Labels: enhancement, t-tooling

#86 - Better approach of making a cache

Issue - State: open - Opened by vdusek 8 months ago - 6 comments
Labels: t-tooling, debt, hacktoberfest

#85 - Refactor initialization of storages

Issue - State: closed - Opened by vdusek 8 months ago - 11 comments
Labels: t-tooling, debt

#84 - Handle configuration (env. variables) using `pydantic-settings`

Issue - State: closed - Opened by janbuchar 8 months ago
Labels: t-tooling, debt

#83 - Implement switching between storage implementations based on autodetection

Issue - State: closed - Opened by janbuchar 8 months ago - 1 comment
Labels: enhancement, t-tooling

#82 - Add storages and memory storage clients

Pull Request - State: closed - Opened by vdusek 8 months ago - 1 comment
Labels: t-tooling, tested

#81 - chore(deps): update dependency build to ~1.2.0

Pull Request - State: closed - Opened by renovate[bot] 8 months ago

#80 - Implement fingerprinting

Issue - State: closed - Opened by vdusek 8 months ago - 4 comments
Labels: enhancement, t-tooling

#79 - Implement initial version of `BrowserPool` and `PlaywrightCrawler`

Issue - State: closed - Opened by vdusek 8 months ago - 1 comment
Labels: enhancement, t-tooling

#78 - Implement session management

Issue - State: closed - Opened by vdusek 8 months ago
Labels: enhancement, t-tooling

#77 - chore: various adjustments to the `AutoscaledPool` interface

Pull Request - State: closed - Opened by janbuchar 8 months ago
Labels: t-tooling, adhoc, tested

#76 - chore(deps): update dependency pytest-cov to v5

Pull Request - State: closed - Opened by renovate[bot] 8 months ago

#75 - chore(deps): update dependency pre-commit to ~3.7.0

Pull Request - State: closed - Opened by renovate[bot] 8 months ago

#74 - chore(deps): update dependency respx to ~0.21.0

Pull Request - State: closed - Opened by renovate[bot] 8 months ago

#73 - Improve unit testing of Snapshotter

Issue - State: open - Opened by vdusek 8 months ago
Labels: t-tooling, debt

#72 - Explore what doc tooling we use in SDK and how it deals with dataclasses docstrings

Issue - State: closed - Opened by vdusek 8 months ago - 3 comments
Labels: documentation, t-tooling

#71 - Fix pytest asyncio auto mode

Pull Request - State: closed - Opened by vdusek 8 months ago
Labels: bug, t-tooling, adhoc, tested

#70 - Introduce a better solution for dealing with byte size

Issue - State: closed - Opened by vdusek 8 months ago
Labels: t-tooling, debt

#69 - chore(deps): update dependency pytest to ~8.1.0 - autoclosed

Pull Request - State: closed - Opened by renovate[bot] 8 months ago

#68 - chore(deps): update dependency pytest-only to ~2.1.0 - autoclosed

Pull Request - State: closed - Opened by renovate[bot] 8 months ago

#67 - chore(deps): update dependency mypy to ~1.9.0

Pull Request - State: closed - Opened by renovate[bot] 8 months ago

#66 - [WIP] Add KVS storage

Pull Request - State: closed - Opened by vdusek 8 months ago

#65 - Downgrade pytest to 8.0.0

Pull Request - State: closed - Opened by vdusek 8 months ago
Labels: t-tooling, adhoc

#64 - Remove type hints for self and cls

Pull Request - State: closed - Opened by vdusek 8 months ago
Labels: t-tooling, adhoc

#63 - chore(deps): update dependency pytest-timeout to ~2.3.0

Pull Request - State: closed - Opened by renovate[bot] 8 months ago

#62 - Implement local storages & storage clients

Issue - State: closed - Opened by vdusek 8 months ago
Labels: enhancement, t-tooling

#61 - chore(deps): update dependency pytest to ~8.1.0

Pull Request - State: closed - Opened by renovate[bot] 9 months ago

#60 - Implement `Snapshotter._snapshot_client()`

Issue - State: open - Opened by vdusek 9 months ago - 1 comment
Labels: enhancement, t-tooling

#59 - Use `uv` as packaging tool used in CI builds

Issue - State: open - Opened by vdusek 9 months ago
Labels: t-tooling, infrastructure, low priority

#58 - chore(deps): update dependency build to ~1.1.0

Pull Request - State: closed - Opened by renovate[bot] 9 months ago

#57 - chore(deps): update dependency ruff to ~0.3.0

Pull Request - State: closed - Opened by renovate[bot] 9 months ago

#56 - feat: implement BasicCrawler

Pull Request - State: closed - Opened by janbuchar 9 months ago - 1 comment
Labels: t-tooling, tested

#55 - feat: AutoscaledPool implementation

Pull Request - State: closed - Opened by janbuchar 9 months ago - 2 comments
Labels: t-tooling, tested

#54 - Update test case names

Pull Request - State: closed - Opened by vdusek 9 months ago
Labels: t-tooling, adhoc, tested

#53 - Add tests for `LocalEventManager`

Pull Request - State: closed - Opened by vdusek 9 months ago
Labels: t-tooling, tested

#52 - Add tests for `LocalEventManager`

Issue - State: closed - Opened by vdusek 9 months ago
Labels: t-tooling

#51 - Add tests for `EventManager`

Pull Request - State: closed - Opened by vdusek 9 months ago
Labels: t-tooling, tested

#50 - Add tests for `EventManager`

Issue - State: closed - Opened by vdusek 9 months ago
Labels: t-tooling

#49 - Add tests for `RecurringTask` and `weighted_avg`

Pull Request - State: closed - Opened by vdusek 9 months ago
Labels: t-tooling, tested

#48 - Add tests for `RecurringTask` and `weighted_avg`

Issue - State: closed - Opened by vdusek 9 months ago
Labels: t-tooling

#47 - Verify accuracy of CPU load measurement in `LocalEventManager`

Issue - State: open - Opened by janbuchar 9 months ago
Labels: t-tooling

#46 - Fix typo in docstring of `LocalEventManager`

Pull Request - State: closed - Opened by vdusek 9 months ago
Labels: t-tooling, adhoc

#45 - Add tests for `CrawleeLogFormatter`

Issue - State: closed - Opened by vdusek 9 months ago
Labels: t-tooling

#44 - Add tests for `CrawleeLogFormatter`

Pull Request - State: closed - Opened by vdusek 9 months ago
Labels: t-tooling, tested

#43 - Update Ruff configuration for v0.2

Pull Request - State: closed - Opened by vdusek 9 months ago
Labels: t-tooling, adhoc

#42 - Update dependency twine to v5

Pull Request - State: closed - Opened by renovate[bot] 9 months ago

#41 - Update dependency ruff to ~0.2.0

Pull Request - State: closed - Opened by renovate[bot] 10 months ago

#40 - Add `LocalEventManager`

Pull Request - State: closed - Opened by vdusek 10 months ago - 3 comments

#39 - Test

Pull Request - State: closed - Opened by vdusek 10 months ago

#38 - Enhance github actions & pre-commit hooks configuration

Pull Request - State: closed - Opened by vdusek 10 months ago
Labels: t-tooling, infrastructure

#37 - test

Issue - State: closed - Opened by vdusek 10 months ago

#36 - Update actions/github-script action to v7 - autoclosed

Pull Request - State: closed - Opened by renovate[bot] 10 months ago

#35 - Fix existing Github Actions pipelines

Pull Request - State: closed - Opened by vdusek 10 months ago
Labels: t-tooling, infrastructure

#34 - Update dependency pytest to v8

Pull Request - State: closed - Opened by renovate[bot] 10 months ago - 2 comments

#33 - Update dependency pre-commit to ~3.6.0

Pull Request - State: closed - Opened by renovate[bot] 10 months ago

#32 - Add Poetry for dependency and packaging management

Pull Request - State: closed - Opened by vdusek 10 months ago

#31 - Implement `BeautifulSoupCrawler`

Issue - State: closed - Opened by vdusek 10 months ago - 1 comment
Labels: enhancement, t-tooling

#30 - Implement `BasicCrawler`

Issue - State: closed - Opened by vdusek 10 months ago - 4 comments
Labels: enhancement, t-tooling

#29 - Update dependency dev/pytest to v8 - autoclosed

Pull Request - State: closed - Opened by renovate[bot] 10 months ago

#28 - Implement `LocalEventManager`

Issue - State: closed - Opened by vdusek 10 months ago
Labels: enhancement, t-tooling

#27 - Update dependency dev/pytest-asyncio to ~=0.23.4

Pull Request - State: closed - Opened by renovate[bot] 10 months ago

#26 - Update dependency dev/pytest to v8

Pull Request - State: closed - Opened by renovate[bot] 10 months ago

#25 - Add the first version of `EventManager`

Pull Request - State: closed - Opened by vdusek 10 months ago
Labels: t-tooling

#24 - Implement `EventManager`

Issue - State: closed - Opened by vdusek 10 months ago
Labels: enhancement, t-tooling

#23 - Init of `log_config` module

Pull Request - State: closed - Opened by vdusek 10 months ago
Labels: enhancement, t-tooling, adhoc

#22 - Add a first version of `system_status` module

Pull Request - State: closed - Opened by vdusek 10 months ago

#21 - Implement `SystemStatus`

Issue - State: closed - Opened by vdusek 10 months ago
Labels: enhancement, t-tooling

#20 - Add Snapshotter

Pull Request - State: closed - Opened by vdusek 10 months ago
Labels: t-tooling, tested

#19 - Implement `AutoscaledPool`

Issue - State: closed - Opened by vdusek 10 months ago
Labels: enhancement, t-tooling

#18 - Generate changelog from the commit messages

Issue - State: closed - Opened by vdusek 10 months ago
Labels: enhancement, t-tooling

#17 - Add package for run-time type checking

Issue - State: open - Opened by vdusek 10 months ago - 2 comments
Labels: enhancement, t-tooling, low priority

#16 - Relase a first version of `crawlee` package to PyPI

Issue - State: closed - Opened by vdusek 10 months ago - 1 comment
Labels: t-tooling, infrastructure

#15 - Update actions/setup-python action to v5

Pull Request - State: closed - Opened by renovate[bot] 10 months ago

#14 - Update dependency dev/pytest-xdist to ~=3.5.0

Pull Request - State: closed - Opened by renovate[bot] 10 months ago

#13 - Add PR template

Pull Request - State: closed - Opened by vdusek 10 months ago

#12 - Update dependency dev/pytest-asyncio to ~=0.23.3

Pull Request - State: closed - Opened by renovate[bot] 10 months ago - 1 comment

#11 - Update dependency dev/pre-commit to ~=3.6.0

Pull Request - State: closed - Opened by renovate[bot] 10 months ago - 1 comment

#10 - Configure Renovate bot

Issue - State: closed - Opened by vdusek 10 months ago - 1 comment
Labels: t-tooling, infrastructure

#9 - Dependency Dashboard

Issue - State: closed - Opened by renovate[bot] 10 months ago

#8 - Update dependency dev/mypy to ~=1.8.0

Pull Request - State: closed - Opened by renovate[bot] 10 months ago

#7 - Update dependency dev/filelock to ~=3.13.1

Pull Request - State: closed - Opened by renovate[bot] 10 months ago

#6 - Migrate to Poetry for packaging and dependency management

Issue - State: closed - Opened by vdusek 10 months ago
Labels: t-tooling, infrastructure

#5 - Add `enqueue_links` helper

Issue - State: closed - Opened by B4nan about 1 year ago - 1 comment
Labels: enhancement, t-tooling

#4 - Configure Renovate

Pull Request - State: closed - Opened by renovate[bot] 10 months ago

#3 - Kick off the AutoscaledPool

Issue - State: closed - Opened by vdusek about 1 year ago - 11 comments
Labels: t-tooling, solutioning

#2 - Implement `Snapshotter`

Issue - State: closed - Opened by vdusek about 1 year ago - 1 comment
Labels: enhancement, t-tooling

#1 - Basic repository setup

Pull Request - State: closed - Opened by vdusek 10 months ago
Labels: t-tooling, adhoc

GitHub / apify/crawlee-python issues and pull requests