scrapy/w3lib issues and pull requests

#238 - Migrate tests from unittest to pure pytest.

Pull Request - State: closed - Opened by wRAR 5 days ago - 1 comment

#237 - Migrate to ruff.

Pull Request - State: closed - Opened by wRAR 21 days ago - 1 comment

#236 - Release notes for 2.3.0.

Pull Request - State: closed - Opened by wRAR 24 days ago - 1 comment

#235 - Remove deprecated functions.

Pull Request - State: closed - Opened by wRAR 26 days ago - 1 comment

#234 - Update tool versions, add pyupgrade, cleanup pylint

Pull Request - State: closed - Opened by wRAR 27 days ago - 1 comment

#233 - test_url.py: handle 3.9 and 3.10 for http://[2a01:5cc0:1:2:3:4] testcase

Pull Request - State: closed - Opened by flokli about 1 month ago

#232 - Add Python 3.13, drop Python 3.8, update tool versions

Pull Request - State: closed - Opened by wRAR 4 months ago

#231 - Release notes for 2.2.1

Pull Request - State: closed - Opened by Gallaecio 8 months ago

#230 - canonicalize_url: do not apply lowercase to userinfo

Pull Request - State: closed - Opened by Gallaecio 8 months ago

#229 - canonicalize_url inappropriately "lowercases" credentials (username/password) in url

Issue - State: closed - Opened by john-parton 8 months ago - 2 comments
Labels: bug

#228 - Release notes for 2.2.0.

Pull Request - State: closed - Opened by wRAR 9 months ago - 1 comment

#227 - Update tool versions, add description

Pull Request - State: closed - Opened by wRAR 9 months ago

#226 - Typing improvements.

Pull Request - State: closed - Opened by wRAR 9 months ago
Labels: enhancement

#225 - Missing PyPI description

Issue - State: closed - Opened by wRAR 10 months ago
Labels: bug, docs, good first issue

#224 - Update intersphinx URLs.

Pull Request - State: closed - Opened by wRAR 10 months ago - 1 comment
Labels: enhancement, CI

#223 - Space at end of query string is trimmed

Issue - State: open - Opened by Laerte 12 months ago - 2 comments

#222 - canonicalize_url incorrectly handles port when using hostname that requires IDNA encoding

Issue - State: open - Opened by hwo411 12 months ago - 1 comment
Labels: bug

#221 - Implement a safe_url based on all standards

Pull Request - State: open - Opened by Gallaecio about 1 year ago - 4 comments

#220 - Adding pre commit

Pull Request - State: closed - Opened by emarondan about 1 year ago - 1 comment

#219 - Add .readthedocs.yml

Pull Request - State: closed - Opened by Gallaecio about 1 year ago - 1 comment

#218 - Add Python 3.12 and PyPy 3.10 to CI.

Pull Request - State: closed - Opened by wRAR over 1 year ago - 1 comment

#217 - update checkout action to version 4

Pull Request - State: closed - Opened by rettinghaus over 1 year ago - 2 comments

#216 - Add release notes for 2.1.2.

Pull Request - State: closed - Opened by wRAR over 1 year ago

#215 - Add Documentation url

Pull Request - State: closed - Opened by koutoftimer over 1 year ago - 6 comments

#214 - Drop Python 3.7 support.

Pull Request - State: closed - Opened by wRAR over 1 year ago - 2 comments

#213 - Fix tests with Python 3.11.4+

Pull Request - State: closed - Opened by shadchin over 1 year ago - 6 comments

#212 - test_safe_url_string_url regressed on 3.11.4

Issue - State: closed - Opened by mweinelt over 1 year ago - 1 comment

#211 - Fix typing of the get_meta_refresh() result

Pull Request - State: closed - Opened by wRAR about 2 years ago - 1 comment

#210 - Location of libw3.a

Issue - State: closed - Opened by htan2013 about 2 years ago - 1 comment

#209 - fix tox 4 compatibility

Pull Request - State: closed - Opened by kmike about 2 years ago - 1 comment

#208 - Changelog

Pull Request - State: closed - Opened by kmike about 2 years ago - 1 comment

#207 - safe_url_string, canonicalize_url: apply stripping from the URL living standard

Pull Request - State: closed - Opened by Gallaecio about 2 years ago - 3 comments

#206 - Full typing

Pull Request - State: closed - Opened by wRAR about 2 years ago - 1 comment

#205 - Add release notes for version 2.1.0

Pull Request - State: closed - Opened by Gallaecio about 2 years ago - 3 comments

#204 - Reimplement safe_url_string based on the URL living standard

Issue - State: open - Opened by Gallaecio about 2 years ago - 4 comments
Labels: enhancement

#203 - safe_url_string: escape additional characters

Pull Request - State: closed - Opened by Gallaecio about 2 years ago - 4 comments

#202 - Handle `OverflowError` exception on `convert_entity`

Pull Request - State: closed - Opened by Laerte over 2 years ago - 1 comment

#201 - Make safe_url_string safer

Pull Request - State: closed - Opened by Gallaecio over 2 years ago - 3 comments

#200 - Drop Python 3.6 support

Pull Request - State: closed - Opened by Laerte over 2 years ago - 2 comments

#199 - Function `convert_entity` does not catch `OverflowError`

Issue - State: closed - Opened by ghost over 2 years ago
Labels: bug, good first issue

#198 - unit test Issue 91 is fixed

Pull Request - State: closed - Opened by felipeboffnunes over 2 years ago - 2 comments

#197 - Use latest version of Ubuntu

Pull Request - State: closed - Opened by Laerte over 2 years ago - 3 comments

#196 - 187 safe url string already encoded user pass

Pull Request - State: closed - Opened by felipeboffnunes over 2 years ago - 1 comment

#195 - Add support for Python 3.11.

Pull Request - State: closed - Opened by wRAR over 2 years ago - 1 comment

#194 - I have added contributing.md file and code_of_conduct.md file along with some very minor changes in the Readme.rst file

Pull Request - State: closed - Opened by VanshajPoonia over 2 years ago - 10 comments

#193 - safe_url_string handling IPv6 URLs

Issue - State: open - Opened by Cash111 over 2 years ago - 5 comments
Labels: bug, good first issue

#192 - changing basic_auth_header flavor to b64encode instead of urlsafe_b64encode

Pull Request - State: closed - Opened by gsweiz over 2 years ago - 1 comment

#191 - update html_to_unicode() so that the BOM is used first to check the e…

Pull Request - State: closed - Opened by BurnzZ over 2 years ago - 1 comment

#190 - update type annotation of auto_detect_fun param in html_to_unicode()

Pull Request - State: closed - Opened by BurnzZ over 2 years ago - 2 comments

#189 - BOM should take precedence over Content-Type header when detecting the encoding

Issue - State: closed - Opened by kmike over 2 years ago

#188 - Issue in safe_url_encoding

Issue - State: closed - Opened by azierariel over 2 years ago - 8 comments

#187 - safe_url_string URL-encodes already-encoded username and password, breaking idempodency

Issue - State: closed - Opened by andersk over 2 years ago - 1 comment
Labels: bug

#186 - Minor language and format suggestions

Pull Request - State: closed - Opened by Gallaecio over 2 years ago - 1 comment

#185 - Changelog

Pull Request - State: closed - Opened by kmike over 2 years ago - 1 comment

#184 - declare w3lib as providing type hints

Pull Request - State: closed - Opened by kmike over 2 years ago - 1 comment

#183 - Fix keep_fragments=True

Pull Request - State: closed - Opened by kmike over 2 years ago

#182 - switch from pytest-flake8 to raw flake8; clean up ignores

Pull Request - State: closed - Opened by kmike over 2 years ago - 1 comment

#181 - basic_auth_header uses the wrong flavor of base64

Issue - State: closed - Opened by Gallaecio over 2 years ago
Labels: bug, good first issue

#180 - [request] Update pypi release

Issue - State: closed - Opened by joe733 over 2 years ago - 1 comment

#179 - Fix issue #162 add different regex pattern to search for meta tags

Pull Request - State: closed - Opened by AngelikiBoura over 2 years ago - 9 comments

#178 - should the canonize_url function convert an apostrophe to %27

Issue - State: closed - Opened by bsekiewicz about 3 years ago - 2 comments

#177 - Replace Travis CI badge with GitHub Actions

Pull Request - State: closed - Opened by hugovk over 3 years ago - 1 comment

#176 - Add support for Python 3.10

Pull Request - State: closed - Opened by hugovk over 3 years ago - 1 comment

#175 - Remove redundant code and fix pylint

Pull Request - State: closed - Opened by hugovk over 3 years ago - 1 comment

#174 - Encode hostname directly instead of netloc

Pull Request - State: closed - Opened by Laerte over 3 years ago - 6 comments

#173 - Run black

Pull Request - State: closed - Opened by wRAR over 3 years ago - 1 comment

#172 - Type annotations

Pull Request - State: closed - Opened by lucywang000 over 3 years ago - 7 comments

#171 - w3lib.url.safe_url_string incorrectly encode IDNA domain with port

Issue - State: closed - Opened by heroesm almost 4 years ago - 1 comment
Labels: bug, good first issue

#170 - w3lib.utils: deprecate functions not needed for Python 3

Pull Request - State: closed - Opened by Gallaecio almost 4 years ago - 2 comments

#169 - Remove deprecated code

Pull Request - State: closed - Opened by Gallaecio almost 4 years ago - 3 comments

#168 - Remove Python 2.7 and 3.5 support, add Python 3.9 support

Pull Request - State: closed - Opened by Gallaecio almost 4 years ago - 1 comment

#167 - Expose the separator parameter added upstream to parse_qs and parse_qsl

Pull Request - State: open - Opened by Gallaecio almost 4 years ago - 3 comments

#166 - [CI] Migrate CI to GitHub actions

Pull Request - State: closed - Opened by elacuesta almost 4 years ago - 1 comment
Labels: enhancement, CI

#165 - Remove test broken by Python CVE-2021-23336 fix

Pull Request - State: closed - Opened by andersk almost 4 years ago - 7 comments

#164 - test_add_or_replace_parameter fails on Python 3.6.13, 3.7.10, 3.8.8, 3.9.2 due to CVE-2021-23336 fix

Issue - State: closed - Opened by andersk almost 4 years ago - 1 comment
Labels: bug

#163 - Fix CI issue on PyPy 3 and the Rust compiler

Issue - State: closed - Opened by Gallaecio almost 4 years ago - 1 comment
Labels: CI, good first issue

#162 - Redirection may not work depending on order of 'content' and 'http-equiv' in meta tag

Issue - State: closed - Opened by gmargari about 4 years ago - 5 comments
Labels: bug, good first issue

#161 - Update PYPY 2 installation into Travis CI

Pull Request - State: closed - Opened by Gallaecio over 4 years ago - 1 comment
Labels: CI

#160 - Fix CI jobs

Pull Request - State: closed - Opened by Gallaecio over 4 years ago - 1 comment
Labels: CI

#159 - [FIX] avoid concating `#` with url if there is no fragment.

Pull Request - State: closed - Opened by EltonChou over 4 years ago - 9 comments

#158 - remove_tags not working on html comments

Issue - State: closed - Opened by mosynaq over 4 years ago - 4 comments
Labels: bug

#157 - Cover w3lib 1.22.0 in the release notes

Pull Request - State: closed - Opened by Gallaecio almost 5 years ago - 2 comments

#156 - Drop Python 3.4 suppot, enable Python 3.8 tests

Pull Request - State: closed - Opened by kmike almost 5 years ago - 1 comment

#155 - Scrapy can not auto detect GBK html encoding

Issue - State: open - Opened by samuelchen almost 5 years ago - 3 comments
Labels: bug

#154 - Do not use an assert for remove_tags parameter checking

Pull Request - State: closed - Opened by Gallaecio about 5 years ago - 1 comment
Labels: enhancement, CI

#153 - Add tooltips to documentation cross-references

Pull Request - State: closed - Opened by Gallaecio over 5 years ago - 2 comments
Labels: enhancement, docs

#152 - Use InterSphinx to link to the documentation of Pytest and Scrapy

Pull Request - State: closed - Opened by Gallaecio over 5 years ago - 2 comments
Labels: enhancement, docs