jmyrberg/finscraper issues and pull requests

#84 - Bump scrapy from 2.7.1 to 2.11.2

Pull Request - State: open - Opened by dependabot[bot] 7 months ago
Labels: dependencies

#83 - Bump tqdm from 4.64.0 to 4.66.3

Pull Request - State: open - Opened by dependabot[bot] 7 months ago
Labels: dependencies

#82 - Bump scrapy from 2.7.1 to 2.11.1

Pull Request - State: closed - Opened by dependabot[bot] 10 months ago - 1 comment
Labels: dependencies

#81 - Standardize linting

Issue - State: open - Opened by jmyrberg about 1 year ago
Labels: enhancement

#80 - Add MNetPage spider

Pull Request - State: closed - Opened by jmyrberg about 1 year ago - 1 comment

#79 - Update ylearticle

Pull Request - State: closed - Opened by jmyrberg about 1 year ago

#78 - Add spider for crawling muusikoiden.net web forum messages

Pull Request - State: closed - Opened by bonskotti over 1 year ago - 1 comment

#77 - OikotieApartment: Update listings xpath

Pull Request - State: closed - Opened by jmyrberg almost 2 years ago

#76 - OikotieApartment fix

Pull Request - State: closed - Opened by jmyrberg almost 2 years ago

#75 - Fix demo link

Pull Request - State: closed - Opened by jmyrberg about 2 years ago

#74 - Use versioneer

Pull Request - State: closed - Opened by jmyrberg about 2 years ago

#73 - Fix PyOpenSSL issue

Pull Request - State: closed - Opened by jmyrberg about 2 years ago

#72 - Bump scrapy from 2.6.1 to 2.6.2

Pull Request - State: closed - Opened by dependabot[bot] over 2 years ago - 1 comment
Labels: dependencies

#71 - Improve oikotie performance and add area parameter

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#70 - More Spider-specific tests

Issue - State: open - Opened by jmyrberg over 2 years ago
Labels: enhancement

#69 - Fix badge link

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#68 - Manifest adjustments, spiders.yml scope fix

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#67 - Include correct files in distribution

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#66 - Fix oikotieapartment

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#65 - Fix oikotieapartment scraper

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#64 - Remove local scheme

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#63 - Add fetch-depth

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#62 - Workflow tweaks

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#61 - Update release drafter format, use twine

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#60 - Run on release published

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#59 - Use PAT

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#58 - Bump scrapy from 2.1.0 to 2.6.1

Pull Request - State: closed - Opened by dependabot[bot] over 2 years ago - 1 comment
Labels: dependencies

#57 - Cicd update

Pull Request - State: closed - Opened by jmyrberg over 2 years ago

#56 - Bump scrapy from 2.1.0 to 2.6.0

Pull Request - State: closed - Opened by dependabot[bot] almost 3 years ago - 1 comment
Labels: dependencies

#55 - Bump scrapy from 2.1.0 to 2.5.1

Pull Request - State: closed - Opened by dependabot[bot] about 3 years ago - 1 comment
Labels: dependencies

#54 - Fix no oikotieapartment cookies modal

Pull Request - State: closed - Opened by jmyrberg about 4 years ago - 1 comment

#53 - Fix oikotie spider

Issue - State: closed - Opened by jmyrberg about 4 years ago
Labels: bug

#52 - Contribution instructions, IS paragraphed

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#51 - Refactoring, styling and data output enhancements

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#50 - Add torideal spider

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#49 - Add suomi24page spider

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#48 - Add scraper for tori.fi

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

#47 - Add demipage spider

Pull Request - State: closed - Opened by jmyrberg over 4 years ago - 1 comment

#46 - Enchancements to documentation

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#45 - Case where chrome not available

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: bug

#44 - Added oikotieapartment spider

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#43 - Add link to online demo in README

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#42 - Multiprocessing for OSX with spawn

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#41 - Spider parameters to limit the content to be scraped

Issue - State: open - Opened by jmyrberg over 4 years ago
Labels: enhancement

#40 - Test only the spider of the current branch

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

#39 - Version 0.0.1dev15

Pull Request - State: closed - Opened by jmyrberg over 4 years ago - 1 comment

#38 - Disabling and enabling log in jupyter will display progress bar

Issue - State: open - Opened by jmyrberg over 4 years ago
Labels: bug

#37 - YLEArticle and spider destroy

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#36 - Generic helper functions for handling text data

Issue - State: closed - Opened by jmyrberg over 4 years ago - 1 comment
Labels: enhancement

#35 - Spider destroy

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#34 - Steps for adding a new spider

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: documentation

#33 - Version 0.0.1dev13

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#32 - Test pip installation in travis

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

#31 - Version 0.0.1dev12

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#30 - Version 0.0.1dev11

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#29 - Version 0.0.1dev10

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#28 - Version 0.0.1dev9

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#27 - Version 0.0.1dev8

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#26 - Version 0.0.1dev7

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#25 - Version 0.0.1dev6

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#24 - Version 0.0.1dev5 (2)

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#23 - Revert "Version 0.0.1dev5"

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#22 - Version 0.0.1dev5

Pull Request - State: closed - Opened by jmyrberg over 4 years ago - 1 comment

#21 - Spider level checks for daily build tests

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

#20 - Version 0.0.1dev4

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#19 - Version 0.0.1dev3

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#18 - Version 0.0.1dev2

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#17 - Remove temp dir content if object destroyed and save not called

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

#16 - Throw warning when desired number of items can't be fetched

Issue - State: open - Opened by jmyrberg over 4 years ago
Labels: enhancement

#15 - Version 0.0.1dev1

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#14 - Add README disclaimer about web scraping and good ethics

Issue - State: closed - Opened by jmyrberg over 4 years ago - 1 comment
Labels: documentation

#13 - Add scraper for Vauva.fi

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

#12 - Add scraper for Demi

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

#11 - Add scraper for Suomi24

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

#10 - Add scraper for Yle News

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

#9 - Notebook tutorial: Utilizing NLP models, e.g. FinBERT

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: documentation

#8 - Notebook tutorial: Basics

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: documentation

#7 - More thorough documentation

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: documentation

#6 - Make number of pages to fetch precise

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

#5 - Version 0.0.1dev0

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#4 - Version 0.0.1d

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#3 - Add logging level to scrape

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

#2 - Added Iltalehti and updated documentation

Pull Request - State: closed - Opened by jmyrberg over 4 years ago

#1 - Add progress bar to .scrape

Issue - State: closed - Opened by jmyrberg over 4 years ago
Labels: enhancement

GitHub / jmyrberg/finscraper issues and pull requests