Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitLab.com / recommend.games/board-game-scraper issues and pull requests
#101 - Reimplement merging in Polars
Issue -
State: opened - Opened by mshepherd over 1 year ago
Labels: medium
#100 - Remove PubSub related code from scraper
Issue -
State: opened - Opened by mshepherd over 1 year ago
Labels: easy
#99 - News processing: option to commit and push to Git
Issue -
State: closed - Opened by mshepherd about 2 years ago
#98 - BGG: get new game IDs from RSS feed
Issue -
State: opened - Opened by mshepherd over 2 years ago
- 2 comments
Labels: medium
#97 - Pull response logs from PubSub
Issue -
State: closed - Opened by mshepherd over 2 years ago
Labels: medium
#96 - Scrape data from Board Game Nexus
Issue -
State: opened - Opened by mshepherd over 2 years ago
Labels: medium
#95 - Scrape data from board game arena
Issue -
State: opened - Opened by mshepherd over 2 years ago
Labels: medium
#94 - Add Knowledge Graph ID to scrapers
Issue -
State: opened - Opened by mshepherd almost 3 years ago
Labels: easy
#93 - Scrape Wikipedia pageview stats for board game articles
Issue -
State: opened - Opened by mshepherd almost 3 years ago
- 3 comments
Labels: easy
#92 - Scrape historical rankings from BGG
Issue -
State: closed - Opened by mshepherd about 3 years ago
Labels: easy
#91 - Allow for more than one scraper per container
Issue -
State: opened - Opened by mshepherd about 3 years ago
Labels: medium
#90 - Remove `board_game_scraper.prefixes` submodule
Issue -
State: opened - Opened by mshepherd about 3 years ago
Labels: easy
#89 - Update Board Game Atlas scraper: adjust for new API model
Issue -
State: opened - Opened by mshepherd about 3 years ago
Labels: medium
#88 - Update to latest docker compose version
Issue -
State: opened - Opened by mshepherd about 3 years ago
Labels: easy
#87 - Better Docker base image
Issue -
State: opened - Opened by mshepherd over 3 years ago
Labels: easy
#86 - Use ItemAdapter everywhere
Issue -
State: opened - Opened by mshepherd over 3 years ago
- 1 comment
Labels: medium
#85 - Scrape (undocumented) BGG JSON API data
Issue -
State: opened - Opened by mshepherd over 3 years ago
Labels: medium
#84 - Script to automatically zip ranking files and delete old ones
Issue -
State: closed - Opened by mshepherd almost 4 years ago
- 1 comment
Labels: medium
#83 - Manage full merge and cleaning up old scraped files automatically
Issue -
State: opened - Opened by mshepherd about 5 years ago
- 1 comment
Labels: easy
#82 - Combine different scrapers in one container
Issue -
State: closed - Opened by mshepherd almost 4 years ago
Labels: medium
#81 - Rankings scraping needs to be much slower and less frequent
Issue -
State: opened - Opened by mshepherd almost 4 years ago
Labels: easy
#80 - Randomise sleeping periods
Issue -
State: opened - Opened by mshepherd almost 4 years ago
Labels: easy
#79 - Scrape games' rankings by game type
Issue -
State: closed - Opened by mshepherd almost 4 years ago
#78 - Limit the number of images to be scraped for a single item
Issue -
State: closed - Opened by mshepherd about 4 years ago
#77 - Calculate blurhash of scraped images
Issue -
State: closed - Opened by mshepherd about 4 years ago
Labels: hard
#76 - Add pre-commit hooks
Issue -
State: closed - Opened by mshepherd about 4 years ago
- 1 comment
#75 - Better date handling in user logs path
Issue -
State: closed - Opened by mshepherd about 4 years ago
#74 - Store date of rating / collection update after merging
Issue -
State: closed - Opened by mshepherd about 4 years ago
#73 - Pull logs from PubSub queue
Issue -
State: closed - Opened by mshepherd about 4 years ago
#72 - Add more URLs to setup.py
Issue -
State: closed - Opened by mshepherd about 4 years ago
#71 - Upgrade dedupe to latest version
Issue -
State: opened - Opened by mshepherd about 4 years ago
Labels: medium
#70 - Upgrade black version
Issue -
State: closed - Opened by mshepherd about 4 years ago
#69 - Upgrade to Python 3.8
Issue -
State: closed - Opened by mshepherd about 4 years ago
#68 - Update Board Game Atlas API
Issue -
State: closed - Opened by mshepherd over 4 years ago
#67 - Upgrade Scrapy to version 2.2
Issue -
State: closed - Opened by mshepherd over 4 years ago
Labels: easy
#66 - Add Recommend.Games blog RSS to news scraper
Issue -
State: closed - Opened by mshepherd over 4 years ago
#65 - Stop scraping, start merging, resume scraping in one script
Issue -
State: closed - Opened by mshepherd over 4 years ago
#64 - Scrape short summary text
Issue -
State: opened - Opened by mshepherd over 4 years ago
- 1 comment
Labels: hard
#63 - Use pathlib everywhere
Issue -
State: opened - Opened by mshepherd over 4 years ago
Labels: medium
#62 - Add host tag to scraper file name
Issue -
State: closed - Opened by mshepherd over 4 years ago
#61 - Make dependencies optional where possible
Issue -
State: opened - Opened by mshepherd over 4 years ago
- 1 comment
Labels: medium
#60 - Make merging with Spark work in containers
Issue -
State: opened - Opened by mshepherd over 4 years ago
Labels: hard
#59 - Write Python script to replace news.sh
Issue -
State: closed - Opened by mshepherd over 4 years ago
- 1 comment
#58 - Clean empty values from output before serializing
Issue -
State: closed - Opened by mshepherd over 4 years ago
- 1 comment
Labels: easy
#57 - Use country codes instead of full names
Issue -
State: opened - Opened by mshepherd over 4 years ago
Labels: easy
#56 - User collection date seems always wrong
Issue -
State: closed - Opened by mshepherd over 4 years ago
- 2 comments
#55 - Fix DBpedia and Wikidata spider
Issue -
State: closed - Opened by mshepherd over 4 years ago
#54 - Scrape BGG hotness from Sundén's project
Issue -
State: closed - Opened by mshepherd over 4 years ago
- 2 comments
#53 - User data request needs to have a higher priority
Issue -
State: closed - Opened by mshepherd over 4 years ago
#52 - Reduce scraping speed for all spiders as much as possible
Issue -
State: closed - Opened by mshepherd over 4 years ago
#51 - Migrate to Poetry
Issue -
State: opened - Opened by mshepherd over 4 years ago
Labels: medium
#50 - Use proxies for scraping
Issue -
State: opened - Opened by mshepherd over 4 years ago
- 2 comments
Labels: medium
#49 - Add total of plays, owned, etc to games
Issue -
State: opened - Opened by mshepherd over 4 years ago
Labels: medium
#48 - Scrape video transcripts
Issue -
State: opened - Opened by mshepherd over 4 years ago
Labels: hard
#47 - Scrape BGG hotness
Issue -
State: closed - Opened by mshepherd over 4 years ago
- 1 comment
#46 - Sentiment analysis on rating comments and reviews
Issue -
State: opened - Opened by mshepherd over 4 years ago
Labels: hard
#45 - Upgrade to Dedupe v2.0
Issue -
State: closed - Opened by mshepherd over 4 years ago
#44 - Item scrape count by class
Issue -
State: opened - Opened by mshepherd over 4 years ago
Labels: medium
#43 - Purge unnecessary data from merged results
Issue -
State: closed - Opened by mshepherd over 4 years ago
Labels: easy
#42 - Games that have been played, but are not in collection otherwise, have no collid
Issue -
State: closed - Opened by mshepherd over 4 years ago
- 1 comment
#41 - Filter out N/A from users' image URLs
Issue -
State: closed - Opened by mshepherd over 4 years ago
#40 - Scrape more user information
Issue -
State: closed - Opened by mshepherd over 4 years ago
#39 - Scrape historical rankings from web archive
Issue -
State: closed - Opened by mshepherd almost 5 years ago
- 1 comment
#38 - Scrape historical rankings from Geeklist
Issue -
State: closed - Opened by mshepherd almost 5 years ago
- 1 comment
#37 - Change emails to @recommend.games
Issue -
State: closed - Opened by mshepherd almost 5 years ago
#36 - Improve README
Issue -
State: opened - Opened by mshepherd almost 5 years ago
Labels: medium
#35 - deprecation note to ludoj-scraper
Issue -
State: closed - Opened by mshepherd almost 5 years ago
- 1 comment
#34 - Replace utils module with pytilty
Issue -
State: closed - Opened by mshepherd almost 5 years ago
#33 - Rewrite Spark merge in new SQL interface
Issue -
State: closed - Opened by mshepherd about 5 years ago
- 2 comments
#32 - Get a game's "main colour"
Issue -
State: opened - Opened by mshepherd about 5 years ago
- 3 comments
Labels: hard
#31 - Rename and move repository
Issue -
State: closed - Opened by mshepherd about 5 years ago
#30 - Add tests
Issue -
State: opened - Opened by mshepherd about 5 years ago
Labels: medium
#29 - Migrate to GitHub
Issue -
State: closed - Opened by mshepherd about 5 years ago
- 1 comment
#28 - Make smart_open an optional dependency and migrate to latest version
Issue -
State: closed - Opened by mshepherd about 5 years ago
#27 - Drop and remove CSV support
Issue -
State: opened - Opened by mshepherd about 5 years ago
Labels: medium
#26 - Factor out generic parts of repo
Issue -
State: closed - Opened by mshepherd about 5 years ago
- 2 comments
#25 - Move news scraping into this repo
Issue -
State: opened - Opened by mshepherd about 5 years ago
Labels: hard
#24 - Clean up scripts
Issue -
State: closed - Opened by mshepherd about 5 years ago
- 2 comments
Labels: easy
#23 - Dockerize scraping
Issue -
State: closed - Opened by mshepherd about 5 years ago
- 3 comments
#22 - Find a better solution for total number of Board Game Atlas items
Issue -
State: closed - Opened by mshepherd about 5 years ago
#21 - Fix spielen.de contract
Issue -
State: closed - Opened by mshepherd about 5 years ago
#20 - Upload to PyPI
Issue -
State: closed - Opened by mshepherd about 5 years ago
- 3 comments
#19 - Add contribution guideline
Issue -
State: opened - Opened by mshepherd about 5 years ago
- 1 comment
Labels: medium
#18 - Add command line entry points in setup.py
Issue -
State: closed - Opened by mshepherd about 5 years ago
#17 - Change PubSub pulling behaviour to longer timeout, but only one pull
Issue -
State: closed - Opened by mshepherd about 5 years ago
#15 - Spielen: parse 'besonders gut mit 4 Spielern'
Issue -
State: opened - Opened by mshepherd almost 6 years ago
Labels: medium
#14 - Send email when scraping has finished
Issue -
State: opened - Opened by mshepherd almost 6 years ago
- 2 comments
Labels: easy
#13 - add type hints everywhere
Issue -
State: opened - Opened by mshepherd almost 6 years ago
- 1 comment
Labels: easy
#12 - scrape awards
Issue -
State: opened - Opened by mshepherd almost 6 years ago
- 1 comment
Labels: hard
#11 - Scrape shop items
Issue -
State: opened - Opened by mshepherd almost 6 years ago
- 1 comment
Labels: hard
#10 - Add more news sources
Issue -
State: opened - Opened by mshepherd almost 6 years ago
- 3 comments
Labels: easy
#9 - Update README
Issue -
State: closed - Opened by mshepherd over 5 years ago
- 4 comments
#8 - Use Spidermon to monitor scrapers
Issue -
State: opened - Opened by mshepherd over 5 years ago
Labels: hard
#7 - Scrape reviews
Issue -
State: opened - Opened by mshepherd almost 6 years ago
Labels: hard
#6 - Luding: scrape implementations/game families/successor
Issue -
State: opened - Opened by mshepherd almost 6 years ago
Labels: medium
#5 - Spielen.de: scrape implementations
Issue -
State: opened - Opened by mshepherd almost 6 years ago
Labels: medium
#4 - use CloseSpider extension to limit execution time
Issue -
State: closed - Opened by mshepherd over 5 years ago
- 1 comment
#3 - Improve linking
Issue -
State: opened - Opened by mshepherd over 5 years ago
- 2 comments
Labels: hard
#2 - resolve category and mechanic IDs in BGA spider
Issue -
State: closed - Opened by mshepherd over 5 years ago
Labels: medium
#1 - there can be several collection entries for each game and user
Issue -
State: opened - Opened by mshepherd over 5 years ago
- 3 comments
Labels: hard