Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitLab.com / recommend.games/board-game-scraper issues and pull requests

#101 - Reimplement merging in Polars

Issue - State: opened - Opened by mshepherd over 1 year ago
Labels: medium

#100 - Remove PubSub related code from scraper

Issue - State: opened - Opened by mshepherd over 1 year ago
Labels: easy

#99 - News processing: option to commit and push to Git

Issue - State: closed - Opened by mshepherd about 2 years ago

#98 - BGG: get new game IDs from RSS feed

Issue - State: opened - Opened by mshepherd over 2 years ago - 2 comments
Labels: medium

#97 - Pull response logs from PubSub

Issue - State: closed - Opened by mshepherd over 2 years ago
Labels: medium

#96 - Scrape data from Board Game Nexus

Issue - State: opened - Opened by mshepherd over 2 years ago
Labels: medium

#95 - Scrape data from board game arena

Issue - State: opened - Opened by mshepherd over 2 years ago
Labels: medium

#94 - Add Knowledge Graph ID to scrapers

Issue - State: opened - Opened by mshepherd almost 3 years ago
Labels: easy

#93 - Scrape Wikipedia pageview stats for board game articles

Issue - State: opened - Opened by mshepherd almost 3 years ago - 3 comments
Labels: easy

#92 - Scrape historical rankings from BGG

Issue - State: closed - Opened by mshepherd about 3 years ago
Labels: easy

#91 - Allow for more than one scraper per container

Issue - State: opened - Opened by mshepherd about 3 years ago
Labels: medium

#90 - Remove `board_game_scraper.prefixes` submodule

Issue - State: opened - Opened by mshepherd about 3 years ago
Labels: easy

#89 - Update Board Game Atlas scraper: adjust for new API model

Issue - State: opened - Opened by mshepherd about 3 years ago
Labels: medium

#88 - Update to latest docker compose version

Issue - State: opened - Opened by mshepherd about 3 years ago
Labels: easy

#87 - Better Docker base image

Issue - State: opened - Opened by mshepherd over 3 years ago
Labels: easy

#86 - Use ItemAdapter everywhere

Issue - State: opened - Opened by mshepherd over 3 years ago - 1 comment
Labels: medium

#85 - Scrape (undocumented) BGG JSON API data

Issue - State: opened - Opened by mshepherd over 3 years ago
Labels: medium

#84 - Script to automatically zip ranking files and delete old ones

Issue - State: closed - Opened by mshepherd almost 4 years ago - 1 comment
Labels: medium

#83 - Manage full merge and cleaning up old scraped files automatically

Issue - State: opened - Opened by mshepherd about 5 years ago - 1 comment
Labels: easy

#82 - Combine different scrapers in one container

Issue - State: closed - Opened by mshepherd almost 4 years ago
Labels: medium

#81 - Rankings scraping needs to be much slower and less frequent

Issue - State: opened - Opened by mshepherd almost 4 years ago
Labels: easy

#80 - Randomise sleeping periods

Issue - State: opened - Opened by mshepherd almost 4 years ago
Labels: easy

#79 - Scrape games' rankings by game type

Issue - State: closed - Opened by mshepherd almost 4 years ago

#78 - Limit the number of images to be scraped for a single item

Issue - State: closed - Opened by mshepherd about 4 years ago

#77 - Calculate blurhash of scraped images

Issue - State: closed - Opened by mshepherd about 4 years ago
Labels: hard

#76 - Add pre-commit hooks

Issue - State: closed - Opened by mshepherd about 4 years ago - 1 comment

#75 - Better date handling in user logs path

Issue - State: closed - Opened by mshepherd about 4 years ago

#74 - Store date of rating / collection update after merging

Issue - State: closed - Opened by mshepherd about 4 years ago

#73 - Pull logs from PubSub queue

Issue - State: closed - Opened by mshepherd about 4 years ago

#72 - Add more URLs to setup.py

Issue - State: closed - Opened by mshepherd about 4 years ago

#71 - Upgrade dedupe to latest version

Issue - State: opened - Opened by mshepherd about 4 years ago
Labels: medium

#70 - Upgrade black version

Issue - State: closed - Opened by mshepherd about 4 years ago

#69 - Upgrade to Python 3.8

Issue - State: closed - Opened by mshepherd about 4 years ago

#68 - Update Board Game Atlas API

Issue - State: closed - Opened by mshepherd over 4 years ago

#67 - Upgrade Scrapy to version 2.2

Issue - State: closed - Opened by mshepherd over 4 years ago
Labels: easy

#66 - Add Recommend.Games blog RSS to news scraper

Issue - State: closed - Opened by mshepherd over 4 years ago

#65 - Stop scraping, start merging, resume scraping in one script

Issue - State: closed - Opened by mshepherd over 4 years ago

#64 - Scrape short summary text

Issue - State: opened - Opened by mshepherd over 4 years ago - 1 comment
Labels: hard

#63 - Use pathlib everywhere

Issue - State: opened - Opened by mshepherd over 4 years ago
Labels: medium

#62 - Add host tag to scraper file name

Issue - State: closed - Opened by mshepherd over 4 years ago

#61 - Make dependencies optional where possible

Issue - State: opened - Opened by mshepherd over 4 years ago - 1 comment
Labels: medium

#60 - Make merging with Spark work in containers

Issue - State: opened - Opened by mshepherd over 4 years ago
Labels: hard

#59 - Write Python script to replace news.sh

Issue - State: closed - Opened by mshepherd over 4 years ago - 1 comment

#58 - Clean empty values from output before serializing

Issue - State: closed - Opened by mshepherd over 4 years ago - 1 comment
Labels: easy

#57 - Use country codes instead of full names

Issue - State: opened - Opened by mshepherd over 4 years ago
Labels: easy

#56 - User collection date seems always wrong

Issue - State: closed - Opened by mshepherd over 4 years ago - 2 comments

#55 - Fix DBpedia and Wikidata spider

Issue - State: closed - Opened by mshepherd over 4 years ago

#54 - Scrape BGG hotness from Sundén's project

Issue - State: closed - Opened by mshepherd over 4 years ago - 2 comments

#53 - User data request needs to have a higher priority

Issue - State: closed - Opened by mshepherd over 4 years ago

#52 - Reduce scraping speed for all spiders as much as possible

Issue - State: closed - Opened by mshepherd over 4 years ago

#51 - Migrate to Poetry

Issue - State: opened - Opened by mshepherd over 4 years ago
Labels: medium

#50 - Use proxies for scraping

Issue - State: opened - Opened by mshepherd over 4 years ago - 2 comments
Labels: medium

#49 - Add total of plays, owned, etc to games

Issue - State: opened - Opened by mshepherd over 4 years ago
Labels: medium

#48 - Scrape video transcripts

Issue - State: opened - Opened by mshepherd over 4 years ago
Labels: hard

#47 - Scrape BGG hotness

Issue - State: closed - Opened by mshepherd over 4 years ago - 1 comment

#46 - Sentiment analysis on rating comments and reviews

Issue - State: opened - Opened by mshepherd over 4 years ago
Labels: hard

#45 - Upgrade to Dedupe v2.0

Issue - State: closed - Opened by mshepherd over 4 years ago

#44 - Item scrape count by class

Issue - State: opened - Opened by mshepherd over 4 years ago
Labels: medium

#43 - Purge unnecessary data from merged results

Issue - State: closed - Opened by mshepherd over 4 years ago
Labels: easy

#41 - Filter out N/A from users' image URLs

Issue - State: closed - Opened by mshepherd over 4 years ago

#40 - Scrape more user information

Issue - State: closed - Opened by mshepherd over 4 years ago

#39 - Scrape historical rankings from web archive

Issue - State: closed - Opened by mshepherd almost 5 years ago - 1 comment

#38 - Scrape historical rankings from Geeklist

Issue - State: closed - Opened by mshepherd almost 5 years ago - 1 comment

#37 - Change emails to @recommend.games

Issue - State: closed - Opened by mshepherd almost 5 years ago

#36 - Improve README

Issue - State: opened - Opened by mshepherd almost 5 years ago
Labels: medium

#35 - deprecation note to ludoj-scraper

Issue - State: closed - Opened by mshepherd almost 5 years ago - 1 comment

#34 - Replace utils module with pytilty

Issue - State: closed - Opened by mshepherd almost 5 years ago

#33 - Rewrite Spark merge in new SQL interface

Issue - State: closed - Opened by mshepherd about 5 years ago - 2 comments

#32 - Get a game's "main colour"

Issue - State: opened - Opened by mshepherd about 5 years ago - 3 comments
Labels: hard

#31 - Rename and move repository

Issue - State: closed - Opened by mshepherd about 5 years ago

#30 - Add tests

Issue - State: opened - Opened by mshepherd about 5 years ago
Labels: medium

#29 - Migrate to GitHub

Issue - State: closed - Opened by mshepherd about 5 years ago - 1 comment

#27 - Drop and remove CSV support

Issue - State: opened - Opened by mshepherd about 5 years ago
Labels: medium

#26 - Factor out generic parts of repo

Issue - State: closed - Opened by mshepherd about 5 years ago - 2 comments

#25 - Move news scraping into this repo

Issue - State: opened - Opened by mshepherd about 5 years ago
Labels: hard

#24 - Clean up scripts

Issue - State: closed - Opened by mshepherd about 5 years ago - 2 comments
Labels: easy

#23 - Dockerize scraping

Issue - State: closed - Opened by mshepherd about 5 years ago - 3 comments

#21 - Fix spielen.de contract

Issue - State: closed - Opened by mshepherd about 5 years ago

#20 - Upload to PyPI

Issue - State: closed - Opened by mshepherd about 5 years ago - 3 comments

#19 - Add contribution guideline

Issue - State: opened - Opened by mshepherd about 5 years ago - 1 comment
Labels: medium

#18 - Add command line entry points in setup.py

Issue - State: closed - Opened by mshepherd about 5 years ago

#15 - Spielen: parse 'besonders gut mit 4 Spielern'

Issue - State: opened - Opened by mshepherd almost 6 years ago
Labels: medium

#14 - Send email when scraping has finished

Issue - State: opened - Opened by mshepherd almost 6 years ago - 2 comments
Labels: easy

#13 - add type hints everywhere

Issue - State: opened - Opened by mshepherd almost 6 years ago - 1 comment
Labels: easy

#12 - scrape awards

Issue - State: opened - Opened by mshepherd almost 6 years ago - 1 comment
Labels: hard

#11 - Scrape shop items

Issue - State: opened - Opened by mshepherd almost 6 years ago - 1 comment
Labels: hard

#10 - Add more news sources

Issue - State: opened - Opened by mshepherd almost 6 years ago - 3 comments
Labels: easy

#9 - Update README

Issue - State: closed - Opened by mshepherd over 5 years ago - 4 comments

#8 - Use Spidermon to monitor scrapers

Issue - State: opened - Opened by mshepherd over 5 years ago
Labels: hard

#7 - Scrape reviews

Issue - State: opened - Opened by mshepherd almost 6 years ago
Labels: hard

#6 - Luding: scrape implementations/game families/successor

Issue - State: opened - Opened by mshepherd almost 6 years ago
Labels: medium

#5 - Spielen.de: scrape implementations

Issue - State: opened - Opened by mshepherd almost 6 years ago
Labels: medium

#4 - use CloseSpider extension to limit execution time

Issue - State: closed - Opened by mshepherd over 5 years ago - 1 comment

#3 - Improve linking

Issue - State: opened - Opened by mshepherd over 5 years ago - 2 comments
Labels: hard

#2 - resolve category and mechanic IDs in BGA spider

Issue - State: closed - Opened by mshepherd over 5 years ago
Labels: medium

#1 - there can be several collection entries for each game and user

Issue - State: opened - Opened by mshepherd over 5 years ago - 3 comments
Labels: hard