lmullen/cchc issues and pull requests

#61 - Use an environment variable to control types of items fetched

Issue - State: open - Opened by lmullen almost 3 years ago
Labels: enhancement

#60 - Use compose profiles for all services

Issue - State: closed - Opened by lmullen almost 3 years ago
Labels: enhancement

#59 - Issue58-Release-strategy

Pull Request - State: closed - Opened by lmullen almost 3 years ago

#58 - Release strategy

Issue - State: closed - Opened by lmullen almost 3 years ago

#57 - Attempt caching docker layers

Pull Request - State: closed - Opened by lmullen almost 3 years ago - 1 comment

#56 - Documentation for end users

Pull Request - State: closed - Opened by lmullen almost 3 years ago

#55 - Create cchc-ctrl CLI/container

Pull Request - State: closed - Opened by lmullen almost 3 years ago - 1 comment

#54 - Write up documentation for end users

Issue - State: closed - Opened by lmullen almost 3 years ago
Labels: documentation

#53 - Enable Git LFS for predictor

Pull Request - State: closed - Opened by lmullen almost 3 years ago - 1 comment

#52 - Enable Git LFS for predictor

Issue - State: closed - Opened by lmullen almost 3 years ago
Labels: bug

#51 - Use Postgres not Rabbit in predictor

Pull Request - State: closed - Opened by lmullen almost 3 years ago

#50 - Automate running migrations

Issue - State: closed - Opened by lmullen almost 3 years ago
Labels: enhancement

#49 - Add database profile in Docker compose for users without capacity to run their own

Issue - State: closed - Opened by lmullen almost 3 years ago
Labels: enhancement

#48 - Try to use build caching in multi-stage Docker builds

Issue - State: closed - Opened by lmullen almost 3 years ago
Labels: enhancement, wontfix

#47 - Nil pointer problem with saving languages

Issue - State: closed - Opened by lmullen almost 3 years ago - 1 comment
Labels: bug

#46 - Fix bug where multiple instances running can get duplicate items when creating job for queue

Issue - State: closed - Opened by lmullen almost 3 years ago - 1 comment
Labels: bug

#45 - Language detection

Pull Request - State: closed - Opened by lmullen almost 3 years ago

#44 - Remove RabbitMQ

Pull Request - State: closed - Opened by lmullen almost 3 years ago

#43 - Qftext take two

Pull Request - State: closed - Opened by lmullen about 3 years ago

#42 - Refactor many things

Pull Request - State: closed - Opened by lmullen about 3 years ago

#41 - Refactor crawler to use items package

Issue - State: open - Opened by lmullen about 3 years ago
Labels: enhancement

#40 - Add migration for Scriptures

Issue - State: open - Opened by lmullen about 3 years ago
Labels: enhancement

#39 - Be gentler when retrying connections

Issue - State: closed - Opened by lmullen about 3 years ago - 1 comment

#38 - Use connection string rather than individual environment variables for DB

Issue - State: closed - Opened by lmullen about 3 years ago - 1 comment
Labels: enhancement

#37 - Enqueue fulltext

Pull Request - State: closed - Opened by lmullen about 3 years ago

#36 - Remove the queue limit on the items metadata

Issue - State: closed - Opened by lmullen about 3 years ago
Labels: bug

#35 - Retrain model on documents that aren't Chronicling America

Issue - State: open - Opened by lmullen about 3 years ago
Labels: enhancement

#34 - Change Postgres connection string to use Unix socket instead of TCP

Issue - State: closed - Opened by lmullen about 3 years ago - 1 comment
Labels: enhancement

#33 - Predictor

Pull Request - State: closed - Opened by lmullen about 3 years ago - 1 comment

#32 - Stacks importer

Pull Request - State: closed - Opened by lmullen about 3 years ago

#31 - Create columns with default timestamps for created/updated

Issue - State: closed - Opened by lmullen about 3 years ago - 1 comment
Labels: enhancement

#30 - Fix panic on empty collections

Issue - State: closed - Opened by lmullen about 3 years ago
Labels: bug

#29 - Improve testing with Gnomock

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#28 - Create separate items container

Pull Request - State: closed - Opened by lmullen over 3 years ago

#27 - Split apart crawler and item metadata processor

Issue - State: closed - Opened by lmullen over 3 years ago

#26 - Create a view for count of items per collection

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#25 - Better error message for HTTP EOF warning

Issue - State: closed - Opened by lmullen over 3 years ago

#24 - Better Makefile commands

Issue - State: closed - Opened by lmullen over 3 years ago

#23 - Better checks for items that have already been fetched

Issue - State: closed - Opened by lmullen over 3 years ago

#22 - LOC.gov pagination limits make it impossible to get all of big collections

Issue - State: open - Opened by lmullen over 3 years ago
Labels: external-problem

#21 - Migrations

Pull Request - State: closed - Opened by lmullen over 3 years ago

#20 - Move DB migrations outside the application

Issue - State: closed - Opened by lmullen over 3 years ago - 2 comments

#19 - Handle items which have more than one page of full text

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#18 - Refactor pagination of digital collections so it is more resilient

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#17 - Try to reconnect to channel if connection is lost

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#16 - Update tags for Dockerfile

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#15 - Initial release of crawler

Pull Request - State: closed - Opened by lmullen over 3 years ago

#14 - Add crawler to the docker-compose script

Issue - State: closed - Opened by lmullen over 3 years ago

#13 - Create script to clean out all data

Issue - State: closed - Opened by lmullen over 3 years ago

#12 - Double check that we don't do work if item metadata already exists

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#11 - Review code for reasonable defaults

Issue - State: closed - Opened by lmullen over 3 years ago

#10 - Refactor main() so that logic is pushed out to functions

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#9 - Add a starting point at the search endpoint in addition to the collections endpoint

Issue - State: closed - Opened by lmullen over 3 years ago
Labels: enhancement

#8 - Log at a less verbose level

Issue - State: closed - Opened by lmullen over 3 years ago

#7 - Start goroutines with context to quit if interrupt is received

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#6 - Crawler interrupts

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#5 - Reasonable timeouts

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#4 - Sketch of passing jobs with message queue

Pull Request - State: closed - Opened by lmullen over 3 years ago

#3 - Merge sketch api crawl

Pull Request - State: closed - Opened by lmullen over 3 years ago

#2 - Slow down if rate limited

Issue - State: closed - Opened by lmullen over 3 years ago - 1 comment

#1 - Retry on API errors

Issue - State: closed - Opened by lmullen over 3 years ago

GitHub / lmullen/cchc issues and pull requests