qri-io/walk issues and pull requests

#30 - Seed domains from sitemaps in robots.txt

Issue - State: open - Opened by Mr0grog over 5 years ago
Labels: enhancement

#29 - docs: Redrafts readme to capture vision

Pull Request - State: closed - Opened by Frijol almost 6 years ago - 1 comment

#28 - feat: orient walk around job/coordinator server paradigm

Pull Request - State: closed - Opened by b5 almost 6 years ago - 4 comments
Labels: feat, refactor

#27 - Fix spelling in README

Pull Request - State: closed - Opened by machawk1 almost 6 years ago - 1 comment

#26 - Ensure GOPATH and reduce repeated commands

Pull Request - State: closed - Opened by Mr0grog about 6 years ago - 1 comment

#25 - Accept invalid SSL certificates but log that they were invalid

Issue - State: open - Opened by Mr0grog about 6 years ago - 2 comments
Labels: enhancement

#24 - Update readme to include build instructions

Pull Request - State: closed - Opened by lightandluck about 6 years ago - 1 comment

#23 - build-from-source instructions shoulde be in README.md

Issue - State: closed - Opened by b5 about 6 years ago

#22 - Recognize URLs that should not be crawled

Issue - State: open - Opened by Mr0grog about 6 years ago
Labels: enhancement

#21 - Learning from Data.gov?

Issue - State: closed - Opened by Frijol about 6 years ago - 2 comments
Labels: question

#20 - feat: initial API, round out flow for local proof-of-concept

Pull Request - State: closed - Opened by b5 about 6 years ago - 4 comments
Labels: WIP

#19 - Make Badger configuration easier

Issue - State: open - Opened by Mr0grog over 6 years ago - 1 comment

#18 - Test that file actually got written in TestCBORResourceFileWriter

Issue - State: open - Opened by Mr0grog over 6 years ago

#17 - Clear out commented old code in `NewBadgerConfig`

Issue - State: closed - Opened by Mr0grog over 6 years ago

#16 - Spec out Ideal interface between Scanner & Walk

Issue - State: open - Opened by b5 over 6 years ago - 7 comments

#15 - typo fixes

Pull Request - State: closed - Opened by Frijol over 6 years ago - 1 comment

#14 - Coordinator doesn’t always automatically end when all work is done

Issue - State: open - Opened by Mr0grog over 6 years ago
Labels: bug

#13 - WIP: Sitemap

Pull Request - State: closed - Opened by b5 over 6 years ago - 15 comments
Labels: feat, test

#12 - Sitemap Resource Handler

Issue - State: open - Opened by b5 over 6 years ago
Labels: feat

#11 - Add a test that confirms walk stays within its configured domains/hosts/origins

Issue - State: open - Opened by b5 over 6 years ago
Labels: test

#10 - adding initial roadmap document

Pull Request - State: closed - Opened by b5 over 6 years ago - 5 comments
Labels: docs

#9 - Refactor Redirect Handling & Add Tests

Issue - State: open - Opened by b5 over 6 years ago
Labels: bug, test

#8 - Improve ResourceHandler / Coordinator Communication to handle Error States & Resource Retries

Issue - State: open - Opened by b5 over 6 years ago
Labels: feat

#7 - Implement Queue.Pop acknowledgement/confirmation for guaranteed delivery

Issue - State: open - Opened by b5 over 6 years ago - 1 comment
Labels: feat

#6 - Define this project's objective & first milestone

Issue - State: closed - Opened by b5 over 6 years ago - 6 comments
Labels: question, docs

#5 - bring sentry's tests into this project