codelionx/commentsearchengine issues and pull requests

#72 - Final settings

Pull Request - State: closed - Opened by Benedikt1992 almost 7 years ago

#71 - Posting list merge

Pull Request - State: closed - Opened by Benedikt1992 almost 7 years ago

#70 - Doc map with skip pointers

Pull Request - State: closed - Opened by Benedikt1992 almost 7 years ago - 2 comments

#69 - small boolean search fix and minor print-changes

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 1 comment

#68 - FIX: stripping newlines from read queries

Pull Request - State: closed - Opened by CodeLionX about 7 years ago

#67 - Using stopword filter

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 1 comment

#66 - README update

Pull Request - State: closed - Opened by CodeLionX about 7 years ago

#65 - Guardian build

Pull Request - State: open - Opened by Benedikt1992 about 7 years ago

#64 - Let the Comment Reader ignore mapping files to speed up access

Pull Request - State: closed - Opened by CodeLionX about 7 years ago

#63 - CLI improvements

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 1 comment

#62 - Build Index for comments from The Guardian dataset

Issue - State: open - Opened by CodeLionX about 7 years ago - 1 comment

#61 - Allow phrase search parts in boolean queries

Pull Request - State: closed - Opened by CodeLionX about 7 years ago

#60 - Create a "replyTo" index

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 1 comment

#59 - Update README

Issue - State: open - Opened by CodeLionX about 7 years ago
Labels: help wanted

#58 - Implement norm caching

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 5 comments
Labels: performance

#57 - Introducing decoded posting list caching

Pull Request - State: closed - Opened by CodeLionX about 7 years ago
Labels: performance

#56 - Caching norm calculation for query

Issue - State: closed - Opened by Benedikt1992 about 7 years ago - 1 comment
Labels: performance

#55 - Cache `PostingList.postingList()` calls

Issue - State: closed - Opened by CodeLionX about 7 years ago
Labels: performance

#54 - Allow seeking in comments file for faster comment text access

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 1 comment

#53 - Also use seek offset and size for CommentReader

Issue - State: closed - Opened by CodeLionX about 7 years ago - 1 comment
Labels: performance

#52 - Query results are extremely bad for new index (binary with delta encoding)

Issue - State: closed - Opened by CodeLionX about 7 years ago - 1 comment

#51 - Optimize Index Creation Time

Issue - State: open - Opened by CodeLionX about 7 years ago - 1 comment
Labels: inactive, performance

#50 - Index compression

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 2 comments
Labels: performance

#49 - Refactored Indexing and fixed some bugs!

Pull Request - State: closed - Opened by CodeLionX about 7 years ago
Labels: bug (-fix), refactoring, performance

#48 - Refactor multi file handling

Pull Request - State: closed - Opened by CodeLionX about 7 years ago

#47 - Ranking in Phrase Search Query

Pull Request - State: closed - Opened by CodeLionX about 7 years ago

#46 - Html removel in existing data

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 3 comments

#45 - to few comments are loaded from some sites

Issue - State: closed - Opened by CodeLionX about 7 years ago
Labels: bug (-fix)

#44 - Index: Use binary files and byte offset as pointers

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 1 comment

#43 - add HTML tag filter to Crawling pipeline

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 4 comments

#42 - Cli parameter

Pull Request - State: closed - Opened by Benedikt1992 about 7 years ago - 1 comment

#41 - refactor ID handling

Issue - State: closed - Opened by Benedikt1992 about 7 years ago - 1 comment

#40 - Implement Vector Space Ranking with tf-idf and cosine normalization

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 1 comment

#39 - Safe crawled comments data in multiple files

Pull Request - State: closed - Opened by Benedikt1992 about 7 years ago - 3 comments
Labels: feature request

#38 - Use Up and downvotes (for compatibility reasons)

Pull Request - State: closed - Opened by Benedikt1992 about 7 years ago

#37 - Sitemap spider

Pull Request - State: closed - Opened by Benedikt1992 about 7 years ago

#36 - phrase search and stopwords

Issue - State: open - Opened by Benedikt1992 about 7 years ago - 1 comment

#35 - Consider html tags as stopwords within comments

Issue - State: closed - Opened by Benedikt1992 about 7 years ago - 1 comment

#34 - added helper module for removing NULL bytes from the csv

Pull Request - State: closed - Opened by CodeLionX about 7 years ago

#33 - Crawl comments from old style api

Pull Request - State: closed - Opened by Benedikt1992 about 7 years ago - 2 comments
Labels: feature request

#32 - Fix for review comments

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 3 comments

#31 - accumulative issue for PR #19 review

Issue - State: closed - Opened by CodeLionX about 7 years ago
Labels: bug (-fix), refactoring

#30 - support boolean and prefix queries

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 1 comment

#29 - Store term positions in index

Pull Request - State: closed - Opened by CodeLionX about 7 years ago

#28 - optimize index file storage

Issue - State: closed - Opened by CodeLionX about 7 years ago - 1 comment
Labels: feature request, performance

#27 - remove dhcp and nfs option

Pull Request - State: closed - Opened by Benedikt1992 about 7 years ago

#26 - quickfix for vagrant setup

Pull Request - State: closed - Opened by CodeLionX about 7 years ago

#25 - Vagrant refactoring

Pull Request - State: closed - Opened by Benedikt1992 about 7 years ago

#24 - Preparation for single file data storage and refactorings

Pull Request - State: closed - Opened by CodeLionX about 7 years ago

#23 - --Preparation for single file data storage and refactorings--

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 1 comment
Labels: inactive

#22 - Parse sidemaps

Pull Request - State: closed - Opened by Benedikt1992 about 7 years ago - 1 comment
Labels: inactive

#21 - Refactor WashingtonPost Handlers

Pull Request - State: closed - Opened by CodeLionX about 7 years ago
Labels: refactoring

#20 - allow crawling of old style API comments

Pull Request - State: closed - Opened by CodeLionX about 7 years ago - 1 comment
Labels: bug (-fix), inactive

#19 - index comments

Pull Request - State: closed - Opened by CodeLionX over 7 years ago - 1 comment

#18 - add sha calculation to util.py

Issue - State: closed - Opened by CodeLionX over 7 years ago
Labels: refactoring

#17 - check result count with real amount of comments on website, check for duplicates

Issue - State: open - Opened by CodeLionX over 7 years ago
Labels: inactive

#16 - Handler takes automatically class name as name (by default)

Issue - State: closed - Opened by CodeLionX over 7 years ago
Labels: refactoring

#15 - remove extra handler classes and include them into processing classes

Issue - State: closed - Opened by CodeLionX over 7 years ago
Labels: refactoring

#14 - parse article for other article urls

Issue - State: closed - Opened by CodeLionX over 7 years ago - 1 comment
Labels: feature request, inactive

#13 - closed comment sections don't return comments on initial requests

Issue - State: closed - Opened by CodeLionX over 7 years ago - 2 comments
Labels: bug (-fix)

#12 - create an asynchronous HandlerContext for Pipeline

Issue - State: open - Opened by CodeLionX over 7 years ago - 1 comment
Labels: feature request, inactive, performance

#11 - Implement a parse pipeline

Pull Request - State: closed - Opened by CodeLionX over 7 years ago

#10 - Integrate wp api into spider

Pull Request - State: closed - Opened by Benedikt1992 over 7 years ago - 2 comments

#9 - [dont merge] porting the crawler to crawl washingtonpost.com

Pull Request - State: closed - Opened by CodeLionX over 7 years ago - 1 comment

#8 - [WIP] port crawler to washingtonpost.com

Pull Request - State: closed - Opened by CodeLionX over 7 years ago - 1 comment
Labels: wip

#7 - change project structure for easier development

Pull Request - State: closed - Opened by CodeLionX over 7 years ago - 1 comment
Labels: bug (-fix)

#6 - Refactor vagrant build process

Issue - State: closed - Opened by Benedikt1992 over 7 years ago - 3 comments

#5 - Refactor projectstructure

Issue - State: closed - Opened by Benedikt1992 over 7 years ago - 1 comment

#4 - Own clean target

Pull Request - State: closed - Opened by CodeLionX over 7 years ago - 1 comment

#3 - Refined project structure

Pull Request - State: closed - Opened by CodeLionX over 7 years ago

#2 - initial setup of vagrant testing environment

Pull Request - State: closed - Opened by Benedikt1992 over 7 years ago

#1 - create valid project structure and setup scripts

Pull Request - State: closed - Opened by CodeLionX over 7 years ago - 2 comments

GitHub / codelionx/commentsearchengine issues and pull requests