Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / crawler-commons/url-frontier issues and pull requests

#115 - Added CloseableIterator interface

Pull Request - State: open - Opened by klockla 7 days ago - 1 comment
Labels: Server, rocksDB

#114 - Added method to count URLs in a frontier

Pull Request - State: open - Opened by klockla 13 days ago - 1 comment
Labels: enhancement, API, Server, rocksDB

#113 - Use replace instead of replaceall

Pull Request - State: closed - Opened by klockla 13 days ago
Labels: enhancement, Server

#112 - enable grpc server reflection

Pull Request - State: closed - Opened by jdpedrie about 1 month ago - 5 comments
Labels: enhancement

#111 - proposed v3 api definition

Pull Request - State: open - Opened by jdpedrie about 1 month ago

#110 - Update API definition to follow protobuf conventions and best practices

Issue - State: open - Opened by jdpedrie about 1 month ago - 4 comments

#109 - Implement `setCrawlLimit` inside the service

Pull Request - State: closed - Opened by zaibacu about 2 months ago - 1 comment

#108 - Fix generation and pushing of image to Dockerhub

Issue - State: closed - Opened by jnioche 2 months ago - 1 comment
Labels: Docker

#107 - Prerelease 2.4

Pull Request - State: closed - Opened by jnioche 2 months ago
Labels: documentation

#106 - Reverted back to GRPC 1.66.0 and updated protoc to 3.25.5

Pull Request - State: closed - Opened by klockla 2 months ago
Labels: dependencies, Security

#105 - Improved handling of dependencies and updated their versions

Pull Request - State: closed - Opened by jnioche 2 months ago
Labels: dependencies

#104 - Reformat some files which were not passing mvn verify

Pull Request - State: closed - Opened by klockla 2 months ago

#103 - Added myself in the developper list

Pull Request - State: closed - Opened by klockla 2 months ago
Labels: good first issue

#102 - Better organisation of Maven plugins and update their version

Pull Request - State: closed - Opened by jnioche 2 months ago
Labels: enhancement, dependencies

#101 - Added test case for discussion #94

Pull Request - State: closed - Opened by klockla 2 months ago

#100 - Remove Ignite, implements #96

Pull Request - State: closed - Opened by jnioche 3 months ago
Labels: Ignite

#99 - Fix #87, similar behaviour re-blocking whether specitying a key or not

Pull Request - State: closed - Opened by jnioche 3 months ago
Labels: bug, Server

#98 - Applied formatting + removed Ignite #96

Pull Request - State: closed - Opened by jnioche 3 months ago - 1 comment
Labels: Ignite

#97 - adds dependabot

Pull Request - State: closed - Opened by jnioche 3 months ago
Labels: enhancement

#96 - Remove Ignite implementation

Issue - State: closed - Opened by jnioche 3 months ago

#93 - Add method ListURLs to list all URLs known in the frontier with their next fetch date

Pull Request - State: closed - Opened by klockla 4 months ago - 10 comments
Labels: enhancement, API, Client

#92 - Add method to get URL Status (returns an URLItem)

Pull Request - State: closed - Opened by klockla 4 months ago - 4 comments
Labels: enhancement, API, Client

#91 - Ability to set URL limit for specific domain

Pull Request - State: closed - Opened by zaibacu 4 months ago - 1 comment
Labels: enhancement, API

#90 - Ability to set Limit on domain

Issue - State: closed - Opened by zaibacu 5 months ago - 3 comments

#89 - Bump ch.qos.logback:logback-classic from 1.4.4 to 1.4.12 in /service

Pull Request - State: closed - Opened by dependabot[bot] about 1 year ago
Labels: dependencies

#88 - Fix typos

Pull Request - State: closed - Opened by MattiSG over 1 year ago - 5 comments

#87 - getURLs will lock whole Queue when not assign Key

Issue - State: closed - Opened by saselovejulie over 1 year ago - 2 comments

#86 - Generate multi arch Docker images

Issue - State: closed - Opened by jnioche over 1 year ago
Labels: Docker

#85 - Bump grpc-protobuf from 1.50.2 to 1.53.0 in /API

Pull Request - State: closed - Opened by dependabot[bot] over 1 year ago
Labels: dependencies

#84 - Making the metrics variables for GetURLs protected

Pull Request - State: closed - Opened by michaeldinzinger over 1 year ago - 1 comment
Labels: enhancement

#82 - Modifying functionality for rocksdb.purge to use abstract method

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago - 1 comment
Labels: enhancement

#82 - Modifying functionality for rocksdb.purge to use abstract method

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago - 1 comment
Labels: enhancement

#81 - Modifying the delete functionality for ignite.purge (Issue #74)

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago - 2 comments
Labels: enhancement, Ignite

#81 - Modifying the delete functionality for ignite.purge (Issue #74)

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago - 2 comments
Labels: enhancement, Ignite

#80 - Forwarding the config map in DistributedFrontierService constructor (Issue #73)

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago - 3 comments

#79 - Preventing IgniteHeartbeat race condition on the start of IgniteService (Issue #72)

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago - 3 comments
Labels: bug, Server

#78 - PutURLs calls failing with java.lang.IllegalStateException #77

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago - 1 comment
Labels: bug, Server

#78 - PutURLs calls failing with java.lang.IllegalStateException #77

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago - 1 comment
Labels: bug, Server

#78 - PutURLs calls failing with java.lang.IllegalStateException #77

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago - 1 comment
Labels: bug, Server

#77 - PutURLs calls failing with java.lang.IllegalStateException

Issue - State: closed - Opened by michaeldinzinger almost 2 years ago - 2 comments

#77 - PutURLs calls failing with java.lang.IllegalStateException

Issue - State: closed - Opened by michaeldinzinger almost 2 years ago - 2 comments

#77 - PutURLs calls failing with java.lang.IllegalStateException

Issue - State: closed - Opened by michaeldinzinger almost 2 years ago - 2 comments

#76 - #72 #73 #74

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago - 2 comments

#76 - #72 #73 #74

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago - 2 comments

#75 - Dev work on ignite service

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago

#75 - Dev work on ignite service

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago

#75 - Dev work on ignite service

Pull Request - State: closed - Opened by michaeldinzinger almost 2 years ago

#74 - ignite.purge answers with 'couldn't delete workdir'

Issue - State: closed - Opened by michaeldinzinger almost 2 years ago
Labels: Ignite

#73 - Configs read.thread.num and write.thread.num are ignored for IgniteService

Issue - State: closed - Opened by michaeldinzinger almost 2 years ago - 1 comment
Labels: Ignite

#72 - IgniteHeartbeat Thread throws a NullPointerException during start of Ignite service

Issue - State: closed - Opened by michaeldinzinger almost 2 years ago - 3 comments
Labels: bug, Server, Ignite

#71 - Some calls to GetURLs failing with java.lang.IllegalStateException

Issue - State: closed - Opened by anjackson about 2 years ago - 18 comments

#71 - Some calls to GetURLs failing with java.lang.IllegalStateException

Issue - State: closed - Opened by anjackson about 2 years ago - 18 comments

#71 - Some calls to GetURLs failing with java.lang.IllegalStateException

Issue - State: closed - Opened by anjackson about 2 years ago - 18 comments

#70 - Exception when trying to delete a non-existing crawl

Issue - State: closed - Opened by jnioche about 2 years ago
Labels: bug, rocksDB

#70 - Exception when trying to delete a non-existing crawl

Issue - State: closed - Opened by jnioche about 2 years ago
Labels: bug, rocksDB

#69 - DistributedFrontierService to use threadpool for all the writes

Issue - State: open - Opened by jnioche about 2 years ago - 2 comments

#68 - Dependency updates

Issue - State: closed - Opened by jnioche about 2 years ago
Labels: dependencies

#67 - ShardedRocksDBService does not return ack when identical URLs are sent in short succession

Issue - State: closed - Opened by jnioche about 2 years ago - 1 comment
Labels: bug

#67 - ShardedRocksDBService does not return ack when identical URLs are sent in short succession

Issue - State: closed - Opened by jnioche about 2 years ago - 1 comment
Labels: bug

#66 - Multithread reading from queues

Pull Request - State: closed - Opened by jnioche about 2 years ago - 5 comments
Labels: enhancement, Server

#65 - Use multiple threads for putting URLs

Pull Request - State: closed - Opened by jnioche about 2 years ago
Labels: enhancement

#64 - Batch write operations

Issue - State: closed - Opened by jnioche over 2 years ago
Labels: rocksDB

#63 - Use multiple threads for putting URLs

Issue - State: closed - Opened by jnioche over 2 years ago - 10 comments
Labels: Server, rocksDB

#62 - URLFrontier AckMessage does not contain IDs of ACKed URLInfo

Issue - State: closed - Opened by FelixEngl over 2 years ago - 3 comments

#62 - URLFrontier AckMessage does not contain IDs of ACKed URLInfo

Issue - State: closed - Opened by FelixEngl over 2 years ago - 3 comments

#62 - URLFrontier AckMessage does not contain IDs of ACKed URLInfo

Issue - State: closed - Opened by FelixEngl over 2 years ago - 3 comments

#61 - Update version of gRPC to 1.50.0

Issue - State: closed - Opened by jnioche over 2 years ago
Labels: dependencies

#60 - RocksDB backend - faster restarts, implements #54

Pull Request - State: closed - Opened by jnioche over 2 years ago
Labels: enhancement, Server, rocksDB

#60 - RocksDB backend - faster restarts, implements #54

Pull Request - State: closed - Opened by jnioche over 2 years ago
Labels: enhancement, Server, rocksDB

#57 - add getInfo endpoint

Issue - State: open - Opened by jnioche over 2 years ago
Labels: enhancement

#57 - add getInfo endpoint

Issue - State: closed - Opened by jnioche over 2 years ago - 1 comment
Labels: enhancement

#56 - _ShardedRocksDBService_

Pull Request - State: closed - Opened by jnioche over 2 years ago
Labels: enhancement, Server, rocksDB

#56 - _ShardedRocksDBService_

Pull Request - State: closed - Opened by jnioche over 2 years ago
Labels: enhancement, Server, rocksDB

#55 - Exception caught when deleting queue

Issue - State: closed - Opened by jnioche over 2 years ago
Labels: bug, Server, rocksDB

#55 - Exception caught when deleting queue

Issue - State: closed - Opened by jnioche over 2 years ago
Labels: bug, Server, rocksDB

#54 - RocksDB backend - faster restarts

Issue - State: closed - Opened by jnioche over 2 years ago - 1 comment
Labels: enhancement, Server

#54 - RocksDB backend - faster restarts

Issue - State: closed - Opened by jnioche over 2 years ago - 1 comment
Labels: enhancement, Server

#52 - Faster recovery for RocksDB service implementation

Issue - State: closed - Opened by jnioche over 2 years ago
Labels: enhancement, Server

#51 - Use Java 11

Issue - State: closed - Opened by jnioche over 2 years ago

#51 - Use Java 11

Issue - State: closed - Opened by jnioche over 2 years ago

#49 - Expose metrics through Prometheus endpoint

Pull Request - State: closed - Opened by jnioche almost 3 years ago
Labels: enhancement

#49 - Expose metrics through Prometheus endpoint

Pull Request - State: closed - Opened by jnioche almost 3 years ago
Labels: enhancement

#49 - Expose metrics through Prometheus endpoint

Pull Request - State: closed - Opened by jnioche almost 3 years ago
Labels: enhancement

#47 - Crawlid

Pull Request - State: closed - Opened by jnioche almost 3 years ago
Labels: enhancement, API, Server

#44 - Make logging levels configurable and be able to do it via the URLFrontier API

Pull Request - State: closed - Opened by jnioche almost 3 years ago
Labels: enhancement

#42 - Publish service jar on Maven

Issue - State: closed - Opened by jnioche almost 3 years ago

#41 - Multithread reading from queues

Issue - State: closed - Opened by jnioche about 3 years ago
Labels: enhancement, Server

#40 - include inactive queues in list operation

Pull Request - State: closed - Opened by jnioche about 3 years ago
Labels: enhancement

#39 - add getURLs functionality to command line client

Pull Request - State: closed - Opened by jnioche about 3 years ago
Labels: Client

#39 - add getURLs functionality to command line client

Pull Request - State: closed - Opened by jnioche about 3 years ago
Labels: Client

#38 - Tuning Rockdb configuration

Issue - State: closed - Opened by jnioche about 3 years ago
Labels: enhancement, Server

#38 - Tuning Rockdb configuration

Issue - State: closed - Opened by jnioche about 3 years ago
Labels: enhancement, Server

#38 - Tuning Rockdb configuration

Issue - State: closed - Opened by jnioche about 3 years ago
Labels: enhancement, Server

#37 - zero-padding the timestamp used in the keys for RocksDB

Issue - State: closed - Opened by jnioche about 3 years ago - 1 comment
Labels: enhancement, Server