vanvalenlab/kiosk-redis-consumer issues and pull requests

#94 - Update dependencies, improve constructor, and reduce memory footprint.

Pull Request - State: closed - Opened by willgraf almost 5 years ago

#93 - Bump copyright to 2020

Pull Request - State: closed - Opened by willgraf almost 5 years ago

#92 - Update kiosk links to kiosk-console.

Pull Request - State: closed - Opened by willgraf almost 5 years ago

#91 - Update PredictClient with updates from source repository

Issue - State: closed - Opened by willgraf almost 5 years ago

#90 - Use GetModelMetadata to pad/tile images for specific model sizes.

Pull Request - State: closed - Opened by willgraf almost 5 years ago

#89 - Fix RTD badge URL in README

Pull Request - State: closed - Opened by willgraf almost 5 years ago

#88 - Modify workflow to use the new PanopticNet deep watershed models.

Pull Request - State: closed - Opened by willgraf almost 5 years ago

#87 - Correct documentation badge to point to master RTD link instead of latest

Issue - State: closed - Opened by msschwartz21 almost 5 years ago
Labels: documentation

#86 - Update for python 2 support.

Pull Request - State: closed - Opened by willgraf almost 5 years ago - 2 comments

#85 - Add table with base set of env vars.

Pull Request - State: closed - Opened by willgraf almost 5 years ago

#84 - Some easy fixes for `mrgn-docs`

Pull Request - State: closed - Opened by willgraf almost 5 years ago - 1 comment

#83 - deepcell-data-processing is now deepcell-toolbox

Pull Request - State: closed - Opened by willgraf almost 5 years ago

#82 - Restructure documentation and implement autodocs

Pull Request - State: closed - Opened by msschwartz21 almost 5 years ago - 1 comment

#81 - Move all consumers into a sub-module.

Pull Request - State: closed - Opened by willgraf almost 5 years ago

#80 - Replace processing.py with deepcell-data-processing==0.1.0

Pull Request - State: closed - Opened by willgraf almost 5 years ago

#79 - model_name and model_version should override label detection.

Issue - State: closed - Opened by willgraf almost 5 years ago

#78 - Add information on environment variables to the README.

Issue - State: closed - Opened by willgraf about 5 years ago - 1 comment

#77 - Kiosk documentation reorganization

Pull Request - State: closed - Opened by msschwartz21 about 5 years ago

#76 - Segmentation post-processing may cause OOM.

Issue - State: closed - Opened by willgraf about 5 years ago - 1 comment

#75 - Add SEGMENTATION_QUEUE env var for tracking-consumer

Pull Request - State: closed - Opened by willgraf about 5 years ago

#74 - Fail a prediction job if it fails more than MAX_RETRY times

Pull Request - State: closed - Opened by willgraf about 5 years ago

#73 - Update deepcell-tracking to 0.2.5 and fix overloaded track_cells

Pull Request - State: closed - Opened by willgraf about 5 years ago

#72 - Update README with instructions for extending the Consumers

Pull Request - State: closed - Opened by willgraf about 5 years ago

#71 - Update deepcell-tracking to 0.2.4

Pull Request - State: closed - Opened by willgraf about 5 years ago

#70 - Upgrade deepcell-tracking to 0.2.3

Pull Request - State: closed - Opened by willgraf about 5 years ago

#69 - deprecate tracking.py for deepcell_tracking pip package.

Pull Request - State: closed - Opened by willgraf over 5 years ago

#68 - Add progress updates to ZipConsumer

Pull Request - State: closed - Opened by willgraf over 5 years ago

#67 - Drift Correction causes errors in tracked output file movies

Issue - State: closed - Opened by willgraf over 5 years ago - 2 comments

#66 - add DRIFT_CORRECTION and NORMALIZE_TRACKING

Pull Request - State: closed - Opened by willgraf over 5 years ago

#65 - Tracking output files may clash in bucket.

Issue - State: closed - Opened by willgraf over 5 years ago - 1 comment

#64 - Boolean environment variables not being parsed properly

Issue - State: closed - Opened by willgraf over 5 years ago - 2 comments

#63 - Enable drift correction for live imaging data

Pull Request - State: closed - Opened by msschwartz21 over 5 years ago

#62 - Monitor job url feature

Issue - State: closed - Opened by msschwartz21 over 5 years ago - 1 comment
Labels: enhancement

#61 - Consider exporting segmentations from a tracking job before starting tracking

Issue - State: closed - Opened by msschwartz21 over 5 years ago - 1 comment
Labels: enhancement

#60 - Bugfix: ImageFileConsumer Scale/Label Detection Integration

Pull Request - State: closed - Opened by willgraf over 5 years ago

#59 - Data is not rescaled before tracking prediction

Issue - State: closed - Opened by msschwartz21 over 5 years ago - 2 comments

#58 - Optimize tracking.py for deployment

Pull Request - State: closed - Opened by willgraf over 5 years ago

#57 - Bugfix - if get_redis_hash finds an invalid key, put it back in the queue.

Pull Request - State: closed - Opened by willgraf over 5 years ago

#56 - refactor `deepcell` transform to `pixelwise`

Pull Request - State: closed - Opened by willgraf over 5 years ago

#55 - ZipConsumer summaries may fetch incomplete data.

Issue - State: closed - Opened by willgraf over 5 years ago - 1 comment
Labels: bug

#54 - Improve coverage of new _consume function

Pull Request - State: closed - Opened by willgraf over 5 years ago

#53 - Consumer._consume() returns the current status of the job.

Pull Request - State: closed - Opened by willgraf over 5 years ago

#52 - Enable scale and label type detection

Pull Request - State: closed - Opened by msschwartz21 over 5 years ago

#51 - ZipConsumer remove each downloaded file after archiving it to save memory

Pull Request - State: closed - Opened by willgraf over 5 years ago

#50 - RetinaMask-based model outputs only process the final output in post-processing

Issue - State: closed - Opened by willgraf over 5 years ago

#49 - Fixed bug for postprocess images and lists of images

Pull Request - State: closed - Opened by willgraf over 5 years ago

#48 - Fixed multiple grpc outputs bug and improved consumer testing

Pull Request - State: closed - Opened by willgraf over 5 years ago

#47 - Update travis-ci to build and push releases to DockerHub

Pull Request - State: closed - Opened by willgraf over 5 years ago

#46 - Minor changes to fix tracking predictions

Pull Request - State: closed - Opened by msschwartz21 over 5 years ago - 1 comment

#45 - Retinanet

Pull Request - State: closed - Opened by msschwartz21 over 5 years ago - 1 comment

#44 - Remove the streaming data processing requests and do the data processing directly

Pull Request - State: closed - Opened by willgraf over 5 years ago

#43 - Update the Redis client wrapper with Sentinel support

Pull Request - State: closed - Opened by willgraf over 5 years ago

#42 - reset connection_pool and retry on ReadOnlyError

Pull Request - State: closed - Opened by willgraf over 5 years ago

#41 - all gRPC calls use a request_timeout of `GRPC_TIMEOUT`

Pull Request - State: closed - Opened by willgraf over 5 years ago

#40 - Update `is_valid_hash` to ignore key prefix

Pull Request - State: closed - Opened by willgraf over 5 years ago

#39 - Cell Tracking

Pull Request - State: closed - Opened by enricozb over 5 years ago

#38 - ZipFileConsumers do not wait for jobs to finish but update the job data

Pull Request - State: closed - Opened by willgraf over 5 years ago

#37 - Update ZipFileConsumer to expire hashes and track failures

Pull Request - State: closed - Opened by willgraf almost 6 years ago

#36 - Fixed ZipFileConsumer bugs with the Redis queue

Pull Request - State: closed - Opened by willgraf almost 6 years ago

#35 - retry gRPC responses with StatusCode.RESOURCE_EXHAUSTED

Issue - State: closed - Opened by willgraf almost 6 years ago

#34 - Get new keys to work on from a Redis queue

Pull Request - State: closed - Opened by willgraf almost 6 years ago

#33 - Pass `count` to `scan_iter` to limit size of results in memory

Pull Request - State: closed - Opened by willgraf almost 6 years ago

#32 - Move tests inside module

Pull Request - State: closed - Opened by willgraf almost 6 years ago

#31 - Upgrade Dockerfile to python:3.6

Pull Request - State: closed - Opened by willgraf almost 6 years ago

#30 - memory leak fix

Pull Request - State: closed - Opened by willgraf almost 6 years ago

#29 - Memory Leak! memory consumption over time goes up linearly

Issue - State: closed - Opened by willgraf almost 6 years ago

#28 - Standardize log output for more efficient logstash parsing

Pull Request - State: closed - Opened by willgraf almost 6 years ago

#27 - Migrate to Python3

Issue - State: closed - Opened by enricozb almost 6 years ago

#26 - Improve logging and default pre/post processing to StreamProcess

Pull Request - State: closed - Opened by willgraf almost 6 years ago

#25 - Clean up tests

Pull Request - State: closed - Opened by willgraf almost 6 years ago

#24 - Bugfix/storage retry

Pull Request - State: closed - Opened by dylanbannon almost 6 years ago
Labels: bug

#23 - Hash Uploaded Files

Pull Request - State: closed - Opened by willgraf almost 6 years ago

#22 - Uploaded filename clashes can cause wrong file to be downloaded

Issue - State: closed - Opened by willgraf almost 6 years ago

#21 - Race Condition: 2 Users submit zip files with contents of the same name at the same time.

Issue - State: closed - Opened by willgraf almost 6 years ago - 1 comment

#20 - writing output timestamp to Redis

Pull Request - State: closed - Opened by dylanbannon about 6 years ago

#19 - Cast images that are being sent to float16 model as float16 np.arrays

Issue - State: closed - Opened by willgraf about 6 years ago

#18 - ZipFileConsumer for processing zipfiles

Pull Request - State: closed - Opened by willgraf about 6 years ago

#17 - Create tests for gRPC clients and the consumer functions that use them

Issue - State: closed - Opened by willgraf about 6 years ago - 1 comment
Labels: enhancement, help wanted, tests

#16 - replace data processing functions with gRPC API client

Pull Request - State: closed - Opened by willgraf about 6 years ago - 2 comments

#15 - Google-style doc-strings and added tests for S3Storage

Pull Request - State: closed - Opened by willgraf about 6 years ago

#14 - tests for consumers.py

Pull Request - State: closed - Opened by willgraf about 6 years ago

#13 - Use a gRPC client to communicate with tensorflow-serving

Pull Request - State: closed - Opened by willgraf about 6 years ago

#12 - Combine pre- and post- processing inside one consumer

Pull Request - State: closed - Opened by willgraf about 6 years ago - 1 comment

#11 - Use kiosk-data-processing API instead of multiple consumers

Pull Request - State: closed - Opened by willgraf about 6 years ago - 1 comment

#10 - for a long time, redis-consumer-deployment tries over and over to connect to tf-serving, with tf-serving refusing over and over because max number of connection tries had been exceeded

Issue - State: closed - Opened by dylanbannon about 6 years ago - 2 comments
Labels: bug

#9 - switch to gRPC API instead of REST API

Issue - State: closed - Opened by willgraf about 6 years ago
Labels: enhancement

#8 - consumer._consume() should be called for every hash

Issue - State: closed - Opened by willgraf about 6 years ago
Labels: enhancement

#7 - Added consumer parameter hash_prefix

Pull Request - State: closed - Opened by willgraf about 6 years ago - 1 comment

#6 - Added pre- and post-processing consumers

Pull Request - State: closed - Opened by willgraf over 6 years ago

#5 - Pre and Post processing should take a list of functions, not just 1

Issue - State: closed - Opened by willgraf over 6 years ago
Labels: enhancement

#4 - Gke integration

Pull Request - State: closed - Opened by dylanbannon over 6 years ago

#3 - TensorFlowServingClient gets 429 errors from tornado when using gen.multi()

Issue - State: closed - Opened by willgraf over 6 years ago - 3 comments

#2 - fixed output url

Pull Request - State: closed - Opened by dylanbannon over 6 years ago

#1 - using StrictRedis for python3 compatibility & saving files to OUTPUT_DIR and LOG_DIR

Pull Request - State: closed - Opened by willgraf over 6 years ago

GitHub / vanvalenlab/kiosk-redis-consumer issues and pull requests