NASA-PDS/registry-sweepers issues and pull requests

#49 - fine-tune _bulk buffer flush for performance

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 1 comment

#48 - 46 bulk flush tuning

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 1 comment

#47 - Improve logging configuration

Issue - State: open - Opened by tloubrieu-jpl about 1 year ago - 2 comments
Labels: i&t.skip, icebox, p.could-have, task

#46 - Tweak _bulk flush threshold

Issue - State: closed - Opened by alexdunnjpl about 1 year ago
Labels: B14.0, i&t.skip, task

#45 - 40 add logging aggregation, LOGLEVEL env var, other logging tweaks

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 2 comments

#44 - 34 43 remove broken cross-cluster remotes support

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 1 comment

#43 - Remove CCS support

Issue - State: closed - Opened by alexdunnjpl about 1 year ago
Labels: B14.0, i&t.skip, task

#42 - Implement more-robust response success checking for all Opensearch requests.

Issue - State: open - Opened by alexdunnjpl about 1 year ago - 2 comments
Labels: enhancement, icebox, p.could-have

#41 - amend metadata update writes to only target primary node, not CCRs

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 2 comments

#40 - Consider suppress-data-warnings option

Issue - State: closed - Opened by alexdunnjpl about 1 year ago - 1 comment
Labels: B14.0, i&t.skip, s.high, task

#39 - Profile memory usage

Issue - State: closed - Opened by alexdunnjpl about 1 year ago - 17 comments
Labels: B14.1, i&t.skip, p.must-have, s.high, task

#38 - fix error logging json attribute path

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 1 comment

#37 - Fatal error upon unexpected error due to bad json path

Issue - State: closed - Opened by alexdunnjpl about 1 year ago
Labels: B14.0, bug, i&t.skip, task

#36 - Review CCR behaviour

Issue - State: closed - Opened by alexdunnjpl about 1 year ago - 1 comment
Labels: B14.0, i&t.skip, task

#35 - Update README.md with benchmarks, docker build instruction

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 2 comments

#34 - Provenance bulk update db writes fail under specific conditions related to presence of CCRs

Issue - State: closed - Opened by alexdunnjpl about 1 year ago - 2 comments
Labels: B14.0, bug, i&t.skip, s.critical

#33 - 32 http retries and error logging/handling improvements

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 3 comments

#32 - Properly resolve errors during db write operations

Issue - State: closed - Opened by alexdunnjpl about 1 year ago
Labels: B14.0, bug, i&t.skip, task

#31 - Limit task count to 1 for ECS provenance cluster

Issue - State: closed - Opened by sjoshi-jpl about 1 year ago - 7 comments
Labels: B14.0, i&t.skip, task, wontfix

#30 - Configure monitoring for Registry Sweeper ECS cluster

Issue - State: closed - Opened by sjoshi-jpl about 1 year ago - 5 comments
Labels: B14.0, i&t.skip, task

#29 - implement chunking for utils.write_updated_docs()

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 1 comment

#28 - registry-sweepers breaks when run against production-scale data

Issue - State: closed - Opened by alexdunnjpl about 1 year ago
Labels: B14.0, bug, i&t.skip, task

#26 - Intialize README.md

Pull Request - State: closed - Opened by tloubrieu-jpl over 1 year ago

#25 - Enhance provenance sweeper with more graceful failure when registry contains zero documents

Issue - State: closed - Opened by alexdunnjpl over 1 year ago - 10 comments
Labels: B14.0, B14.1, i&t.skip, invalid, task

#24 - add support for legacy data with non-array-typed singleton properties

Pull Request - State: closed - Opened by alexdunnjpl over 1 year ago

#23 - implement graceful handling of malformed registry documents

Pull Request - State: closed - Opened by alexdunnjpl over 1 year ago

#22 - Update logging and terraform, and default to secure-HTTPS

Pull Request - State: closed - Opened by alexdunnjpl over 1 year ago

#21 - Catch empty remotes list and add logging to sweepers_driver

Issue - State: closed - Opened by alexdunnjpl over 1 year ago - 1 comment
Labels: B14.0, i&t.skip, task

#20 - Malformed product docs break ancestry sweeper

Issue - State: closed - Opened by alexdunnjpl over 1 year ago
Labels: bug

#19 - Bundle documents with string-like reference properties are not handled well

Issue - State: closed - Opened by alexdunnjpl over 1 year ago - 1 comment
Labels: bug, needs:triage

#18 - Add node information to select log messages

Issue - State: closed - Opened by alexdunnjpl over 1 year ago - 2 comments
Labels: B14.0, i&t.skip, task

#17 - registry-sweeper deployment on AWS (prod)

Issue - State: closed - Opened by tloubrieu-jpl over 1 year ago - 3 comments
Labels: B14.0, i&t.skip, task

#16 - Prepare the deployment of the registry-sweeper on AWS (stage)

Issue - State: closed - Opened by tloubrieu-jpl over 1 year ago - 13 comments
Labels: B14.0, i&t.skip, task

#15 - registry-sweeper deployment on AWS (prod)

Issue - State: closed - Opened by tloubrieu-jpl over 1 year ago
Labels: duplicate

#14 - Implement ancestry

Issue - State: closed - Opened by alexdunnjpl over 1 year ago
Labels: B14.0, i&t.skip, task

#13 - Implement functional tests for provenance.py

Issue - State: closed - Opened by alexdunnjpl over 1 year ago - 2 comments
Labels: B14.0, i&t.skip, task

#12 - Switch utils from raw requests calls to opensearch-py

Issue - State: closed - Opened by alexdunnjpl over 1 year ago - 1 comment
Labels: B14.0, i&t.skip, task

#11 - ignore style rule D105

Pull Request - State: closed - Opened by alexdunnjpl over 1 year ago

#10 - Ancestry

Pull Request - State: closed - Opened by alexdunnjpl over 1 year ago - 10 comments

#9 - Add a configuration for the cloudwatch event monitoring

Issue - State: closed - Opened by tloubrieu-jpl over 1 year ago - 1 comment
Labels: B14.0, i&t.skip, task

#8 - Implement docker build/push in CICD

Pull Request - State: closed - Opened by alexdunnjpl over 1 year ago - 2 comments

#7 - Implement docker build/push in CICD

Pull Request - State: closed - Opened by alexdunnjpl over 1 year ago - 1 comment

#6 - Create the docker image and push it to docker hub as part of the CICD

Issue - State: closed - Opened by tloubrieu-jpl over 1 year ago
Labels: B14.0, i&t.skip, task

#5 - Registry api code migration

Pull Request - State: closed - Opened by alexdunnjpl over 1 year ago

#4 - Revert "Registry api code migration"

Pull Request - State: closed - Opened by alexdunnjpl over 1 year ago - 1 comment

#3 - Registry api code migration

Pull Request - State: closed - Opened by alexdunnjpl over 1 year ago

#2 - Update non-essential Dockerfile elements for new repository structure

Issue - State: closed - Opened by alexdunnjpl over 1 year ago - 3 comments
Labels: B14.0, i&t.skip, task

#1 - Migrate registry-api/provenance script into this repository

Issue - State: closed - Opened by tloubrieu-jpl over 1 year ago
Labels: B14.0, i&t.skip, task

GitHub / NASA-PDS/registry-sweepers issues and pull requests