NASA-PDS/registry-sweepers issues and pull requests

#141 - delete dockerhub-publish.yml

Pull Request - State: closed - Opened by alexdunnjpl 22 days ago

#140 - Update dockerhub-publish.yml

Pull Request - State: closed - Opened by alexdunnjpl 22 days ago

#139 - Create dockerhub-publish.yml

Pull Request - State: closed - Opened by alexdunnjpl 22 days ago

#138 - update client to support direct env var credentials for fargate compatibility

Pull Request - State: closed - Opened by alexdunnjpl 23 days ago - 1 comment

#137 - Update README.md

Pull Request - State: closed - Opened by alexdunnjpl 25 days ago

#136 - Investigate retirement of portions of repairkit

Issue - State: open - Opened by jordanpadams about 1 month ago - 1 comment
Labels: B15.1, i&t.skip, icebox, task

#135 - Deploy Registry-Sweeper in MCP Prod

Issue - State: open - Opened by sjoshi-jpl about 1 month ago - 1 comment
Labels: B15.0, i&t.skip, sprint-backlog, task

#134 - Repairkit pagination fix

Pull Request - State: closed - Opened by alexdunnjpl about 1 month ago

#133 - Remove all mutation of arguments from query_registry_db_with_search_after()

Issue - State: open - Opened by alexdunnjpl about 1 month ago
Labels: B15.0, i&t.skip, task

#132 - Unreproducible crash when running remotely against AOSS.

Issue - State: open - Opened by alexdunnjpl about 1 month ago
Labels: bug, needs:triage

#131 - Pull MULTITENANCY_NODE_ID handling to top-level script

Issue - State: open - Opened by alexdunnjpl about 1 month ago
Labels: B15.0, i&t.skip, task

#130 - Implement multitenancy support

Pull Request - State: closed - Opened by alexdunnjpl about 2 months ago - 5 comments

#129 - As a user, I want to force update all types that mismatch their expected types per their schema

Issue - State: open - Opened by jordanpadams 2 months ago
Labels: icebox, p.must-have, requirement

#128 - As a user, I want to generate a report of all schema types that do not match their expected schema type per their LDD

Issue - State: open - Opened by jordanpadams 2 months ago
Labels: icebox, p.should-have, requirement

#127 - --insecure operation may not have been migrated when switching from requests to opensearch

Issue - State: open - Opened by alexdunnjpl 3 months ago
Labels: B15.0, i&t.skip, task

#126 - sweepers no longer supports common CLI arg parser

Issue - State: open - Opened by alexdunnjpl 3 months ago
Labels: bug, needs:triage

#125 - Implement es -> aoss data sync scripts

Pull Request - State: closed - Opened by alexdunnjpl 4 months ago

#124 - sweepers not run(ning) against geo-prod

Issue - State: open - Opened by jordanpadams 5 months ago - 13 comments
Labels: B15.0, bug, s.critical

#123 - Investigate psa-prod extended runtime

Issue - State: open - Opened by alexdunnjpl 6 months ago - 2 comments
Labels: B15.0, i&t.skip, task

#122 - implement multitenancy support

Pull Request - State: closed - Opened by alexdunnjpl 6 months ago - 6 comments

#121 - Provenance runtime/memory optimisations

Issue - State: open - Opened by alexdunnjpl 6 months ago
Labels: B15.0, i&t.skip, task

#120 - Registry-sweeper upgrade for multitenant registry

Issue - State: closed - Opened by tloubrieu-jpl 6 months ago - 15 comments
Labels: B14.1, B15.0, i&t.skip, s.high, sprint-backlog, task

#119 - Investigate questionable repairkit behaviour

Issue - State: closed - Opened by alexdunnjpl 6 months ago - 5 comments
Labels: B15.0, i&t.skip, sprint-backlog, task

#119 - Investigate questionable repairkit behaviour

Issue - State: open - Opened by alexdunnjpl 6 months ago
Labels: B15.0, i&t.skip, task

#118 - Clean up ancestry codebase some

Issue - State: open - Opened by alexdunnjpl 6 months ago
Labels: B15.0, i&t.skip, task

#118 - Clean up ancestry codebase some

Issue - State: open - Opened by alexdunnjpl 6 months ago
Labels: enhancement, i&t.skip, icebox, p.should-have

#117 - add note about tqdm crashes in debug mode

Pull Request - State: closed - Opened by alexdunnjpl 6 months ago

#116 - Deferred partial updates

Pull Request - State: closed - Opened by alexdunnjpl 6 months ago

#115 - Collection iteration optimization

Pull Request - State: closed - Opened by alexdunnjpl 6 months ago

#114 - Nonaggregate products present in "foreign" collections/bundles do not have correct ancestry.

Issue - State: closed - Opened by alexdunnjpl 6 months ago - 5 comments
Labels: bug

#113 - Update chunks to avoid timeout

Pull Request - State: closed - Opened by jordanpadams 6 months ago

#112 - `superseded_by` fields with `null` values causing multiple versions of same products to appear in API searches

Issue - State: closed - Opened by jordanpadams 6 months ago - 9 comments
Labels: B15.0, bug, s.high

#111 - Timeout bug when running legacy dashboard sync

Issue - State: closed - Opened by jordanpadams 6 months ago - 1 comment
Labels: B14.1, bug, s.high

#110 - Publish stable Docker image corresponding to release/X.Y.Z tag

Pull Request - State: closed - Opened by nutjob4life 7 months ago

#109 - When building registry-sweeper version 1.2.1, docker image 1.3.0 was published on docker hub

Issue - State: closed - Opened by tloubrieu-jpl 9 months ago - 1 comment
Labels: B14.1, bug, i&t.skip, s.medium

#108 - Run sweepers locally against PSA prod

Issue - State: closed - Opened by alexdunnjpl 8 months ago - 21 comments
Labels: B14.1, i&t.skip, s.high, task

#108 - Run sweepers locally against PSA prod

Issue - State: open - Opened by alexdunnjpl 8 months ago - 14 comments
Labels: B14.1, i&t.skip, s.high, sprint-backlog, task

#107 - demote noisy error logs

Pull Request - State: closed - Opened by alexdunnjpl 8 months ago

#107 - demote noisy error logs

Pull Request - State: closed - Opened by alexdunnjpl 8 months ago

#106 - Search after finalization

Pull Request - State: closed - Opened by alexdunnjpl 8 months ago

#106 - Search after finalization

Pull Request - State: closed - Opened by alexdunnjpl 8 months ago

#105 - 91 - improve performance when logging ancestry orphaned documents

Pull Request - State: closed - Opened by alexdunnjpl 8 months ago

#104 - Provenance regression tests

Pull Request - State: closed - Opened by alexdunnjpl 8 months ago

#103 - add ancestry/provenance sweeper version to logs

Pull Request - State: closed - Opened by alexdunnjpl 8 months ago

#102 - update README.md with sweepers optimisation info

Pull Request - State: closed - Opened by alexdunnjpl 8 months ago - 1 comment

#101 - Non redundant provenance

Pull Request - State: closed - Opened by alexdunnjpl 8 months ago - 1 comment

#100 - Non redundant ancestry

Pull Request - State: closed - Opened by alexdunnjpl 8 months ago - 1 comment

#99 - Fix image construction problem

Pull Request - State: closed - Opened by nutjob4life 9 months ago - 1 comment

#98 - Test latest sweeper changes on all production OpenSearch clusters

Issue - State: closed - Opened by sjoshi-jpl 9 months ago - 5 comments
Labels: B14.1, i&t.skip, task

#97 - Revert mistaken commits

Pull Request - State: closed - Opened by alexdunnjpl 9 months ago

#96 - Roundup test

Pull Request - State: closed - Opened by alexdunnjpl 9 months ago

#95 - 94 - pin sphinx components/deps for compatibility with sphinx 3.2.1

Pull Request - State: closed - Opened by alexdunnjpl 9 months ago

#94 - docs build fails due to dependency incompatibility

Issue - State: closed - Opened by alexdunnjpl 9 months ago
Labels: B14.1, i&t.skip, task

#93 - 39 - implement ancestry chunking memory optimization

Pull Request - State: closed - Opened by alexdunnjpl 9 months ago - 1 comment

#92 - Investigate/implement non-redundant provenance processing

Issue - State: closed - Opened by alexdunnjpl 9 months ago - 7 comments
Labels: B14.1, enhancement, p.should-have, sprint-backlog

#92 - Investigate/implement non-redundant provenance processing

Issue - State: closed - Opened by alexdunnjpl 9 months ago - 8 comments
Labels: B14.1, enhancement, p.should-have

#91 - Investigate/implement non-redundant ancestry processing

Issue - State: closed - Opened by alexdunnjpl 9 months ago - 5 comments
Labels: requirement

#90 - revert implementation of temporary repairkit fix

Pull Request - State: closed - Opened by alexdunnjpl 10 months ago - 2 comments

#89 - add ops:Tracking_Meta/ops:archive_status to EXCLUDED_PROPERTIES

Pull Request - State: closed - Opened by alexdunnjpl 10 months ago - 1 comment

#88 - Repairkit expansion fix

Pull Request - State: closed - Opened by alexdunnjpl 10 months ago

#87 - 86 - expand application of allarrays repairkit fix to all properties

Pull Request - State: closed - Opened by alexdunnjpl 10 months ago - 2 comments

#86 - Property values returned by the API are inconsistent, as list or single value.

Issue - State: closed - Opened by tloubrieu-jpl 10 months ago - 7 comments
Labels: B14.1, bug, i&t.done, s.high

#85 - Refresh ancestry metadata on all nodes

Issue - State: closed - Opened by alexdunnjpl 10 months ago - 8 comments
Labels: B14.1, i&t.skip, task

#84 - 83 - ensure ancestry metadata keys are present in db index

Pull Request - State: closed - Opened by alexdunnjpl 11 months ago

#84 - 83 - ensure ancestry metadata keys are present in db index

Pull Request - State: closed - Opened by alexdunnjpl 11 months ago

#83 - ensure ancestry metadata key presence in index

Issue - State: closed - Opened by alexdunnjpl 11 months ago
Labels: B14.1, i&t.skip, sprint-backlog, task

#83 - ensure ancestry metadata key presence in index

Issue - State: closed - Opened by alexdunnjpl 11 months ago
Labels: B14.1, i&t.skip, task

#82 - Add default modification date in legacy registry synchronization

Pull Request - State: closed - Opened by tloubrieu-jpl 11 months ago

#81 - Add secrets detection

Pull Request - State: closed - Opened by nutjob4life 11 months ago

#80 - migrate elasticsearch client to opensearch-py for legacy synx sweeper…

Pull Request - State: closed - Opened by tloubrieu-jpl 12 months ago

#79 - Standardize code for compliance with python 3.9 (previously 3.10)

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago

#78 - Standardize CICD on python 3.9

Issue - State: closed - Opened by alexdunnjpl about 1 year ago
Labels: B14.1, i&t.skip, task

#77 - ensure repairkit compatibility with large-doc nodes

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago

#76 - Enable traceability of the deployment in production

Issue - State: open - Opened by tloubrieu-jpl about 1 year ago
Labels: B14.1, enhancement, i&t.skip, icebox, p.should-have

#75 - As a user, I want to know if the datasets available in the registry are published and visible in the API

Issue - State: open - Opened by tloubrieu-jpl about 1 year ago - 2 comments
Labels: B14.1, needs:triage, requirement

#74 - add descriptive error message for unparseable endpoint value

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago

#73 - Implement sweeper data versioning for repairkit

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago

#72 - Use opensearchPy instead of direct opensearch API requests

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago

#71 - improve log message on empty query hits

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago

#70 - Update repairkit to include repairkit version metadata and check to streamline execution

Issue - State: closed - Opened by jordanpadams about 1 year ago - 2 comments
Labels: B14.0, enhancement, i&t.skip, s.high, task

#69 - Registry-Sweepers Error: contained no hits when hits were expected

Issue - State: closed - Opened by sjoshi-jpl about 1 year ago - 6 comments
Labels: B14.0, i&t.skip, s.high, task

#68 - Synchronization of Legacy Solr Registry in the new

Pull Request - State: closed - Opened by tloubrieu-jpl about 1 year ago - 8 comments

#67 - fix incorrectly-implemented retries

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 1 comment

#66 - Fix bugged retry functionality

Issue - State: closed - Opened by alexdunnjpl about 1 year ago
Labels: B14.0, i&t.skip, task

#65 - hotfix zero-update writes regression

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago

#64 - Empty write HTTP400 regression

Issue - State: closed - Opened by alexdunnjpl about 1 year ago
Labels: B14.0, i&t.skip, task

#63 - refactor utils module

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago

#62 - improve repairkit sweeper performance

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 5 comments

#61 - Deploy repairkit sweeper to delta and prod

Issue - State: closed - Opened by jordanpadams about 1 year ago - 22 comments
Labels: B14.0, i&t.skip, task

#60 - Registry-Sweeper ECS Enchancements (Post Multi-Tenancy)

Issue - State: closed - Opened by sjoshi-jpl about 1 year ago - 2 comments
Labels: enhancement, i&t.skip, wontfix

#59 - Registry-Sweeper ECS Enchancements (Pre Multi-Tenancy)

Issue - State: closed - Opened by sjoshi-jpl about 1 year ago - 2 comments
Labels: B14.0, i&t.skip, task

#58 - Regularly synchronize the legacy registry collections on Solr in the registry in opensearch

Issue - State: closed - Opened by tloubrieu-jpl about 1 year ago - 5 comments
Labels: B14.0, i&t.skip, task

#57 - Bugfix http retries, increase retries

Pull Request - State: closed - Opened by alexdunnjpl about 1 year ago - 2 comments

#56 - Remedy absent retry-behaviour

Issue - State: closed - Opened by alexdunnjpl about 1 year ago
Labels: B14.0, i&t.skip, task

#55 - Remediate findings from Provenance Script Testing

Issue - State: closed - Opened by sjoshi-jpl about 1 year ago - 6 comments
Labels: B14.0

#54 - New repairkit sweeper for updating metadata loaded with older versions of Harvest to use lists instead of single-value strings

Pull Request - State: closed - Opened by al-niessner about 1 year ago - 17 comments

GitHub / NASA-PDS/registry-sweepers issues and pull requests