cedadev/nlds issues and pull requests

#113 - initial use case/feature updates, needs discussion

Pull Request - State: open - Opened by mjpritchard 26 days ago

#112 - Created command line tool to output status of all jobs in NLDS

Pull Request - State: open - Opened by Will-Cross1 27 days ago - 1 comment

#111 - Add ACL into Object Store on bucket creation

Issue - State: open - Opened by nmassey001 about 1 month ago

#110 - Given that we can have user metadata with objects in the object store, can we do that with the NLDS too?

Issue - State: open - Opened by bnlawrence 4 months ago

#109 - Add user roles

Pull Request - State: closed - Opened by nf679 5 months ago - 1 comment

#108 - Ensure consumers obey SIGTERM and SIGHUP properly

Issue - State: open - Opened by nmassey001 6 months ago

#107 - Add support for tape pools

Issue - State: open - Opened by nmassey001 6 months ago - 1 comment

#106 - Only add Object Storage location to Catalog DB for a file when the transfer is complete

Issue - State: open - Opened by nmassey001 6 months ago

#105 - Refactor PathDetails so that it more closely matches Catalog DB

Issue - State: open - Opened by nmassey001 6 months ago

#104 - Retry system should fail sooner on errors that will never be resolved

Issue - State: open - Opened by nmassey001 7 months ago - 1 comment

#103 - Updates and bugfixes for v1.0.1

Pull Request - State: closed - Opened by jackleland 8 months ago

#102 - Colons in filenames getting errored in get-transfer

Issue - State: open - Opened by jackleland 8 months ago

#101 - Switch to sphinx-test-reports for generating a test coverage report for the docs

Issue - State: open - Opened by jackleland 8 months ago

#100 - NLDS docs errata

Issue - State: open - Opened by nmassey001 8 months ago

#99 - Flesh out and update documentation

Pull Request - State: closed - Opened by jackleland 8 months ago

#98 - Paths created by NLDS during `get` not deletable by user

Issue - State: open - Opened by jackleland 9 months ago

#97 - System monitor does not work

Issue - State: open - Opened by nmassey001 9 months ago

#96 - Progress toward docs 1.0

Pull Request - State: closed - Opened by jackleland 9 months ago

#95 - NLDS Backlog Tasks

Issue - State: open - Opened by jackleland 9 months ago - 1 comment

#94 - Write a function that returns returns tape name and object store name

Issue - State: open - Opened by nmassey001 9 months ago - 1 comment

#93 - Fix beta testing issues and implement deamon keepalive thread for Consumers

Pull Request - State: closed - Opened by jackleland 9 months ago - 1 comment

#92 - Infinite loop possible when a message fails in Monitor

Issue - State: closed - Opened by jackleland 9 months ago - 3 comments

#91 - Implement threaded consumers to handle long running consumption microprocesses

Issue - State: closed - Opened by jackleland 9 months ago - 1 comment

#90 - Implement threaded consumers for connection keepalive during long-running consumption

Pull Request - State: closed - Opened by jackleland 9 months ago

#89 - v1.0

Pull Request - State: closed - Opened by jackleland 10 months ago

#88 - Add deployment information to documentation

Issue - State: closed - Opened by nmassey001 10 months ago - 1 comment

#87 - Move to production tape from pre-prod

Issue - State: open - Opened by nmassey001 10 months ago

#86 - Deploy independently of CEDA architecture

Issue - State: open - Opened by nmassey001 10 months ago

#85 - Remove any CEDA branding from the docs.

Issue - State: closed - Opened by nmassey001 10 months ago - 1 comment

#84 - Create a Docker Desktop "one click" deployment.

Issue - State: open - Opened by nmassey001 10 months ago

#83 - Make containers for individual microservices

Issue - State: open - Opened by nmassey001 10 months ago

#82 - Documentation of microservices

Issue - State: open - Opened by nmassey001 10 months ago - 1 comment

#81 - nlds put Exception during callback: (psycopg2.errors.InvalidTextRepresentation) invalid input value for enum state: "CATALOG_ROLLBACK" LINE 1: UPDATE sub_record SET state='CATALOG_ROLLBACK', retry_count=...

Issue - State: closed - Opened by mbanjestfc 10 months ago - 2 comments

#80 - Implement deleting files in archive_del.py

Issue - State: open - Opened by nmassey001 11 months ago

#79 - Put correct details for Tape Location in _catalog_restore

Issue - State: open - Opened by nmassey001 11 months ago - 1 comment

#78 - Add autogenerate config file

Issue - State: closed - Opened by nmassey001 11 months ago - 2 comments

#77 - Add foreign key relationship between Aggregation and Transaction

Issue - State: open - Opened by nmassey001 12 months ago - 1 comment

#76 - two bugfixes - see full description

Pull Request - State: closed - Opened by alaniwi 12 months ago

#75 - Filesize captured at the index step can be stale at the time of transfer

Issue - State: open - Opened by jackleland 12 months ago - 1 comment

#74 - Files being retried can still be attempted to be `GET`

Issue - State: closed - Opened by jackleland 12 months ago - 2 comments

#73 - Need an NLDS tenancy

Issue - State: closed - Opened by jackleland 12 months ago - 2 comments

#72 - Ownership/permissions on retrieved files

Issue - State: closed - Opened by jackleland 12 months ago - 5 comments

#71 - Rewrites and improvements to the archive processors

Pull Request - State: closed - Opened by jackleland about 1 year ago

#70 - Fail files above a configurable size at the indexing step

Issue - State: closed - Opened by jackleland about 1 year ago - 2 comments

#69 - Users

Pull Request - State: closed - Opened by nmassey001 about 1 year ago

#68 - Implementation of alembic migrations for database schema & data changes

Pull Request - State: closed - Opened by jackleland over 1 year ago - 2 comments

#68 - Implementation of alembic migrations for database schema & data changes

Pull Request - State: closed - Opened by jackleland over 1 year ago - 2 comments

#67 - made status monitor functional (mostly)

Pull Request - State: closed - Opened by Will-Cross1 over 1 year ago

#66 - Implementation of tape support

Pull Request - State: closed - Opened by jackleland over 1 year ago - 1 comment
Labels: milestone

#65 - Duplicate files in a PUT request cause hang

Issue - State: closed - Opened by nmassey001 over 1 year ago - 1 comment
Labels: bug

#64 - NLDS system status page

Issue - State: closed - Opened by nmassey001 over 1 year ago - 2 comments
Labels: enhancement

#63 - Figure out a way to migrate to new database schemas upon deployment

Issue - State: closed - Opened by jackleland over 1 year ago - 1 comment

#62 - Pull development into main ahead of tagged release

Pull Request - State: closed - Opened by nmassey001 over 1 year ago

#61 - Fix for modify holding attribute error

Pull Request - State: closed - Opened by jackleland over 1 year ago - 1 comment

#60 - Documentation update for release

Pull Request - State: closed - Opened by jackleland almost 2 years ago

#59 - Tags

Pull Request - State: closed - Opened by nmassey001 almost 2 years ago - 1 comment

#58 - Unroutable message errors should be caught and logged

Issue - State: closed - Opened by jackleland almost 2 years ago - 1 comment
Labels: bug

#57 - Add transaction-level retry mechanism

Issue - State: closed - Opened by jackleland almost 2 years ago - 1 comment

#56 - Requesting files from a holding that doesn't exist results in perpetual "ROUTING"

Issue - State: closed - Opened by nmassey001 almost 2 years ago - 2 comments

#55 - List transactions via job label

Issue - State: closed - Opened by nmassey001 almost 2 years ago - 2 comments
Labels: bug

#54 - Restore list transactions via transaction id

Issue - State: closed - Opened by nmassey001 almost 2 years ago - 2 comments
Labels: bug

#53 - Add tag funcitonality

Issue - State: closed - Opened by nmassey001 almost 2 years ago - 1 comment
Labels: enhancement

#52 - Prevent duplicate files being added to a holding

Pull Request - State: closed - Opened by jackleland almost 2 years ago

#51 - Add API endpoints for metrics extraction

Issue - State: open - Opened by jackleland almost 2 years ago - 1 comment
Labels: enhancement, milestone

#50 - added MANAGER use cases

Pull Request - State: closed - Opened by mjpritchard almost 2 years ago

#49 - Db commit

Pull Request - State: closed - Opened by nmassey001 almost 2 years ago - 1 comment

#48 - Add times to command

Issue - State: closed - Opened by nmassey001 almost 2 years ago - 1 comment

#47 - Update GWS_use_case.md

Pull Request - State: closed - Opened by mjpritchard almost 2 years ago

#46 - Make sure no duplicate file paths in a holding

Issue - State: closed - Opened by nmassey001 about 2 years ago - 2 comments
Labels: bug

#45 - Milestone 4 Development: User Interactivity

Pull Request - State: closed - Opened by jackleland about 2 years ago

#44 - Catalog dev

Pull Request - State: closed - Opened by nmassey001 about 2 years ago

#43 - Catalog dev

Pull Request - State: closed - Opened by nmassey001 about 2 years ago

#42 - URI for a file in NLDS

Issue - State: closed - Opened by bnlawrence about 2 years ago - 4 comments
Labels: enhancement

#41 - Milestone 6 tasks

Issue - State: closed - Opened by nmassey001 about 2 years ago - 1 comment
Labels: milestone

#40 - Milestone 5 tasks

Issue - State: closed - Opened by nmassey001 about 2 years ago
Labels: milestone

#39 - Milestone 4 tasks

Issue - State: closed - Opened by nmassey001 about 2 years ago - 1 comment
Labels: milestone

#38 - Fix lack of logging when default config options resorted to on consumer startup

Issue - State: open - Opened by jackleland about 2 years ago
Labels: bug

#37 - Sort out logging on catalog

Issue - State: closed - Opened by jackleland about 2 years ago - 1 comment
Labels: bug

#36 - Implement transfer-get consumer and improve transfer-put

Pull Request - State: closed - Opened by jackleland over 2 years ago - 3 comments

#35 - Investigate / implement aiobotocore version of transfer processor

Issue - State: closed - Opened by nmassey001 over 2 years ago - 2 comments
Labels: wontfix

#34 - Implement Transfer-put Consumer and Associated Message Flow

Pull Request - State: closed - Opened by jackleland over 2 years ago - 1 comment

#33 - Add tagging to UUID / transaction ID

Issue - State: closed - Opened by nmassey001 over 2 years ago - 1 comment

#32 - What do we do with links and empty directories?

Issue - State: closed - Opened by nmassey001 over 2 years ago - 1 comment
Labels: wontfix

#31 - Add ROLES to Users

Issue - State: open - Opened by nmassey001 over 2 years ago
Labels: enhancement

#30 - Add delay to retry messages

Issue - State: closed - Opened by jackleland over 2 years ago

#29 - Implement log rotate

Issue - State: closed - Opened by jackleland over 2 years ago - 1 comment

#28 - Merge overhauls of indexer and logger into main

Pull Request - State: closed - Opened by jackleland over 2 years ago

#27 - Write transfer specification

Issue - State: closed - Opened by nmassey001 over 2 years ago

#26 - Fix ConnectionResetError upon message publishing

Issue - State: closed - Opened by jackleland over 2 years ago - 2 comments

#25 - Pass access key / secret key through from client to server to processors

Issue - State: closed - Opened by nmassey001 over 2 years ago

#24 - Write logging specification

Issue - State: closed - Opened by nmassey001 over 2 years ago

#23 - Implement universal loggin.

Issue - State: closed - Opened by nmassey001 over 2 years ago - 1 comment

#22 - Indexer should report missing files

Issue - State: closed - Opened by nmassey001 over 2 years ago - 1 comment

#21 - What tool should be doing the data movement?

Issue - State: closed - Opened by bnlawrence almost 3 years ago - 3 comments

#20 - What is the best size for batching up file operations?

Issue - State: closed - Opened by bnlawrence almost 3 years ago - 3 comments
Labels: good first issue

#19 - Indexer, bug fixes and sphinx auto-doc generation

Pull Request - State: closed - Opened by jackleland almost 3 years ago

#18 - Merge documentation work into development

Pull Request - State: closed - Opened by jackleland almost 3 years ago

#17 - Add a CANCEL command

Issue - State: open - Opened by nmassey001 almost 3 years ago - 2 comments
Labels: enhancement, question

#16 - Does the indexer / scanner allow a user to index files they do not have permission to read or write?

Issue - State: closed - Opened by nmassey001 almost 3 years ago - 1 comment
Labels: question

#15 - Write NLDS overview presentation

Issue - State: closed - Opened by nmassey001 almost 3 years ago - 1 comment
Labels: milestone

GitHub / cedadev/nlds issues and pull requests