nasa-pds/nucleus issues and pull requests

#132 - Integrate the latest version 4.0.1 of harvest in Nucleus workflowNew harvest

Pull Request - State: closed - Opened by ramesh-maddegoda 19 days ago

#131 - Update Architecture and Implement Separate EFS Per Node Baseline DAG

Issue - State: open - Opened by jordanpadams 26 days ago
Labels: B15.1, p.could-have, theme, Epic, i&t.skip

#130 - Update Product-Level DAG with Upgraded Harvest

Issue - State: open - Opened by jordanpadams 26 days ago - 1 comment
Labels: B15.1, p.must-have, theme, Epic, i&t.skip

#129 - Design and Implement Trigger for Public Release of Data

Issue - State: open - Opened by jordanpadams about 1 month ago
Labels: icebox, theme, Epic, i&t.skip

#128 - CSS MVP: Onboard SBN to Monitor CSS Processing

Issue - State: open - Opened by jordanpadams about 1 month ago
Labels: B15.1, theme, Epic, i&t.skip

#128 - CSS MVP: Onboard SBN to Monitor CSS Processing

Issue - State: open - Opened by jordanpadams about 1 month ago
Labels: B15.1, theme, Epic, i&t.skip

#127 - CSS MVP: Deploy to Prod and Kickoff Processing

Issue - State: open - Opened by jordanpadams about 1 month ago
Labels: B15.1, theme, Epic, i&t.skip

#127 - CSS MVP: Deploy to Prod and Kickoff Processing

Issue - State: open - Opened by jordanpadams about 1 month ago
Labels: B15.1, theme, Epic, i&t.skip

#126 - Implement Data Release Workflow

Issue - State: open - Opened by jordanpadams about 2 months ago
Labels: B15.1, Epic, task, i&t.skip

#126 - Implement Data Release Workflow

Issue - State: open - Opened by jordanpadams about 2 months ago
Labels: B15.1, Epic, task, i&t.skip

#125 - As a user, I want to execute bundle-level referential integrity checking

Issue - State: open - Opened by jordanpadams about 2 months ago
Labels: B15.1, p.should-have, requirement

#125 - As a user, I want to execute bundle-level referential integrity checking

Issue - State: open - Opened by jordanpadams about 2 months ago
Labels: B15.1, p.should-have, requirement

#124 - Implement Bundle Management Workflow

Issue - State: open - Opened by jordanpadams about 2 months ago
Labels: B15.1, theme, Epic, i&t.skip

#123 - Web based Cognito authentication for Nucleus Airflow UI

Issue - State: open - Opened by ramesh-maddegoda about 2 months ago - 7 comments
Labels: B15.1, p.must-have, sprint-backlog, theme, Epic, i&t.skip

#122 - ADD Python script to get Airflow UI web token using Cognito credentials

Pull Request - State: closed - Opened by ramesh-maddegoda about 2 months ago

#122 - ADD Python script to get Airflow UI web token using Cognito credentials

Pull Request - State: closed - Opened by ramesh-maddegoda about 2 months ago

#121 - Integrate the latest version 4.0.1 of harvest in Nucleus workflow

Issue - State: closed - Opened by ramesh-maddegoda 2 months ago - 11 comments
Labels: B15.1, enhancement, sprint-backlog, i&t.skip

#120 - PDS Nucleus Archive Replication

Pull Request - State: closed - Opened by ramesh-maddegoda 3 months ago

#120 - PDS Nucleus Archive Replication

Pull Request - State: closed - Opened by ramesh-maddegoda 3 months ago

#119 - Nucleus hot and cold archives and related workflow changes

Pull Request - State: closed - Opened by ramesh-maddegoda 3 months ago

#119 - Nucleus hot and cold archives and related workflow changes

Pull Request - State: closed - Opened by ramesh-maddegoda 3 months ago

#118 - Find a solution to execute Terraform resources that take long time to deploy

Issue - State: closed - Opened by ramesh-maddegoda 4 months ago - 1 comment
Labels: B15.0, sprint-backlog, task, i&t.skip

#118 - Find a solution to execute Terraform resources that take long time to deploy

Issue - State: closed - Opened by ramesh-maddegoda 4 months ago - 1 comment
Labels: B15.0, sprint-backlog, task, i&t.skip

#117 - Tracking product label processing status in an RDS database and using SQS to control the flow of S3 events to lambda functions

Pull Request - State: closed - Opened by ramesh-maddegoda 4 months ago

#115 - As a node operator, I want Nucleus to take care of the versioning of my products

Issue - State: open - Opened by tloubrieu-jpl 5 months ago
Labels: icebox, p.could-have, requirement

#114 - As a tenant, I want to support cross-account DAG execution in Airflow

Issue - State: open - Opened by viviant100 5 months ago - 1 comment
Labels: icebox, p.could-have, requirement

#113 - Add unstable/stable deployments

Issue - State: open - Opened by jordanpadams 5 months ago - 1 comment
Labels: enhancement, icebox, p.should-have, task, i&t.skip

#113 - Add unstable/stable deployments

Issue - State: open - Opened by jordanpadams 5 months ago - 1 comment
Labels: enhancement, icebox, p.should-have, task, i&t.skip

#112 - Update hashicorp/aws requirement from ~> 4.0.0 to ~> 5.54.1 in /terraform

Pull Request - State: closed - Opened by dependabot[bot] 5 months ago - 1 comment
Labels: needs:dependency, terraform

#112 - Update hashicorp/aws requirement from ~> 4.0.0 to ~> 5.54.1 in /terraform

Pull Request - State: closed - Opened by dependabot[bot] 5 months ago - 1 comment
Labels: needs:dependency, terraform

#111 - Bump actions/setup-python from 3 to 5

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: needs:dependency, github_actions

#111 - Bump actions/setup-python from 3 to 5

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: needs:dependency, github_actions

#110 - Update build_docs.yml to only use workflow_dispatch

Pull Request - State: closed - Opened by ramesh-maddegoda 6 months ago

#110 - Update build_docs.yml to only use workflow_dispatch

Pull Request - State: closed - Opened by ramesh-maddegoda 6 months ago

#109 - Delete .github/workflows/build-docs.yml because there is another duplicated file

Pull Request - State: closed - Opened by ramesh-maddegoda 6 months ago - 3 comments

#108 - Bump hashicorp/setup-terraform from 2 to 3

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: needs:dependency, github_actions

#108 - Bump hashicorp/setup-terraform from 2 to 3

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: needs:dependency, github_actions

#107 - Bump actions/upload-artifact from 3 to 4

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: needs:dependency, github_actions

#107 - Bump actions/upload-artifact from 3 to 4

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: needs:dependency, github_actions

#106 - Bump aws-actions/configure-aws-credentials from 2 to 4

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: needs:dependency, github_actions

#105 - Bump github/codeql-action from 2 to 3

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: needs:dependency, github_actions

#105 - Bump github/codeql-action from 2 to 3

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: needs:dependency, github_actions

#104 - Bump actions/checkout from 1 to 4

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: needs:dependency, github_actions

#104 - Bump actions/checkout from 1 to 4

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: needs:dependency, github_actions

#103 - Update hashicorp/aws requirement from ~> 4.0.0 to ~> 5.53.0 in /terraform

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago - 1 comment
Labels: needs:dependency, terraform

#103 - Update hashicorp/aws requirement from ~> 4.0.0 to ~> 5.53.0 in /terraform

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago - 1 comment
Labels: needs:dependency, terraform

#102 - Setup role based authentication and authorization for Airflow UI with Cognito

Issue - State: closed - Opened by ramesh-maddegoda 6 months ago - 14 comments
Labels: B15.1, sprint-backlog, task, i&t.skip

#102 - Setup role based authentication and authorization for Airflow UI with Cognito

Issue - State: closed - Opened by ramesh-maddegoda 6 months ago - 14 comments
Labels: B15.1, sprint-backlog, task, i&t.skip

#101 - Nucleus MWAA DAG tasks are unable to read remote logs from Cloudwatch

Issue - State: closed - Opened by ramesh-maddegoda 6 months ago - 1 comment
Labels: B15.0, bug

#100 - Read harvest auth credentials from AWS secret manager

Issue - State: closed - Opened by ramesh-maddegoda 6 months ago - 2 comments
Labels: B15.0, task, i&t.skip

#100 - Read harvest auth credentials from AWS secret manager

Issue - State: closed - Opened by ramesh-maddegoda 6 months ago - 2 comments
Labels: B15.0, task, i&t.skip

#99 - Support processing data coming from multiple staging buckets with one Airflow environment

Issue - State: closed - Opened by ramesh-maddegoda 6 months ago
Labels: B15.0, task, i&t.skip

#98 - Updates to deploy PDS Nucleus in MCP Test and Prod environments

Pull Request - State: closed - Opened by ramesh-maddegoda 7 months ago - 4 comments

#98 - Updates to deploy PDS Nucleus in MCP Test and Prod environments

Pull Request - State: closed - Opened by ramesh-maddegoda 7 months ago - 4 comments

#97 - Updates to deploy PDS Nucleus in MCP Test and Prod environments

Pull Request - State: closed - Opened by ramesh-maddegoda 7 months ago

#97 - Updates to deploy PDS Nucleus in MCP Test and Prod environments

Pull Request - State: closed - Opened by ramesh-maddegoda 7 months ago

#96 - Minimize EFS use of Nucleus to reduce the cost and to avoid DataSync related complications

Issue - State: closed - Opened by ramesh-maddegoda 9 months ago - 4 comments
Labels: B15.0, invalid, task, i&t.skip

#96 - Minimize EFS use of Nucleus to reduce the cost and to avoid DataSync related complications

Issue - State: closed - Opened by ramesh-maddegoda 9 months ago - 4 comments
Labels: B15.0, invalid, task, i&t.skip

#95 - Remove data from EFS at the end of PDS basic use case

Issue - State: closed - Opened by ramesh-maddegoda 9 months ago - 1 comment
Labels: B15.0, task, i&t.skip

#95 - Remove data from EFS at the end of PDS basic use case

Issue - State: closed - Opened by ramesh-maddegoda 9 months ago - 1 comment
Labels: B15.0, task, i&t.skip

#94 - Remove data from staging S3 bucket at the end of PDS basic use case

Issue - State: open - Opened by ramesh-maddegoda 9 months ago
Labels: B15.0, task, i&t.skip

#93 - CSS MVP: Deploy Baseline Nucleus for Catalina Sky Survey in Test and Production Environments

Issue - State: closed - Opened by jordanpadams 9 months ago - 11 comments
Labels: B15.0, theme, Epic, i&t.skip

#93 - CSS MVP: Deploy Baseline Nucleus for Catalina Sky Survey in Test and Production Environments

Issue - State: closed - Opened by jordanpadams 9 months ago - 11 comments
Labels: B15.0, theme, Epic, i&t.skip

#92 - Pilot project with IMG processing using Nucleus

Issue - State: open - Opened by jordanpadams 9 months ago - 2 comments
Labels: B15.0, theme, Epic, i&t.skip

#92 - Pilot project with IMG processing using Nucleus

Issue - State: open - Opened by jordanpadams 9 months ago - 2 comments
Labels: B15.0, theme, Epic, i&t.skip

#91 - Implement Warm Backup Storage Solution (Data Backup Plan)

Issue - State: closed - Opened by jordanpadams 9 months ago - 7 comments
Labels: B15.0, theme, Epic, i&t.skip

#91 - Implement Warm Backup Storage Solution (Data Backup Plan)

Issue - State: closed - Opened by jordanpadams 9 months ago - 7 comments
Labels: B15.0, theme, Epic, i&t.skip

#90 - Deploy Nucleus in Production env

Issue - State: open - Opened by viviant100 9 months ago
Labels: B14.1, B15.0, task, i&t.skip

#90 - Deploy Nucleus in Production env

Issue - State: open - Opened by viviant100 9 months ago
Labels: B14.1, B15.0, task, i&t.skip

#89 - Deploy Nucleus in Test env

Issue - State: closed - Opened by viviant100 9 months ago - 14 comments
Labels: B14.1, B15.0, task, i&t.skip

#89 - Deploy Nucleus in Test env

Issue - State: closed - Opened by viviant100 9 months ago - 14 comments
Labels: B14.1, B15.0, task, i&t.skip

#88 - Nucleus: Track the DAG processing status of each PDS product for monitoring and troubleshooting

Issue - State: closed - Opened by ramesh-maddegoda 9 months ago - 4 comments
Labels: B14.1, B15.0, task, i&t.skip

#88 - Nucleus: Track the DAG processing status of each PDS product for monitoring and troubleshooting

Issue - State: closed - Opened by ramesh-maddegoda 9 months ago - 4 comments
Labels: B14.1, B15.0, task, i&t.skip

#87 - Nucleus Airflow Validate task fails with error while reading data file: For input string: "Infinity"

Issue - State: closed - Opened by ramesh-maddegoda 9 months ago - 2 comments
Labels: B14.1, B15.1, bug, needs:triage, sprint-backlog, wontfix

#86 - Nucleus Airflow ECEOperator failed to launch ECS task with error "capacity is unavailable at this time"

Issue - State: closed - Opened by ramesh-maddegoda 9 months ago - 1 comment
Labels: B14.1, bug, invalid, s.high

#86 - Nucleus Airflow ECEOperator failed to launch ECS task with error "capacity is unavailable at this time"

Issue - State: closed - Opened by ramesh-maddegoda 9 months ago - 1 comment
Labels: B14.1, bug, invalid, s.high

#85 - Changes in lambda functions to horizontally scale, instead of trying to process a large amount of files in one lambda

Pull Request - State: closed - Opened by ramesh-maddegoda 10 months ago

#85 - Changes in lambda functions to horizontally scale, instead of trying to process a large amount of files in one lambda

Pull Request - State: closed - Opened by ramesh-maddegoda 10 months ago

#84 - Lambda improvements

Pull Request - State: closed - Opened by ramesh-maddegoda 10 months ago

#84 - Lambda improvements

Pull Request - State: closed - Opened by ramesh-maddegoda 10 months ago

#83 - Nucleus lambda function pds-nucleus-datasync-completion sometimes fails to write copied data file names to Nucleus database

Issue - State: closed - Opened by ramesh-maddegoda 10 months ago - 3 comments
Labels: bug, s.high

#83 - Nucleus lambda function pds-nucleus-datasync-completion sometimes fails to write copied data file names to Nucleus database

Issue - State: closed - Opened by ramesh-maddegoda 10 months ago - 3 comments
Labels: bug, s.high

GitHub / nasa-pds/nucleus issues and pull requests