nasa-pds/web-analytics issues and pull requests

#44 - Prototype using LogStash and OpenSearch for Web Analytics

Issue - State: open - Opened by jordanpadams 7 months ago
Labels: B15.1, theme, i&t.skip, Epic

#43 - Correct Grok pattern to include hostnames as well as IP addresses. Pr…

Pull Request - State: closed - Opened by kaipak 8 months ago

#42 - Document strategy for web analytics system migration to mcp

Pull Request - State: closed - Opened by kaipak 10 months ago

#41 - Implement Additional Data Pipeline Pre-processing

Issue - State: open - Opened by kaipak 10 months ago - 1 comment
Labels: icebox, p.should-have, theme, i&t.skip, Epic

#40 - Dev

Pull Request - State: closed - Opened by kaipak 10 months ago

#39 - update repo with template files

Pull Request - State: closed - Opened by kaipak 10 months ago - 1 comment
Labels: B15.0, requirement, i&t.skip

#38 - 33 update repo with template files

Pull Request - State: closed - Opened by kaipak 10 months ago

#37 - Fix silent failure/exception with aws s3 sync script and other script improvements

Pull Request - State: closed - Opened by kaipak 11 months ago - 1 comment
Labels: B15.0

#36 - 12 sync script fails silently if aws call fails

Pull Request - State: closed - Opened by kaipak 11 months ago

#35 - Basic unit testing

Issue - State: open - Opened by kaipak 11 months ago
Labels: icebox, task, i&t.skip

#34 - Design and Implement Analytics Pipeline in Amazon Glue for Python Code Execution

Issue - State: open - Opened by kaipak 11 months ago - 7 comments
Labels: icebox, theme, Epic

#33 - Update repo with template files

Issue - State: open - Opened by kaipak 11 months ago - 5 comments
Labels: icebox, task, i&t.skip

#32 - Document Strategy for Web Analytics System Migration to MCP

Issue - State: closed - Opened by jordanpadams 11 months ago - 4 comments
Labels: B15.0, theme, i&t.skip, Epic

#31 - Develop Reports and Procedures for Generating Monthly Metrics

Issue - State: open - Opened by jordanpadams 11 months ago - 7 comments
Labels: B15.0, theme, i&t.skip, Epic

#30 - Automate Log Sync to S3 and Athena

Issue - State: closed - Opened by jordanpadams 11 months ago - 6 comments
Labels: B15.0, theme, i&t.skip, Epic

#29 - Train Ops Analytics Team on how to update and tweak web analytics system

Issue - State: open - Opened by jordanpadams about 1 year ago
Labels: B15.0, task, i&t.skip

#28 - Document end-to-end procedure for pulling logs and updating metrics reports

Issue - State: open - Opened by jordanpadams about 1 year ago
Labels: B15.0, task, i&t.skip

#27 - Document how to monitor Athena processing

Issue - State: open - Opened by jordanpadams about 1 year ago
Labels: icebox, task, i&t.skip

#26 - Update prd_tbl_all_det_2.sql

Pull Request - State: closed - Opened by kaipak over 1 year ago

#25 - Do logs need to persist in S3?

Issue - State: closed - Opened by kaipak over 1 year ago - 1 comment
Labels: B14.0, task, i&t.skip

#25 - Do logs need to persist in S3?

Issue - State: closed - Opened by kaipak over 1 year ago - 1 comment
Labels: B14.0, task, i&t.skip

#24 - As a user, I want a mission-specific dashboard showing instrument and product type download metrics

Issue - State: closed - Opened by jordanpadams over 1 year ago - 4 comments
Labels: B14.0, B15.0, p.should-have, requirement, i&t.skip

#23 - As a project scientist I want to know the number of requests for products over a specified period of time

Issue - State: open - Opened by jordanpadams almost 4 years ago - 1 comment
Labels: icebox, needs:triage, requirement

#22 - As a Node Manager, I want to know the frequency of access of each archive artifact

Issue - State: closed - Opened by TWilson2017 almost 4 years ago - 3 comments
Labels: icebox, needs:triage, requirement

#21 - As a user, I want year over year metrics for total egress

Issue - State: closed - Opened by jordanpadams over 1 year ago - 3 comments
Labels: B14.0, B14.1, p.should-have, requirement

#20 - For EN search table, there seems to be parsing error with log files

Issue - State: open - Opened by kaipak over 1 year ago - 1 comment
Labels: bug, icebox, s.low

#19 - Implement crawler to refresh Athena table partitions.

Issue - State: open - Opened by kaipak over 1 year ago - 5 comments
Labels: B15.0, enhancement, requirement

#18 - As a manager, I want access metrics on a specific subset of International domains

Issue - State: open - Opened by jordanpadams over 1 year ago - 1 comment
Labels: icebox, p.wont-have, requirement

#17 - As a manager, I want access metrics on a specific subset of USA domains

Issue - State: open - Opened by jordanpadams over 1 year ago - 1 comment
Labels: icebox, p.wont-have, requirement

#16 - Use humanize to compute data transferred for file sync script.

Issue - State: open - Opened by kaipak almost 2 years ago - 1 comment
Labels: enhancement, icebox, p.could-have, i&t.skip

#15 - Create sync script for syncing logs from logging server to AWS and load into Athena

Issue - State: closed - Opened by jordanpadams almost 2 years ago
Labels: B14.0, task, i&t.skip

#14 - 2 local aws filesync shell mod

Pull Request - State: closed - Opened by kaipak almost 2 years ago - 2 comments

#13 - Map special characters in Athena/Presto SQL queries before dataset creation in QS.

Issue - State: closed - Opened by kaipak almost 2 years ago - 2 comments
Labels: B14.0, enhancement, i&t.skip

#12 - Sync script fails silently if aws call fails

Issue - State: closed - Opened by kaipak almost 2 years ago - 5 comments
Labels: B15.0, bug, s.medium, i&t.skip

#11 - 2 local aws filesync shell mod

Pull Request - State: closed - Opened by kaipak almost 2 years ago

#10 - Dashboard: EN Search Query analytics - most used queries or search terms

Issue - State: closed - Opened by kaipak almost 2 years ago
Labels: B14.0, task, i&t.skip

#9 - Dashboard: EN Search Query analytics - queries over time period

Issue - State: closed - Opened by kaipak almost 2 years ago - 1 comment
Labels: B14.0, needs:triage, p.must-have, requirement, i&t.skip

#8 - 2 local aws filesync shell mod

Pull Request - State: closed - Opened by kaipak almost 2 years ago

#7 - 2 local aws filesync

Pull Request - State: closed - Opened by kaipak almost 2 years ago

#6 - Logfile Error checking

Issue - State: open - Opened by kaipak almost 2 years ago - 1 comment
Labels: enhancement, icebox, p.should-have, i&t.skip

#5 - Improve Robot detection in PDS analytics data pipeline

Issue - State: open - Opened by kaipak almost 2 years ago - 4 comments
Labels: enhancement, icebox, p.should-have, i&t.skip

#4 - As a data scientist, I want to update and refine web metrics dashboards, to provide improved views on PDS node usage patterns over time

Issue - State: closed - Opened by kaipak almost 2 years ago
Labels: needs:triage, requirement, i&t.skip

GitHub / nasa-pds/web-analytics issues and pull requests