cal-itp/data-infra issues and pull requests

#2463 - Create dedicated tables for regional subfeed guidelines assessment

Issue - State: open - Opened by lauriemerrell over 1 year ago

#2426 - Analyst POC tables (from issues #2381 and #2382)

Pull Request - State: closed - Opened by charlie-costanzo over 1 year ago - 2 comments

#2424 - Clean up mart NTD data

Issue - State: closed - Opened by lauriemerrell over 1 year ago

#2420 - Look into devcontainers for local development

Issue - State: closed - Opened by atvaccaro over 1 year ago - 2 comments

#2412 - Add count of messages to `fct_observed_trips`

Issue - State: open - Opened by lauriemerrell over 1 year ago

#2399 - RT archiver: Investigate cases where header_timestamp is >20 sec more recent than tick

Issue - State: closed - Opened by lauriemerrell over 1 year ago - 1 comment

#2382 - User Story: monthly aggregation for mart_gtfs.fct_daily_scheduled_shapes

Issue - State: closed - Opened by tiffanychu90 over 1 year ago
Labels: warehouse-poc

#2381 - User Story: add summary stats for to mart_gtfs.fct_observed_trips

Issue - State: closed - Opened by tiffanychu90 over 1 year ago - 2 comments
Labels: warehouse-poc

#2359 - Python models MVP and demo

Issue - State: closed - Opened by atvaccaro over 1 year ago - 1 comment

#2349 - User Story: please remove GTFS Data Issue Template

Issue - State: closed - Opened by evansiroky over 1 year ago - 1 comment

#2307 - add check for persistent vehicle IDs in VP feed

Pull Request - State: closed - Opened by owades over 1 year ago

#2302 - Develop preliminary data model(s) of extracted Elavon data

Issue - State: closed - Opened by j-meelah over 1 year ago - 1 comment
Labels: project-payments

#2266 - Look into better secrets handling

Issue - State: closed - Opened by atvaccaro over 1 year ago - 1 comment

#2260 - Grafana and Sentry database backups

Issue - State: closed - Opened by atvaccaro over 1 year ago - 1 comment

#2237 - User Story: Python dbt model to produce shape-stop grain table

Issue - State: closed - Opened by tiffanychu90 over 1 year ago - 4 comments
Labels: warehouse-poc

#2236 - User Story: daily schedule vs RT number and percent of trips

Issue - State: closed - Opened by tiffanychu90 over 1 year ago - 9 comments
Labels: warehouse-poc

#2214 - Create fact validation outcomes

Issue - State: closed - Opened by atvaccaro over 1 year ago - 1 comment

#2212 - Cleanup Tasks for Open Data Publishing

Issue - State: open - Opened by SorenSpicknall over 1 year ago

#2194 - Bug: Metrolink shape_array_key is None

Issue - State: open - Opened by tiffanychu90 over 1 year ago

#2187 - Airtable to switch from API keys to personal access tokens at the end of Jan 2024

Issue - State: closed - Opened by evansiroky over 1 year ago

#2186 - Ingest guideline feature statuses

Pull Request - State: closed - Opened by lauriemerrell over 1 year ago
Labels: do-not-merge

#2151 - Sync links to dbt docs as the descriptions in Metabase

Issue - State: closed - Opened by atvaccaro over 1 year ago - 1 comment

#2120 - Bug: v3 archiver ticker fails to cleanly handle invalid download configs

Issue - State: open - Opened by atvaccaro over 1 year ago

#2095 - Move `fct_schedule_feed_downloads` out of `mart_gtfs`

Issue - State: closed - Opened by lauriemerrell almost 2 years ago - 1 comment

#2091 - Ingest Transit Data Guideline Feature Statuses from Airtable into warehouse

Issue - State: open - Opened by evansiroky almost 2 years ago - 1 comment

#2074 - Recreate payments_rides Metabase questions with new warehouse tables

Issue - State: closed - Opened by charlie-costanzo almost 2 years ago - 2 comments

#2073 - Add email notifications for new payments_rides tests: transaction volume delta and freshness

Issue - State: closed - Opened by charlie-costanzo almost 2 years ago - 1 comment

#2038 - Analyze originating country of unique riders for SBMTD

Issue - State: closed - Opened by j-meelah almost 2 years ago
Labels: project-payments

#2032 - Payments Pipeline V2

Issue - State: closed - Opened by j-meelah almost 2 years ago
Labels: epic

#1982 - Handle cases where schedule file parsing fails in v2

Issue - State: closed - Opened by lauriemerrell almost 2 years ago - 1 comment

#1941 - Pull Metabase dashboards/questions into dbt as exposures

Issue - State: closed - Opened by atvaccaro almost 2 years ago

#1938 - Automatically reload secrets in RT archiver every 5 minutes

Issue - State: closed - Opened by atvaccaro almost 2 years ago

#1929 - Expose route.network_id field in various tables

Issue - State: closed - Opened by evansiroky almost 2 years ago - 1 comment

#1927 - Add file row number to GTFS Schedule CSV to JSONL conversion

Issue - State: closed - Opened by atvaccaro almost 2 years ago - 2 comments

#1911 - Bug: GCS client is not handling 5XX errors sufficiently for RT

Issue - State: closed - Opened by atvaccaro almost 2 years ago - 3 comments
Labels: bug

#1906 - Bug: Old Siuba version on Hub throws warnings

Issue - State: closed - Opened by edasmalchi almost 2 years ago - 1 comment
Labels: bug

#1880 - Documentation request: how to download many files from JupyterHub

Issue - State: closed - Opened by blakeflei almost 2 years ago
Labels: documentation, size: S

#1770 - GTFS schedule backfill: Airtable

Issue - State: closed - Opened by lauriemerrell about 2 years ago - 1 comment

#1744 - GTFS Schedule Pipeline Rewrite: Documentation Updates

Issue - State: open - Opened by lauriemerrell about 2 years ago
Labels: documentation, epic

#1725 - Refactor: use PartitionedGCSArtifact for publishing and dbt artifacts

Issue - State: closed - Opened by atvaccaro about 2 years ago

#1724 - User Story: Add a "sync" step for Airtable

Issue - State: closed - Opened by lauriemerrell about 2 years ago - 2 comments
Labels: airtable

#1723 - Enroll GCS buckets and data transfer jobs in Terraform

Issue - State: closed - Opened by atvaccaro about 2 years ago - 1 comment

#1722 - Set up CI/CD for Terraform on merges

Issue - State: closed - Opened by atvaccaro about 2 years ago - 1 comment

#1721 - Enroll IAM and service accounts in Terraform

Issue - State: closed - Opened by atvaccaro about 2 years ago - 1 comment

#1720 - Migrate external table definitions from Airflow to Terraform

Issue - State: closed - Opened by atvaccaro about 2 years ago

#1719 - Enroll GCP infrastructure in Terraform

Issue - State: closed - Opened by atvaccaro about 2 years ago
Labels: epic

#1651 - give jupyter users 64gb instead of 8

Pull Request - State: closed - Opened by atvaccaro about 2 years ago - 2 comments

#1645 - User Story: Grant Conveyal GCS access

Issue - State: closed - Opened by j-meelah about 2 years ago - 1 comment
Labels: project-gtfs-schedule

#1629 - Enhancement: Ensure same timestamp across Airtable extracts

Issue - State: closed - Opened by lauriemerrell about 2 years ago - 2 comments

#1626 - Turn off old Airtable pipeline

Issue - State: closed - Opened by lauriemerrell about 2 years ago - 2 comments
Labels: airtable

#1547 - Split up Metabase databases into separate service accounts for payments and non-payments access

Issue - State: open - Opened by atvaccaro over 2 years ago - 1 comment

#1498 - docs: shared analytics / calitp glossary

Issue - State: closed - Opened by charlie-costanzo over 2 years ago
Labels: documentation, enhancement

#1497 - docs: research request process map for new workflow

Issue - State: closed - Opened by charlie-costanzo over 2 years ago
Labels: documentation, enhancement

#1495 - docs: converting analyst tutorial files from .md to .ipynb

Issue - State: closed - Opened by charlie-costanzo over 2 years ago
Labels: documentation, enhancement

#1484 - User Story: Take account of feed_info when determining service

Issue - State: open - Opened by lauriemerrell over 2 years ago - 1 comment
Labels: project-gtfs-schedule, size: M

#1477 - Airtable operator refactor

Pull Request - State: closed - Opened by lauriemerrell over 2 years ago
Labels: airtable

#1470 - User Story: Relabel mislabeled GTFS RT data (wrong RT type)

Issue - State: closed - Opened by lauriemerrell over 2 years ago - 3 comments
Labels: project-gtfs-rt

#1469 - Long-term: rename gtfs-rt-parser to gtfs-rt-processor (or some other name)

Issue - State: closed - Opened by atvaccaro over 2 years ago

#1467 - Fix payments_views.payments_rides

Issue - State: closed - Opened by j-meelah over 2 years ago
Labels: project-payments, size: XS

#1466 - Grafana Dashboard | Metabase

Issue - State: closed - Opened by holly-g over 2 years ago - 2 comments

#1464 - Add Google Analytics to DBT docs site

Issue - State: closed - Opened by thekaveman over 2 years ago - 1 comment