ccao-data/data-architecture issues and pull requests

#641 - Add provisional assessment stages to PIN value views

Pull Request - State: open - Opened by jeancochrane 13 days ago

#640 - Ingest pre-procname data into lake

Issue - State: open - Opened by jeancochrane 18 days ago

#639 - Exclude new uv venv path from pre-commit

Pull Request - State: closed - Opened by jeancochrane 19 days ago

#638 - Define unit tests and distinguish them from non-iasWorld data tests

Pull Request - State: open - Opened by jeancochrane 19 days ago

#637 - Improve design of `export` module interface

Issue - State: open - Opened by jeancochrane 19 days ago

#636 - 2024 commercial valuation ingest

Pull Request - State: open - Opened by wrridgeway 19 days ago

#635 - Switch to uv for Python management

Pull Request - State: closed - Opened by dfsnow 20 days ago

#634 - 2024 Commercial Valuation Ingest

Issue - State: open - Opened by wrridgeway 20 days ago - 1 comment
Labels: open data

#633 - Switch dependency management to pyproject.toml

Pull Request - State: closed - Opened by dfsnow 21 days ago

#632 - 2024 Open Data Refresh

Issue - State: open - Opened by wrridgeway 21 days ago
Labels: open data

#631 - Add row_id to `default.vw_pin_universe`

Pull Request - State: closed - Opened by wrridgeway 29 days ago

#630 - Add comment about manual cleaning to `ccao-legacy.R` script

Pull Request - State: closed - Opened by jeancochrane 30 days ago

#629 - Properties that most impact each school district's property taxes

Pull Request - State: closed - Opened by wrridgeway about 1 month ago - 4 comments

#628 - Update `cdu` and `user16` documentation

Pull Request - State: closed - Opened by wrridgeway about 1 month ago

#627 - Assist: properties that most impact each school district's property taxes

Issue - State: closed - Opened by wrridgeway about 1 month ago - 2 comments

#626 - Update QC town close export script to prep for automation

Pull Request - State: closed - Opened by jeancochrane about 1 month ago - 1 comment

#625 - Update dbt sort order linter to check the order of table definitions

Issue - State: open - Opened by jeancochrane about 1 month ago
Labels: dbt

#624 - Create CDU codes dbt seed and add CDU descriptions to `default.vw_pin_status`

Pull Request - State: closed - Opened by wrridgeway about 1 month ago

#623 - Create CDU codes dbt seed and add code descriptions to `default.vw_pin_status`

Issue - State: closed - Opened by wrridgeway about 1 month ago

#622 - Correct `CDU` column for `iasworld.dweldat` in `default.vw_pin_status`

Pull Request - State: closed - Opened by wrridgeway about 1 month ago - 1 comment

#621 - Correct `CDU` column for `iasworld.dweldat` in `default.vw_pin_status`

Issue - State: closed - Opened by wrridgeway about 1 month ago - 1 comment

#620 - Create IDOT features

Pull Request - State: open - Opened by Damonamajor about 2 months ago

#619 - Add appeal reason code seed and include it in `default.vw_pin_appeal`

Pull Request - State: closed - Opened by wrridgeway about 2 months ago - 4 comments

#618 - Add appeal reason code seed and include it in `default.vw_pin_appeal`

Issue - State: closed - Opened by wrridgeway about 2 months ago

#617 - Add IDOT data to data-lake

Pull Request - State: closed - Opened by Damonamajor about 2 months ago - 3 comments

#616 - Add traffic data to data-lake

Pull Request - State: closed - Opened by Damonamajor about 2 months ago

#615 - Explore new feature: IDOT traffic data

Issue - State: closed - Opened by Damonamajor about 2 months ago

#614 - Tweak the output of the `--print-table-refresh-command` flag for QC reports

Pull Request - State: closed - Opened by jeancochrane about 2 months ago

#613 - `--rebuild` arg to export scripts should rebuild parents

Issue - State: open - Opened by jeancochrane about 2 months ago
Labels: bug

#612 - Flesh out permit docs based on feedback

Pull Request - State: closed - Opened by jeancochrane about 2 months ago

#611 - Add homeowner exemption legacy extract to data lake

Pull Request - State: closed - Opened by jeancochrane about 2 months ago

#610 - Switch sale_filter_logic

Pull Request - State: closed - Opened by wagnerlmichael about 2 months ago - 5 comments

#609 - Add missing tax columns to socrata column transformations

Pull Request - State: closed - Opened by wrridgeway 2 months ago

#608 - Fix incorrect reference to athena results bucket in `export_models`

Pull Request - State: closed - Opened by jeancochrane 2 months ago

#607 - Improve sales val dbt docs

Pull Request - State: closed - Opened by wagnerlmichael 2 months ago

#606 - Tweak Res Edit town close QC report to store percentage columns as numbers

Pull Request - State: closed - Opened by jeancochrane 2 months ago

#604 - Update mode calculation for `res_report_summary` view

Pull Request - State: closed - Opened by dfsnow 2 months ago - 1 comment

#603 - Modify dbt test workflow and script to allow control over test selection and artifact output

Pull Request - State: closed - Opened by jeancochrane 2 months ago - 1 comment

#602 - Add `-r` tag to `pip install` syntax in qc export model section of dbt readme

Pull Request - State: closed - Opened by wrridgeway 2 months ago

#601 - Remove +1 increment on unique combination of columns test

Pull Request - State: closed - Opened by wagnerlmichael 2 months ago - 2 comments

#600 - Fix unique combination of columns allowed duplicates

Pull Request - State: closed - Opened by wagnerlmichael 2 months ago

#599 - Store enumerated iasWorld column value crosswalks using seeds

Issue - State: open - Opened by jeancochrane 2 months ago
Labels: dbt

#598 - Two small tweaks to data tests and QC reports

Pull Request - State: closed - Opened by jeancochrane 3 months ago

#597 - Add new permits view

Pull Request - State: closed - Opened by jeancochrane 3 months ago - 1 comment

#596 - Move `comdat.bldgval` test back onto the correct column

Pull Request - State: closed - Opened by jeancochrane 3 months ago

#595 - Simplify design of failing test notification system

Issue - State: open - Opened by jeancochrane 3 months ago - 1 comment
Labels: dbt

#594 - Fix socrata upload actionworkflow

Pull Request - State: closed - Opened by wrridgeway 3 months ago - 1 comment

#593 - Fix socrata upload action

Issue - State: closed - Opened by wrridgeway 3 months ago

#592 - Disable natural language check in super-linter workflow

Pull Request - State: closed - Opened by jeancochrane 3 months ago

#591 - New `default` view consolidating non-characteristic pin stasuses

Pull Request - State: closed - Opened by wrridgeway 3 months ago - 1 comment

#590 - Factor shared dbt script logic out into `utils` module

Pull Request - State: closed - Opened by jeancochrane 3 months ago

#589 - Add scripts and schemas for iasWorld test and legacy files

Pull Request - State: closed - Opened by dfsnow 3 months ago

#588 - Integrate mydec sales into vw_pin_sale

Pull Request - State: open - Opened by wagnerlmichael 3 months ago - 3 comments

#587 - Fix Python import order in `socrata/socrata_upload.py`

Pull Request - State: closed - Opened by jeancochrane 3 months ago

#586 - Add script to export town close QC reports and print command for refreshing tables

Pull Request - State: closed - Opened by jeancochrane 3 months ago

#585 - Add a `loaded_at` column to all sources

Issue - State: open - Opened by dfsnow 3 months ago
Labels: dbt

#584 - Remove `vw_` prefix from `reporting.assessment_progress` table name

Pull Request - State: closed - Opened by wrridgeway 3 months ago - 1 comment

#583 - Create a sales view that combines iasWorld, myDec, and CCRD sales

Issue - State: open - Opened by dfsnow 3 months ago - 2 comments
Labels: dbt

#582 - Configure ruff to sort Python imports

Pull Request - State: closed - Opened by jeancochrane 3 months ago

#581 - Ruff isn't configured to sort Python imports

Issue - State: closed - Opened by jeancochrane 3 months ago
Labels: bug

#580 - Improve socrata api upload script

Issue - State: open - Opened by wrridgeway 3 months ago

#579 - Add framework for instant email notifications of failing tests

Pull Request - State: closed - Opened by jeancochrane 3 months ago - 2 comments

#578 - Add GitHub action to check dbt yaml key sort order

Pull Request - State: closed - Opened by wagnerlmichael 3 months ago - 1 comment

#576 - Refactor town close report export process to infer tri vs. non-tri status

Issue - State: closed - Opened by jeancochrane 3 months ago

#575 - Refactor dbt setup using GitHub deployment environments

Issue - State: open - Opened by dfsnow 3 months ago
Labels: dbt, ci

#574 - Update QC report tags, code, and docs to split tri town close reports from non-tri towns

Pull Request - State: closed - Opened by jeancochrane 3 months ago

#573 - Add a proximity to stadium feature

Pull Request - State: closed - Opened by Damonamajor 3 months ago

#572 - Add automated test with notifications for `dweldat.spot`

Issue - State: open - Opened by jeancochrane 3 months ago
Labels: dbt

#571 - Rename tag for iasWorld data tests and refactor script to run tests

Pull Request - State: closed - Opened by jeancochrane 3 months ago - 2 comments

#569 - Move Python dependency lists from disparate requirements files into `pyproject.toml`

Issue - State: open - Opened by jeancochrane 4 months ago

#568 - Improve documentation for QC products

Pull Request - State: closed - Opened by jeancochrane 4 months ago - 1 comment

#567 - Correct `default.vw_pin_sale` primary key

Pull Request - State: closed - Opened by wrridgeway 4 months ago

#566 - Implement socrata updating through publisher API

Pull Request - State: closed - Opened by wrridgeway 4 months ago

#565 - Document common groups of classes and make a view for them

Issue - State: open - Opened by jeancochrane 4 months ago

#563 - New `default` view consolidating non-characteristic pin stasuses

Issue - State: closed - Opened by wrridgeway 4 months ago - 1 comment

#562 - How-to: Count total number of housing units in Cook County with public data

Issue - State: open - Opened by dfsnow 4 months ago - 11 comments
Labels: new data/feature

#561 - Build a process for selectively ingesting data for QC reports

Issue - State: closed - Opened by jeancochrane 4 months ago - 1 comment
Labels: dbt

#557 - [3/3] Migrate Will's town close QC reports to dbt models

Pull Request - State: closed - Opened by jeancochrane 4 months ago - 2 comments

#556 - [2/3] Migrate Will's town close QC reports to dbt models

Pull Request - State: closed - Opened by jeancochrane 4 months ago

#554 - [1/3] Migrate Will's town close QC reports to dbt models

Pull Request - State: closed - Opened by jeancochrane 4 months ago

#551 - Detatch municipal assessment progress from `reporting.vw_assessment_roll_muni`

Pull Request - State: closed - Opened by wrridgeway 4 months ago - 2 comments

#545 - Assessment status tracker: expand geo types, and remove per major class

Issue - State: closed - Opened by ccao-jardine 4 months ago - 1 comment

#541 - Detatch municipal assessment progress from `reporting.vw_assessment_roll_muni`

Issue - State: closed - Opened by wrridgeway 4 months ago
Labels: new data/feature

#539 - Improve documentation for QC tests

Issue - State: closed - Opened by jeancochrane 5 months ago
Labels: dbt

#525 - Automate Will's QC reports with dbt models and a simple script

Issue - State: closed - Opened by jeancochrane 5 months ago - 1 comment
Labels: dbt

#521 - Refactor ratio stats for build speed increase

Pull Request - State: open - Opened by wagnerlmichael 5 months ago - 1 comment

#511 - Identify leasehold properties and update views

Issue - State: closed - Opened by dfsnow 6 months ago - 1 comment
Labels: new data/feature

#496 - First draft of Reporting Source of Truth™

Pull Request - State: open - Opened by wrridgeway 6 months ago

#477 - Improve the dbt documenation for ccaocorner lot

Pull Request - State: closed - Opened by Damonamajor 6 months ago - 1 comment

#423 - Create issue template for new dbt tests

Pull Request - State: open - Opened by wagnerlmichael 7 months ago - 3 comments

#407 - Draft test

Pull Request - State: closed - Opened by Damonamajor 7 months ago

#382 - Explicitly differentiate dbt unit tests from dbt data tests

Issue - State: open - Opened by dfsnow 7 months ago - 5 comments
Labels: dbt

#379 - Convert geoid --> district num for state rep, state senate, and congressional districts in vw_pin_universe and Open Data

Issue - State: open - Opened by dfsnow 8 months ago
Labels: new data/feature

#363 - Add test to ensure omitted classes have `tot57` values for the same tax year

Issue - State: open - Opened by jeancochrane 8 months ago - 6 comments
Labels: dbt

#346 - Scope test for val override fields

Issue - State: open - Opened by jeancochrane 9 months ago
Labels: dbt

#239 - Create dbt model for permits view

Issue - State: closed - Opened by jeancochrane about 1 year ago
Labels: dbt, open data

#238 - Contribute fix to dbt core to allow us to use ephemeral models for QC testing

Issue - State: closed - Opened by jeancochrane about 1 year ago - 1 comment
Labels: dbt

#227 - Add 2024 Commercial Valuation Model Data to Open Data

Issue - State: closed - Opened by wrridgeway about 1 year ago - 1 comment
Labels: open data

#209 - Add GitHub Action to check dbt YAML key sort order

Issue - State: closed - Opened by dfsnow about 1 year ago
Labels: dbt, ci

#201 - Add final dbt column descriptions

Issue - State: closed - Opened by dfsnow about 1 year ago - 1 comment
Labels: documentation, dbt

GitHub / ccao-data/data-architecture issues and pull requests