palewire/django-calaccess-raw-data issues and pull requests

#1539 - Bump starlette from 0.37.2 to 0.40.0

Pull Request - State: open - Opened by dependabot[bot] 4 months ago
Labels: dependencies, python

#1538 - Bump actions/download-artifact from 3 to 4.1.7 in /.github/workflows

Pull Request - State: open - Opened by dependabot[bot] 5 months ago
Labels: dependencies, github_actions

#1537 - Bump zipp from 3.13.0 to 3.19.1

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago - 1 comment
Labels: dependencies

#1536 - Bump certifi from 2022.12.7 to 2024.7.4

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago
Labels: dependencies

#1535 - Bump markdown-it-py from 2.1.0 to 2.2.0

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#1534 - Bump tornado from 6.2 to 6.4.1

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#1533 - Bump jinja2 from 3.1.2 to 3.1.4

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#1532 - Bump requests from 2.28.1 to 2.32.2

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#1531 - Bump urllib3 from 1.26.14 to 1.26.19

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#1530 - Bump django from 4.0.7 to 4.1.7

Pull Request - State: closed - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies

#1529 - Bump cryptography from 38.0.4 to 39.0.1

Pull Request - State: closed - Opened by dependabot[bot] about 2 years ago - 1 comment
Labels: dependencies

#1528 - Bump django from 4.0.7 to 4.0.9

Pull Request - State: closed - Opened by dependabot[bot] about 2 years ago - 1 comment
Labels: dependencies

#1527 - Bump django from 4.0.7 to 4.0.8

Pull Request - State: closed - Opened by dependabot[bot] about 2 years ago - 1 comment
Labels: dependencies

#1526 - Bump certifi from 2022.6.15.1 to 2022.12.7

Pull Request - State: closed - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#1525 - Extend character field on E530 model

Pull Request - State: closed - Opened by palewire over 2 years ago

#1524 - Flatten the application by removing version tracking

Pull Request - State: closed - Opened by palewire over 2 years ago

#1523 - Bump django from 3.2.13 to 3.2.15

Pull Request - State: closed - Opened by dependabot[bot] over 2 years ago - 1 comment
Labels: dependencies

#1522 - Bump django from 3.2.13 to 3.2.14

Pull Request - State: closed - Opened by dependabot[bot] over 2 years ago - 1 comment
Labels: dependencies

#1521 - Bump django from 3.2.6 to 3.2.12

Pull Request - State: closed - Opened by dependabot[bot] about 3 years ago - 1 comment
Labels: dependencies

#1520 - Bump sqlparse from 0.4.1 to 0.4.2

Pull Request - State: closed - Opened by dependabot[bot] over 3 years ago - 1 comment
Labels: dependencies

#1519 - Request mocking for testing of the archive system

Issue - State: closed - Opened by palewire over 3 years ago

#1518 - Deprecate csvkit dependency

Issue - State: closed - Opened by palewire over 3 years ago

#1517 - Bump pygments from 2.2.0 to 2.7.4

Pull Request - State: closed - Opened by dependabot[bot] almost 4 years ago - 1 comment
Labels: dependencies

#1516 - Bump pyyaml from 3.13 to 5.4

Pull Request - State: closed - Opened by dependabot[bot] almost 4 years ago - 1 comment
Labels: dependencies

#1515 - Bump jinja2 from 2.10 to 2.11.3

Pull Request - State: closed - Opened by dependabot[bot] almost 4 years ago - 1 comment
Labels: dependencies

#1514 - Bump django from 2.1 to 2.2.13

Pull Request - State: closed - Opened by dependabot[bot] over 4 years ago - 1 comment
Labels: dependencies

#1513 - expn code "S.M." should be "S.M"

Issue - State: open - Opened by breardon2011 over 4 years ago

#1512 - Bump django from 2.1 to 2.2.10

Pull Request - State: closed - Opened by dependabot[bot] about 5 years ago - 1 comment
Labels: dependencies

#1511 - Bump django from 2.1 to 2.1.11

Pull Request - State: closed - Opened by dependabot[bot] over 5 years ago - 1 comment
Labels: dependencies

#1510 - StopIteration on loading empty file

Issue - State: closed - Opened by palewire over 6 years ago

#1509 - Logging of cleaning work is off when there are empty files

Issue - State: closed - Opened by palewire over 6 years ago

#1508 - command error with "message"

Issue - State: closed - Opened by palewire over 6 years ago

#1507 - Idea for correcting data

Issue - State: closed - Opened by rkiddy over 6 years ago - 2 comments

#1506 - csv or csvkit not protecting commas in clean

Issue - State: closed - Opened by rkiddy over 6 years ago - 1 comment

#1505 - Need on_delete field settings for Django 2.0

Issue - State: closed - Opened by palewire almost 7 years ago

#1504 - python3: "/cleancalaccessrawfile.py:116: DeprecationWarning: 'U' mode is deprecated"

Issue - State: closed - Opened by palewire almost 7 years ago
Labels: bug, small, backend

#1503 - Deprecate test mode on management commands

Issue - State: closed - Opened by gordonje over 7 years ago
Labels: enhancement, medium, backend

#1502 - The directory structure of the ZIP has changed again

Issue - State: closed - Opened by palewire over 7 years ago - 2 comments
Labels: bug

#1501 - Naive datetime warning

Issue - State: closed - Opened by palewire almost 8 years ago
Labels: bug, small, backend

#1500 - Deprecation warning in django.conf.urls.include()

Issue - State: closed - Opened by gordonje almost 8 years ago

#1499 - Can't drop and re-add table constraints/indexes in MySQL

Issue - State: closed - Opened by gordonje almost 8 years ago - 1 comment

#1498 - Searching admin in lobbyingchglogcd results in "Related Field got invalid lookup: icontains"

Issue - State: closed - Opened by hcharley about 8 years ago - 1 comment

#1497 - Break out the index dropping tricks as a separate library

Issue - State: closed - Opened by palewire about 8 years ago - 1 comment
Labels: enhancement, large, backend

#1496 - django.db.utils.DataError on load of Cvr2SoCd

Issue - State: closed - Opened by hcharley about 8 years ago - 5 comments

#1495 - Typo in RCPT_CD.FILING_ID help_text

Issue - State: closed - Opened by palewire over 8 years ago

#1494 - Typo in Form 460 Schedule A-1 definition

Issue - State: closed - Opened by palewire over 8 years ago

#1493 - EXPN_CODE column on EXPN_CD needs better description

Issue - State: closed - Opened by palewire over 8 years ago
Labels: bug

#1492 - Naming inconsistency between "clean_record_count" method and "clean_records_count" fields in our tracking models

Issue - State: closed - Opened by palewire over 8 years ago - 1 comment
Labels: bug

#1491 - Unnecessary download when resuming update

Issue - State: closed - Opened by gordonje over 8 years ago

#1490 - ReceivedFilingsCd.filing_file_name char length too short

Issue - State: closed - Opened by gordonje over 8 years ago - 1 comment

#1489 - Consistent data_type for various FILER_ID fields

Issue - State: closed - Opened by gordonje over 8 years ago - 4 comments

#1488 - Error uploading new dist when running py3.5

Issue - State: closed - Opened by gordonje over 8 years ago
Labels: bug

#1487 - Discrepancy between expected and actual zip file size

Issue - State: closed - Opened by gordonje over 8 years ago - 9 comments

#1486 - Remind me why we save the column counts in the database?

Issue - State: closed - Opened by palewire over 8 years ago - 1 comment

#1485 - At some point we need to clear out the pre-squash migrations

Issue - State: closed - Opened by palewire over 8 years ago - 1 comment

#1484 - RawDataVersion manager the limits queryset to "complete" updates

Issue - State: closed - Opened by palewire over 8 years ago

#1483 - Size of the clean archive zip

Issue - State: closed - Opened by sahilchinoy over 8 years ago - 3 comments

#1482 - Why are our clean CSVs coming out significantly larger than the raw TSVs?

Issue - State: closed - Opened by palewire over 8 years ago - 1 comment

#1481 - get_model_class property on RawDataFile that will return the calaccess_raw model of the TSV table

Issue - State: closed - Opened by palewire over 8 years ago

#1480 - An reprocesscalaccessrawdata or something command that would download from an archive, rerun our processing and loading and revise the tracking models and data files

Issue - State: closed - Opened by palewire over 8 years ago
Labels: enhancement, medium, backend

#1479 - Sleuth and solve error logs to determine cause of lost records

Issue - State: open - Opened by palewire over 8 years ago
Labels: bug, medium, backend

#1478 - Could each RawDataFile's error log be saved along with its TSV and CSV in the model?

Issue - State: closed - Opened by palewire over 8 years ago

#1477 - Add size to raw data file

Issue - State: closed - Opened by sahilchinoy over 8 years ago - 1 comment

#1476 - Add filesize column to model

Issue - State: closed - Opened by aboutaaron over 8 years ago

#1475 - Should we be packaging a wheel for PyPI?

Issue - State: closed - Opened by palewire over 8 years ago

#1474 - Use flake8_docstrings to clean up our string formatting throughout the app

Issue - State: closed - Opened by palewire over 8 years ago
Labels: enhancement, medium, backend, documentation

#1473 - Can admins be grouped within an app?

Issue - State: closed - Opened by palewire over 8 years ago

#1472 - Create a new group for models we know are deprecated

Issue - State: closed - Opened by palewire over 8 years ago

#1471 - I suspect some of our UNIQUE_KEY fields might not actually be on the table

Issue - State: closed - Opened by palewire over 8 years ago - 3 comments

#1470 - Switch from pyflakes/pep8 to flake8

Issue - State: closed - Opened by palewire over 8 years ago

#1469 - Introduce testing for Django 1.10

Issue - State: closed - Opened by palewire over 8 years ago - 1 comment

#1468 - Some kind of notification system (maybe an email) when dumper finishes

Issue - State: closed - Opened by palewire over 8 years ago - 1 comment

#1467 - Could the media file uploads to S3 but done in parallel to speed things up?

Issue - State: closed - Opened by palewire over 8 years ago - 1 comment
Labels: enhancement, medium, backend

#1466 - Should we integrate the base management command's logger with Python logging module so the output can be managed by Django?

Issue - State: closed - Opened by palewire over 8 years ago

#1465 - Installing backend dependencies should be optional

Issue - State: closed - Opened by adborden over 8 years ago - 5 comments
Labels: bug

#1464 - I think a couple lowercase UNIQUE_KEY strings snuck in

Issue - State: closed - Opened by palewire over 8 years ago

#1463 - If Form 700s are only in the FilerFilings table, does that mean their actual data has been withheld?

Issue - State: closed - Opened by palewire over 8 years ago - 1 comment
Labels: question, backend

#1461 - Form method to pull a small sample of real PDF urls

Issue - State: closed - Opened by palewire almost 9 years ago - 1 comment

#1459 - Decode the meaning of mystery form IDs

Issue - State: open - Opened by gordonje almost 9 years ago - 1 comment
Labels: documentation, unsolved mystery

#1458 - Should we have a conda package?

Issue - State: closed - Opened by palewire almost 9 years ago - 2 comments
Labels: enhancement, medium, backend

#1456 - Forms documentation page will need a high up caveat pointing out that our page numbers connect to the sample forms and not necessarily every real form you look up

Issue - State: closed - Opened by palewire almost 9 years ago
Labels: documentation

#1436 - Add choices and documentcloud_pages to EfsFilingLogCd.filingstatus (in other.py)

Issue - State: closed - Opened by gordonje almost 9 years ago - 1 comment
Labels: enhancement, documentation, unsolved mystery

#1390 - Should we have a dedicated repo for a single superduper documentation package?

Issue - State: closed - Opened by palewire almost 9 years ago - 1 comment

#1323 - Trim and edit model docstrings to omit forms lists that are now structured via the new FilingForm system

Issue - State: closed - Opened by palewire almost 9 years ago

#1322 - Prettify the names of the modeld documentation DocumentCloud pages so they are more humanized in our ReadTheDocs

Issue - State: closed - Opened by palewire almost 9 years ago - 1 comment

#1320 - Add FAQ section with a list of the missing tables, emphasizing how some valuable ones are gone

Issue - State: closed - Opened by palewire almost 9 years ago - 1 comment
Labels: documentation

#1319 - Section headings for all the little parts of the database tables docs page

Issue - State: closed - Opened by palewire almost 9 years ago - 1 comment
Labels: documentation

#1318 - Refactor tests so that an extra test download command is not necessary can can be built on the fly

Issue - State: closed - Opened by palewire almost 9 years ago - 1 comment

#1283 - Add DocumentCloud references for MapCalFormat2Fields / campaign.py

Issue - State: closed - Opened by amandabee almost 9 years ago - 2 comments
Labels: documentation

#1213 - Pool the LOAD DATA INFILE and COPY commands to speed up loading

Issue - State: closed - Opened by palewire almost 9 years ago - 6 comments
Labels: enhancement, large, backend

#1201 - FAQ entry explaining why we use the bulk loaders

Issue - State: closed - Opened by palewire about 9 years ago
Labels: documentation

#1200 - Investigate why some database tables end up with more clean records than downloaded records

Issue - State: closed - Opened by gordonje about 9 years ago - 2 comments
Labels: bug, medium, research

#1197 - Introducing Raw Data tracking and Command Logs

Pull Request - State: closed - Opened by gordonje about 9 years ago - 29 comments

#1195 - Log of instances where CAL-ACCESS zip_file download fails

Issue - State: closed - Opened by gordonje about 9 years ago - 24 comments
Labels: research

#1194 - Add choices definitions for all coded fields in the database

Issue - State: closed - Opened by palewire about 9 years ago
Labels: enhancement, large, documentation

#1193 - Next release checklist

Issue - State: closed - Opened by gordonje about 9 years ago - 1 comment

#1187 - README.md looks like crap on PyPI

Issue - State: closed - Opened by palewire about 9 years ago - 6 comments
Labels: bug

#1185 - Expand dat support

Issue - State: closed - Opened by aboutaaron about 9 years ago - 3 comments
Labels: enhancement, large, backend, documentation

#1184 - Refactor cleancalaccessrawfile to use lower-level command-line tools or other methods that are faster than the current slow Python loop through each file

Issue - State: open - Opened by palewire about 9 years ago - 3 comments
Labels: enhancement, large, backend

#1172 - FAQ question that explains why address data are missing, what models they've been removed from and how you can still get them via the CD

Issue - State: open - Opened by palewire about 9 years ago
Labels: enhancement, small, documentation

GitHub / palewire/django-calaccess-raw-data issues and pull requests