equres/sec issues and pull requests

#100 - Understand SEC.gov new API

Issue - State: closed - Opened by wkoszek about 3 years ago - 3 comments
Labels: enhancement

#99 - Write a new chapter in a `SPEC.md` about implementation of financial data ingest

Issue - State: closed - Opened by wkoszek about 3 years ago - 5 comments
Labels: enhancement

#98 - Refactor the worklist for loop

Issue - State: closed - Opened by Hazeman99 about 3 years ago
Labels: refactor

#97 - implemented sec find command

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#96 - Explore XML could be inserted too

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: enhancement

#95 - Sec unzip 20210901

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#94 - Sec indexz 20210830

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 2 comments

#93 - Fix the style a little bit

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: refactor

#92 - Try out vagrant / Ansible

Issue - State: closed - Opened by wkoszek about 3 years ago - 2 comments
Labels: enhancement, estimate-requested

#91 - Design a simple page for showing fillings

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: enhancement

#90 - Improve CIK handling - get rid of `sec retrieve`. Update `sec.tickers` during `sec index`

Issue - State: closed - Opened by wkoszek about 3 years ago - 1 comment
Labels: enhancement, estimate-requested

#89 - Implement `sec find`

Issue - State: closed - Opened by Hazeman99 about 3 years ago

#88 - Implement `sec unzip`

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: enhancement, estimate-requested

#87 - exclude images and include xml files

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 3 comments

#86 - Implement `sec indexz`

Issue - State: closed - Opened by wkoszek about 3 years ago - 3 comments
Labels: enhancement

#85 - Bug: looks like not all .htm fillings are getting indexed

Issue - State: closed - Opened by wkoszek about 3 years ago - 4 comments
Labels: bug

#84 - Combine dest z 20210829

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#83 - Sec index filebody 20210828

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#82 - Use `LookUp()` to define flags in variables

Issue - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#81 - Combine `dest` and `destz`

Issue - State: closed - Opened by Hazeman99 about 3 years ago

#80 - Make an IMPLEMENTATION.md with all details

Issue - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment
Labels: enhancement

#79 - Only `dow` commands should be sending HTTP requests

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: bug, enhancement

#78 - Sec config bugs 20210825

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 2 comments

#77 - Bug: `sec dest` prints different sizes

Issue - State: closed - Opened by wkoszek about 3 years ago - 1 comment
Labels: bug

#76 - Why are so many files 0-length

Issue - State: closed - Opened by wkoszek about 3 years ago - 4 comments
Labels: bug, triage

#75 - Bug: we keep re-downloading files for some reason

Issue - State: closed - Opened by wkoszek about 3 years ago - 4 comments
Labels: bug

#74 - Sec config bugs 20210825

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#73 - Bug: Error: pq: sorry, too many clients already

Issue - State: closed - Opened by wkoszek about 3 years ago - 2 comments
Labels: bug

#72 - Bug after creating config file

Issue - State: closed - Opened by Hazeman99 about 3 years ago

#71 - Bug in `dest`

Issue - State: closed - Opened by wkoszek about 3 years ago - 2 comments
Labels: bug, enhancement

#70 - fixed err in de and added test.sh

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 2 comments

#69 - Bug in `sec de`

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: bug, enhancement

#68 - Download pkg 20210824

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 4 comments

#67 - added curl downloading in setup

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago

#66 - added sec dowz to download zip xbrl files

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 2 comments

#65 - Implement `sec index`

Issue - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#64 - changed join functionality from url

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#63 - Pkg directory 20210823

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 3 comments

#62 - Project structure 20210822

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 3 comments

#61 - changed to using url in connectDB

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#60 - `sec destz` generates error: We need better error processing to

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: bug

#59 - Refactor downloading: Don't download stuff if we don't have to

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: bug, enhancement, estimate-requested

#58 - Different config path 20210821

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#57 - Using a different path for the config file

Issue - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment
Labels: enhancement, task

#56 - Make --verbose global flag

Issue - State: closed - Opened by wkoszek about 3 years ago - 1 comment
Labels: enhancement, estimate-requested

#55 - added command destz for zip files

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 8 comments

#54 - added sec config command to cli

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 3 comments

#53 - Implement `sec dowz`

Issue - State: closed - Opened by wkoszek about 3 years ago - 4 comments
Labels: enhancement, task

#52 - Implement `sec destz`

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: bug

#51 - Bug in saving files to directory

Issue - State: closed - Opened by wkoszek about 3 years ago - 7 comments
Labels: bug

#50 - Http testing 20210818

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 2 comments

#49 - added sec index to save xbrl files to DB

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 2 comments

#48 - added migration checking in commands

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 2 comments

#47 - postgres yaml file for CI

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 3 comments

#46 - Move sec-specific code out of util package

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: estimate-requested, refactor

#45 - DBGetDataSourceName may not be required

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: task

#44 - Add simple (light) commands to the GitHub Actions upon we have local HTTP server running

Issue - State: closed - Opened by wkoszek about 3 years ago - 3 comments
Labels: estimate-requested

#43 - DB migrations appear broken

Issue - State: closed - Opened by wkoszek about 3 years ago - 4 comments
Labels: bug, estimate-requested

#42 - Find a way to detect where migrations weren't run

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: bug, est:1hr

#41 - Sec dow subcommands 20210816

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 3 comments

#40 - Let's fix the config to make it easier to understand

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: bug, est:1hr

#39 - save rss item in db with migration

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 4 comments

#38 - 'sec dow' returns EOF

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: bug, est:1hr, took:2hr

#37 - 'sec dest' is somehow broken

Issue - State: closed - Opened by wkoszek about 3 years ago - 5 comments
Labels: bug, est:2hr

#36 - Move all tables under 'sec' schema

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: bug, est:1hr, took:1hr

#35 - Something appears wrong with failure handling?

Issue - State: closed - Opened by wkoszek about 3 years ago - 1 comment
Labels: bug, est:1hr, took:0.5hr

#34 - Implement `sec index` which will be indexing files into the DB

Issue - State: closed - Opened by wkoszek about 3 years ago - 4 comments
Labels: task, est:1hr, est:2hr

#33 - Learn more about XBRL files and how to parse

Issue - State: closed - Opened by wkoszek about 3 years ago - 4 comments
Labels: task, est:2hr

#32 - We should write a minimum unit test with an HTTP server serving files from a "test" directory

Issue - State: closed - Opened by wkoszek about 3 years ago - 2 comments
Labels: task, est:1hr, est:2hr

#31 - Figure out how to start PostgreSQL on GitHub actions

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: task, est:1hr

#30 - Make a table to keep all "item" elements from RSS files indexed

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: task, est:1hr, took:2hr

#29 - changed migration up (needs fixing)

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 2 comments

#28 - Improved error handling 20210813

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 2 comments

#27 - Bug in the downloading algorithm

Issue - State: closed - Opened by wkoszek about 3 years ago - 2 comments

#26 - sec dlist command added

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#25 - Add progress meter to 'sec dow'

Issue - State: closed - Opened by wkoszek about 3 years ago

#24 - Newline is missing in 'dest' command

Issue - State: closed - Opened by wkoszek about 3 years ago

#23 - Let's add 'sec dlist' command to show enabled months/years

Issue - State: closed - Opened by wkoszek about 3 years ago

#22 - Add a sample config file to the repo

Issue - State: closed - Opened by wkoszek about 3 years ago

#21 - Fix crashes if program isn't used correctly

Issue - State: closed - Opened by wkoszek about 3 years ago - 3 comments

#20 - fixed downloading files and checking sizes

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#19 - Start using compressed requests

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: task

#18 - Fix SQL directory to allow users to start using the program

Issue - State: closed - Opened by wkoszek about 3 years ago - 2 comments

#17 - added sec dest command

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 2 comments

#16 - Implement new command: sec dest

Issue - State: closed - Opened by wkoszek about 3 years ago - 1 comment
Labels: task, est:2hr

#15 - downloading items listed in edgar XML files

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#14 - Update SPEC.md

Pull Request - State: closed - Opened by wkoszek about 3 years ago

#13 - questions md file

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago

#12 - added golangci-lint in linting yaml file

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#11 - added two functions to retrieve the two different json files

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 1 comment

#10 - Use embed/sqlx package for SQL connection, and use gomigrate for DB migrations.

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: task, est:1hr, est:2hr

#9 - CI format testing doesn't work

Issue - State: closed - Opened by wkoszek about 3 years ago - 4 comments
Labels: bug, task

#8 - Create SPEC.md

Pull Request - State: closed - Opened by wkoszek about 3 years ago - 2 comments

#7 - Add golangci-lint to the style checking

Issue - State: closed - Opened by wkoszek about 3 years ago - 1 comment
Labels: task, est:1hr

#6 - Update db.go

Pull Request - State: closed - Opened by wkoszek about 3 years ago - 1 comment

#5 - Basic ci 20210805

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 2 comments

#4 - retrieve and process JSON & save in DB

Pull Request - State: closed - Opened by Hazeman99 about 3 years ago - 4 comments

#3 - Add parsing of company_tickers_exchange.json

Issue - State: closed - Opened by wkoszek about 3 years ago - 1 comment
Labels: task, est:1hr, took:1hr

#2 - Add a basic CI support

Issue - State: closed - Opened by wkoszek about 3 years ago - 8 comments
Labels: task, est:1hr, took:1hr

#1 - First task: try to ingest JSONs from sec.gov.

Issue - State: closed - Opened by wkoszek about 3 years ago
Labels: task, est:1hr, est:2hr, estimate-approved, $$ invoice-paid

GitHub / equres/sec issues and pull requests