hynky1999/CmonCrawl issues and pull requests

#109 - resolves #108 typo in aws athena policy

Pull Request - State: open - Opened by drmarshall 9 months ago

#108 - Typo in AWS policy

Issue - State: open - Opened by drmarshall 9 months ago

#107 - RegExp not works

Issue - State: open - Opened by ZeusFSX 10 months ago - 2 comments

#106 - feature: add optional cache layer to `S3Dao`

Pull Request - State: closed - Opened by mik3y 11 months ago - 1 comment

#105 - deps: bump aiohttp to 3.9.3

Pull Request - State: closed - Opened by mik3y 11 months ago - 2 comments

#104 - Question about Step: 4 Run the extractor

Issue - State: closed - Opened by Old-Lorry 12 months ago - 2 comments

#103 - Throttling of query requests

Pull Request - State: closed - Opened by hynky1999 about 1 year ago

#102 - Readme consult status page

Pull Request - State: closed - Opened by hynky1999 about 1 year ago

#101 - Divide by Zero error when using the CLI

Issue - State: closed - Opened by ramsaylanier about 1 year ago - 2 comments

#100 - max_requests_per_second cannot be zero otherwise it will break here :…

Pull Request - State: closed - Opened by spacewaterbear about 1 year ago - 1 comment

#99 - Add max requests per second to cli

Pull Request - State: closed - Opened by hynky1999 about 1 year ago

#98 - readme & dotenv & banner

Pull Request - State: closed - Opened by hynky1999 about 1 year ago

#97 - cli-update

Pull Request - State: closed - Opened by hynky1999 about 1 year ago

#96 - AttributeError: 'Namespace' object has no attribute 'download_method'

Issue - State: closed - Opened by rsamf about 1 year ago - 1 comment

#95 - Requirements lock

Pull Request - State: closed - Opened by hynky1999 about 1 year ago

#94 - Update README.md

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#93 - Docs update

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#92 - Ruff Linting and easier development cycle with Makefile

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#91 - ⚡️ Better default parameters, fixes for athena

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#90 - Update documentation to reflect current state of project

Issue - State: closed - Opened by hynky1999 over 1 year ago

#89 - Remove release tests

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#88 - remove tests fix downloader

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#87 - 🔥 Removal of cc indexes arg

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#86 - Athena

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#85 - `HTMLExtractor` should be derived from `IExtractor`. This should substantially speedup downloads

Issue - State: closed - Opened by hynky1999 over 1 year ago

#84 - Removal cc_indexes_server argument from `index_query`

Issue - State: closed - Opened by hynky1999 over 1 year ago

#83 - Add rate-limit throttle to downloader/index query.

Issue - State: closed - Opened by hynky1999 over 1 year ago

#82 - cmon via cli not working..

Issue - State: closed - Opened by julianschnell over 1 year ago - 2 comments

#81 - Structure

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#80 - Installation

Issue - State: closed - Opened by Jack-Lewis1 over 1 year ago - 7 comments

#79 - Stub files

Issue - State: closed - Opened by hynky1999 over 1 year ago

#78 - verbosity

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#77 - Revert "Verbosity"

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#76 - Verbosity

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#75 - Local warc

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#74 - Directory output overhaul

Issue - State: closed - Opened by hynky1999 over 1 year ago

#73 - Better loggin

Issue - State: closed - Opened by hynky1999 over 1 year ago

#72 - Update README.md

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#71 - Hotfix

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#70 - added info about athena

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#69 - Update README.md

Pull Request - State: closed - Opened by hynky1999 over 1 year ago

#68 - encoding + typing + better index retry

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#67 - docs

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#66 - remove build

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#65 - Update README.md

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#64 - with rst

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#63 - added docs

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#62 - Download update

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#61 - bugs + additional info

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#60 - pypi update on release

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#59 - Pipeline

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#58 - Pipeline

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#57 - updated toml

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#56 - Update pyproject.toml

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#55 - Update test_and_push.yml

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#54 - Update test_and_push.yml

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#53 - Cli updates

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#52 - PIP integration

Issue - State: closed - Opened by hynky1999 almost 2 years ago

#51 - Clean up documentation

Issue - State: closed - Opened by hynky1999 almost 2 years ago

#50 - Cleaner CI

Issue - State: closed - Opened by hynky1999 almost 2 years ago

#49 - Split

Pull Request - State: closed - Opened by hynky1999 almost 2 years ago

#48 - added build

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#47 - jekkyl

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#46 - Added docs

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#45 - Edited unify to filter more

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#44 - tmp files

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#43 - sleep step fix

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#42 - Fixed sleepstep

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#41 - Relasse V1

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#40 - Fixed grid

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#39 - Aic

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#38 - Removed artemis-create

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#37 - Add support for mutiple css selectors at extractors_css specification

Issue - State: closed - Opened by hynky1999 over 2 years ago - 1 comment

#36 - Pre-cluster test

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#35 - Ouptut folder based on hostname variable

Issue - State: closed - Opened by hynky1999 over 2 years ago

#34 - Add ending condition to processors

Issue - State: closed - Opened by hynky1999 over 2 years ago

#33 - Ihned.cz

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#32 - Restruct

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#31 - Novinky.cz

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#30 - Fixed not downloading issue + qos tweaks

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#29 - Added irozhlas.cz

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#28 - Transition to select

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#27 - Timeout error

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#26 - Closing fix

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#25 - Fixed outstreamer and added loggings

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#24 - Artemis

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#23 - TimeoutError handling at aiohttp

Issue - State: closed - Opened by hynky1999 over 2 years ago

#22 - New folders creation

Issue - State: closed - Opened by hynky1999 over 2 years ago
Labels: bug

#21 - Improve logging

Issue - State: closed - Opened by hynky1999 over 2 years ago

#20 - Added seznamzpravy

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#19 - Finished idnes.cz

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#18 - Final Update

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#17 - create extractor for seznamzpravy.cz

Issue - State: closed - Opened by hynky1999 over 2 years ago

#16 - Create extractor for novinky.cz

Issue - State: closed - Opened by hynky1999 over 2 years ago

#15 - Create extractor for idnes.cz

Issue - State: closed - Opened by hynky1999 over 2 years ago

#14 - Big update Finished aktualne.cz

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#13 - Aktualne.cz

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#12 - Verification fix

Pull Request - State: closed - Opened by hynky1999 over 2 years ago

#11 - Add unification for ulrs when checking for duplication

Issue - State: closed - Opened by hynky1999 over 2 years ago

#10 - Create simple pipeline for downloading artiles

Issue - State: closed - Opened by hynky1999 over 2 years ago

GitHub / hynky1999/CmonCrawl issues and pull requests