Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / holgerd77/django-dynamic-scraper issues and pull requests

#152 - Updated requirements.txt

Pull Request - State: open - Opened by ronak7613 over 2 years ago

#151 - Bump celery from 3.1.25 to 5.2.2

Pull Request - State: open - Opened by dependabot[bot] over 2 years ago
Labels: dependencies

#149 - New Scrapy Support List

Issue - State: open - Opened by bezkos about 3 years ago

#148 - New Release v0.13.3

Pull Request - State: closed - Opened by holgerd77 over 3 years ago

#147 - Maintenance

Pull Request - State: closed - Opened by holgerd77 over 3 years ago

#146 - How can I save crawled data in multi model?

Issue - State: open - Opened by relaxdevvv over 3 years ago

#144 - Dynamically change the url of the "Website" component

Issue - State: open - Opened by benjaminelkrieff almost 4 years ago

#143 - Automatically Scrape a HUGE amount of url at scale

Issue - State: open - Opened by benjaminelkrieff almost 4 years ago

#142 - Added GitHub actions build CI configuration

Pull Request - State: closed - Opened by holgerd77 almost 4 years ago

#141 - Switched README format to .md, removed donations section

Pull Request - State: closed - Opened by holgerd77 almost 4 years ago
Labels: documentation

#140 - django 2

Issue - State: open - Opened by andytwoods over 4 years ago - 3 comments

#139 - docs: Fix simple typo, peridoc -> periodic

Pull Request - State: open - Opened by timgates42 over 4 years ago

#138 - No more python_2_unicode_compatible on django 3.0

Issue - State: open - Opened by jyr almost 5 years ago - 1 comment

#137 - Read scrapyd url from settings file

Pull Request - State: closed - Opened by umrashrf almost 5 years ago

#136 - Read scrapyd hostname from env / remove hardcode hostname

Issue - State: open - Opened by umrashrf almost 5 years ago - 1 comment

#134 - Scehduling error with broker and scrapyd. HELP!

Issue - State: open - Opened by Aliiibukhari about 5 years ago

#132 - django-dynamic-scrapy do not work with python3.x after upgrading

Issue - State: closed - Opened by odainasser about 5 years ago - 1 comment

#130 - Follow all URLs on page with dynamic pagination

Pull Request - State: open - Opened by albert-nagy about 5 years ago

#129 - _

Issue - State: open - Opened by 17637462979 about 5 years ago

#128 - django on_delete

Pull Request - State: open - Opened by ahmadjd94 over 5 years ago

#127 - Support django 2 on_delete for model

Issue - State: open - Opened by ahmadjd94 over 5 years ago - 1 comment

#126 - Detail object of scraped element

Issue - State: open - Opened by rafrasenberg over 5 years ago - 1 comment

#125 - page.html

Issue - State: closed - Opened by cavidanhasanli over 5 years ago - 1 comment

#124 - event_main.html

Issue - State: closed - Opened by cavidanhasanli over 5 years ago - 1 comment

#123 - Updated docs index page

Pull Request - State: closed - Opened by holgerd77 over 5 years ago

#122 - Minor release note doc format fixes

Pull Request - State: closed - Opened by holgerd77 over 5 years ago

#121 - New release 0.13.2

Pull Request - State: closed - Opened by holgerd77 over 5 years ago

#120 - Updated Scrapy from 1.4 to 1.5, removed Django 1.8, 1.9, 1.10 support

Pull Request - State: closed - Opened by holgerd77 over 5 years ago

#119 - Support for Python 3.6, 3.7 | Updated future, Pillow, attrs dependencies

Pull Request - State: closed - Opened by holgerd77 over 5 years ago - 1 comment

#118 - Run tests on Python 2.7

Pull Request - State: closed - Opened by holgerd77 over 5 years ago

#117 - Improve Travis Support

Pull Request - State: closed - Opened by holgerd77 over 5 years ago

#116 - CircleCI Support

Pull Request - State: closed - Opened by holgerd77 over 5 years ago

#115 - can't install django-dynamic-scraper with django 1.9 and python 3.6

Issue - State: closed - Opened by FelipeDelFierro over 5 years ago - 2 comments

#114 - How to utilize - html as string in json response

Issue - State: open - Opened by shashitechno almost 6 years ago

#113 - RawGit is shutting down, replace it with jsDelivr

Pull Request - State: open - Opened by jsdelivrbot almost 6 years ago

#112 - Add missing migration file

Pull Request - State: open - Opened by yazanpsut almost 6 years ago

#111 - Version 0.13.1 mission migration file.

Issue - State: open - Opened by yazanhorani almost 6 years ago

#110 - Returning multiple elements

Issue - State: open - Opened by narankhetani about 6 years ago

#109 - Resolves #106 - updated scrapy req after successful test run.

Pull Request - State: open - Opened by ryokamiya over 6 years ago

#108 - Installation Failure in Pillow req when Brew's JPEG package isn't installed

Issue - State: closed - Opened by tom-price over 6 years ago - 5 comments

#107 - how to view traceback?

Issue - State: open - Opened by ehsankhorasani over 6 years ago

#106 - Support for Scrapy 1.5

Issue - State: closed - Opened by holgerd77 over 6 years ago - 1 comment
Labels: feature, test, help wanted

#105 - Django 2+ support

Issue - State: closed - Opened by tigrus over 6 years ago - 1 comment

#104 - Updated for Django 2 compatibility

Pull Request - State: closed - Opened by ryokamiya over 6 years ago

#103 - Add explicit on_delete argument to be compatible for Django 2.0.

Pull Request - State: closed - Opened by ryokamiya over 6 years ago - 9 comments

#102 - I get error:Unhandled error in Deferred

Issue - State: closed - Opened by Jasonhy over 6 years ago - 2 comments

#100 - enables parsing of scraped dictionary

Pull Request - State: open - Opened by Dean-Christian-Armada almost 7 years ago - 2 comments

#99 - How to scrape a JSON object instead of a JSON object inside a list?

Issue - State: closed - Opened by Dean-Christian-Armada almost 7 years ago - 1 comment

#98 - Scraping in time

Issue - State: closed - Opened by moreplavec almost 7 years ago - 1 comment

#97 - Get scrapy port

Pull Request - State: closed - Opened by DeanSherwin about 7 years ago - 5 comments

#96 - Note to remind users to add checkers module to settings

Pull Request - State: closed - Opened by DeanSherwin about 7 years ago - 1 comment

#95 - Custom HTTP status codes for DDS checker

Issue - State: open - Opened by WarToaster about 7 years ago - 2 comments

#94 - How to use the scheduling parameters to only run scraper for only 1 time ?

Issue - State: open - Opened by vaimdev about 7 years ago - 1 comment

#93 - Can DDS supports Python 3.6+?

Issue - State: open - Opened by xichagui about 7 years ago - 2 comments

#92 - Bug with Scrapyd/DDS

Issue - State: open - Opened by bezkos about 7 years ago

#91 - Question: IN/ACTIVE status on NewsWebsite?

Issue - State: closed - Opened by senoadiw over 7 years ago - 4 comments

#90 - Scrapers Detail Admins Page load too slow

Issue - State: open - Opened by bezkos over 7 years ago - 8 comments

#89 - Cannot complete the wikinews example project due to a logging issue

Issue - State: closed - Opened by senoadiw over 7 years ago - 2 comments

#88 - Zero actions counter and Standard Update

Issue - State: closed - Opened by bezkos over 7 years ago - 2 comments

#87 - DDS unusable with django >= 1.10

Issue - State: closed - Opened by tigrus over 7 years ago - 3 comments

#86 - multiple jsonpath

Issue - State: closed - Opened by klkim over 7 years ago - 1 comment

#85 - [root] ERROR: No base objects found!

Issue - State: closed - Opened by ghost over 7 years ago

#84 - Problem with DDS+Postgresql

Issue - State: closed - Opened by bezkos over 7 years ago - 1 comment

#83 - Scraping with JSONPath does not return all items

Issue - State: closed - Opened by rakanalh over 7 years ago - 1 comment

#82 - Using scraped text in another xpath/regex/processors

Issue - State: closed - Opened by renodesper almost 8 years ago - 1 comment

#81 - urlopen error Int or String expected

Issue - State: closed - Opened by yunmanger1 almost 8 years ago - 1 comment

#80 - Scheduler does not work in example project

Issue - State: closed - Opened by zeonn almost 8 years ago - 2 comments

#79 - fix task_utils.py for python3 support

Pull Request - State: closed - Opened by zeonn almost 8 years ago

#77 - Update reference.rst

Pull Request - State: closed - Opened by tigrus about 8 years ago - 3 comments
Labels: unconfirmed

#75 - OperationalError at /admin/open_news/newswebsite/

Issue - State: closed - Opened by prabhatpankaj about 8 years ago - 1 comment

#74 - I installed django dynamic scraper to my app and when i pushed it my app broke

Issue - State: closed - Opened by idesignedme about 8 years ago - 1 comment

#73 - how can i config scraper and crawl this articles?

Issue - State: closed - Opened by MightyWing about 8 years ago - 1 comment

#71 - (Docs) Remove unnecesary comma from getting_started.rst

Pull Request - State: closed - Opened by kas about 8 years ago

#70 - (Docs) Quick grammar fix in introduction.rst

Pull Request - State: closed - Opened by kas about 8 years ago

#60 - adding missing migrations

Pull Request - State: closed - Opened by bashu over 8 years ago - 5 comments

#57 - how "dynamic scheduling" config and work

Issue - State: closed - Opened by pythonwood over 8 years ago - 1 comment

#56 - Duplicates items

Issue - State: closed - Opened by yunmanger1 over 8 years ago - 1 comment

#54 - can't run python manage.py celeryd

Issue - State: closed - Opened by ratha-pkh almost 9 years ago - 8 comments

#53 - Allow the user to customize the scraper

Issue - State: closed - Opened by ghost almost 9 years ago - 11 comments

#52 - SystemCheckError: System check identified some issues:

Issue - State: closed - Opened by harryprince almost 9 years ago - 1 comment

#49 - Future developments of this repo?

Issue - State: closed - Opened by rakanalh over 9 years ago - 5 comments

#47 - Adding TakeAll processor to be used instead of take first. resolves #45

Pull Request - State: closed - Opened by rakanalh over 9 years ago - 3 comments

#46 - * add formrequest version of spider and checker

Pull Request - State: open - Opened by canercandan almost 10 years ago - 3 comments
Labels: unconfirmed

#45 - TakeFirst vs Returning multiple elements found

Issue - State: closed - Opened by holgerd77 almost 10 years ago - 3 comments

#33 - Add priority of scrapy jobs

Pull Request - State: closed - Opened by zzpwelkin over 10 years ago

#28 - user or developer can use processors customed

Pull Request - State: closed - Opened by zzpwelkin about 11 years ago - 3 comments

#25 - added dynamic processor function

Pull Request - State: closed - Opened by scott-coates about 11 years ago - 1 comment

#24 - Added FOLLOW pagination type.

Pull Request - State: closed - Opened by scott-coates about 11 years ago - 10 comments
Labels: someday

#23 - added ProcessBasedUtils to run spiders in-process

Pull Request - State: open - Opened by scott-coates about 11 years ago
Labels: someday

#19 - Attributes crawled from the detail_page are not detected as unicode

Issue - State: closed - Opened by Netquin over 11 years ago - 2 comments

#18 - Support for more than one image attribute

Issue - State: open - Opened by Netquin over 11 years ago - 3 comments
Labels: someday

#15 - Allow storing extra XPATHs / add another pagination option

Issue - State: closed - Opened by mridang almost 12 years ago - 5 comments