Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / holgerd77/django-dynamic-scraper issues and pull requests
#154 - SystemError: ffi_prep_closure(): bad user_data (it seems that the version of the libffi library seen at runtime is different from the 'ffi.h' file seen at compile-time)
Issue -
State: open - Opened by natea over 1 year ago
- 1 comment
#152 - Updated requirements.txt
Pull Request -
State: open - Opened by ronak7613 almost 3 years ago
#151 - Bump celery from 3.1.25 to 5.2.2
Pull Request -
State: open - Opened by dependabot[bot] almost 3 years ago
Labels: dependencies
#149 - New Scrapy Support List
Issue -
State: open - Opened by bezkos over 3 years ago
#148 - New Release v0.13.3
Pull Request -
State: closed - Opened by holgerd77 over 3 years ago
#147 - Maintenance
Pull Request -
State: closed - Opened by holgerd77 over 3 years ago
#146 - How can I save crawled data in multi model?
Issue -
State: open - Opened by relaxdevvv almost 4 years ago
#145 - Django Dynamic Scraper: Celery Tasks not executed in Scrapyd
Issue -
State: open - Opened by benjaminelkrieff about 4 years ago
#144 - Dynamically change the url of the "Website" component
Issue -
State: open - Opened by benjaminelkrieff about 4 years ago
#143 - Automatically Scrape a HUGE amount of url at scale
Issue -
State: open - Opened by benjaminelkrieff about 4 years ago
#142 - Added GitHub actions build CI configuration
Pull Request -
State: closed - Opened by holgerd77 about 4 years ago
#141 - Switched README format to .md, removed donations section
Pull Request -
State: closed - Opened by holgerd77 about 4 years ago
Labels: documentation
#140 - django 2
Issue -
State: open - Opened by andytwoods over 4 years ago
- 3 comments
#139 - docs: Fix simple typo, peridoc -> periodic
Pull Request -
State: open - Opened by timgates42 over 4 years ago
#138 - No more python_2_unicode_compatible on django 3.0
Issue -
State: open - Opened by jyr almost 5 years ago
- 1 comment
#137 - Read scrapyd url from settings file
Pull Request -
State: closed - Opened by umrashrf about 5 years ago
#136 - Read scrapyd hostname from env / remove hardcode hostname
Issue -
State: open - Opened by umrashrf about 5 years ago
- 1 comment
#135 - Replace django-celery with django-celery-beat and django-celery-results
Issue -
State: open - Opened by umrashrf about 5 years ago
#134 - Scehduling error with broker and scrapyd. HELP!
Issue -
State: open - Opened by Aliiibukhari about 5 years ago
#133 - Could somebody help me execute the scheduling spiders using djcelery?
Issue -
State: open - Opened by Aliiibukhari over 5 years ago
#132 - django-dynamic-scrapy do not work with python3.x after upgrading
Issue -
State: closed - Opened by odainasser over 5 years ago
- 1 comment
#131 - More than one scheduler, the error raises about TypeError("'run_spiders' object is not iterable",)
Issue -
State: open - Opened by itualoha over 5 years ago
#130 - Follow all URLs on page with dynamic pagination
Pull Request -
State: open - Opened by albert-nagy over 5 years ago
#129 - _
Issue -
State: open - Opened by 17637462979 over 5 years ago
#128 - django on_delete
Pull Request -
State: open - Opened by ahmadjd94 over 5 years ago
#127 - Support django 2 on_delete for model
Issue -
State: open - Opened by ahmadjd94 over 5 years ago
- 1 comment
#126 - Detail object of scraped element
Issue -
State: open - Opened by rafrasenberg over 5 years ago
- 1 comment
#125 - page.html
Issue -
State: closed - Opened by cavidanhasanli almost 6 years ago
- 1 comment
#124 - event_main.html
Issue -
State: closed - Opened by cavidanhasanli almost 6 years ago
- 1 comment
#123 - Updated docs index page
Pull Request -
State: closed - Opened by holgerd77 almost 6 years ago
#122 - Minor release note doc format fixes
Pull Request -
State: closed - Opened by holgerd77 almost 6 years ago
#121 - New release 0.13.2
Pull Request -
State: closed - Opened by holgerd77 almost 6 years ago
#120 - Updated Scrapy from 1.4 to 1.5, removed Django 1.8, 1.9, 1.10 support
Pull Request -
State: closed - Opened by holgerd77 almost 6 years ago
#119 - Support for Python 3.6, 3.7 | Updated future, Pillow, attrs dependencies
Pull Request -
State: closed - Opened by holgerd77 almost 6 years ago
- 1 comment
#118 - Run tests on Python 2.7
Pull Request -
State: closed - Opened by holgerd77 almost 6 years ago
#117 - Improve Travis Support
Pull Request -
State: closed - Opened by holgerd77 almost 6 years ago
#116 - CircleCI Support
Pull Request -
State: closed - Opened by holgerd77 almost 6 years ago
#115 - can't install django-dynamic-scraper with django 1.9 and python 3.6
Issue -
State: closed - Opened by FelipeDelFierro almost 6 years ago
- 2 comments
#114 - How to utilize - html as string in json response
Issue -
State: open - Opened by shashitechno almost 6 years ago
#113 - RawGit is shutting down, replace it with jsDelivr
Pull Request -
State: open - Opened by jsdelivrbot almost 6 years ago
#112 - Add missing migration file
Pull Request -
State: open - Opened by yazanpsut almost 6 years ago
#111 - Version 0.13.1 mission migration file.
Issue -
State: open - Opened by yazanhorani almost 6 years ago
#110 - Returning multiple elements
Issue -
State: open - Opened by narankhetani over 6 years ago
#109 - Resolves #106 - updated scrapy req after successful test run.
Pull Request -
State: open - Opened by ryokamiya over 6 years ago
#108 - Installation Failure in Pillow req when Brew's JPEG package isn't installed
Issue -
State: closed - Opened by tom-price over 6 years ago
- 5 comments
#107 - how to view traceback?
Issue -
State: open - Opened by ehsankhorasani over 6 years ago
#106 - Support for Scrapy 1.5
Issue -
State: closed - Opened by holgerd77 over 6 years ago
- 1 comment
Labels: feature, test, help wanted
#105 - Django 2+ support
Issue -
State: closed - Opened by tigrus over 6 years ago
- 1 comment
#104 - Updated for Django 2 compatibility
Pull Request -
State: closed - Opened by ryokamiya almost 7 years ago
#103 - Add explicit on_delete argument to be compatible for Django 2.0.
Pull Request -
State: closed - Opened by ryokamiya almost 7 years ago
- 9 comments
#102 - I get error:Unhandled error in Deferred
Issue -
State: closed - Opened by Jasonhy almost 7 years ago
- 2 comments
#101 - ERROR: Spider error processing, DoesNotExist: RequestPageType, KeyError: 'MP', TypeError: must be str, not list`
Issue -
State: closed - Opened by brylor about 7 years ago
#100 - enables parsing of scraped dictionary
Pull Request -
State: open - Opened by Dean-Christian-Armada about 7 years ago
- 2 comments
#99 - How to scrape a JSON object instead of a JSON object inside a list?
Issue -
State: closed - Opened by Dean-Christian-Armada about 7 years ago
- 1 comment
#98 - Scraping in time
Issue -
State: closed - Opened by moreplavec about 7 years ago
- 1 comment
#97 - Get scrapy port
Pull Request -
State: closed - Opened by DeanSherwin about 7 years ago
- 5 comments
#96 - Note to remind users to add checkers module to settings
Pull Request -
State: closed - Opened by DeanSherwin over 7 years ago
- 1 comment
#95 - Custom HTTP status codes for DDS checker
Issue -
State: open - Opened by WarToaster over 7 years ago
- 2 comments
#94 - How to use the scheduling parameters to only run scraper for only 1 time ?
Issue -
State: open - Opened by vaimdev over 7 years ago
- 1 comment
#93 - Can DDS supports Python 3.6+?
Issue -
State: open - Opened by xichagui over 7 years ago
- 2 comments
#92 - Bug with Scrapyd/DDS
Issue -
State: open - Opened by bezkos over 7 years ago
#91 - Question: IN/ACTIVE status on NewsWebsite?
Issue -
State: closed - Opened by senoadiw over 7 years ago
- 4 comments
#90 - Scrapers Detail Admins Page load too slow
Issue -
State: open - Opened by bezkos over 7 years ago
- 8 comments
#89 - Cannot complete the wikinews example project due to a logging issue
Issue -
State: closed - Opened by senoadiw over 7 years ago
- 2 comments
#88 - Zero actions counter and Standard Update
Issue -
State: closed - Opened by bezkos over 7 years ago
- 2 comments
#87 - DDS unusable with django >= 1.10
Issue -
State: closed - Opened by tigrus over 7 years ago
- 3 comments
#86 - multiple jsonpath
Issue -
State: closed - Opened by klkim over 7 years ago
- 1 comment
#85 - [root] ERROR: No base objects found!
Issue -
State: closed - Opened by ghost over 7 years ago
#84 - Problem with DDS+Postgresql
Issue -
State: closed - Opened by bezkos almost 8 years ago
- 1 comment
#83 - Scraping with JSONPath does not return all items
Issue -
State: closed - Opened by rakanalh almost 8 years ago
- 1 comment
#82 - Using scraped text in another xpath/regex/processors
Issue -
State: closed - Opened by renodesper almost 8 years ago
- 1 comment
#81 - urlopen error Int or String expected
Issue -
State: closed - Opened by yunmanger1 almost 8 years ago
- 1 comment
#80 - Scheduler does not work in example project
Issue -
State: closed - Opened by zeonn about 8 years ago
- 2 comments
#79 - fix task_utils.py for python3 support
Pull Request -
State: closed - Opened by zeonn about 8 years ago
#78 - TypeError: the JSON object must be str, not 'bytes' from utils/task_utils.py on python 3.5 (FIX)
Issue -
State: closed - Opened by zeonn about 8 years ago
#77 - Update reference.rst
Pull Request -
State: closed - Opened by tigrus about 8 years ago
- 3 comments
Labels: unconfirmed
#76 - pre_url produces ERROR Unsupported URL scheme 'doublehttp' when rerunning scrapy after saving articles to DB
Issue -
State: closed - Opened by Akramz about 8 years ago
- 4 comments
#75 - OperationalError at /admin/open_news/newswebsite/
Issue -
State: closed - Opened by prabhatpankaj over 8 years ago
- 1 comment
#74 - I installed django dynamic scraper to my app and when i pushed it my app broke
Issue -
State: closed - Opened by idesignedme over 8 years ago
- 1 comment
#73 - how can i config scraper and crawl this articles?
Issue -
State: closed - Opened by MightyWing over 8 years ago
- 1 comment
#71 - (Docs) Remove unnecesary comma from getting_started.rst
Pull Request -
State: closed - Opened by kas over 8 years ago
#70 - (Docs) Quick grammar fix in introduction.rst
Pull Request -
State: closed - Opened by kas over 8 years ago
#60 - adding missing migrations
Pull Request -
State: closed - Opened by bashu over 8 years ago
- 5 comments
#57 - how "dynamic scheduling" config and work
Issue -
State: closed - Opened by pythonwood over 8 years ago
- 1 comment
#56 - Duplicates items
Issue -
State: closed - Opened by yunmanger1 over 8 years ago
- 1 comment
#54 - can't run python manage.py celeryd
Issue -
State: closed - Opened by ratha-pkh almost 9 years ago
- 8 comments
#53 - Allow the user to customize the scraper
Issue -
State: closed - Opened by ghost about 9 years ago
- 11 comments
#52 - SystemCheckError: System check identified some issues:
Issue -
State: closed - Opened by harryprince about 9 years ago
- 1 comment
#49 - Future developments of this repo?
Issue -
State: closed - Opened by rakanalh over 9 years ago
- 5 comments
#47 - Adding TakeAll processor to be used instead of take first. resolves #45
Pull Request -
State: closed - Opened by rakanalh almost 10 years ago
- 3 comments
#46 - * add formrequest version of spider and checker
Pull Request -
State: open - Opened by canercandan almost 10 years ago
- 3 comments
Labels: unconfirmed
#45 - TakeFirst vs Returning multiple elements found
Issue -
State: closed - Opened by holgerd77 almost 10 years ago
- 3 comments
#33 - Add priority of scrapy jobs
Pull Request -
State: closed - Opened by zzpwelkin over 10 years ago
#28 - user or developer can use processors customed
Pull Request -
State: closed - Opened by zzpwelkin about 11 years ago
- 3 comments
#25 - added dynamic processor function
Pull Request -
State: closed - Opened by scott-coates over 11 years ago
- 1 comment
#24 - Added FOLLOW pagination type.
Pull Request -
State: closed - Opened by scott-coates over 11 years ago
- 10 comments
Labels: someday
#23 - added ProcessBasedUtils to run spiders in-process
Pull Request -
State: open - Opened by scott-coates over 11 years ago
Labels: someday
#19 - Attributes crawled from the detail_page are not detected as unicode
Issue -
State: closed - Opened by Netquin over 11 years ago
- 2 comments
#18 - Support for more than one image attribute
Issue -
State: open - Opened by Netquin over 11 years ago
- 3 comments
Labels: someday
#15 - Allow storing extra XPATHs / add another pagination option
Issue -
State: closed - Opened by mridang about 12 years ago
- 5 comments