Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / jayzeng/scrapy-elasticsearch issues and pull requests

#95 - Fix: support for scrapy's dataclass item

Pull Request - State: closed - Opened by b1tkeeper over 2 years ago

#94 - Doesn't support scrapy dataclass item

Issue - State: open - Opened by b1tkeeper over 2 years ago

#93 - elasticsearch.helpers.BulkIndexError after long time of scraping

Issue - State: closed - Opened by SuperMasterBlasterLaser over 2 years ago - 5 comments

#92 - Cluster name and Cluster node field not available

Issue - State: open - Opened by SaksheePhade over 3 years ago

#90 - Support ES7 typeless API

Pull Request - State: closed - Opened by junmasui over 3 years ago - 1 comment

#89 - Add support to create index with mapping definition

Pull Request - State: open - Opened by andersoncarubelli almost 4 years ago

#88 - Please support Scrapy 2.4.1

Issue - State: open - Opened by videni almost 4 years ago - 1 comment

#85 - Added possibility to use api-key for authentification.

Pull Request - State: open - Opened by julfes almost 4 years ago

#84 - deleted

Issue - State: closed - Opened by misterch0c over 4 years ago

#83 - Scrapy logging show UnicodeDecodeError

Issue - State: open - Opened by isamzwuairi over 4 years ago - 1 comment

#82 - Add option to save documents by merging them with existing ones

Pull Request - State: open - Opened by diegov over 4 years ago

#80 - is it possible update item if this item with id exists?

Issue - State: open - Opened by heilwood over 4 years ago - 2 comments

#79 - got an unexpected keyword argument 'headers'

Issue - State: open - Opened by llermaly almost 6 years ago - 3 comments

#78 - Missing header information for ElasticSearch 6.2

Issue - State: open - Opened by nerdstein over 6 years ago - 2 comments

#77 - BulkIndexError

Issue - State: closed - Opened by abc16810 over 6 years ago - 1 comment

#76 - Removal of _type requirement

Issue - State: open - Opened by powerinva over 6 years ago

#75 - Unique key is tuple if using items

Issue - State: closed - Opened by sorenjacobi over 6 years ago - 1 comment

#74 - Fix typo in Readme

Pull Request - State: closed - Opened by julien-duponchelle over 6 years ago - 1 comment

#73 - Text field always gets ignore_above keyword

Issue - State: closed - Opened by tomasn4a almost 7 years ago - 1 comment

#72 - Add index_type from a field in the item

Pull Request - State: open - Opened by aleroot almost 7 years ago - 8 comments

#71 - Add support for field based index splitting

Pull Request - State: open - Opened by dameyerdave almost 7 years ago - 2 comments

#70 - Allow composite key inside ELASTICSEARCH_UNIQ_KEY

Pull Request - State: closed - Opened by aleroot almost 7 years ago - 1 comment

#69 - Content-Type required, Elasticsearch 6.x

Issue - State: closed - Opened by sebz1504 about 7 years ago - 1 comment

#68 - Custom ca

Pull Request - State: closed - Opened by jayzeng about 7 years ago

#67 - Unable to post to ssl endpoint with custom CA

Issue - State: closed - Opened by LordBrain about 7 years ago - 7 comments

#66 - What does 'ELASTICSEARCH_UNIQ_KEY' do?

Issue - State: closed - Opened by Feelthewind about 7 years ago - 2 comments

#65 - Move ID generation to separate method

Pull Request - State: closed - Opened by alukach about 7 years ago - 1 comment

#64 - Elasticsearch not receiving data from scrapy

Issue - State: closed - Opened by harakiri406 about 7 years ago - 4 comments

#63 - Pipeline sending data after spider_closed and opened again.

Issue - State: closed - Opened by ghost about 7 years ago - 3 comments

#62 - ELASTICSEARCH_BUFFER_LENGTH

Issue - State: closed - Opened by ghost over 7 years ago - 2 comments

#61 - Elasticsearch 5 has maybe more reason to allow the creation of mapping

Issue - State: open - Opened by kootenpv over 7 years ago - 1 comment

#60 - flush/commit every ELASTICSEARCH_FLUSH_SIZE items, and flush at end.

Issue - State: closed - Opened by danizen over 7 years ago - 2 comments

#58 - Ability to specify ingest pipeline as a query parameter

Issue - State: open - Opened by dbuijs over 7 years ago - 2 comments

#57 - Elasticsearch pipeline not enabled - Scrapy 1.3.3 / ES 5.2

Issue - State: closed - Opened by Beenhakker over 7 years ago - 6 comments

#56 - Specifiy specific fields to index

Issue - State: closed - Opened by maanas over 7 years ago - 3 comments

#55 - [SUGGESTION] Tackling MemoryError raised on bulk inserts

Issue - State: closed - Opened by eventuallyc0nsistent over 7 years ago - 2 comments

#54 - Location of scrapyelasticsearch.py file

Issue - State: closed - Opened by punit07 over 7 years ago - 2 comments

#53 - Delete data from ES index before inserting data again ?

Issue - State: closed - Opened by punit07 over 7 years ago - 3 comments

#52 - How to insert data into an existing index ?

Issue - State: closed - Opened by punit07 over 7 years ago - 4 comments

#51 - add index mapping

Issue - State: open - Opened by dijadev almost 8 years ago - 5 comments

#50 - Fix: str key was never encoded in utf-8.

Pull Request - State: closed - Opened by PPACI almost 8 years ago - 1 comment

#49 - ElasticSearch on AWS

Issue - State: open - Opened by philippbussche almost 8 years ago - 1 comment

#47 - Ntlm optional

Pull Request - State: closed - Opened by jayzeng almost 8 years ago

#46 - How to handle deleted documents?

Issue - State: closed - Opened by burnash almost 8 years ago - 4 comments

#45 - ELASTICSEARCH_UNIQ_KEY from multiple item fields

Issue - State: open - Opened by jenkin almost 8 years ago - 2 comments

#44 - NTLM authentication adds a dependency even if you don't need it

Issue - State: closed - Opened by jenkin almost 8 years ago - 5 comments

#43 - ELASTICSEARCH_SERVERS not really required

Issue - State: closed - Opened by jenkin almost 8 years ago - 2 comments

#42 - Time-based indices' name from scraped data

Issue - State: closed - Opened by jenkin almost 8 years ago - 3 comments

#41 - Python 3 issue with hashlib.sha1() for unique ID?

Issue - State: closed - Opened by hkkenneth almost 8 years ago - 7 comments

#40 - Include S3 images field

Issue - State: closed - Opened by devlesedi almost 8 years ago - 2 comments

#39 - AttributeError: module 'types' has no attribute 'ListType'

Issue - State: closed - Opened by saplaum about 8 years ago - 7 comments

#38 - ImportError: No module named requests_ntlm

Issue - State: closed - Opened by ThomasRafiki about 8 years ago - 3 comments

#37 - fix incorrect import path; code clean up

Pull Request - State: closed - Opened by jayzeng about 8 years ago

#36 - Dynamically set on index/type?

Issue - State: closed - Opened by jbasrai about 8 years ago - 6 comments

#35 - make it possible to retry in case of failures

Pull Request - State: closed - Opened by tpeng about 8 years ago

#34 - ImportError: No module named 'transportNTLM'

Issue - State: closed - Opened by yangtoude about 8 years ago - 8 comments

#33 - Make ITEM_PIPELINES in the example a dict

Pull Request - State: closed - Opened by denizdogan about 8 years ago - 1 comment

#32 - Usage documentation outdated

Issue - State: closed - Opened by mgur about 8 years ago - 1 comment

#31 - fixes issue #30

Pull Request - State: closed - Opened by jsgervais about 8 years ago - 1 comment

#30 - NTLM

Issue - State: closed - Opened by kathryn-thompson over 8 years ago - 2 comments

#29 - fix requirements.txt

Pull Request - State: closed - Opened by sajattack over 8 years ago

#28 - Added date suffix to index name. Fixed Elasticsearch Buffer Length default

Pull Request - State: closed - Opened by dougiep16 over 8 years ago - 1 comment

#27 - Add optional date suffix to index name

Issue - State: closed - Opened by dougiep16 over 8 years ago - 1 comment

#26 - Added NLTM authentification for sending items down the elasticsearch …

Pull Request - State: closed - Opened by jsgervais over 8 years ago - 8 comments

#25 - 'set' object has no attribute 'iteritems'

Issue - State: closed - Opened by Alborto over 8 years ago - 8 comments

#24 - NTLM Authentification with elasticsearch server

Issue - State: closed - Opened by jsgervais over 8 years ago - 7 comments

#23 - Review of last two PRs

Pull Request - State: closed - Opened by jenkin over 8 years ago - 2 comments

#22 - * bulk insertion

Pull Request - State: closed - Opened by jayzeng over 8 years ago - 2 comments

#21 - Pyes to elasticsearch

Pull Request - State: closed - Opened by jayzeng over 8 years ago

#20 - Bulk indexing instead of single item indexing

Issue - State: closed - Opened by jenkin over 8 years ago - 4 comments

#19 - Add support for multiple ES nodes

Issue - State: closed - Opened by jenkin over 8 years ago - 2 comments

#18 - TypeError: sha1() argument 1 must be string or buffer, not list

Issue - State: closed - Opened by J3tto over 8 years ago - 2 comments

#17 - migrate to other elasticsearch client library

Issue - State: closed - Opened by gerosalesc over 8 years ago - 15 comments

#16 - Switch to proper logging.

Pull Request - State: closed - Opened by lljrsr over 8 years ago - 1 comment

#15 - module name change :bug: uniq_key

Pull Request - State: closed - Opened by songzhiyong about 9 years ago - 4 comments

#14 - refactor(scrapyelasticsearch/): auto format the PEP8 errors

Pull Request - State: closed - Opened by aniketmaithani over 9 years ago - 1 comment

#13 - getting an error: exceptions.KeyError: 'url'

Issue - State: closed - Opened by javed1211 over 9 years ago - 3 comments

#12 - Fix README.rst :-(

Pull Request - State: closed - Opened by andskli over 9 years ago - 1 comment

#11 - Update scrapyelasticsearch.py

Pull Request - State: closed - Opened by glynnallen1704 almost 10 years ago - 1 comment

#10 - Fix settings

Pull Request - State: closed - Opened by ignaciovazquez almost 10 years ago - 6 comments

#9 - Fix indexing error

Pull Request - State: closed - Opened by ignaciovazquez almost 10 years ago - 2 comments

#8 - Fixed synxtax error

Pull Request - State: closed - Opened by ignaciovazquez almost 10 years ago - 5 comments

#7 - Fixed undefined uniq_id variable issue

Pull Request - State: closed - Opened by ignaciovazquez almost 10 years ago - 3 comments

#6 - * correct version

Pull Request - State: closed - Opened by jayzeng almost 10 years ago

#5 - Fixed some bugs in scrapyelasticsearch.py

Pull Request - State: closed - Opened by mjm159 about 10 years ago

#4 - Now we can talk to pypi

Pull Request - State: closed - Opened by jayzeng about 10 years ago - 1 comment

#3 - formatting for PyPI

Pull Request - State: closed - Opened by mjm159 about 10 years ago

#2 - Made more generic

Pull Request - State: closed - Opened by mjm159 about 10 years ago

#1 - updated scrapyelasticsearch.py to handle multiple items

Pull Request - State: closed - Opened by mjm159 about 10 years ago - 1 comment