beir-cellar/beir issues and pull requests

#87 - Reproducing msmarco-MiniLM-L-6-v3 results

Issue - State: closed - Opened by matprst over 2 years ago - 2 comments

#86 - Pre-processing code for missing datasets

Issue - State: closed - Opened by memray over 2 years ago - 6 comments

#85 - Introduce `RetrievalModel` abstract base class

Pull Request - State: closed - Opened by tstadel over 2 years ago - 2 comments

#84 - Support for custom retrievers: common base type for `EvaluateRetrieval`'s `retriever` param

Issue - State: open - Opened by tstadel over 2 years ago - 3 comments

#83 - Merging Development into master

Pull Request - State: closed - Opened by thakur-nandan over 2 years ago

#82 - Marco triplet in train_msmarco_v2.py

Issue - State: closed - Opened by WenzhengZhang over 2 years ago - 2 comments

#81 - The number of queries for Robust04 seems to be 250 instead of 249

Issue - State: closed - Opened by kwang2049 over 2 years ago - 2 comments

#80 - Question about MS MARCO dataset in BEIR

Issue - State: closed - Opened by jordane95 over 2 years ago - 2 comments

#79 - Elasticsearch connection error for BM25

Issue - State: closed - Opened by jaxball over 2 years ago - 1 comment

#78 - Title needed when using retriever.retrieve after using GenericDataLoader(...)load_custom(...)

Issue - State: open - Opened by obelhumeur over 2 years ago - 1 comment

#77 - How did you evaluate ColBERT on BEIR benchmark?

Issue - State: closed - Opened by jordane95 over 2 years ago - 1 comment

#76 - Include Vespa Lexical Search as an option to BEIR benchmark

Pull Request - State: open - Opened by thigm85 over 2 years ago - 1 comment

#75 - Question about details/scripts for generating the datasets

Issue - State: closed - Opened by narayanacharya6 over 2 years ago - 4 comments

#74 - Strange NDCG@10 for Touche-2020 on the BEIR leaderboard

Issue - State: open - Opened by thigm85 almost 3 years ago - 6 comments

#73 - End-Task Labels

Issue - State: closed - Opened by anthonywchen almost 3 years ago - 2 comments

#72 - Why index the queries together with the corpus?

Issue - State: closed - Opened by thigm85 almost 3 years ago - 2 comments

#71 - On the dependency `faiss`

Issue - State: open - Opened by jordane95 almost 3 years ago - 1 comment

#70 - Eval script breaks for custom evaluations when query does not have any hits

Issue - State: closed - Opened by narayanacharya6 almost 3 years ago - 1 comment

#69 - Question on the BM25 implementation

Issue - State: closed - Opened by jordane95 almost 3 years ago

#68 - Training configuration for ColBERT

Issue - State: closed - Opened by jihyukkim-nlp almost 3 years ago - 5 comments

#67 - Evaluation codes for ColBERT

Issue - State: open - Opened by rainatam almost 3 years ago - 11 comments

#66 - TypeError when running Quick Example

Issue - State: open - Opened by ReyonRen almost 3 years ago - 1 comment

#65 - Script to generate leaderboard metrics

Issue - State: closed - Opened by thigm85 almost 3 years ago - 3 comments

#64 - ValueError when running `evaluate_bm25.py`

Issue - State: open - Opened by jordane95 almost 3 years ago - 5 comments

#63 - Sparse query vector

Pull Request - State: open - Opened by maximedb almost 3 years ago - 5 comments

#62 - Fix sparse search

Pull Request - State: closed - Opened by maximedb almost 3 years ago - 1 comment

#61 - Missing datasets

Issue - State: closed - Opened by thigm85 almost 3 years ago - 2 comments

#60 - Error in `beir/beir/retrieval/search/sparse/sparse_search.py`

Issue - State: open - Opened by jin530 almost 3 years ago - 1 comment

#59 - Question about ideal architecture for deep IR

Issue - State: open - Opened by pablogranolabar almost 3 years ago

#58 - Unsupported Elastic Search distribution on BEIR.ipynb

Issue - State: open - Opened by thigm85 almost 3 years ago - 5 comments

#57 - No Quora & CQADupstack in leaderboard?

Issue - State: open - Opened by Muennighoff almost 3 years ago - 2 comments

#56 - Providing BM25 top-100 for all datasets

Issue - State: closed - Opened by davidmrau almost 3 years ago - 1 comment

#55 - 250 queries for Robust04?

Issue - State: closed - Opened by Muennighoff almost 3 years ago

#54 - Rerank scores lower than vanilla dense IR?

Issue - State: open - Opened by pablogranolabar almost 3 years ago - 8 comments

#53 - BaseException with rerank - 'dict' object has no attribute 'strip'

Issue - State: closed - Opened by pablogranolabar almost 3 years ago

#52 - Another metric with the same name already exists.

Issue - State: closed - Opened by pritamdeka about 3 years ago - 2 comments

#51 - Training a T5 model

Issue - State: open - Opened by pritamdeka about 3 years ago - 3 comments

#50 - Leaderboard results of USE

Issue - State: closed - Opened by ikuyamada about 3 years ago - 4 comments

#49 - UnsupportedProductError: The client noticed that the server is not a supported distribution of Elasticsearch

Issue - State: closed - Opened by Muennighoff about 3 years ago

#48 - Merging latest main branch to development

Pull Request - State: closed - Opened by thakur-nandan about 3 years ago

#47 - create qrel.tsv file

Issue - State: closed - Opened by xiangpku about 3 years ago - 2 comments

#46 - Fixed how to start Anserini docker and HTTPS request error

Pull Request - State: open - Opened by ArthurCamara about 3 years ago

#45 - Error in accuracy function

Issue - State: closed - Opened by wolhandlerdeb about 3 years ago - 1 comment

#36 - Training data for NQ?

Issue - State: open - Opened by ReyonRen over 3 years ago - 6 comments

#15 - Storing document embeddings index

Issue - State: closed - Opened by svakulenk0 over 3 years ago - 7 comments

GitHub / beir-cellar/beir issues and pull requests