Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / embeddings-benchmark/mteb issues and pull requests

#1697 - fix: update model loader to trust remote code

Pull Request - State: closed - Opened by isaac-chung about 1 month ago

#1697 - fix: update model loader to trust remote code

Pull Request - State: closed - Opened by isaac-chung about 1 month ago

#1696 - openbmb/MiniCPM-Embedding still fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1696 - openbmb/MiniCPM-Embedding still fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1695 - fix: add trust_remote_code to Snowflake/snowflake-arctic-embed-m-long

Pull Request - State: closed - Opened by Muennighoff about 1 month ago

#1695 - fix: add trust_remote_code to Snowflake/snowflake-arctic-embed-m-long

Pull Request - State: closed - Opened by Muennighoff about 1 month ago

#1694 - BUCC fails

Issue - State: open - Opened by Muennighoff about 1 month ago - 4 comments

#1693 - Lajavaness/bilingual-embedding-large fails due to trust_remote_code

Issue - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1693 - Lajavaness/bilingual-embedding-large fails due to trust_remote_code

Issue - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1692 - fix: add revision for jinaai/jina-embeddings-v2-small-en

Pull Request - State: closed - Opened by Samoed about 1 month ago

#1692 - fix: add revision for jinaai/jina-embeddings-v2-small-en

Pull Request - State: closed - Opened by Samoed about 1 month ago

#1691 - fix: arg name for openbmb/MiniCPM-Embedding

Pull Request - State: closed - Opened by Samoed about 1 month ago - 2 comments

#1691 - fix: arg name for openbmb/MiniCPM-Embedding

Pull Request - State: closed - Opened by Samoed about 1 month ago - 2 comments

#1690 - Unittests to check model loading?

Issue - State: closed - Opened by Muennighoff about 1 month ago - 4 comments

#1690 - Unittests to check model loading?

Issue - State: closed - Opened by Muennighoff about 1 month ago - 4 comments

#1689 - jinaai/jina-embeddings-v2-small-en fails

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1689 - jinaai/jina-embeddings-v2-small-en fails

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1688 - openbmb/MiniCPM-Embedding fails

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1688 - openbmb/MiniCPM-Embedding fails

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1687 - fix: NanoBeir

Pull Request - State: closed - Opened by Samoed about 1 month ago

#1687 - fix: NanoBeir

Pull Request - State: closed - Opened by Samoed about 1 month ago

#1686 - [mieb] SketchyI2IRetrieval hangs in the beginning

Issue - State: open - Opened by Muennighoff about 1 month ago - 2 comments
Labels: modality: image

#1686 - [mieb] SketchyI2IRetrieval hangs in the beginning

Issue - State: open - Opened by Muennighoff about 1 month ago - 2 comments
Labels: modality: image

#1685 - fix: nomic prompts

Pull Request - State: closed - Opened by Samoed about 1 month ago - 4 comments

#1684 - feat: Add nomic modern bert

Pull Request - State: closed - Opened by Samoed about 1 month ago - 5 comments

#1684 - feat: Add nomic modern bert

Pull Request - State: open - Opened by Samoed about 1 month ago - 4 comments

#1683 - fix: nomic tensor return

Pull Request - State: closed - Opened by Samoed about 1 month ago

#1683 - fix: nomic tensor return

Pull Request - State: closed - Opened by Samoed about 1 month ago

#1682 - fix: trust remote code for snowflake-arctic-embed-m-v2.0

Pull Request - State: closed - Opened by Muennighoff about 1 month ago - 3 comments

#1682 - fix: trust remote code for snowflake-arctic-embed-m-v2.0

Pull Request - State: closed - Opened by Muennighoff about 1 month ago - 3 comments

#1681 - voyage fails

Issue - State: open - Opened by Muennighoff about 1 month ago - 2 comments

#1681 - voyage fails

Issue - State: open - Opened by Muennighoff about 1 month ago - 2 comments

#1680 - nomic-ai/nomic-embed-text-v1.5 fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 2 comments

#1680 - nomic-ai/nomic-embed-text-v1.5 fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 2 comments

#1679 - LLM2Vec fails

Issue - State: open - Opened by Muennighoff about 1 month ago

#1679 - LLM2Vec fails

Issue - State: open - Opened by Muennighoff about 1 month ago

#1678 - fix: Add warning for non-retrieval tasks when using bm25s

Pull Request - State: closed - Opened by isaac-chung about 1 month ago

#1678 - fix: Add warning for non-retrieval tasks when using bm25s

Pull Request - State: closed - Opened by isaac-chung about 1 month ago

#1677 - feat: add `avsolatorio/NoInstruct-small-Embedding-v0`

Pull Request - State: closed - Opened by Samoed about 1 month ago

#1677 - feat: add `avsolatorio/NoInstruct-small-Embedding-v0`

Pull Request - State: closed - Opened by Samoed about 1 month ago

#1676 - fix: allow kwargs in init for RerankingWrapper

Pull Request - State: closed - Opened by Samoed about 1 month ago - 2 comments

#1676 - fix: allow kwargs in init for RerankingWrapper

Pull Request - State: closed - Opened by Samoed about 1 month ago - 2 comments

#1675 - fix: add check for key error in loader

Pull Request - State: closed - Opened by Samoed about 1 month ago - 1 comment

#1675 - fix: add check for key error in loader

Pull Request - State: closed - Opened by Samoed about 1 month ago - 1 comment

#1674 - fix: Update BUCC dataset revision

Pull Request - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1674 - fix: Update BUCC dataset revision

Pull Request - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1673 - BUCC fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 2 comments

#1673 - BUCC fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 2 comments

#1672 - SwedishSentimentClassification fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 5 comments

#1672 - SwedishSentimentClassification fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 5 comments

#1671 - Reranker models do not work with cli

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1671 - Reranker models do not work with cli

Issue - State: open - Opened by Muennighoff about 1 month ago

#1670 - fix: Updated metadata for CPM

Pull Request - State: closed - Opened by KennethEnevoldsen about 1 month ago

#1669 - fix: Pass trust_remote_code=True to CPM model

Pull Request - State: closed - Opened by KennethEnevoldsen about 1 month ago - 1 comment

#1668 - fix: Use batch size kwargs for openai APIs

Pull Request - State: closed - Opened by KennethEnevoldsen about 1 month ago

#1667 - fix: Cast all Model2Vec outputs as floats

Pull Request - State: closed - Opened by isaac-chung about 1 month ago

#1667 - fix: Cast all Model2Vec outputs as floats

Pull Request - State: closed - Opened by isaac-chung about 1 month ago

#1666 - fix: remove model as a parameter for MulticlassClassification

Pull Request - State: closed - Opened by Samoed about 1 month ago - 2 comments

#1666 - fix: remove model as a parameter for MulticlassClassification

Pull Request - State: closed - Opened by Samoed about 1 month ago - 2 comments

#1665 - fix: Use prompts instead of prompt names for voyage

Pull Request - State: closed - Opened by Samoed about 1 month ago

#1665 - fix: Use prompts instead of prompt names for voyage

Pull Request - State: closed - Opened by Samoed about 1 month ago

#1664 - UrduRomanSentimentClassification fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1664 - UrduRomanSentimentClassification fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1663 - JSTS seems to rely on outdated datasets version leading to failure

Issue - State: closed - Opened by Muennighoff about 1 month ago - 2 comments

#1663 - JSTS seems to rely on outdated datasets version leading to failure

Issue - State: closed - Opened by Muennighoff about 1 month ago - 2 comments

#1662 - minishlab/potion-base-2M and minishlab/M2V_base_output fail

Issue - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1662 - minishlab/potion-base-2M and minishlab/M2V_base_output fail

Issue - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1661 - BeastyZ/e5-R-mistral-7b fails

Issue - State: open - Opened by Muennighoff about 1 month ago - 1 comment

#1661 - BeastyZ/e5-R-mistral-7b fails

Issue - State: open - Opened by Muennighoff about 1 month ago - 1 comment

#1660 - consciousAI/cai-stellaris-text-embeddings fails

Issue - State: open - Opened by Muennighoff about 1 month ago - 1 comment

#1660 - consciousAI/cai-stellaris-text-embeddings fails

Issue - State: open - Opened by Muennighoff about 1 month ago - 1 comment

#1659 - openbmb/MiniCPM-Embedding fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1658 - Hum-Works/lodestone-base-4096-v1 fails

Issue - State: open - Opened by Muennighoff about 1 month ago - 1 comment

#1657 - HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 fails

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1657 - HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 fails

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1656 - avsolatorio/NoInstruct-small-Embedding-v0 fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 2 comments

#1656 - avsolatorio/NoInstruct-small-Embedding-v0 fails

Issue - State: closed - Opened by Muennighoff about 1 month ago - 2 comments

#1655 - zeta-alpha-ai/Zeta-Alpha-E5-Mistral cannot be loaded

Issue - State: open - Opened by Muennighoff about 1 month ago - 4 comments

#1655 - zeta-alpha-ai/Zeta-Alpha-E5-Mistral cannot be loaded

Issue - State: closed - Opened by Muennighoff about 1 month ago - 4 comments

#1652 - voyageai/voyage-3 fails on RuBQReranking

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1652 - voyageai/voyage-3 fails on RuBQReranking

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1651 - cli does not allow passing trust_remote_code=True to get_model

Issue - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1651 - cli does not allow passing trust_remote_code=True to get_model

Issue - State: closed - Opened by Muennighoff about 1 month ago - 1 comment

#1650 - openai/text-embedding-3-large fails on sts22

Issue - State: open - Opened by Muennighoff about 1 month ago - 3 comments

#1649 - error when running voyageai/voyage-3-lite on DBPedia

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1649 - error when running voyageai/voyage-3-lite on DBPedia

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1648 - [mieb] Use mock abstask classes

Pull Request - State: closed - Opened by isaac-chung about 1 month ago

#1648 - [mieb] Use mock abstask classes

Pull Request - State: closed - Opened by isaac-chung about 1 month ago

#1647 - error when runing e5_v in mieb

Issue - State: open - Opened by afalf about 1 month ago - 3 comments
Labels: bug, modality: image

#1647 - error when runing e5_v in mieb

Issue - State: closed - Opened by afalf about 1 month ago - 7 comments
Labels: bug, mieb

#1646 - bm25s KeyError

Issue - State: closed - Opened by Muennighoff about 1 month ago - 6 comments

#1646 - bm25s KeyError

Issue - State: closed - Opened by Muennighoff about 1 month ago - 6 comments

#1645 - OpenAI API batch size

Issue - State: closed - Opened by Muennighoff about 1 month ago

#1644 - fix: Register MicroLlama Text Embedding

Pull Request - State: closed - Opened by keeeeenw about 1 month ago

#1643 - fix: Update gritlm kwargs

Pull Request - State: closed - Opened by Muennighoff about 1 month ago

#1642 - Fix output_folder for co2 evaluation

Pull Request - State: closed - Opened by Muennighoff about 1 month ago - 2 comments