michaelfeil/infinity issues and pull requests

#105 - fix: cli start

Pull Request - State: closed - Opened by michaelfeil 7 months ago

#105 - fix: cli start

Pull Request - State: closed - Opened by michaelfeil 7 months ago

#104 - Deps free

Pull Request - State: closed - Opened by michaelfeil 7 months ago - 1 comment

#103 - ct2 bump

Pull Request - State: closed - Opened by michaelfeil 7 months ago - 1 comment

#103 - ct2 bump

Pull Request - State: closed - Opened by michaelfeil 7 months ago - 1 comment

#102 - add engine args similar to vllm

Pull Request - State: closed - Opened by michaelfeil 7 months ago - 1 comment

#101 - pydantic-v1-backwards-fixes

Pull Request - State: closed - Opened by michaelfeil 7 months ago

#100 - pydantic upgrade

Pull Request - State: closed - Opened by michaelfeil 7 months ago - 2 comments

#100 - pydantic upgrade

Pull Request - State: closed - Opened by michaelfeil 7 months ago - 2 comments

#99 - update poetry version + cache in ci

Pull Request - State: closed - Opened by michaelfeil 7 months ago - 1 comment

#98 - 422 error if /embeddings input is a string

Issue - State: closed - Opened by OlegIvaniv 7 months ago - 3 comments

#98 - 422 error if /embeddings input is a string

Issue - State: closed - Opened by OlegIvaniv 7 months ago - 3 comments

#97 - Torch dynamic shapes

Pull Request - State: closed - Opened by michaelfeil 7 months ago

#96 - Update dependencies

Pull Request - State: closed - Opened by NirantK 7 months ago - 3 comments

#95 - AWQ-Bert / 4-bit Bert

Issue - State: open - Opened by michaelfeil 7 months ago - 2 comments
Labels: enhancement, help wanted

#94 - AMD ROCm docker images support (+ optimization)

Issue - State: open - Opened by michaelfeil 8 months ago - 10 comments
Labels: help wanted

#93 - Update tensorrt, onnxruntime, cuda base

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#92 - Return actual token count on forward pass

Issue - State: closed - Opened by michaelfeil 8 months ago - 2 comments
Labels: good first issue

#92 - Return actual token count on forward pass

Issue - State: closed - Opened by michaelfeil 8 months ago - 2 comments
Labels: good first issue

#91 - Update README.md contribution guidelines

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#88 - How is long text handled?

Issue - State: closed - Opened by YanDavKMS 8 months ago

#87 - Adding max token budget per batch

Issue - State: open - Opened by michaelfeil 8 months ago

#86 - starting to deprecated fastembed and ctranslate2

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#85 - unexpected keyword argument 'trust_remote_code'

Issue - State: closed - Opened by BSVogler 8 months ago - 3 comments

#84 - adding revision

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#83 - Update Dockerfile to python 3.11 + CI fix

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#82 - support for `revision`

Issue - State: closed - Opened by michaelfeil 8 months ago - 1 comment
Labels: help wanted

#81 - support hf_transfer

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#81 - support hf_transfer

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#80 - update torch 2.2+cu121

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#80 - update torch 2.2+cu121

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#79 - update dstack support

Pull Request - State: closed - Opened by deep-diver 8 months ago - 1 comment

#78 - rename device name

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#76 - bump sentence-transformers

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#76 - bump sentence-transformers

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#75 - update dockerfile and tensorrt

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#75 - update dockerfile and tensorrt

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#74 - improvements optimum

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#74 - improvements optimum

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#73 - update docker

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#72 - update optimum_utils

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#71 - Arm poetry lock

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#70 - bum 0.0.18

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#70 - bum 0.0.18

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#69 - Revert "Add optimum[onnx]"

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#69 - Revert "Add optimum[onnx]"

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#68 - Add optimum[onnx]

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#68 - Add optimum[onnx]

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#66 - Launch via Dstack

Issue - State: closed - Opened by michaelfeil 8 months ago - 1 comment
Labels: documentation, help wanted, good first issue

#64 - Idea: add a parameter to configure number of decimals in JSON output

Issue - State: open - Opened by lasttero 8 months ago - 3 comments
Labels: enhancement

#64 - Idea: add a parameter to configure number of decimals in JSON output

Issue - State: open - Opened by lasttero 8 months ago - 3 comments
Labels: enhancement

#63 - Update README.md

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#63 - Update README.md

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#62 - Support e5-mistral-7b-instruct

Issue - State: closed - Opened by yuhon0528 8 months ago - 11 comments
Labels: new model

#61 - Update README.md

Pull Request - State: closed - Opened by michaelfeil 8 months ago

#60 - Update to self-built sentence_transformers 2.2.3

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#60 - Update to self-built sentence_transformers 2.2.3

Pull Request - State: closed - Opened by michaelfeil 8 months ago - 1 comment

#59 - support mps backend.

Pull Request - State: closed - Opened by ninehills 8 months ago - 4 comments

#58 - Support for Optimum Inference?

Issue - State: closed - Opened by jens-ghc 8 months ago - 13 comments
Labels: help wanted

#57 - Refactor batching to os.fork / multiprocessing

Pull Request - State: open - Opened by michaelfeil 9 months ago

#56 - Refactor: async usage in BatchHandler

Pull Request - State: open - Opened by michaelfeil 9 months ago - 1 comment

#55 - Support Apple Metal

Issue - State: closed - Opened by michaelfeil 9 months ago - 4 comments

#55 - Support Apple Metal

Issue - State: closed - Opened by michaelfeil 9 months ago - 4 comments

#54 - update dockerfile and tests

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#54 - update dockerfile and tests

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#53 - fixing delayed warmup and expose capabilities

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#53 - fixing delayed warmup and expose capabilities

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#52 - Linting and better model errors

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#52 - Linting and better model errors

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#51 - adding tests and better typing

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#50 - Add rerank

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#50 - Add rerank

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#49 - fix-fp16

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#48 - update-ci-and-readme

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#47 - make fp16 default and add bettertransformer

Pull Request - State: closed - Opened by michaelfeil 9 months ago

#47 - make fp16 default and add bettertransformer

Pull Request - State: closed - Opened by michaelfeil 9 months ago

#46 - Make `cuda` fp16 the default.

Issue - State: closed - Opened by michaelfeil 9 months ago

#46 - Make `cuda` fp16 the default.

Issue - State: closed - Opened by michaelfeil 9 months ago

#45 - Add `bettertransformer` and `flash` to rerank and predict

Issue - State: closed - Opened by michaelfeil 9 months ago

#44 - add classification pipeline

Pull Request - State: closed - Opened by michaelfeil 9 months ago

#44 - add classification pipeline

Pull Request - State: closed - Opened by michaelfeil 9 months ago

#43 - Refactoring of API + initial support for ReRank.

Pull Request - State: closed - Opened by michaelfeil 9 months ago - 1 comment

#42 - setting the pooling strategy - supported models?

Issue - State: closed - Opened by arbi-dev 10 months ago - 3 comments

#42 - setting the pooling strategy - supported models?

Issue - State: closed - Opened by arbi-dev 10 months ago - 3 comments

#41 - Setup Auth Access?

Issue - State: closed - Opened by bendangelo 10 months ago - 6 comments

#40 - make return the usage

Pull Request - State: closed - Opened by michaelfeil 10 months ago - 1 comment

#40 - make return the usage

Pull Request - State: closed - Opened by michaelfeil 10 months ago - 1 comment

#39 - add the device feature

Pull Request - State: closed - Opened by michaelfeil 10 months ago - 1 comment

#39 - add the device feature

Pull Request - State: closed - Opened by michaelfeil 10 months ago - 1 comment

#38 - Update README.md

Pull Request - State: closed - Opened by BrianPulfer 10 months ago - 4 comments

#37 - Update README.md

Pull Request - State: closed - Opened by BrianPulfer 10 months ago - 1 comment

#36 - OpenAI compatible server embeddings endpoint not accepting list[str]

Issue - State: closed - Opened by saatvikshah 10 months ago - 11 comments

#36 - OpenAI compatible server embeddings endpoint not accepting list[str]

Issue - State: closed - Opened by saatvikshah 10 months ago - 11 comments

#35 - Cross-encoder rerank support

Issue - State: closed - Opened by michaelfeil 10 months ago - 1 comment

#35 - Cross-encoder rerank support

Issue - State: closed - Opened by michaelfeil 10 months ago - 1 comment

#34 - support embedding with "instructions"

Issue - State: closed - Opened by arbi-dev 10 months ago - 9 comments

#33 - Docker: Cuda11.8, make dependencies optional

Pull Request - State: closed - Opened by michaelfeil 11 months ago - 1 comment

#32 - add python api

Pull Request - State: closed - Opened by michaelfeil 11 months ago - 1 comment

#31 - Async Python interface

Issue - State: closed - Opened by michaelfeil 11 months ago

#30 - ONNX: fastembed on GPU

Issue - State: closed - Opened by michaelfeil 11 months ago

GitHub / michaelfeil/infinity issues and pull requests