rustformers/llm issues and pull requests

#456 - Question: GPU support

Issue - State: open - Opened by toastxc 6 months ago

#455 - Not enough space in the context's memory pool

Issue - State: open - Opened by thecodechemist99 7 months ago

#454 - build: fix `nix build`

Pull Request - State: closed - Opened by tensor5 7 months ago - 1 comment

#453 - Out of context answers

Issue - State: open - Opened by DravidVaishnav 8 months ago

#452 - Include bytes of model in program?

Issue - State: open - Opened by Lamby777 8 months ago - 1 comment

#451 - Sub reddit is down

Issue - State: open - Opened by Gamithon 9 months ago - 2 comments

#451 - Sub reddit is down

Issue - State: open - Opened by Gamithon 9 months ago - 1 comment

#451 - Sub reddit is down

Issue - State: open - Opened by Gamithon 9 months ago - 1 comment

#450 - Currently in dev any inference is broken

Issue - State: open - Opened by gadLinux 9 months ago - 2 comments

#449 - When using tokio and HuggingFaceRemote it breaks dropping the runtime

Issue - State: open - Opened by gadLinux 9 months ago - 1 comment

#448 - Build fails: error: no such file or directory: 'ggml/src/ggml.c'

Issue - State: open - Opened by yurivict 10 months ago

#447 - Behavior when missing quantization version

Issue - State: open - Opened by Reichenbachian 11 months ago - 1 comment

#446 - EOS is not read from gguf format

Issue - State: open - Opened by Alisa-lisa 11 months ago - 1 comment

#445 - Support Separate Loading of Vocabulary or Tensors

Issue - State: open - Opened by skirodev 11 months ago

#444 - Fix embedded tokenizer

Pull Request - State: closed - Opened by skirodev 11 months ago - 2 comments

#443 - fix &'static lifetime warning

Pull Request - State: closed - Opened by JRazek 11 months ago - 1 comment

#442 - Develop

Pull Request - State: closed - Opened by philpax 12 months ago

#442 - Develop

Pull Request - State: open - Opened by philpax 12 months ago

#441 - chore: update rustix 0.38

Pull Request - State: closed - Opened by philpax 12 months ago

#440 - Update to llm-samplers v0.0.7

Pull Request - State: closed - Opened by KerfuffleV2 12 months ago - 5 comments

#439 - Why is the feed_prompt process so slow?

Issue - State: open - Opened by zackshen 12 months ago - 3 comments

#439 - Why is the feed_prompt process so slow?

Issue - State: open - Opened by zackshen 12 months ago - 5 comments

#438 - Fix snapshot serialization/deserialization: rename logits to last_logits

Pull Request - State: closed - Opened by lucksus 12 months ago

#437 - Reduce dependencies

Issue - State: open - Opened by philpax about 1 year ago
Labels: issue:enhancement, meta:maintenance

#436 - Disable tokenizers-remote support for the library by default

Issue - State: open - Opened by philpax about 1 year ago - 1 comment
Labels: issue:enhancement, meta:breaking-change

#434 - Support for Mistral-7b

Issue - State: open - Opened by ranaya-formant about 1 year ago - 5 comments
Labels: issue:enhancement, topic:model-support

#434 - Support for Mistral-7b

Issue - State: open - Opened by ranaya-formant about 1 year ago - 5 comments
Labels: issue:enhancement, topic:model-support

#434 - Support for Mistral-7b

Issue - State: open - Opened by ranaya-formant about 1 year ago - 5 comments
Labels: issue:enhancement, topic:model-support

#433 - How to disable ggml logging?

Issue - State: open - Opened by mrwilby about 1 year ago - 1 comment

#433 - How to disable ggml logging?

Issue - State: open - Opened by mrwilby about 1 year ago - 1 comment

#433 - How to disable ggml logging?

Issue - State: open - Opened by mrwilby about 1 year ago - 1 comment

#433 - How to disable ggml logging?

Issue - State: open - Opened by mrwilby about 1 year ago - 1 comment

#432 - Fix rewind crash

Pull Request - State: closed - Opened by olexiyb about 1 year ago

#432 - Fix rewind crash

Pull Request - State: closed - Opened by olexiyb about 1 year ago

#432 - Fix rewind crash

Pull Request - State: closed - Opened by olexiyb about 1 year ago

#432 - Fix rewind crash

Pull Request - State: closed - Opened by olexiyb about 1 year ago

#431 - Clarify MSRV policy

Issue - State: open - Opened by chris-ha458 about 1 year ago - 2 comments

#431 - Clarify MSRV policy

Issue - State: open - Opened by chris-ha458 about 1 year ago - 2 comments

#431 - Clarify MSRV policy

Issue - State: open - Opened by chris-ha458 about 1 year ago - 2 comments

#431 - Clarify MSRV policy

Issue - State: open - Opened by chris-ha458 about 1 year ago - 2 comments

#430 - Fix typo in README.md

Pull Request - State: closed - Opened by najielhachem about 1 year ago - 1 comment

#429 - few unwrap removes

Pull Request - State: closed - Opened by chris-ha458 about 1 year ago - 1 comment

#428 - Build against newer GGML version

Pull Request - State: closed - Opened by LLukas22 about 1 year ago - 8 comments

#427 - How do I use Huggingface tokenization to use a model on Huggingace in MODEL_PATH instead of my local machine?

Issue - State: open - Opened by alfellati about 1 year ago - 1 comment

#426 - Fix build on macos m1

Pull Request - State: closed - Opened by olexiyb about 1 year ago - 1 comment

#425 - Add "context swap" functions to session and add "decoded_tokens" to snapshot read/write

Pull Request - State: closed - Opened by Andreybest about 1 year ago

#424 - Add "context swap" functions to session and add "decoded_tokens" to snapshot read/write

Pull Request - State: closed - Opened by Andreybest about 1 year ago - 1 comment

#423 - Medusa Speculative Decoding

Issue - State: open - Opened by someone13574 about 1 year ago - 1 comment

#422 - SIGTRAP triggered on MacOS

Issue - State: open - Opened by jafioti about 1 year ago - 2 comments

#420 - Default String for ConfiguredSamplers

Issue - State: open - Opened by JuliaMerz about 1 year ago - 1 comment

#419 - Add Default GPU Split and Runtime Configuration

Pull Request - State: closed - Opened by jacohend about 1 year ago

#418 - NaN logits on LLaMA 65B when using 2k+ token contexts

Issue - State: open - Opened by hugoabonizio about 1 year ago

#417 - WizardCoder llama assert failure

Issue - State: open - Opened by jacohend about 1 year ago - 3 comments

#417 - WizardCoder llama assert failure

Issue - State: open - Opened by jacohend about 1 year ago - 3 comments

#417 - WizardCoder llama assert failure

Issue - State: open - Opened by jacohend about 1 year ago - 3 comments

#416 - Rust 1.72 fixes

Pull Request - State: closed - Opened by philpax about 1 year ago

#416 - Rust 1.72 fixes

Pull Request - State: closed - Opened by philpax about 1 year ago

#416 - Rust 1.72 fixes

Pull Request - State: closed - Opened by philpax about 1 year ago

#416 - Rust 1.72 fixes

Pull Request - State: closed - Opened by philpax about 1 year ago

#415 - AMD ROCm support with HIPBLAS

Issue - State: open - Opened by xangelix about 1 year ago - 2 comments

#415 - AMD ROCm support with HIPBLAS

Issue - State: open - Opened by xangelix about 1 year ago - 2 comments

#415 - AMD ROCm support with HIPBLAS

Issue - State: open - Opened by xangelix about 1 year ago - 1 comment

#415 - AMD ROCm support with HIPBLAS

Issue - State: open - Opened by xangelix about 1 year ago - 1 comment

#415 - AMD ROCm support with HIPBLAS

Issue - State: open - Opened by xangelix about 1 year ago - 1 comment

#414 - Api Server Example

Issue - State: open - Opened by e253 about 1 year ago

#414 - Api Server Example

Issue - State: open - Opened by e253 about 1 year ago - 5 comments

#414 - Api Server Example

Issue - State: open - Opened by e253 about 1 year ago

#414 - Api Server Example

Issue - State: open - Opened by e253 about 1 year ago

#414 - Api Server Example

Issue - State: open - Opened by e253 about 1 year ago

#414 - Api Server Example

Issue - State: open - Opened by e253 about 1 year ago