GitHub / utilityai/llama-cpp-rs issues and pull requests
#772 - Are there plans to support the CANN backend?
Issue -
State: open - Opened by Ryaningli 16 days ago
#771 - chore(deps): bump clap from 4.5.40 to 4.5.41
Pull Request -
State: closed - Opened by dependabot[bot] 17 days ago
Labels: rust, dependencies
#770 - Bumped version to 0.1.112
Pull Request -
State: closed - Opened by github-actions[bot] 21 days ago
#769 - Bumped version to 0.1.111
Pull Request -
State: closed - Opened by github-actions[bot] 21 days ago
#768 - Bumped version to 0.1.110
Pull Request -
State: closed - Opened by github-actions[bot] 22 days ago
#767 - build.rs: workaround for windows/vulkan filetracker errors
Pull Request -
State: closed - Opened by AsbjornOlling 23 days ago
#766 - #765 (Fixed): Include `llama.cpp` Vendored Libraries in Builds
Pull Request -
State: closed - Opened by caer 23 days ago
- 3 comments
#765 - publish failing
Issue -
State: closed - Opened by MarcusDunn 23 days ago
Labels: help wanted
#764 - chore(deps): bump cc from 1.2.27 to 1.2.29
Pull Request -
State: closed - Opened by dependabot[bot] 24 days ago
Labels: rust, dependencies
#763 - Add swa_full
Pull Request -
State: closed - Opened by yujonglee 25 days ago
- 1 comment
#762 - decode: cannot decode batches with this context (calling encode() instead)
Issue -
State: open - Opened by jiabochao about 1 month ago
- 1 comment
Labels: help wanted, β question
#761 - chore(deps): bump docker/setup-buildx-action from 3.10.0 to 3.11.1
Pull Request -
State: closed - Opened by dependabot[bot] about 1 month ago
Labels: dependencies, github_actions
#760 - feat(logging): optimize log handling by early level filtering
Pull Request -
State: closed - Opened by DAIMENGEN about 1 month ago
#759 - fix(build): update CUDA linking strategy for Windows.
Pull Request -
State: closed - Opened by DAIMENGEN about 1 month ago
- 2 comments
#758 - Make LlamaSampler::grammar() return an Option
Pull Request -
State: closed - Opened by MatthewCash about 1 month ago
#757 - fix(build): update CUDA linking strategy for Windows.
Pull Request -
State: closed - Opened by DAIMENGEN about 1 month ago
- 5 comments
#756 - fix(build): update CUDA linking strategy for WindowsοΌDeletedοΌ
Pull Request -
State: closed - Opened by DAIMENGEN about 1 month ago
#755 - Bump llamacpp b5686 vulkan CI
Pull Request -
State: closed - Opened by AsbjornOlling about 1 month ago
- 1 comment
#754 - Bump llama.cpp to b5686, fix build failures
Pull Request -
State: closed - Opened by AsbjornOlling about 1 month ago
- 6 comments
#753 - chore(deps): bump enumflags2 from 0.7.11 to 0.7.12
Pull Request -
State: closed - Opened by dependabot[bot] about 2 months ago
Labels: rust, dependencies
#752 - chore(deps): bump clap from 4.5.39 to 4.5.40
Pull Request -
State: closed - Opened by dependabot[bot] about 2 months ago
Labels: rust, dependencies
#751 - chore(deps): bump cc from 1.2.26 to 1.2.27
Pull Request -
State: closed - Opened by dependabot[bot] about 2 months ago
Labels: rust, dependencies
#750 - chore(deps): bump tracing-core from 0.1.33 to 0.1.34
Pull Request -
State: closed - Opened by dependabot[bot] about 2 months ago
Labels: rust, dependencies
#749 - chore(deps): bump cc from 1.2.25 to 1.2.26
Pull Request -
State: closed - Opened by dependabot[bot] about 2 months ago
Labels: rust, dependencies
#748 - Bumped version to 0.1.109
Pull Request -
State: closed - Opened by github-actions[bot] about 2 months ago
#747 - Fails to build for x86_64-linux w/ Vulkan backend.
Issue -
State: open - Opened by AsbjornOlling about 2 months ago
- 2 comments
#746 - chore(deps): bump cc from 1.2.24 to 1.2.25
Pull Request -
State: closed - Opened by dependabot[bot] about 2 months ago
Labels: rust, dependencies
#745 - chore(deps): bump clap from 4.5.38 to 4.5.39
Pull Request -
State: closed - Opened by dependabot[bot] about 2 months ago
Labels: rust, dependencies
#744 - Multimodal support (`libmtmd`)
Issue -
State: open - Opened by fellhorn 2 months ago
- 1 comment
#743 - Fix: GCC Target Mismatch for `vdotq_s32` on AArch64 (Apple M1, M2, etc)
Pull Request -
State: closed - Opened by russellwmy 2 months ago
- 2 comments
#742 - Bumped version to 0.1.108
Pull Request -
State: closed - Opened by github-actions[bot] 2 months ago
#741 - chore(deps): bump cc from 1.2.23 to 1.2.24
Pull Request -
State: closed - Opened by dependabot[bot] 2 months ago
Labels: rust, dependencies
#740 - Resolve build errors: update/remove kv cache APIs, disable building tools, latest release & upstream org ref
Pull Request -
State: closed - Opened by brittlewis12 2 months ago
- 1 comment
#739 - compile error for `update-llama-cpp-2025-05-21` branch
Issue -
State: open - Opened by yujonglee 2 months ago
- 1 comment
#738 - chore(deps): bump cc from 1.2.22 to 1.2.23
Pull Request -
State: closed - Opened by dependabot[bot] 2 months ago
Labels: rust, dependencies
#737 - Fix MacOS 15 build
Pull Request -
State: closed - Opened by windoze 2 months ago
#736 - chore(deps): bump cc from 1.2.21 to 1.2.22
Pull Request -
State: closed - Opened by dependabot[bot] 3 months ago
Labels: rust, dependencies
#735 - chore(deps): bump clap from 4.5.37 to 4.5.38
Pull Request -
State: closed - Opened by dependabot[bot] 3 months ago
Labels: rust, dependencies
#734 - it run good
Issue -
State: closed - Opened by werruww 3 months ago
#733 - how?
Issue -
State: closed - Opened by werruww 3 months ago
- 7 comments
#732 - Bumped version to 0.1.107
Pull Request -
State: closed - Opened by github-actions[bot] 3 months ago
#731 - error when loading model
Issue -
State: closed - Opened by jiabochao 3 months ago
- 2 comments
#730 - Bumped version to 0.1.106
Pull Request -
State: closed - Opened by github-actions[bot] 3 months ago
#729 - Bumped version to 0.1.105
Pull Request -
State: closed - Opened by github-actions[bot] 3 months ago
#728 - Bumped version to 0.1.104
Pull Request -
State: closed - Opened by github-actions[bot] 3 months ago
#727 - The versions released on crates.io and GitHub tags are inconsistent, which may cause confusion.
Issue -
State: closed - Opened by jiabochao 3 months ago
- 2 comments
#726 - Bumped version to 0.1.104
Pull Request -
State: closed - Opened by github-actions[bot] 3 months ago
#725 - Plans to support AMD
Issue -
State: closed - Opened by ljt019 3 months ago
- 1 comment
#724 - Fix common/minja missing in cargo publish
Pull Request -
State: closed - Opened by fellhorn 3 months ago
#723 - Add llama backend init to the doc tests that depend on it
Pull Request -
State: closed - Opened by AsbjornOlling 3 months ago
#722 - A few test-build.Dockerfile fixes
Pull Request -
State: closed - Opened by AsbjornOlling 3 months ago
#721 - Bump llama.cpp, disable CURL
Pull Request -
State: closed - Opened by AsbjornOlling 3 months ago
- 6 comments
#720 - Update llama.cpp submodule to b5225
Pull Request -
State: closed - Opened by fellhorn 3 months ago
- 4 comments
#719 - Support `qwen3` model architecture
Issue -
State: closed - Opened by vlad-ivanov-name 3 months ago
- 5 comments
#718 - example to build aarch64-linux-android
Issue -
State: open - Opened by aesthetic-factory 3 months ago
- 5 comments
Labels: π build
#717 - chore(deps): bump cc from 1.2.19 to 1.2.20
Pull Request -
State: closed - Opened by dependabot[bot] 3 months ago
Labels: rust, dependencies
#716 - chore(deps): bump clap from 4.5.36 to 4.5.37
Pull Request -
State: open - Opened by dependabot[bot] 3 months ago
Labels: rust, dependencies
#715 - Logging forwarding unconditionally sends logs to subscriber without checking if enabled
Issue -
State: closed - Opened by torkleyy 3 months ago
- 2 comments
Labels: π bug, help wanted, lib
#714 - LlamaBatch::get_one returns 'static ownership to borrowed data
Issue -
State: open - Opened by torkleyy 3 months ago
Labels: π bug, help wanted, lib
#713 - Linux docker build failed on Apple M2 pro
Issue -
State: closed - Opened by anidotnet 3 months ago
- 2 comments
#712 - Fails to copy build-info.cpp on windows
Issue -
State: open - Opened by torkleyy 3 months ago
- 2 comments
Labels: πͺ windows, help wanted, π build
#711 - chore(deps): bump clap from 4.5.35 to 4.5.36
Pull Request -
State: closed - Opened by dependabot[bot] 4 months ago
Labels: rust, dependencies
#710 - chore(deps): bump cc from 1.2.18 to 1.2.19
Pull Request -
State: closed - Opened by dependabot[bot] 4 months ago
Labels: rust, dependencies
#709 - chore(deps): bump anyhow from 1.0.97 to 1.0.98
Pull Request -
State: open - Opened by dependabot[bot] 4 months ago
Labels: rust, dependencies
#708 - Recommended way to handle thinking model templates
Issue -
State: open - Opened by ljt019 4 months ago
- 1 comment
#707 - Gemma 3 Support
Issue -
State: closed - Opened by ljt019 4 months ago
- 1 comment
#706 - Add llama-grammar.h for bindgen
Pull Request -
State: closed - Opened by yujonglee 4 months ago
- 1 comment
#705 - chore(deps): bump cc from 1.2.17 to 1.2.18
Pull Request -
State: closed - Opened by dependabot[bot] 4 months ago
Labels: rust, dependencies
#704 - chore(deps): bump clap from 4.5.34 to 4.5.35
Pull Request -
State: closed - Opened by dependabot[bot] 4 months ago
Labels: rust, dependencies
#703 - chore(deps): bump openssl from 0.10.70 to 0.10.72
Pull Request -
State: closed - Opened by dependabot[bot] 4 months ago
Labels: rust, dependencies
#702 - chore(deps): bump clap from 4.5.32 to 4.5.34
Pull Request -
State: closed - Opened by dependabot[bot] 4 months ago
Labels: rust, dependencies
#701 - LLGuidance support with feature flag
Issue -
State: open - Opened by yujonglee 4 months ago
- 1 comment
Labels: πͺ enhancement, help wanted, π build
#700 - Expose string metadata fetching methods
Pull Request -
State: closed - Opened by AsbjornOlling 4 months ago
- 2 comments
#699 - Reimplement get_chat_template to use `llama_model_chat_template`
Pull Request -
State: closed - Opened by AsbjornOlling 4 months ago
- 4 comments
#698 - chore(deps): bump cc from 1.2.16 to 1.2.17
Pull Request -
State: closed - Opened by dependabot[bot] 4 months ago
Labels: rust, dependencies
#697 - chore(deps): bump clap from 4.5.31 to 4.5.32
Pull Request -
State: closed - Opened by dependabot[bot] 5 months ago
Labels: rust, dependencies
#696 - chore(deps): bump ring from 0.17.8 to 0.17.13
Pull Request -
State: closed - Opened by dependabot[bot] 5 months ago
Labels: rust, dependencies
#695 - how to bundle the llama-cpp in binary
Issue -
State: closed - Opened by vvaibhavv11 5 months ago
- 3 comments
Labels: π waiting on response
#694 - error: could not find native static library `culibos`
Issue -
State: closed - Opened by xutianyi1999 5 months ago
- 4 comments
Labels: πͺ windows, π build
#693 - chore(deps): bump anyhow from 1.0.96 to 1.0.97
Pull Request -
State: closed - Opened by dependabot[bot] 5 months ago
Labels: rust, dependencies
#692 - chore(deps): bump cc from 1.2.15 to 1.2.16
Pull Request -
State: closed - Opened by dependabot[bot] 5 months ago
Labels: rust, dependencies
#691 - chore(deps): bump docker/setup-buildx-action from 3.9.0 to 3.10.0
Pull Request -
State: closed - Opened by dependabot[bot] 5 months ago
Labels: dependencies, github_actions
#690 - chore(deps): bump docker/setup-qemu-action from 3.4.0 to 3.6.0
Pull Request -
State: closed - Opened by dependabot[bot] 5 months ago
Labels: dependencies, github_actions
#689 - Expose n_head_kv
Pull Request -
State: closed - Opened by vlovich 5 months ago
#688 - Fix build.rs: copy build_info_src into build_info_target
Pull Request -
State: closed - Opened by AsbjornOlling 5 months ago
#687 - Fix to check if events should be recorded in tracing
Pull Request -
State: closed - Opened by kusaanko 5 months ago
- 2 comments
#686 - thinking model stop only on thinking
Issue -
State: closed - Opened by vvaibhavv11 5 months ago
- 2 comments
#685 - Bumped version to 0.1.103
Pull Request -
State: closed - Opened by github-actions[bot] 5 months ago
#684 - Bumped version to 0.1.102
Pull Request -
State: closed - Opened by github-actions[bot] 5 months ago
#683 - Use CString::new instead of CString::from_str to init chat template
Pull Request -
State: closed - Opened by AsbjornOlling 5 months ago
- 2 comments
#682 - Explicitly apply optimization flags to msvc compiler also on other profiles than debug
Pull Request -
State: closed - Opened by AsbjornOlling 5 months ago
#681 - Bumped version to 0.1.101
Pull Request -
State: closed - Opened by github-actions[bot] 5 months ago
#680 - Bumped version to 0.1.100
Pull Request -
State: closed - Opened by github-actions[bot] 5 months ago
#679 - chore(deps): bump clap from 4.5.29 to 4.5.31
Pull Request -
State: closed - Opened by dependabot[bot] 5 months ago
Labels: rust, dependencies
#678 - Create LISENCE
Pull Request -
State: closed - Opened by MarcusDunn 5 months ago
#677 - Make LogOptions public
Pull Request -
State: closed - Opened by kusaanko 5 months ago
- 2 comments
#676 - Repository is missing a license
Issue -
State: closed - Opened by rileysu 5 months ago
- 1 comment
#675 - chore(deps): bump cc from 1.2.14 to 1.2.15
Pull Request -
State: closed - Opened by dependabot[bot] 5 months ago
Labels: rust, dependencies
#674 - chore(deps): bump anyhow from 1.0.95 to 1.0.96
Pull Request -
State: closed - Opened by dependabot[bot] 5 months ago
Labels: rust, dependencies
#673 - chore(deps): bump clap from 4.5.29 to 4.5.30
Pull Request -
State: closed - Opened by dependabot[bot] 5 months ago
- 1 comment
Labels: rust, dependencies