withcatai/node-llama-cpp issues and pull requests

#480 - feat: smollm3 support

Issue - State: closed - Opened by Fi1osof 19 days ago - 2 comments
Labels: new feature

#479 - feat: builtin ROCm support

Issue - State: open - Opened by ExposedCat 29 days ago - 1 comment
Labels: new feature, help wanted

#478 - feat: Gemma 3n support

Issue - State: open - Opened by ketansp about 1 month ago - 2 comments
Labels: new feature

#477 - feat: support sycl gpu on windows

Issue - State: open - Opened by makejiang about 1 month ago - 2 comments
Labels: new feature

#476 - bug: init: embeddings required but some input tokens were not marked as outputs -> overriding

Issue - State: closed - Opened by markg85 about 1 month ago - 3 comments
Labels: bug, requires triage

#475 - feat: Use responsePrefix to start the model's reasoning

Issue - State: closed - Opened by tomwetherell about 2 months ago - 1 comment
Labels: new feature, requires triage

#473 - test: fix a test

Pull Request - State: closed - Opened by giladgd about 2 months ago - 1 comment
Labels: released

#472 - feat(JSON Schema Grammar): `$defs` and `$ref` support with full inferred types

Pull Request - State: closed - Opened by giladgd about 2 months ago - 1 comment
Labels: released

#471 - bug: tool call sometimes not parsed correctly?

Issue - State: closed - Opened by Ricki-BumbleDev about 2 months ago - 4 comments
Labels: bug, good first issue, released

#469 - feat: support for launching HTTP service

Issue - State: closed - Opened by mushan0x0 about 2 months ago - 1 comment
Labels: new feature, requires triage

#468 - feat: reasoning budget

Pull Request - State: closed - Opened by giladgd about 2 months ago - 1 comment
Labels: released

#466 - fix: Allow importing when using a SEA binary

Pull Request - State: closed - Opened by Thomas101 2 months ago - 2 comments

#465 - feat: Export getLlamaForOptions

Pull Request - State: closed - Opened by Thomas101 2 months ago - 2 comments

#463 - fix(`getLlamaGpuTypes`): edge case

Pull Request - State: closed - Opened by giladgd 2 months ago

#461 - feat: model fine-tuning

Issue - State: open - Opened by giladgd 3 months ago
Labels: new feature, roadmap

#460 - feat: stream function call parameters

Pull Request - State: open - Opened by giladgd 3 months ago

#459 - npx --no node-llama-cpp source download --release latest don't work now

Issue - State: closed - Opened by webstatic 3 months ago - 2 comments
Labels: bug, released

#456 - Support Qwen3

Issue - State: closed - Opened by ckvv 3 months ago - 6 comments
Labels: new feature, released

#454 - Build failed on Linux with Cuda 12.8

Issue - State: closed - Opened by ruochenjia 3 months ago - 5 comments
Labels: bug

#452 - Example Electron app to chat with models using a UI does not work

Issue - State: closed - Opened by davayd 4 months ago - 3 comments
Labels: documentation, released

#450 - CUDA error

Issue - State: closed - Opened by neverl805 4 months ago - 2 comments
Labels: documentation, requires triage

#447 - can not get the same result for `createGrammarForJsonSchema`

Issue - State: closed - Opened by snowyu 4 months ago - 2 comments
Labels: bug, requires triage

#446 - feat: initial TTS support

Issue - State: open - Opened by giladgd 4 months ago
Labels: new feature, roadmap

#445 - The output quality is severely degraded compared to the original llama.cpp

Issue - State: closed - Opened by snowyu 4 months ago - 2 comments
Labels: bug, requires triage

#444 - feat: extract function calling syntax from a Jinja template

Pull Request - State: closed - Opened by giladgd 4 months ago - 1 comment
Labels: released

#443 - error with chalk dependency

Issue - State: closed - Opened by vvaibhavv11 4 months ago - 2 comments
Labels: bug, requires triage

#442 - docs: fix electron command

Pull Request - State: closed - Opened by yhg8423 5 months ago - 1 comment
Labels: released

#440 - feat: Gemma 3 Support

Issue - State: closed - Opened by yhg8423 5 months ago - 10 comments
Labels: new feature, released, roadmap

#439 - "Module not found" error on Mac Mini

Issue - State: closed - Opened by neoalvin 5 months ago
Labels: bug, requires triage

#435 - Limit default context size in the node template

Issue - State: closed - Opened by CrossPr0duct 5 months ago - 5 comments
Labels: bug, released

#432 - docs: fix cover images

Pull Request - State: closed - Opened by giladgd 5 months ago - 1 comment
Labels: released

#430 - fix: uncaught exception

Pull Request - State: closed - Opened by giladgd 5 months ago - 1 comment
Labels: released

#428 - feat: DeepSeek R1 support

Pull Request - State: closed - Opened by giladgd 5 months ago - 1 comment
Labels: released

#425 - chore: update modules

Pull Request - State: closed - Opened by giladgd 6 months ago - 1 comment
Labels: released

#424 - fix: adapt to `llama.cpp` breaking changes

Pull Request - State: closed - Opened by giladgd 6 months ago - 1 comment
Labels: released

#423 - Unable to run on GPU with latest version

Issue - State: closed - Opened by vlamanna 6 months ago - 2 comments
Labels: bug, released

#421 - feat: shorter model URIs

Pull Request - State: closed - Opened by giladgd 6 months ago - 1 comment
Labels: released

#420 - fix: metadata string encoding

Pull Request - State: closed - Opened by giladgd 6 months ago - 1 comment
Labels: released

#418 - Naive parsing lead to incorrect UTF-8 character recognition in GGUF metadata

Issue - State: closed - Opened by pqnet 6 months ago - 3 comments
Labels: bug, released

#417 - Top-level await leads to ERR_REQUIRE_ASYNC_MODULE

Issue - State: closed - Opened by art1c0 6 months ago - 1 comment
Labels: new feature

#415 - fix: ranking empty inputs

Pull Request - State: closed - Opened by giladgd 7 months ago - 1 comment
Labels: released

#412 - fix: reranking probabilities

Pull Request - State: closed - Opened by giladgd 7 months ago - 1 comment
Labels: released

#411 - chore: update modules

Pull Request - State: closed - Opened by giladgd 7 months ago - 1 comment
Labels: released

#407 - Update AddonSampler.cpp

Pull Request - State: closed - Opened by anonyein 7 months ago - 1 comment

#406 - Update AddonGrammar.cpp

Pull Request - State: closed - Opened by anonyein 7 months ago - 1 comment

#405 - feat: token prediction (speculative decoding)

Pull Request - State: closed - Opened by giladgd 7 months ago - 1 comment
Labels: released

#404 - illegal hardware instruction | installation

Issue - State: closed - Opened by salacoste 7 months ago - 3 comments
Labels: bug