An open API service for providing issue and pull request metadata for open source projects.

GitHub / withcatai/node-llama-cpp issues and pull requests

#154 - fix: release config

Pull Request - State: closed - Opened by giladgd over 1 year ago - 2 comments
Labels: released, released on @beta

#153 - feat: manual binding loading

Pull Request - State: closed - Opened by giladgd over 1 year ago - 2 comments
Labels: released, released on @beta

#152 - Bun support

Issue - State: closed - Opened by mnlttt over 1 year ago - 1 comment
Labels: bug, invalid

#151 - ESM support?

Issue - State: closed - Opened by jacoblee93 over 1 year ago - 3 comments
Labels: new feature

#150 - fix: build Metal by default for Apple silicone devices

Pull Request - State: closed - Opened by giladgd over 1 year ago - 2 comments
Labels: released, released on @beta

#149 - feat(minor): add more flags to the `chat` command

Pull Request - State: closed - Opened by giladgd over 1 year ago - 2 comments
Labels: released, released on @beta

#148 - Revert "feat(minor): add more flags to the `chat` command"

Pull Request - State: closed - Opened by giladgd over 1 year ago

#147 - feat(minor): add more flags to the `chat` command

Pull Request - State: closed - Opened by giladgd over 1 year ago - 2 comments
Labels: released

#146 - CLI does not work with Bun

Issue - State: closed - Opened by drschwabe over 1 year ago - 1 comment
Labels: bug, invalid

#145 - feat(minor): add `--batchSize` and `--promptFile` options to the `chat` CLI command

Pull Request - State: closed - Opened by stewartoallen over 1 year ago - 1 comment

#144 - feat: get embedding for text

Pull Request - State: closed - Opened by giladgd over 1 year ago - 2 comments
Labels: released, released on @beta

#143 - docs(README): update version 3 beta message

Pull Request - State: closed - Opened by giladgd over 1 year ago - 2 comments
Labels: released, released on @beta

#142 - feat: show `llama.cpp` release in GitHub releases

Pull Request - State: closed - Opened by giladgd over 1 year ago - 2 comments
Labels: released, released on @beta

#141 - Add llama.cpp build number as info

Issue - State: closed - Opened by nathanlesage over 1 year ago - 4 comments
Labels: new feature, released, released on @beta

#139 - feat: function calling

Pull Request - State: closed - Opened by giladgd over 1 year ago - 3 comments
Labels: released, released on @beta

#138 - feat(minor): add `--printTimings` option to the `chat` CLI command

Pull Request - State: closed - Opened by JonHolman over 1 year ago - 4 comments
Labels: released, released on @beta

#136 - Could not find a KV slot

Issue - State: closed - Opened by Zambonilli over 1 year ago - 6 comments
Labels: bug

#135 - Issue with Webpack Compilation

Issue - State: closed - Opened by nathanlesage over 1 year ago - 9 comments
Labels: bug, requires triage

#133 - feat: max GPU layers param

Issue - State: closed - Opened by quidmonkey over 1 year ago - 2 comments
Labels: new feature, released, roadmap, released on @beta

#132 - langchain.js - throws error "disposed undefined"

Issue - State: closed - Opened by mrddter over 1 year ago - 1 comment
Labels: bug, invalid

#131 - docs: fix code example

Pull Request - State: closed - Opened by scenaristeur over 1 year ago - 2 comments
Labels: released, released on @beta

#130 - docs: cannot read properties of undefined (reading '_chatGrammar') on penalty example

Issue - State: closed - Opened by scenaristeur over 1 year ago - 2 comments
Labels: documentation, released, released on @beta

#129 - Node exits when n_tokens <= n_batch

Issue - State: closed - Opened by platypii over 1 year ago - 1 comment
Labels: bug, roadmap

#128 - get embedding for text

Pull Request - State: closed - Opened by jlabrada71 over 1 year ago - 1 comment

#127 - fix: optional typescript peer dependency

Pull Request - State: closed - Opened by giladgd over 1 year ago - 2 comments
Labels: released, released on @beta

#125 - feat: reuse context for different chat session history

Issue - State: closed - Opened by sooraj007 over 1 year ago - 4 comments
Labels: new feature, roadmap

#124 - other people's gguf file can not run

Issue - State: closed - Opened by xuedaobian over 1 year ago - 2 comments
Labels: bug, unrelated

#123 - feat: get embedding for text

Issue - State: closed - Opened by giladgd over 1 year ago - 3 comments
Labels: new feature, released, roadmap, released on @beta

#122 - No CUDA toolset found Error even its Found CUDAToolkit

Issue - State: closed - Opened by sooraj007 over 1 year ago - 3 comments
Labels: bug, requires triage

#120 - Naming the `LlamaModel` anything but `model`makes the app crash when creating a new `LlamaContext`

Issue - State: closed - Opened by stduhpf over 1 year ago - 1 comment
Labels: bug, requires triage

#119 - feat: minP support

Issue - State: closed - Opened by stduhpf over 1 year ago - 2 comments
Labels: new feature, released, roadmap, released on @beta

#117 - fix: adapt to breaking changes of `llama.cpp`

Pull Request - State: closed - Opened by giladgd over 1 year ago - 2 comments
Labels: released, released on @beta

#114 - bug: model parameter `threads` doesn't work

Issue - State: closed - Opened by pafik13 over 1 year ago - 5 comments
Labels: bug, good first issue, released, released on @beta

#113 - node-llama-cpp doesn`t work with typescript

Issue - State: closed - Opened by eugene-kirnasuk over 1 year ago - 3 comments
Labels: bug, released, released on @beta

#110 - docs(README): add v3.0 beta

Pull Request - State: closed - Opened by giladgd over 1 year ago - 2 comments
Labels: released, released on @beta

#108 - docs: Update documentation on metal support via NODE_LLAMA_CPP_METAL env

Pull Request - State: closed - Opened by timothycarambat over 1 year ago - 2 comments

#106 - feat: hide llama.cpp logs

Issue - State: closed - Opened by ExposedCat over 1 year ago - 3 comments
Labels: new feature, released, roadmap, released on @beta

#105 - feat: version 3.0

Pull Request - State: open - Opened by giladgd over 1 year ago - 19 comments

#104 - feat: automatic batching

Pull Request - State: closed - Opened by giladgd over 1 year ago - 4 comments
Labels: released, released on @beta

#103 - feat: Apply different LoRA dynamically

Issue - State: closed - Opened by snowyu over 1 year ago - 13 comments
Labels: new feature, released, released on @beta

#101 - feat: function calling support in a chat session's `prompt` function

Issue - State: closed - Opened by giladgd over 1 year ago - 3 comments
Labels: new feature, help wanted, released, roadmap, released on @beta

#100 - support commonjs

Issue - State: closed - Opened by mainfraame over 1 year ago - 6 comments
Labels: new feature

#99 - fix package.json to use module instead of main

Pull Request - State: closed - Opened by mainfraame over 1 year ago - 4 comments

#95 - `(node:23396) UnhandledPromiseRejectionWarning: Error: AbortError`

Issue - State: closed - Opened by jparismorgan over 1 year ago - 1 comment
Labels: question

#91 - feat: export `llama.cpp` release info

Pull Request - State: closed - Opened by giladgd over 1 year ago - 1 comment
Labels: released

#90 - docs(README): add roadmap links, improve `README.md`

Pull Request - State: closed - Opened by giladgd over 1 year ago - 1 comment
Labels: released

#89 - feat: `create-project` command to make it easier to bootstrap a new project

Issue - State: closed - Opened by giladgd over 1 year ago - 1 comment
Labels: new feature, roadmap

#88 - feat: pass an image as part of the evaluation

Issue - State: open - Opened by giladgd over 1 year ago - 11 comments
Labels: new feature, roadmap

#86 - feat: use multiple machines for evaluating large models that require a lot of RAM

Issue - State: open - Opened by giladgd over 1 year ago
Labels: new feature, roadmap

#85 - feat: automatic batching

Issue - State: closed - Opened by giladgd over 1 year ago - 9 comments
Labels: new feature, released, roadmap, released on @beta

#84 - Please add AMD ROCm support

Issue - State: closed - Opened by zxcvxzcv-johndoe over 1 year ago - 9 comments
Labels: new feature, help wanted, released, released on @beta

#80 - fix: bugs

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#79 - Not worlking as intended.

Issue - State: closed - Opened by arthurwolf almost 2 years ago - 3 comments
Labels: bug, released

#78 - CUDA compilation failing with VS 2022 Community

Issue - State: closed - Opened by ThomasVuillaume almost 2 years ago - 7 comments
Labels: bug, released, requires triage

#75 - A way to get the answer while it's generating.

Issue - State: closed - Opened by pierrbt almost 2 years ago - 1 comment
Labels: new feature, requires triage

#74 - Error building with Cuda

Issue - State: closed - Opened by TillWege almost 2 years ago - 1 comment
Labels: bug

#73 - docs(README): add social poster

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#71 - feat(minor): save and load history to `chat` command

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#70 - fix: `GeneralChatPromptWrapper` output

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#69 - fix: improve JSON schema validation error messages

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#68 - feat: add JSON schema grammar support

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#66 - fix: improve CUDA compilation

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#65 - fix: add documentation to Google Search

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#64 - fix: git bundle info for build

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#63 - docs(README): add changelog link

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#62 - feat: new documentation website

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#61 - feat: git release bundle

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#60 - feat: adapt to `llama.cpp` changes, repeat penalty, improved grammar

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#59 - ggml_allocr_alloc: not enough space in the buffer

Issue - State: closed - Opened by Pixelycia almost 2 years ago - 8 comments
Labels: bug

#58 - Error [ERR_REQUIRE_ESM]: require() of ES Module

Issue - State: closed - Opened by gbourgeat almost 2 years ago - 5 comments
Labels: bug, released

#57 - Set repeat-penalty request

Issue - State: closed - Opened by v4lentin1879 almost 2 years ago - 1 comment
Labels: new feature, released

#55 - fix: make disabling metal on build work

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#54 - feat: fall back to build from source if prebuilt binary loading fails

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#53 - feat: add `FalconChatPromptWrapper`

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#52 - docs: improve CUDA documentation

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#51 - feat: load conversation history into a `LlamaChatSession`

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#50 - feat: only build one binary for all node versions

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#49 - fix: adapt to `llama.cpp` interface change

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#48 - docs: fix typo in CONTRIBUTING.md

Pull Request - State: closed - Opened by ido-pluto almost 2 years ago - 1 comment
Labels: released

#47 - ci: run workflows also on PRs from forked repos

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment

#44 - fix: cmake compile args error

Pull Request - State: closed - Opened by cmeka almost 2 years ago - 2 comments

#43 - fix: cmake compile args error

Pull Request - State: closed - Opened by cmeka almost 2 years ago - 1 comment

#42 - docs: improve contributing docs

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#41 - Llama2 Template Error

Issue - State: closed - Opened by saul-jb almost 2 years ago - 2 comments
Labels: bug, requires triage

#40 - Error when compiling with CUDA on Windows

Issue - State: closed - Opened by BennyH26 almost 2 years ago - 4 comments
Labels: bug, help wanted

#39 - Add method for dumping context and loading it.

Issue - State: closed - Opened by saul-jb almost 2 years ago - 2 comments
Labels: new feature, released, requires triage

#37 - feat: use `cmake` instead of `node-gyp`

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#36 - OMG Thank you

Issue - State: closed - Opened by koolamusic almost 2 years ago
Labels: new feature, requires triage

#35 - fix: load image urls properly also outside GitHub

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#34 - docs(README): improve `README.md` formatting and add images

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#33 - feat: `threads` count setting on a model

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#32 - fix: handle stop words remainder properly in a chat session

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#31 - fix: move default to the last in package.json

Pull Request - State: closed - Opened by itsuka-dev almost 2 years ago - 2 comments
Labels: released

#30 - Module not found: Default condition should be last one

Issue - State: closed - Opened by itsuka-dev almost 2 years ago - 1 comment
Labels: bug, released, requires triage

#29 - feat: export class options types

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#28 - feat: make contributions and support more efficient via GitHub templates

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#27 - feat: improve error message when `llama.cpp` source is not downloaded

Pull Request - State: closed - Opened by giladgd almost 2 years ago - 1 comment
Labels: released

#25 - Failed to fetch llama.cpp release info RequestError [HttpError]: Not Found

Issue - State: closed - Opened by loretoparisi almost 2 years ago - 2 comments

#24 - Error node-llama-cpp build

Issue - State: closed - Opened by loretoparisi almost 2 years ago - 2 comments