Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / edgenai/llama_cpp-rs issues and pull requests

#94 - Fix typo in `tokenize_bytes` doc comment

Pull Request - State: open - Opened by smoelius 7 days ago

#92 - Issues with Gemma 2b v1.1, all quants.

Issue - State: open - Opened by cooperll 6 months ago

#91 - Bump llama.cpp to version b3038

Pull Request - State: open - Opened by vargad 6 months ago

#90 - Building with latest version of llama.cpp

Issue - State: open - Opened by cooperll 6 months ago - 3 comments

#89 - Add support for building with mingw

Issue - State: open - Opened by jeberger 6 months ago

#88 - bump llama.cpp version to the latest

Pull Request - State: open - Opened by zh217 6 months ago

#86 - How to see logs from across FFI boundary?

Issue - State: closed - Opened by hazelnutcloud 7 months ago

#85 - What's the difference between `set_context` and `advance_context`?

Issue - State: closed - Opened by hazelnutcloud 7 months ago - 2 comments

#84 - wrong sentence from LlamaModel [bos, eos, nl]

Issue - State: closed - Opened by GIOVANNI-75 7 months ago

#83 - bump crate versions

Pull Request - State: closed - Opened by pedro-devv 7 months ago

#83 - bump crate versions

Pull Request - State: closed - Opened by pedro-devv 7 months ago

#81 - Build failed with CUDA feature enabled

Issue - State: closed - Opened by isikkema 7 months ago - 6 comments

#80 - enable tokio's rt-multi-thread feature

Pull Request - State: closed - Opened by pedro-devv 7 months ago

#80 - enable tokio's rt-multi-thread feature

Pull Request - State: closed - Opened by pedro-devv 7 months ago

#79 - Metal build fix

Pull Request - State: closed - Opened by benpoulson 7 months ago

#79 - Metal build fix

Pull Request - State: closed - Opened by benpoulson 7 months ago

#77 - n_tokens_all <= cparams.n_batch

Issue - State: open - Opened by ElhamAryanpur 7 months ago - 2 comments

#75 - Metal build is broken

Issue - State: closed - Opened by ri-nat 7 months ago - 7 comments

#75 - Metal build is broken

Issue - State: closed - Opened by ri-nat 7 months ago - 7 comments

#74 - Wrong token infered

Issue - State: closed - Opened by glcraft 7 months ago - 4 comments

#74 - Wrong token infered

Issue - State: closed - Opened by glcraft 7 months ago - 4 comments

#73 - adjusted session size prediction, fixed embeddings

Pull Request - State: closed - Opened by pedro-devv 7 months ago

#73 - adjusted session size prediction, fixed embeddings

Pull Request - State: closed - Opened by pedro-devv 7 months ago

#72 - Fix/cuda compilation

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#72 - Fix/cuda compilation

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#71 - Fix/compilation issues

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#71 - Fix/compilation issues

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#70 - llama_cpp_sys build issue: u8 vs i8 in APIs

Issue - State: closed - Opened by anisse 8 months ago - 3 comments

#70 - llama_cpp_sys build issue: u8 vs i8 in APIs

Issue - State: closed - Opened by anisse 8 months ago - 3 comments

#69 - Fix/thread safety

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#69 - Fix/thread safety

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#68 - updated build.rs

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#68 - updated build.rs

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#67 - added sys_verbosity feature

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#67 - added sys_verbosity feature

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#66 - Feat/embed session estimate

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#66 - Feat/embed session estimate

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#65 - Fix bugs when truncating/setting context

Pull Request - State: closed - Opened by nkoppel 8 months ago

#65 - Fix bugs when truncating/setting context

Pull Request - State: closed - Opened by nkoppel 8 months ago

#64 - parking_lot

Issue - State: open - Opened by pedro-devv 8 months ago
Labels: enhancement

#64 - parking_lot

Issue - State: open - Opened by pedro-devv 8 months ago
Labels: enhancement

#63 - Sync vs Async

Issue - State: open - Opened by pedro-devv 8 months ago
Labels: documentation, enhancement

#63 - Sync vs Async

Issue - State: open - Opened by pedro-devv 8 months ago
Labels: documentation, enhancement

#62 - updated lib docs and README.md

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#62 - updated lib docs and README.md

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#61 - Add Custom SamplerStage

Pull Request - State: open - Opened by nkoppel 8 months ago

#61 - Add Custom SamplerStage

Pull Request - State: open - Opened by nkoppel 8 months ago

#60 - Fix #53; replace beam search with greedy sampling

Pull Request - State: closed - Opened by nkoppel 8 months ago

#60 - Fix #53; replace beam search with greedy sampling

Pull Request - State: closed - Opened by nkoppel 8 months ago

#59 - Feat/allocation prediction

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#59 - Feat/allocation prediction

Pull Request - State: closed - Opened by pedro-devv 8 months ago

#58 - Utilize AMD GPUs

Pull Request - State: closed - Opened by masmullin2000 8 months ago - 3 comments

#58 - Utilize AMD GPUs

Pull Request - State: closed - Opened by masmullin2000 8 months ago - 3 comments

#57 - Sampler Expansion - GBNF Grammar

Pull Request - State: closed - Opened by ianmarmour 8 months ago - 1 comment

#57 - Sampler Expansion - GBNF Grammar

Pull Request - State: closed - Opened by ianmarmour 8 months ago - 1 comment

#56 - Add remove_tokens_in_range method

Pull Request - State: closed - Opened by nkoppel 9 months ago

#56 - Add remove_tokens_in_range method

Pull Request - State: closed - Opened by nkoppel 9 months ago

#55 - Update submodules

Pull Request - State: closed - Opened by pedro-devv 9 months ago

#55 - Update submodules

Pull Request - State: closed - Opened by pedro-devv 9 months ago

#54 - Sampler Expansion - GBNF Grammar

Issue - State: closed - Opened by ianmarmour 9 months ago - 4 comments
Labels: enhancement

#54 - Sampler Expansion - GBNF Grammar

Issue - State: closed - Opened by ianmarmour 9 months ago - 4 comments
Labels: enhancement

#53 - 'block_on' loops infinitely after a certain number of calls when used in an async context

Issue - State: closed - Opened by nkoppel 9 months ago - 3 comments
Labels: bug

#53 - 'block_on' loops infinitely after a certain number of calls when used in an async context

Issue - State: closed - Opened by nkoppel 9 months ago - 3 comments
Labels: bug

#52 - handle large embedding inputs

Pull Request - State: closed - Opened by pedro-devv 9 months ago

#52 - handle large embedding inputs

Pull Request - State: closed - Opened by pedro-devv 9 months ago

#52 - handle large embedding inputs

Pull Request - State: closed - Opened by pedro-devv 9 months ago

#51 - inference is painfully slow

Issue - State: closed - Opened by bruceunx 9 months ago - 3 comments
Labels: unconfirmed bug

#51 - inference is painfully slow

Issue - State: closed - Opened by bruceunx 9 months ago - 3 comments
Labels: unconfirmed bug

#50 - Create a more modular sampler API

Pull Request - State: closed - Opened by nkoppel 9 months ago - 1 comment

#50 - Create a more modular sampler API

Pull Request - State: closed - Opened by nkoppel 9 months ago - 1 comment

#49 - Clean package

Pull Request - State: closed - Opened by pedro-devv 9 months ago

#49 - Clean package

Pull Request - State: closed - Opened by pedro-devv 9 months ago

#48 - release: llama_cpp v0.3.1

Pull Request - State: closed - Opened by github-actions[bot] 9 months ago

#48 - release: llama_cpp v0.3.1

Pull Request - State: closed - Opened by github-actions[bot] 9 months ago

#47 - release: llama_cpp_sys v0.3.2

Pull Request - State: closed - Opened by github-actions[bot] 9 months ago

#47 - release: llama_cpp_sys v0.3.2

Pull Request - State: closed - Opened by github-actions[bot] 9 months ago

#46 - release: llama_cpp v0.3.1

Pull Request - State: closed - Opened by github-actions[bot] 9 months ago

#46 - release: llama_cpp v0.3.1

Pull Request - State: closed - Opened by github-actions[bot] 9 months ago

#45 - release: llama_cpp_sys v0.3.1

Pull Request - State: closed - Opened by github-actions[bot] 9 months ago

#45 - release: llama_cpp_sys v0.3.1

Pull Request - State: closed - Opened by github-actions[bot] 9 months ago

#44 - Updated examples

Pull Request - State: closed - Opened by pedro-devv 9 months ago

#44 - Updated examples

Pull Request - State: closed - Opened by pedro-devv 9 months ago

#43 - canot println!("{}", String::from_utf8_lossy(&*next_token.detokenize()));

Issue - State: closed - Opened by bruceunx 9 months ago - 1 comment

#43 - canot println!("{}", String::from_utf8_lossy(&*next_token.detokenize()));

Issue - State: closed - Opened by bruceunx 9 months ago - 1 comment

#42 - Remove RwLock from LlamaModel

Pull Request - State: closed - Opened by nkoppel 9 months ago

#42 - Remove RwLock from LlamaModel

Pull Request - State: closed - Opened by nkoppel 9 months ago

#41 - LLamaModel::decode_tokens hanging up

Issue - State: closed - Opened by pedro-devv 9 months ago - 2 comments
Labels: bug

#41 - LLamaModel::decode_tokens hanging up

Issue - State: closed - Opened by pedro-devv 9 months ago - 2 comments
Labels: bug

#40 - Add support for embedding metal support directly via static linking.

Pull Request - State: closed - Opened by ianmarmour 9 months ago - 2 comments

#40 - Add support for embedding metal support directly via static linking.

Pull Request - State: closed - Opened by ianmarmour 9 months ago - 2 comments

#39 - Metal Support Broken

Issue - State: closed - Opened by ianmarmour 9 months ago - 1 comment

#39 - Metal Support Broken

Issue - State: closed - Opened by ianmarmour 9 months ago - 1 comment

#38 - Sampler expansion

Issue - State: closed - Opened by pedro-devv 9 months ago
Labels: enhancement