SciSharp/LLamaSharp issues and pull requests

#618 - Unable to use lora in llamasharp but can use it in llama.cpp

Issue - State: open - Opened by pugafran 7 months ago - 8 comments
Labels: question

#617 - [LLamaSharp.Backend.Cuda12 v0.10.0] Unable to load the model onto multiple GPUs

Issue - State: closed - Opened by ChengYen-Tang 7 months ago - 3 comments
Labels: question

#616 - Segmentation fault on Docker

Issue - State: open - Opened by faibistes 7 months ago - 2 comments
Labels: bug

#615 - [LLama.KernelMemory] Fixed System.ArgumentException: EmbeddingMode must be true & #617

Pull Request - State: closed - Opened by ChengYen-Tang 7 months ago - 2 comments
Labels: bug

#614 - SemanticKernel ChatCompletion is Stateless

Issue - State: open - Opened by kidkych 7 months ago - 5 comments
Labels: feature request, discussion

#613 - `BatchedExecutor.Create()` method

Pull Request - State: closed - Opened by martindevans 7 months ago

#612 - Update Semantic Kernel & Kernel Memory Package

Pull Request - State: closed - Opened by xbotter 7 months ago - 4 comments

#611 - about NVidia GPU use example

Issue - State: open - Opened by CrazyJson 7 months ago - 7 comments
Labels: question

#610 - how to prevent the llama from completing requests

Issue - State: closed - Opened by K1tiK4 7 months ago - 1 comment

#609 - Feature: Llava executor

Pull Request - State: closed - Opened by SignalRT 7 months ago - 3 comments
Labels: enhancement, break change, llava

#608 - Godot game engine example

Issue - State: open - Opened by adammikulis 7 months ago - 25 comments
Labels: help wanted, question

#607 - LLava Test Slowdown

Pull Request - State: closed - Opened by martindevans 7 months ago - 4 comments
Labels: llava, ci/cd

#606 - Fatal error. System.Runtime.InteropServices.SEHException

Issue - State: closed - Opened by K1tiK4 7 months ago - 32 comments
Labels: bug

#605 - Build CUDA with AVX

Issue - State: open - Opened by martindevans 7 months ago - 2 comments
Labels: enhancement, distribution, backend, discussion

#604 - docs: update the example in readme.

Pull Request - State: closed - Opened by AsakusaRinne 7 months ago

#603 - `SetDllImportResolver` based loading

Pull Request - State: closed - Opened by martindevans 7 months ago - 11 comments
Labels: enhancement, backend

#602 - build: add llama.cpp as submodule.

Pull Request - State: closed - Opened by AsakusaRinne 7 months ago - 13 comments

#601 - Drastic CUDA compute speed drop in last version

Issue - State: closed - Opened by zsogitbe 7 months ago - 13 comments
Labels: question

#600 - Consider adding Windows on ARM build of llama.dll to LLamaSharp.Backend.Cpu

Issue - State: open - Opened by david-nordvall 7 months ago - 7 comments
Labels: feature request, backend

#599 - Examples don't run with CUDA12

Issue - State: open - Opened by EtienneT 7 months ago - 17 comments
Labels: bug

#598 - Not able to read fields from appsetings.json

Issue - State: open - Opened by Ibrahim21310 7 months ago - 4 comments

#597 - Llama.web app published into iis windows 64bit server, after deployment model values not loaded from appsettings

Issue - State: open - Opened by pxramesh 7 months ago - 4 comments

#596 - Thread Safety in llama.cpp

Issue - State: open - Opened by martindevans 7 months ago - 1 comment
Labels: Upstream

#595 - llama_decode lock

Pull Request - State: closed - Opened by martindevans 7 months ago

#594 - fix: incorrect loading of native library with multiple backends

Pull Request - State: closed - Opened by AsakusaRinne 7 months ago - 9 comments
Labels: bug, break change, backend

#593 - Added conditional compilation code to progress_callback (in LlamaModelParams struct)

Pull Request - State: closed - Opened by clovisribeiro 7 months ago - 1 comment

#592 - build(deps): bump Microsoft.KernelMemory.Abstractions from 0.26.240104.1 to 0.32.240307.1

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago - 1 comment
Labels: dependencies

#591 - build(deps): bump Microsoft.SemanticKernel.Abstractions from 1.4.0 to 1.5.0

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago - 5 comments
Labels: dependencies

#590 - build(deps): bump Microsoft.KernelMemory.Core and Microsoft.KernelMemory.Abstractions

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago - 1 comment
Labels: dependencies

#589 - Nuget references both CPU and CUDA simultaneously

Issue - State: closed - Opened by xuzeyu91 7 months ago - 2 comments

#588 - Cuda is not used when multiple backend packages are installed

Issue - State: closed - Opened by AsakusaRinne 7 months ago - 1 comment
Labels: bug

#587 - update readme.md backends

Pull Request - State: closed - Opened by warquys 7 months ago - 2 comments
Labels: documentation

#586 - Mutable Logits

Pull Request - State: closed - Opened by martindevans 7 months ago

#585 - Cannot add a user message after another user message (Parameter message

Issue - State: open - Opened by xuzeyu91 7 months ago - 9 comments
Labels: bug

#584 - Streaming output does not support StreamingChatMessage Content

Issue - State: closed - Opened by xuzeyu91 7 months ago - 3 comments
Labels: bug

#583 - Separating and Streamlining llama/llava binaries Suggestion

Issue - State: open - Opened by zsogitbe 7 months ago - 19 comments

#580 - [Kernel Memory] Integrate TextGenerationOptions to LLamaSharp.kernel-memory

Issue - State: open - Opened by AsakusaRinne 7 months ago
Labels: good first issue, feature request

#579 - Exception "EmbeddingMode must be true" after upgrading to v0.10.0

Issue - State: closed - Opened by LSXAxeller 8 months ago - 4 comments
Labels: question

#578 - Stateless executor doesn't work with LlamaSharp 0.10 & NET 8.0

Issue - State: open - Opened by pugafran 8 months ago - 6 comments
Labels: bug, question

#577 - Feature： Add llava support

Pull Request - State: closed - Opened by IntptrMax 8 months ago - 3 comments
Labels: enhancement, llava

#576 - Add llava support.

Pull Request - State: closed - Opened by IntptrMax 8 months ago

#575 - GPU Memory Leak test

Pull Request - State: closed - Opened by zsogitbe 8 months ago - 21 comments
Labels: bug, Upstream

#574 - build(deps): bump Microsoft.KernelMemory.Abstractions from 0.26.240104.1 to 0.30.240227.1

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#573 - build(deps): bump Microsoft.KernelMemory.Core and Microsoft.KernelMemory.Abstractions

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#572 - build(deps): bump Microsoft.SemanticKernel and Microsoft.SemanticKernel.Abstractions

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#571 - build(deps): bump System.Text.Json from 8.0.1 to 8.0.2

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#570 - build(deps): bump Microsoft.KernelMemory.Abstractions and System.Text.Json

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#569 - build(deps): bump Microsoft.SemanticKernel, Microsoft.SemanticKernel.Abstractions and System.Text.Json

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#568 - build(deps): bump Microsoft.SemanticKernel.Abstractions and System.Text.Json

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#567 - build(deps): bump Microsoft.KernelMemory.Core, System.Text.Json and Microsoft.KernelMemory.Abstractions

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#566 - Unable to load all-MiniLM-L6-v2-f16.gguf OR all-MiniLM-L6-v2-f16.bin

Issue - State: closed - Opened by SidAtBluB0X 8 months ago - 4 comments
Labels: Upstream, feature request

#565 - March Binary Update

Pull Request - State: closed - Opened by martindevans 8 months ago - 6 comments
Labels: backend

#563 - Llava api

Pull Request - State: closed - Opened by SignalRT 8 months ago - 18 comments
Labels: enhancement, break change, llava

#562 - How to accelerate running speed in CPU environment?

Issue - State: open - Opened by lmxin123 8 months ago - 19 comments
Labels: question

#561 - Fixed Publish File paths

Pull Request - State: closed - Opened by martindevans 8 months ago

#560 - Chat session state management

Pull Request - State: closed - Opened by eublefar 8 months ago - 11 comments
Labels: enhancement, break change

#559 - Switching ChatSessions without writing to file.

Issue - State: closed - Opened by eublefar 8 months ago - 3 comments

#558 - The document update is too old

Issue - State: closed - Opened by lmxin123 8 months ago - 2 comments
Labels: question

#556 - Build Llava binaries

Pull Request - State: closed - Opened by SignalRT 8 months ago - 3 comments

#555 - Multi modal

Pull Request - State: closed - Opened by SignalRT 8 months ago - 11 comments

#554 - Can't find verbose to set it to false.

Issue - State: closed - Opened by HikiWaltz 8 months ago - 9 comments
Labels: question, Upstream

#553 - Removed `llama_eval()`

Pull Request - State: closed - Opened by martindevans 8 months ago

#552 - Removed Obsolete SamplingApi

Pull Request - State: closed - Opened by martindevans 8 months ago

#551 - Memory Disposal Tests

Pull Request - State: closed - Opened by martindevans 8 months ago

#550 - Disposing/Releasing GPU memory

Pull Request - State: closed - Opened by zsogitbe 8 months ago - 12 comments

#549 - how to use tokenizer? I found this method in LLamaSharp Documentation 0.5 but can't find in this package code.

Issue - State: closed - Opened by happye 8 months ago

#548 - .NET WinForms: Setup project: Cannot find Dependencies for .NET 8/6

Issue - State: closed - Opened by SINAPSA-IC 8 months ago - 17 comments
Labels: help wanted

#547 - How to use embedding correctly

Issue - State: open - Opened by xuzeyu91 8 months ago - 4 comments

#546 - build(deps): bump Microsoft.KernelMemory.Core, System.Text.Json and Microsoft.KernelMemory.Abstractions

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#545 - build(deps): bump Microsoft.KernelMemory.Abstractions and System.Text.Json

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#544 - build(deps): bump Microsoft.SemanticKernel from 1.1.0 to 1.4.0

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#543 - Possibly useful for documentation: Article by us on Medium about building a Console App with .Net 8.0

Issue - State: open - Opened by SINAPSA-IC 8 months ago - 2 comments

#539 - Add Link To Blazor Demo

Pull Request - State: open - Opened by alexhiggins732 8 months ago

#538 - `ReadOnlySpan<float>` in ISamplingPipeline

Pull Request - State: closed - Opened by martindevans 8 months ago

#537 - ZLUDA Support

Issue - State: open - Opened by waylaa 8 months ago - 1 comment
Labels: Upstream

#536 - Classifier Free Guidance

Pull Request - State: closed - Opened by martindevans 8 months ago - 15 comments

#535 - Negative Prompt support - not found

Issue - State: closed - Opened by zsogitbe 8 months ago - 5 comments
Labels: enhancement

#534 - Used `AnsiConsole` in a few more places

Pull Request - State: closed - Opened by martindevans 8 months ago

#533 - Gemma Is Not Supported

Issue - State: closed - Opened by zddtpy 8 months ago - 8 comments
Labels: enhancement

#532 - LLamaSharp.Examples: Document Q&A with local storage

Pull Request - State: closed - Opened by swharden 8 months ago - 1 comment

#531 - LLamaLogLevel: ensure numbering matches llama.cpp

Issue - State: closed - Opened by swharden 8 months ago - 2 comments

#530 - GitHub: link to documentation page

Issue - State: closed - Opened by swharden 8 months ago - 1 comment

#529 - NativeLibraryConfig.WithLogs() overload to set log level

Pull Request - State: closed - Opened by swharden 8 months ago - 5 comments

#528 - Getting exception: "llama_decode failed: 'NoKvSlot'" when LLM analyze text (news)

Issue - State: closed - Opened by MagicMaxxx 8 months ago - 6 comments
Labels: question

#527 - LlamaSharp.Backend.MacMetal is broken

Issue - State: closed - Opened by vshapenko 8 months ago - 6 comments
Labels: bug

#526 - LLama.Examples: improve model path prompt

Pull Request - State: closed - Opened by swharden 8 months ago - 5 comments

#525 - Improve "embeddings" example

Pull Request - State: closed - Opened by swharden 8 months ago - 2 comments

#524 - NativeApi: `TryLoadLibrary()` can fail for some systems

Issue - State: open - Opened by swharden 8 months ago - 4 comments

#523 - ChatSession: improve exception message

Pull Request - State: closed - Opened by swharden 8 months ago - 3 comments

#522 - build(deps): bump xunit from 2.6.6 to 2.7.0

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#521 - build(deps): bump Microsoft.AspNetCore.OpenApi from 8.0.1 to 8.0.2

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#520 - build(deps): bump xunit.runner.visualstudio from 2.5.6 to 2.5.7

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#519 - build(deps): bump Microsoft.KernelMemory.Core, Microsoft.KernelMemory.Abstractions and Microsoft.SemanticKernel.Abstractions

Pull Request - State: open - Opened by dependabot[bot] 8 months ago
Labels: dependencies

GitHub / SciSharp/LLamaSharp issues and pull requests