RWKV/rwkv.cpp issues and pull requests

#77 - conversion seems to only support float16/float32, not quantized formats.

Issue - State: closed - Opened by cmdicely over 1 year ago - 1 comment

#76 - latest changes

Pull Request - State: closed - Opened by DarokCx over 1 year ago - 4 comments

#75 - Various improvements & upgrade ggml

Pull Request - State: closed - Opened by saharNooby over 1 year ago - 7 comments

#74 - file parsing and memory usage optimization

Pull Request - State: closed - Opened by LoganDark over 1 year ago - 26 comments

#73 - Flush output every token in generate_completions.py

Pull Request - State: closed - Opened by LoganDark over 1 year ago

#72 - Silence PyTorch warnings by using untyped storage

Pull Request - State: closed - Opened by LoganDark over 1 year ago

#71 - last second move things over in the error enum

Pull Request - State: closed - Opened by LoganDark over 1 year ago

#70 - Switch to fstat64

Pull Request - State: closed - Opened by LoganDark over 1 year ago - 2 comments

#69 - Move graph building into its own function

Pull Request - State: closed - Opened by LoganDark over 1 year ago - 3 comments

#68 - Add rwkv_set_print_errors and rwkv_get_last_error

Pull Request - State: closed - Opened by LoganDark over 1 year ago - 25 comments

#67 - Slow Inference

Issue - State: closed - Opened by xdevfaheem over 1 year ago - 3 comments

#66 - How to increase state size?

Issue - State: closed - Opened by richardburleigh over 1 year ago - 2 comments

#65 - Feature add cublas support

Pull Request - State: closed - Opened by yorkzero831 over 1 year ago - 27 comments

#64 - UnExpected Outputs

Issue - State: closed - Opened by xdevfaheem over 1 year ago - 3 comments

#63 - Get error status and message without stderr

Issue - State: closed - Opened by LoganDark over 1 year ago - 8 comments
Labels: good first issue

#62 - Add CuBLAS support

Issue - State: closed - Opened by yorkzero831 over 1 year ago - 1 comment
Labels: good first issue

#61 - Basic Samplers?

Issue - State: closed - Opened by ArEnSc over 1 year ago - 4 comments

#60 - Is it possible to implement the seq mode for loading prompt?

Issue - State: closed - Opened by L-M-Sherlock over 1 year ago - 1 comment

#59 - Apple Silicon : mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64')

Issue - State: open - Opened by mozzipa over 1 year ago - 3 comments

#58 - Fix encoding issue when loading prompt data

Pull Request - State: closed - Opened by baiyuanneko over 1 year ago

#57 - How can i build android rwkv.cpp?

Issue - State: closed - Opened by xiaol over 1 year ago - 2 comments

#55 - Blas-like Prompt Parallelization? (sequence processing mode)

Issue - State: closed - Opened by paryska99 over 1 year ago - 1 comment

#54 - Library Fails to Build

Issue - State: closed - Opened by wereretot over 1 year ago - 1 comment

#53 - Python type hint cannot work: A: list[int]=[] when run chat_with_bot.py

Issue - State: closed - Opened by Oshibuki over 1 year ago - 3 comments

#52 - Various improvements

Pull Request - State: closed - Opened by saharNooby over 1 year ago

#51 - WARNING: Unused parameter in LoRA state dict

Issue - State: closed - Opened by iclgg over 1 year ago - 6 comments

#50 - Add MMAP support

Issue - State: open - Opened by PicoCreator over 1 year ago - 2 comments

#49 - Adding rwkv_eval_array operation

Pull Request - State: closed - Opened by PicoCreator over 1 year ago - 3 comments

#48 - AssertionError: xxxxxxxxx.bin is not a file

Issue - State: closed - Opened by s567901 over 1 year ago - 2 comments

#47 - Various improvements

Pull Request - State: closed - Opened by saharNooby over 1 year ago

#46 - "Unsupported quantization type" when quantizing model

Issue - State: closed - Opened by BuilderGuy1 over 1 year ago - 2 comments

#45 - Use main ggml repo instead of fork

Pull Request - State: closed - Opened by saharNooby over 1 year ago

#44 - Add support for Q5_0, Q5_1 and Q8_0 formats; remove Q4_1_O format

Pull Request - State: closed - Opened by saharNooby over 1 year ago

#43 - Illegal instruction (Intel N4200, Linux Ubuntu Jaunty)

Issue - State: open - Opened by radscience over 1 year ago - 4 comments
Labels: bug, help wanted

#42 - Inference binary

Issue - State: closed - Opened by drdaffey over 1 year ago - 1 comment

#41 - Cmake Error

Issue - State: open - Opened by QuanBit over 1 year ago - 2 comments
Labels: help wanted

#40 - fraction of my custom stuff rebased onto #21

Pull Request - State: closed - Opened by iacore over 1 year ago - 1 comment

#39 - Improve chat_with_bot.py script

Pull Request - State: closed - Opened by saharNooby over 1 year ago

#38 - Sync ggml with upstream

Pull Request - State: closed - Opened by saharNooby over 1 year ago

#37 - punish repetitions & break if END_OF_TEXT & decouple prompts from chat script

Pull Request - State: closed - Opened by L-M-Sherlock over 1 year ago - 5 comments

#36 - chat_with_bot will stop when '\n' in response.

Issue - State: closed - Opened by asukaminato0721 over 1 year ago - 1 comment

#35 - Consider uploading some quantized checkpoints to hugginface

Issue - State: open - Opened by Calandiel over 1 year ago - 2 comments

#34 - Improve the prompt & fix chinese display issue & support commands

Pull Request - State: closed - Opened by L-M-Sherlock over 1 year ago - 4 comments

#33 - Add robust automatic testing

Pull Request - State: closed - Opened by saharNooby over 1 year ago

#32 - (Ubuntu x86_64) Segmentation Fault Running Q4_1_O Model

Issue - State: closed - Opened by cryscan over 1 year ago - 12 comments

#30 - a bunch of features

Pull Request - State: closed - Opened by iacore over 1 year ago - 8 comments

#29 - Mac Build stops with Errors

Issue - State: closed - Opened by BuilderGuy1 over 1 year ago - 3 comments

#28 - Move ggml to submodule

Pull Request - State: closed - Opened by saharNooby over 1 year ago - 1 comment

#27 - Can we use Q4_1 for some of the matrices?

Issue - State: closed - Opened by BlinkDL over 1 year ago - 2 comments

#25 - Code difference is getting more between ggml and rwkv.cpp

Issue - State: closed - Opened by yorkzero831 over 1 year ago - 4 comments

#24 - Crash on an `endbr64` instruction.

Issue - State: open - Opened by RnMss over 1 year ago - 8 comments
Labels: bug, help wanted

#23 - Lanchain.js integration

Issue - State: open - Opened by ansarizafar over 1 year ago - 4 comments

#22 - chat_with_bot.py not work well with Raven v8

Issue - State: closed - Opened by zklhp over 1 year ago - 3 comments

#21 - Create Pip Package

Pull Request - State: closed - Opened by abetlen over 1 year ago - 7 comments

#20 - fix: Mention of incorrect filename for MacOS cmake build artifact

Pull Request - State: closed - Opened by BrutalCoding over 1 year ago

#19 - Q4_1_O quantization test is not passing (Linux aarch64)

Issue - State: closed - Opened by cgisky1980 over 1 year ago - 30 comments

#18 - Update github action to support linux and macos asset uploading

Pull Request - State: closed - Opened by yorkzero831 over 1 year ago - 1 comment

#17 - rwkv.cpp server

Issue - State: open - Opened by abetlen over 1 year ago - 8 comments

#16 - Add Q4_1_O quantization format that preserves outliers in weights and does dot in FP32

Pull Request - State: closed - Opened by saharNooby over 1 year ago - 2 comments

#15 - Typo in README.md

Issue - State: closed - Opened by davidrimshnick over 1 year ago

#14 - Update macOS, better instructions, streaming output

Pull Request - State: closed - Opened by hypnopump over 1 year ago - 1 comment

#13 - we actually build a dylib on macos

Pull Request - State: closed - Opened by pixelkaiser over 1 year ago

#12 - Q4_0 and Q4_1 quantization breaks RWKV due to weight/activation outliers

Issue - State: closed - Opened by saharNooby over 1 year ago - 7 comments

#11 - generate_completions feedback

Issue - State: open - Opened by bennmann over 1 year ago - 1 comment

#9 - Adds instructions and works on linux as well

Pull Request - State: closed - Opened by hypnopump over 1 year ago

#8 - Memory error

Issue - State: closed - Opened by dillfrescott over 1 year ago - 2 comments

#7 - OSError: bin/Release/rwkv.so: undefined symbol: max

Issue - State: closed - Opened by RedBoxing over 1 year ago

#6 - OSError: bin/Release/rwkv.so: undefined symbol: max

Issue - State: closed - Opened by RedBoxing over 1 year ago - 2 comments

#5 - Hypnopump/expand readme instructions and working on linux

Pull Request - State: closed - Opened by hypnopump over 1 year ago - 2 comments

GitHub / RWKV/rwkv.cpp issues and pull requests