Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / rustformers/llm issues and pull requests

#407 - Proper Rewind+Refeed when stop token is detected.

Issue - State: open - Opened by JuliaMerz about 1 year ago - 1 comment

#407 - Proper Rewind+Refeed when stop token is detected.

Issue - State: open - Opened by JuliaMerz about 1 year ago - 1 comment

#407 - Proper Rewind+Refeed when stop token is detected.

Issue - State: open - Opened by JuliaMerz about 1 year ago - 1 comment

#407 - Proper Rewind+Refeed when stop token is detected.

Issue - State: open - Opened by JuliaMerz about 1 year ago - 1 comment

#407 - Proper Rewind+Refeed when stop token is detected.

Issue - State: open - Opened by JuliaMerz about 1 year ago - 1 comment

#406 - Updated tokenizers crate to 0.13.4

Pull Request - State: closed - Opened by clarkmcc about 1 year ago - 1 comment

#406 - Updated tokenizers crate to 0.13.4

Pull Request - State: closed - Opened by clarkmcc about 1 year ago - 1 comment

#406 - Updated tokenizers crate to 0.13.4

Pull Request - State: closed - Opened by clarkmcc about 1 year ago - 1 comment

#406 - Updated tokenizers crate to 0.13.4

Pull Request - State: closed - Opened by clarkmcc about 1 year ago - 1 comment

#406 - Updated tokenizers crate to 0.13.4

Pull Request - State: closed - Opened by clarkmcc about 1 year ago - 1 comment

#406 - Updated tokenizers crate to 0.13.4

Pull Request - State: closed - Opened by clarkmcc about 1 year ago - 1 comment

#406 - Updated tokenizers crate to 0.13.4

Pull Request - State: closed - Opened by clarkmcc about 1 year ago - 1 comment

#406 - Updated tokenizers crate to 0.13.4

Pull Request - State: closed - Opened by clarkmcc about 1 year ago - 1 comment

#406 - Updated tokenizers crate to 0.13.4

Pull Request - State: closed - Opened by clarkmcc about 1 year ago - 1 comment

#405 - Cannot Compile llm-base on main

Issue - State: closed - Opened by carllippert about 1 year ago - 4 comments

#405 - Cannot Compile llm-base on main

Issue - State: closed - Opened by carllippert about 1 year ago - 4 comments

#405 - Cannot Compile llm-base on main

Issue - State: closed - Opened by carllippert about 1 year ago - 4 comments

#405 - Cannot Compile llm-base on main

Issue - State: closed - Opened by carllippert about 1 year ago - 4 comments

#405 - Cannot Compile llm-base on main

Issue - State: closed - Opened by carllippert about 1 year ago - 4 comments

#405 - Cannot Compile llm-base on main

Issue - State: closed - Opened by carllippert about 1 year ago - 4 comments

#405 - Cannot Compile llm-base on main

Issue - State: closed - Opened by carllippert about 1 year ago - 4 comments

#403 - Metal Prompt Feeding

Issue - State: open - Opened by jafioti about 1 year ago - 6 comments
Labels: issue:bug, topic:metal

#403 - Metal Prompt Feeding

Issue - State: open - Opened by jafioti about 1 year ago - 1 comment
Labels: issue:bug, topic:metal

#402 - Supporting Llama-2 70B param

Issue - State: open - Opened by AmineDiro about 1 year ago - 4 comments
Labels: topic:model-support, model:llama

#402 - Supporting Llama-2 70B param

Issue - State: open - Opened by AmineDiro about 1 year ago - 6 comments
Labels: topic:model-support, model:llama

#402 - Supporting Llama-2 70B param

Issue - State: open - Opened by AmineDiro about 1 year ago - 4 comments
Labels: topic:model-support, model:llama

#402 - Supporting Llama-2 70B param

Issue - State: open - Opened by AmineDiro about 1 year ago - 4 comments
Labels: topic:model-support, model:llama

#402 - Supporting Llama-2 70B param

Issue - State: open - Opened by AmineDiro about 1 year ago - 4 comments
Labels: topic:model-support, model:llama

#402 - Supporting Llama-2 70B param

Issue - State: open - Opened by AmineDiro about 1 year ago - 4 comments
Labels: topic:model-support, model:llama

#401 - Add the ability to quantize into k-quants

Pull Request - State: open - Opened by LLukas22 about 1 year ago - 4 comments

#401 - Add the ability to quantize into k-quants

Pull Request - State: open - Opened by LLukas22 about 1 year ago - 4 comments

#401 - Add the ability to quantize into k-quants

Pull Request - State: open - Opened by LLukas22 about 1 year ago - 4 comments

#401 - Add the ability to quantize into k-quants

Pull Request - State: closed - Opened by LLukas22 about 1 year ago - 5 comments

#401 - Add the ability to quantize into k-quants

Pull Request - State: open - Opened by LLukas22 about 1 year ago - 4 comments

#400 - fix(deps): remove pinned `half` dependency

Pull Request - State: closed - Opened by radu-matei about 1 year ago - 2 comments

#399 - Video Tutorials

Issue - State: open - Opened by okpatil4u about 1 year ago - 3 comments

#398 - add bert model

Pull Request - State: closed - Opened by nerdypepper about 1 year ago - 9 comments

#397 - GPT-2 load errors

Issue - State: closed - Opened by pabl-o-ce about 1 year ago - 5 comments
Labels: issue:bug, model:gpt-2

#396 - Build failure on Windows

Issue - State: closed - Opened by NuSkooler about 1 year ago - 4 comments

#395 - Remove `repeat` operation and add acceleration support for other architectures

Pull Request - State: closed - Opened by LLukas22 about 1 year ago - 6 comments

#394 - Fix #393 halting feed_prompt

Pull Request - State: closed - Opened by clarkmcc over 1 year ago - 3 comments

#392 - Reddit community Wiki page is disabled

Issue - State: closed - Opened by viktor-ferenczi over 1 year ago - 1 comment

#391 - stack overflow after new merge

Issue - State: closed - Opened by fluffydolphin over 1 year ago - 3 comments
Labels: issue:bug, model:llama, os:windows, topic:cublas

#390 - Free tensors from RAM if they are offloaded to an Accelerator

Issue - State: open - Opened by LLukas22 over 1 year ago
Labels: issue:enhancement, topic:cublas, topic:clblast, topic:metal

#389 - Custom RoPE Scaling

Pull Request - State: closed - Opened by LLukas22 over 1 year ago - 3 comments

#388 - Installation of CLI on macOS

Issue - State: closed - Opened by twardoch over 1 year ago - 2 comments

#386 - Runtime GPU backend selection

Issue - State: open - Opened by philpax over 1 year ago - 4 comments
Labels: issue:enhancement, topic:api-design, topic:cublas, topic:clblast, topic:metal

#385 - Better GPU Documentation

Pull Request - State: closed - Opened by LLukas22 over 1 year ago - 1 comment

#384 - Invalid magic number while loading LoRAs

Issue - State: open - Opened by clarkmcc over 1 year ago - 2 comments
Labels: meta:question

#383 - WizardLM inference error: ggml-metal.m:773: false && "not implemented"

Issue - State: open - Opened by clarkmcc over 1 year ago - 6 comments
Labels: issue:bug, model:llama, os:macos, topic:metal

#382 - Any plans for being able to fine tune models in rustformers llm?

Issue - State: closed - Opened by moonstripe over 1 year ago - 1 comment

#380 - Update README.md

Pull Request - State: closed - Opened by baskrahmer over 1 year ago - 1 comment

#379 - Update README.md

Pull Request - State: closed - Opened by basraayman over 1 year ago - 1 comment

#378 - Implement SuperHOT/interpolated RoPE support

Issue - State: closed - Opened by philpax over 1 year ago - 1 comment
Labels: issue:enhancement, model:llama

#377 - Add classifier-free guidance

Issue - State: open - Opened by philpax over 1 year ago - 2 comments
Labels: issue:enhancement

#376 - Peg CUDA architecture

Pull Request - State: closed - Opened by LLukas22 over 1 year ago - 3 comments

#375 - Fix MSRV to 1.65.0

Pull Request - State: closed - Opened by philpax over 1 year ago

#374 - I can't compile llm with nix

Issue - State: open - Opened by GENDRAUD over 1 year ago - 6 comments
Labels: issue:bug, app:cli, topic:packaging

#373 - Certain quantization levels produce garbage with CUDA acceleration

Issue - State: closed - Opened by philpax over 1 year ago - 1 comment
Labels: issue:bug, model:llama, topic:cublas

#372 - Shared `ExecutionParameters` for all operations

Issue - State: open - Opened by philpax over 1 year ago
Labels: meta:maintenance, topic:api-design

#371 - Multi-GPU support for inferencing

Issue - State: open - Opened by philpax over 1 year ago - 1 comment
Labels: issue:enhancement, topic:cublas, topic:clblast

#370 - feat(model/clone): derive `Clone` for `Box<dyn Model>`

Pull Request - State: closed - Opened by radu-matei over 1 year ago - 3 comments

#369 - Fix tensor name API

Issue - State: closed - Opened by philpax over 1 year ago
Labels: issue:enhancement, meta:maintenance, topic:api-design

#368 - add Falcon 40B model support

Pull Request - State: closed - Opened by skirodev over 1 year ago - 19 comments

#367 - feat(tracing): add tracing to `llm` and `llm-base` crates

Pull Request - State: closed - Opened by radu-matei over 1 year ago - 6 comments

#366 - Add CI for OpenCL on windows

Pull Request - State: closed - Opened by LLukas22 over 1 year ago

#365 - Support GGUF

Issue - State: open - Opened by philpax over 1 year ago - 4 comments
Labels: issue:enhancement, app:cli

#364 - allow chat to halt new token generation on `stop_sequence`

Pull Request - State: closed - Opened by averypelle over 1 year ago - 5 comments
Labels: issue:enhancement, app:cli

#363 - Chat does not halt

Issue - State: closed - Opened by averypelle over 1 year ago
Labels: issue:bug, app:cli

#362 - Update gpt2 to use wte if no lm_head

Pull Request - State: closed - Opened by steventrouble over 1 year ago - 3 comments
Labels: issue:enhancement, model:gpt-2

#361 - Bloom 176B inference is broken

Issue - State: open - Opened by HaileyStorm over 1 year ago - 10 comments
Labels: issue:bug, model:bloom

#360 - Add CI for cuda builds

Pull Request - State: closed - Opened by LLukas22 over 1 year ago

#359 - Use llm_samplers crate for sampler backend

Pull Request - State: closed - Opened by KerfuffleV2 over 1 year ago - 32 comments
Labels: issue:enhancement

#358 - Fix linux CLBlast build and add CI for accelerated builds

Pull Request - State: closed - Opened by LLukas22 over 1 year ago - 1 comment

#357 - Using gpu is slower as not using it

Issue - State: open - Opened by sonic182 over 1 year ago - 4 comments
Labels: issue:enhancement, topic:cublas

#356 - Automatic CI testing of the `llm` CLI

Issue - State: open - Opened by philpax over 1 year ago - 2 comments
Labels: issue:enhancement, meta:maintenance, app:cli, app:llm-test

#355 - Info on getting models?

Issue - State: closed - Opened by twardoch over 1 year ago - 1 comment

#354 - `ggml-metal.metal` download location?

Issue - State: closed - Opened by twardoch over 1 year ago - 1 comment

#353 - Error compiling CLI: Compiling macro_rules_attribute v0.1.3

Issue - State: closed - Opened by twardoch over 1 year ago - 5 comments
Labels: issue:bug, app:cli, os:macos, arch:x86

#352 - Wrong instructions for building the CLI

Issue - State: closed - Opened by twardoch over 1 year ago - 2 comments

#351 - Add placeholder check for message prompt

Pull Request - State: closed - Opened by viirya over 1 year ago - 2 comments
Labels: issue:enhancement

#350 - --prelude-prompt-file doesn't work

Issue - State: closed - Opened by fruit765 over 1 year ago - 1 comment
Labels: issue:bug, app:cli

#349 - Model Load Error: invariant broken: 1720913039 <= 2

Issue - State: closed - Opened by AnubhabB over 1 year ago - 3 comments

#348 - Improve model architecture error message

Pull Request - State: closed - Opened by viirya over 1 year ago - 2 comments

#347 - cuBLAS error

Issue - State: open - Opened by cometyang over 1 year ago - 11 comments
Labels: issue:bug, os:linux, topic:cublas

#346 - fix #216 - split prompts for chat mode in CLI

Pull Request - State: closed - Opened by philpax over 1 year ago

#345 - GPT-NeoX, GPT-J and BLOOM do not produce consistent results for the integration test

Issue - State: open - Opened by philpax over 1 year ago - 4 comments
Labels: issue:bug, model:bloom, model:gpt-neox, model:gpt-j, app:llm-test

#344 - feat(test): check hyperparameters can roundtrip

Pull Request - State: closed - Opened by philpax over 1 year ago

#343 - fix #338 - use wte if no lm_head for gpt2

Pull Request - State: closed - Opened by philpax over 1 year ago - 6 comments

#342 - Building with clblast

Issue - State: closed - Opened by vsndev3 over 1 year ago - 7 comments
Labels: issue:bug, os:linux, topic:clblast

#341 - build failure on orin agx

Issue - State: open - Opened by malv-c over 1 year ago - 3 comments
Labels: issue:bug, os:linux

#339 - Added tokenizers-remote

Pull Request - State: closed - Opened by jafioti over 1 year ago - 4 comments

#338 - GPT-2 doesn't always have an `lm_head`

Issue - State: closed - Opened by steventrouble over 1 year ago - 2 comments
Labels: issue:bug, model:gpt-2

#337 - Basic Integration Testing

Pull Request - State: closed - Opened by LLukas22 over 1 year ago - 5 comments

#334 - Add ability to delete tokens (undo feed)

Pull Request - State: closed - Opened by steventrouble over 1 year ago - 21 comments

#333 - Paged Attention

Issue - State: open - Opened by vikigenius over 1 year ago - 10 comments
Labels: issue:enhancement, topic:backend-support

#332 - FR: Add methods for removing tokens

Issue - State: closed - Opened by steventrouble over 1 year ago - 1 comment
Labels: issue:enhancement, topic:api-design

#330 - Support quantizing to K-quant formats

Issue - State: open - Opened by philpax over 1 year ago - 1 comment
Labels: issue:enhancement, app:cli