Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / fasterdecoding/rest issues and pull requests
#22 - Lama2 70B-chat is not supported?
Issue -
State: open - Opened by Chlience about 1 month ago
#21 - Tensor parallelism
Issue -
State: open - Opened by lethean1 about 1 month ago
#20 - about retrieve sequence length
Issue -
State: open - Opened by Siegfried-qgf about 2 months ago
- 1 comment
#19 - OSError: failed to fill whole buffer
Issue -
State: open - Opened by Siegfried-qgf about 2 months ago
- 6 comments
#18 - How to adjust the maximum token lengths when drafting?
Issue -
State: open - Opened by zomss 2 months ago
- 3 comments
#17 - LLama3 8B is not supported
Issue -
State: open - Opened by liranringel 4 months ago
- 2 comments
#16 - If I want to change REST code to support multi-batch inference, what needs to be changed?
Issue -
State: open - Opened by yangbohust 6 months ago
#16 - If I want to change REST code to support multi-batch inference, what needs to be changed?
Issue -
State: open - Opened by yangbohust 6 months ago
#15 - How to support the `repetition_penalty` parameter?
Issue -
State: open - Opened by yangbohust 6 months ago
#14 - Segmentation Fault when calling libsais_int
Issue -
State: open - Opened by julianmukaj 6 months ago
#13 - ValueError: draft_choices was not cut enough / draft_len should not exceed 65
Issue -
State: open - Opened by yangbohust 6 months ago
- 3 comments
#12 - What are the meanings of each parameter of the reader.search() function? k\choices\long
Issue -
State: closed - Opened by yangbohust 7 months ago
- 9 comments
#11 - pyo3_runtime.PanicException: called `Result::unwrap()` on an `Err` value: RuntimeError(StackOverflow)
Issue -
State: closed - Opened by yangbohust 7 months ago
- 1 comment
#10 - Gracefully handles when draft_choices is not cut enough
Pull Request -
State: closed - Opened by wangpatrick57 7 months ago
#9 - codellama-7b working on GPUs with 24GB memory
Pull Request -
State: closed - Opened by wangpatrick57 7 months ago
#8 - Ngram build cli
Pull Request -
State: closed - Opened by wangpatrick57 7 months ago
#7 - Small QOL changes
Pull Request -
State: closed - Opened by wangpatrick57 8 months ago
- 2 comments
#6 - Questions about past_key_values_data
Issue -
State: closed - Opened by reflectionie 8 months ago
- 2 comments
#5 - What is the acceptance procedure in REST?
Issue -
State: closed - Opened by jivanph 9 months ago
- 3 comments
#4 - Cannot install the .whl
Issue -
State: closed - Opened by hasuoshenyun 9 months ago
- 2 comments
#3 - Incompatibility issues with llama-7b model
Issue -
State: closed - Opened by preminstrel 9 months ago
- 6 comments
#2 - Could REST support beam search sampling policy?
Issue -
State: closed - Opened by leiwen83 12 months ago
- 1 comment
#1 - DraftRetriever wheels file missing
Issue -
State: closed - Opened by drdsgvo about 1 year ago
- 2 comments