Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / PygmalionAI/aphrodite-engine issues and pull requests

#617 - feat: quant_llm floating point quantization

Pull Request - State: closed - Opened by intervitens 2 months ago - 1 comment

#607 - [Bug]: With tp > 1, model never loads, and there's hardly any CPU utilization

Issue - State: closed - Opened by BlairSadewitz 3 months ago - 8 comments
Labels: bug

#561 - [Bug]: Problem loading EXL2 in rc_054

Issue - State: open - Opened by nikitabalakin 4 months ago - 3 comments
Labels: bug

#419 - [WIP] feat: Mamba support

Pull Request - State: closed - Opened by AlpinDale 7 months ago - 1 comment

#101 - fix: correct auto ntk scaling_factor for 4k ctx case

Pull Request - State: closed - Opened by sandwichdoge about 1 year ago - 9 comments

#100 - fix: force v2 for ctxlen larger than 8192

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#99 - feat: add exllamav2 for GPTQ

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#98 - chore: clean up endpoints

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#97 - feat: batched topk/a/p and CUDA kernels

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#96 - New Mirostatv2 implementation

Pull Request - State: closed - Opened by 50h100a about 1 year ago - 1 comment

#95 - feat: AMD ROCm support

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 2 comments

#94 - feat: spaces between special tokens

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#93 - fix: sync CPU delay in sampler

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#92 - Request: Support CLI option for concurrent request rate limit

Issue - State: closed - Opened by sandwichdoge about 1 year ago - 3 comments

#91 - fix: pylint complaints

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#90 - chore: reformats

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#89 - feat: exllamav2 quantization

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment

#88 - chore: reformats

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment

#87 - feat: finish up tests and workflows

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment

#86 - feat: add mistral support for GPTQ

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#85 - feat: flattened 1D tensor -> 2D tensor

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#84 - ModuleNotFoundError: No module named 'aphrodite.common.logits'

Issue - State: closed - Opened by yixuantt about 1 year ago - 5 comments

#83 - Make entrypoint executable

Pull Request - State: closed - Opened by city-unit about 1 year ago - 1 comment

#82 - Correct Conda Env Creation in Dockerfile

Pull Request - State: closed - Opened by city-unit about 1 year ago - 1 comment

#81 - fix: remove unnecessary lines

Pull Request - State: closed - Opened by g4rg about 1 year ago

#80 - feat:Enable banning tokens

Pull Request - State: closed - Opened by StefanGliga about 1 year ago - 6 comments

#79 - fix: revert mirostat v2

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#78 - Request: Better CLI control over max CTX and rope scaling

Issue - State: closed - Opened by Pyroserenus about 1 year ago - 1 comment

#77 - feat: prompt logprobs and batched samplers

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment

#76 - feat: add PagedAttention V2 kernels

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 2 comments

#75 - fix: launch AWQ kernels on the current CUDAStream

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#74 - Don't enforce values for unused mirostat parameters

Pull Request - State: closed - Opened by 50h100a about 1 year ago - 2 comments

#73 - Mirostat v2 Fix

Pull Request - State: closed - Opened by 50h100a about 1 year ago - 2 comments

#72 - GPTQRowParallelLinear has no attribute world_size

Issue - State: closed - Opened by AWAS666 about 1 year ago - 2 comments

#71 - fix: prompt processing overhead introduced by #66

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#70 - Added `min_tokens` and reimplemented `ignore_eos` using a new logit processor

Pull Request - State: closed - Opened by 50h100a about 1 year ago - 1 comment
Labels: enhancement

#69 - Mirostat

Pull Request - State: closed - Opened by StefanGliga about 1 year ago - 2 comments
Labels: enhancement

#68 - feat: INT8 support via SmoothQuant

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment
Labels: enhancement

#67 - feat: YaRN context window extension support

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#66 - fix: change the timing of logit sorting

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#65 - chore: fix datatype check

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#64 - Overcomplicated and unexplained usage for beginners

Issue - State: open - Opened by Avroboros about 1 year ago - 13 comments

#63 - Inference results from vLLM is inconsistant with HF

Issue - State: closed - Opened by silverriver about 1 year ago - 3 comments
Labels: bug

#62 - Possible circular import issue

Issue - State: closed - Opened by silverriver about 1 year ago - 2 comments

#61 - Update requirements.txt

Pull Request - State: closed - Opened by Godlikedesigningmachine about 1 year ago - 1 comment

#60 - Update requirements.txt

Pull Request - State: closed - Opened by Godlikedesigningmachine about 1 year ago

#59 - Update requirements.txt

Pull Request - State: closed - Opened by Godlikedesigningmachine about 1 year ago

#58 - Locked Ray version to 2.5.1

Pull Request - State: closed - Opened by RecoveredApparatus about 1 year ago

#57 - feat: refactor megatron and quants

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment

#56 - chore: allow the user to specify install method

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#55 - Make NVCC work for different versions

Pull Request - State: closed - Opened by official-elinas about 1 year ago - 1 comment

#54 - Micromamba Runtime

Pull Request - State: closed - Opened by henk717 about 1 year ago - 1 comment

#53 - feat: AWQ support for Turing GPUs

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#52 - fix: attention kernel attribute

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment

#51 - Allow CORS connections from anywhere

Pull Request - State: closed - Opened by n-galrion about 1 year ago - 1 comment

#50 - CUDA illegal memory access when loading 70b AWQ with RoPE

Issue - State: closed - Opened by g4rg about 1 year ago - 8 comments
Labels: bug

#48 - chore: KoboldAI/koboldcpp updates

Pull Request - State: closed - Opened by g4rg about 1 year ago - 9 comments

#47 - fix: add kcpp /generate/check stub

Pull Request - State: closed - Opened by g4rg about 1 year ago - 1 comment

#46 - fix: requests stalling in KAI non-streaming endpoint

Pull Request - State: closed - Opened by g4rg about 1 year ago - 1 comment

#45 - fix: more KAI parameter adaptations

Pull Request - State: closed - Opened by g4rg about 1 year ago - 1 comment

#44 - fix: SamplingParameters validation

Pull Request - State: closed - Opened by g4rg about 1 year ago - 1 comment

#43 - fix: torch version mismatch

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#42 - Adds a copy of embedded Kobold Lite Web UI

Pull Request - State: closed - Opened by LostRuins about 1 year ago - 5 comments

#41 - Force torch with cuda 11.8

Pull Request - State: closed - Opened by AWAS666 about 1 year ago - 9 comments

#40 - PyTorch 2.1

Issue - State: closed - Opened by AWAS666 about 1 year ago - 2 comments
Labels: help wanted

#39 - Mirostat v2

Pull Request - State: closed - Opened by 50h100a about 1 year ago - 1 comment
Labels: enhancement

#38 - Revert license back to AGPLv3

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 7 comments

#36 - Classifier-Free Guidance support

Issue - State: open - Opened by bdashore3 about 1 year ago - 4 comments
Labels: enhancement

#35 - chore: allow exclusion of AWQ kernels during build

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment
Labels: enhancement

#34 - feat: add model and sampler tests

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment

#33 - feat: add detokenize test suite

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#32 - license: AGPL-3.0 -> MIT

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 3 comments

#31 - KoboldAI endpoint

Pull Request - State: closed - Opened by g4rg about 1 year ago - 4 comments

#30 - Set ooba API Key as argument

Issue - State: closed - Opened by miku448 about 1 year ago - 5 comments
Labels: good first issue

#29 - chore:fix tfs

Pull Request - State: closed - Opened by StefanGliga about 1 year ago

#28 - Exception in TFS implementation on simultaneous requests

Issue - State: closed - Opened by g4rg about 1 year ago - 3 comments

#27 - feat: Add Eta, Epsilon and Locally Typical sampling

Pull Request - State: closed - Opened by StefanGliga about 1 year ago - 1 comment

#26 - Fix LogitProcessor infrastructure

Pull Request - State: closed - Opened by 50h100a about 1 year ago - 1 comment

#25 - Restore RoPE Scaling

Pull Request - State: closed - Opened by 50h100a about 1 year ago

#24 - Added top_a and repetition_penalty samplers.

Pull Request - State: closed - Opened by 50h100a about 1 year ago - 1 comment

#23 - feat: add tail-free sampling

Pull Request - State: closed - Opened by StefanGliga about 1 year ago - 1 comment

#22 - Rename geppeto to GetPortaPros

Issue - State: closed - Opened by h4n1virus about 1 year ago - 1 comment

#21 - GPTQ+exllama support

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#20 - feat: mistral support

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment

#19 - fix: openai server

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 3 comments

#18 - No logits_processors in sampling params

Issue - State: closed - Opened by AWAS666 about 1 year ago - 4 comments

#17 - Merge @dev branch to @main

Pull Request - State: closed - Opened by AlpinDale about 1 year ago

#16 - Pygmalion-2 generated unexpected responses

Issue - State: closed - Opened by BaiMoHan about 1 year ago - 3 comments

#15 - Error running Chat API server

Issue - State: closed - Opened by firelightning13 about 1 year ago - 2 comments

#14 - Initialize GraphAllReduce

Pull Request - State: closed - Opened by 50h100a about 1 year ago - 1 comment

#13 - Instructions for multithreaded compilation of xformers

Pull Request - State: closed - Opened by 50h100a about 1 year ago - 1 comment

#12 - Refactors

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment

#11 - Feat: quantization support

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 2 comments

#10 - add safetensor support

Pull Request - State: closed - Opened by AlpinDale about 1 year ago - 1 comment

#9 - Pygmalion6b generate unexpected texts

Issue - State: closed - Opened by BaiMoHan over 1 year ago - 2 comments

#8 - AttributeError: 'NoneType' object has no attribute 'fs' at fresh install

Issue - State: closed - Opened by AWAS666 over 1 year ago - 8 comments