replicate/cog-vllm issues and pull requests

#39 - PromptTooLong error

Pull Request - State: closed - Opened by technillogue 3 months ago

#38 - Issue creating a new model

Issue - State: open - Opened by luarss 3 months ago

#37 - Update downloader to support local weights cache

Pull Request - State: closed - Opened by joehoover 4 months ago

#36 - Minor cleanup to CI

Pull Request - State: closed - Opened by joehoover 4 months ago

#35 - Add seed to inputs

Pull Request - State: closed - Opened by joehoover 4 months ago

#34 - Emit input and output tokens

Pull Request - State: closed - Opened by joehoover 4 months ago

#33 - Make test prediction at end of setup

Pull Request - State: closed - Opened by joehoover 4 months ago

#32 - Revert "Make test prediction at end of setup"

Pull Request - State: closed - Opened by joehoover 4 months ago

#31 - Make test prediction at end of setup

Pull Request - State: closed - Opened by joehoover 4 months ago

#30 - Push vllm to replicate-internal org

Pull Request - State: closed - Opened by joehoover 4 months ago

#29 - Manually install cog 0.10.0-alpha20 in build ci

Pull Request - State: closed - Opened by joehoover 4 months ago

#28 - Revert "Manually install cog 0.10.0-alpha20 in build ci"

Pull Request - State: closed - Opened by joehoover 4 months ago

#27 - Manually install cog 0.10.0-alpha20 in build ci

Pull Request - State: closed - Opened by joehoover 4 months ago

#26 - Bump vllm to 0.5.3.post1 and add 9.0 (h100) target

Pull Request - State: closed - Opened by joehoover 4 months ago

#25 - Optimize local end-to-end test

Pull Request - State: closed - Opened by joehoover 4 months ago

#24 - Fix auth failure in buid-and-push workflow

Pull Request - State: closed - Opened by joehoover 4 months ago

#23 - Only build and push on dispatch

Pull Request - State: closed - Opened by joehoover 4 months ago

#22 - Allow predictor_config placement in project root

Pull Request - State: closed - Opened by joehoover 4 months ago

#21 - Make build depend on previous steps

Pull Request - State: closed - Opened by joehoover 4 months ago

#20 - Configure CI and do some general cleanup

Pull Request - State: closed - Opened by joehoover 4 months ago

#19 - Set engine args in `predictor_config.json`

Pull Request - State: closed - Opened by joehoover 4 months ago

#18 - Set engine args via `predictor_config.json`

Issue - State: closed - Opened by joehoover 4 months ago

#17 - This commit adds `prompt_template` as an input field

Pull Request - State: closed - Opened by joehoover 4 months ago

#16 - Feature: Allow COG_WEIGHTS to point to local path

Pull Request - State: closed - Opened by joehoover 5 months ago

#16 - Feature: Allow COG_WEIGHTS to point to local path

Pull Request - State: closed - Opened by joehoover 5 months ago

#15 - Ensure that tokenizer's `chat_template` is used by default

Pull Request - State: closed - Opened by joehoover 5 months ago

#14 - Tokenizer chat template is not used by default

Issue - State: closed - Opened by joehoover 6 months ago
Labels: bug

#14 - Tokenizer chat template is not used by default

Issue - State: closed - Opened by joehoover 6 months ago
Labels: bug

#13 - Support COG_WEIGHTS local path

Issue - State: closed - Opened by joehoover 6 months ago
Labels: enhancement

#13 - Support COG_WEIGHTS local path

Issue - State: closed - Opened by joehoover 6 months ago
Labels: enhancement

#12 - solve formatting

Pull Request - State: closed - Opened by technillogue 6 months ago

#11 - Pass `prompt_template` into trained weights through `predictor_config.json`

Pull Request - State: closed - Opened by mattt 6 months ago - 1 comment

#10 - Add `pyproject.toml`, manage Python dependencies with `requirements.txt`

Pull Request - State: closed - Opened by mattt 6 months ago

#9 - Syl/mattt/train

Pull Request - State: closed - Opened by technillogue 6 months ago

#8 - Refactor cog-vllm to support training workflow

Pull Request - State: closed - Opened by mattt 6 months ago

#7 - add initial steps to quickstart in readme

Pull Request - State: closed - Opened by zeke 6 months ago

#6 - gitignore config.yaml

Pull Request - State: closed - Opened by zeke 6 months ago - 1 comment

#5 - Error: Additional property concurrency is not allowed

Issue - State: closed - Opened by zeke 6 months ago - 6 comments

#4 - Refactor cog-vllm to support config workflows and multiple models

Pull Request - State: closed - Opened by joehoover 6 months ago

#3 - improvements to weight downloading and some personal preferences

Pull Request - State: closed - Opened by ghost 7 months ago

#2 - add hamels code

Pull Request - State: closed - Opened by joehoover 8 months ago - 1 comment

#1 - Factor in Hamel's cog-vllm implementation

Pull Request - State: closed - Opened by joehoover 8 months ago - 1 comment

GitHub / replicate/cog-vllm issues and pull requests