Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / OpenRouterTeam/openrouter-runner issues and pull requests

#90 - Can support dall-e-3 model ？

Issue - State: open - Opened by gyp719 6 months ago

#88 - 调用 gpt 模型 如何生成 图片？

Issue - State: closed - Opened by gyp719 6 months ago - 1 comment

#87 - perf: let noromaid mixtral scale to zero

Pull Request - State: closed - Opened by sambarnes 6 months ago

#86 - perf: let midnight rose scale to zero

Pull Request - State: closed - Opened by sambarnes 6 months ago

#85 - perf: let bagel scale to zero

Pull Request - State: closed - Opened by sambarnes 6 months ago

#84 - perf: reduce container idle timeout for neuralchat & psyfighter1

Pull Request - State: closed - Opened by sambarnes 6 months ago

#83 - perf: always keep one midnight rose

Pull Request - State: closed - Opened by sambarnes 7 months ago

#82 - chore: temporarily comment out keep_warm

Pull Request - State: closed - Opened by sambarnes 7 months ago

#81 - perf: serve quantized Psyfighter2

Pull Request - State: closed - Opened by sambarnes 7 months ago

#79 - feat: add quantize_model() fn & a MidnightRose70B

Pull Request - State: closed - Opened by sambarnes 7 months ago

#78 - deps: bump vllm from 0.2.6 to 0.3.3

Pull Request - State: open - Opened by sambarnes 7 months ago

#77 - perf: serve quantized versions of noromaid mixtral & bagel

Pull Request - State: closed - Opened by sambarnes 7 months ago

#75 - feat: keep_warm=1 for noromaid mixtral & bagel

Pull Request - State: closed - Opened by sambarnes 7 months ago

#74 - feat: add support for h100s & bump backlog limit

Pull Request - State: closed - Opened by sambarnes 7 months ago

#73 - perf: bump noromaidmixtral to max_containers=3

Pull Request - State: closed - Opened by sambarnes 7 months ago

#72 - fix: add a concurrency_limit to noromaidmixtral & bagel

Pull Request - State: closed - Opened by sambarnes 7 months ago

#71 - refactor: move all models to their own unique containers

Pull Request - State: closed - Opened by sambarnes 7 months ago

#70 - feat: add finish_reason to the protocol

Pull Request - State: closed - Opened by louisgv 7 months ago

#69 - WIP: H100 support for Bagel

Pull Request - State: closed - Opened by alexanderatallah 8 months ago

#68 - refactor: deprecate old usage fields & simplify vllm generate fn

Pull Request - State: closed - Opened by sambarnes 8 months ago

#67 - docs: Update Docs to be more consistent.

Pull Request - State: closed - Opened by tyllenb 8 months ago - 1 comment

#66 - Make model downloading synchronous again

Pull Request - State: closed - Opened by alexanderatallah 8 months ago

#65 - Don't autoscale some containers

Pull Request - State: closed - Opened by alexanderatallah 8 months ago - 1 comment

#64 - fix: running total of tokens for streams

Pull Request - State: closed - Opened by sambarnes 8 months ago - 1 comment

#63 - fix: sentry scrubbing

Pull Request - State: closed - Opened by sambarnes 8 months ago - 1 comment

#62 - feat: move phi-2 to a dedicated container, remove backup models

Pull Request - State: closed - Opened by louisgv 8 months ago

#61 - feat: track completion request origin

Pull Request - State: closed - Opened by louisgv 8 months ago

#60 - feat: timer estimates GPU costs

Pull Request - State: closed - Opened by sambarnes 9 months ago - 1 comment

#59 - feat: remote generation on GPU timer to track costs

Pull Request - State: closed - Opened by sambarnes 9 months ago

#58 - fix: key error when popping CUDA_VISIBLE_DEVICES env

Pull Request - State: closed - Opened by sambarnes 9 months ago

#57 - fix: unset CUDA_VISIBLE_DEVICES in vLLM containers to patch Ray bug

Pull Request - State: closed - Opened by sambarnes 9 months ago - 1 comment

#55 - ci: temporarily disable downloading models in CI, only deploy

Pull Request - State: closed - Opened by sambarnes 9 months ago - 1 comment

#54 - fix: revert use of @enter entrypoint due to bug

Pull Request - State: closed - Opened by sambarnes 9 months ago

#53 - perf: bump vllm container cpu memory from 128M to 1024M

Pull Request - State: closed - Opened by sambarnes 9 months ago

#52 - ci: release to modal e2e env on pr label creation

Pull Request - State: open - Opened by sambarnes 9 months ago

#51 - ci: release to modal main env on push to main

Pull Request - State: closed - Opened by sambarnes 9 months ago

#50 - fix: automatically attach logging extras into the log record json

Pull Request - State: closed - Opened by sambarnes 9 months ago - 1 comment

#49 - feat: add a simple timer & start profiling vLLM engine startup

Pull Request - State: closed - Opened by sambarnes 9 months ago - 1 comment

#48 - Add Datadog Logging

Pull Request - State: closed - Opened by montasaurus 9 months ago - 1 comment

#47 - fix: report generation errors to sentry w/ model name

Pull Request - State: closed - Opened by sambarnes 9 months ago

#46 - feat: sentry fastapi integration added

Pull Request - State: closed - Opened by sambarnes 9 months ago

#45 - perf: move VLLM engine initialization from __init__ to an @enter() hook

Pull Request - State: closed - Opened by sambarnes 9 months ago - 1 comment

#44 - deps: bump vllm from 0.2.6 to 0.2.7

Pull Request - State: closed - Opened by sambarnes 9 months ago - 3 comments

#43 - fix path serialization

Pull Request - State: closed - Opened by montasaurus 9 months ago

#42 - remove unused code

Pull Request - State: closed - Opened by montasaurus 9 months ago - 1 comment

#41 - Dynamically Add and Complete Models

Pull Request - State: closed - Opened by montasaurus 9 months ago

#40 - perf: try completion stub async to avoid many new threads

Pull Request - State: closed - Opened by sambarnes 9 months ago - 2 comments

#39 - test: convert test_large_prompt to a python integration test

Pull Request - State: closed - Opened by sambarnes 9 months ago - 3 comments

#38 - isolate bagel inference

Pull Request - State: closed - Opened by montasaurus 9 months ago

#37 - test: integration suite started, replacing manual scripts

Pull Request - State: closed - Opened by sambarnes 9 months ago

#36 - add sentry to vllm container

Pull Request - State: closed - Opened by montasaurus 9 months ago

#35 - add bagel-34b-v0.2 and chronos-hermes-13b-v2

Pull Request - State: closed - Opened by montasaurus 9 months ago - 1 comment

#34 - remove unused models

Pull Request - State: closed - Opened by montasaurus 9 months ago

#33 - Add ability to specify model Revision with ":" syntax

Pull Request - State: closed - Opened by deoxykev 9 months ago - 6 comments

#32 - ci: fix linter action to also check formatting

Pull Request - State: closed - Opened by sambarnes 9 months ago - 1 comment

#31 - fix: dedupe auth logic & patch potential timing attack

Pull Request - State: closed - Opened by sambarnes 9 months ago - 3 comments

#30 - ci: add linter action on prs & main pushes

Pull Request - State: closed - Opened by sambarnes 9 months ago - 2 comments

#29 - chore: introduce ruff linter and formatter

Pull Request - State: closed - Opened by sambarnes 10 months ago - 2 comments

#28 - docs: update main README.md and Runner README.md

Pull Request - State: closed - Opened by tyllenb 10 months ago

#27 - feat: dolphin mixtral

Pull Request - State: closed - Opened by louisgv 10 months ago

#26 - fix: modal premature 503, bump concurrency

Pull Request - State: closed - Opened by louisgv 10 months ago

#25 - feat: add psyfighter 2

Pull Request - State: closed - Opened by louisgv 10 months ago

#24 - feat: migrate shap-e to modal

Pull Request - State: closed - Opened by louisgv 10 months ago

#23 - feat: Add psyfighter

Pull Request - State: closed - Opened by louisgv 10 months ago

#22 - feat: add toppy 7B

Pull Request - State: closed - Opened by louisgv 10 months ago

#21 - fix: vllm container for 20B model

Pull Request - State: closed - Opened by louisgv 10 months ago

#20 - Noromaid, and improve clarity

Pull Request - State: closed - Opened by alexanderatallah 10 months ago

#19 - feat: add intel neural chat

Pull Request - State: closed - Opened by louisgv 10 months ago

#18 - add orca 2

Pull Request - State: closed - Opened by louisgv 11 months ago

#17 - feat: capybara 34b

Pull Request - State: closed - Opened by louisgv 11 months ago

#16 - feat: add yarn 128k

Pull Request - State: closed - Opened by louisgv 11 months ago

#15 - feat: add zephyr to modal runner

Pull Request - State: closed - Opened by louisgv 11 months ago

#14 - feat: Adding punctuator

Pull Request - State: closed - Opened by louisgv 12 months ago - 1 comment

#13 - feat: Adding tuner on modal

Pull Request - State: closed - Opened by louisgv 12 months ago - 1 comment

#12 - feat: adding mistral 7B

Pull Request - State: closed - Opened by louisgv about 1 year ago - 1 comment

#11 - feat: testing out modal with L4

Pull Request - State: closed - Opened by louisgv about 1 year ago

#10 - Switch to a10s for mythalion

Pull Request - State: closed - Opened by alexanderatallah about 1 year ago - 1 comment

#9 - feat: rope long ctx

Pull Request - State: closed - Opened by louisgv about 1 year ago

#8 - feat: modal runner

Pull Request - State: closed - Opened by louisgv about 1 year ago - 1 comment

#7 - feat: initial refactor to make it easier to spawn new modal model

Pull Request - State: closed - Opened by louisgv about 1 year ago

#6 - feat: allow undefined max_tokens, use the remaining amount if None

Pull Request - State: closed - Opened by louisgv about 1 year ago

#5 - feat: mythalion 4096 context + error handling on request

Pull Request - State: closed - Opened by louisgv about 1 year ago - 1 comment

#4 - fix: add better test and a common runner

Pull Request - State: closed - Opened by louisgv about 1 year ago

#3 - WIP: Use cheaper GPUs

Pull Request - State: closed - Opened by alexanderatallah about 1 year ago - 1 comment

#2 - hotfix: remove vllm requests logging

Pull Request - State: closed - Opened by louisgv about 1 year ago

#1 - feat: add mythalion

Pull Request - State: closed - Opened by louisgv about 1 year ago