Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / xorbitsai/inference issues and pull requests
#96 - FEAT: slot based model allocation
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
Labels: feature
#95 - ENH: Add download progress if model is not cached
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#95 - ENH: Add download progress if model is not cached
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#94 - FEAT: model group and load blancer
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 3 comments
Labels: feature, stale
#94 - FEAT: model group and load blancer
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 3 comments
Labels: feature, stale
#93 - FEAT: dashboard
Issue -
State: closed - Opened by UranusSeven over 1 year ago
Labels: help wanted, feature, gpu
#93 - FEAT: dashboard
Issue -
State: closed - Opened by UranusSeven over 1 year ago
Labels: help wanted, feature, gpu
#92 - BLD: Add workflow for uploading to PyPI
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#92 - BLD: Add workflow for uploading to PyPI
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#91 - ENH: remove baichuan-chat
Issue -
State: closed - Opened by aresnow1 over 1 year ago
Labels: enhancement
#91 - ENH: remove baichuan-chat
Issue -
State: closed - Opened by aresnow1 over 1 year ago
Labels: enhancement
#90 - FEAT: add both versions of chatglm
Pull Request -
State: closed - Opened by Bojun-Feng over 1 year ago
#90 - FEAT: add both versions of chatglm
Pull Request -
State: closed - Opened by Bojun-Feng over 1 year ago
#89 - REF: rename package
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#88 - ENH: unify gradio and fastapi
Pull Request -
State: closed - Opened by jiayini1119 over 1 year ago
#88 - ENH: unify gradio and fastapi
Pull Request -
State: closed - Opened by jiayini1119 over 1 year ago
#87 - BUG: too many clients
Pull Request -
State: closed - Opened by Bojun-Feng over 1 year ago
#86 - BUG: too many clients
Pull Request -
State: closed - Opened by Bojun-Feng over 1 year ago
#85 - REF: pass model uid and spec to model
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#85 - REF: pass model uid and spec to model
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#84 - BUG: too many clients
Issue -
State: closed - Opened by Bojun-Feng over 1 year ago
#84 - BUG: too many clients
Issue -
State: closed - Opened by Bojun-Feng over 1 year ago
#83 - BUG: RESTful api actor cannot exit
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#82 - BLD: repo rename & make public
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 1 comment
Labels: build
#82 - BLD: repo rename & make public
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 1 comment
Labels: build
#81 - BLD: pypi
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 1 comment
Labels: build
#81 - BLD: pypi
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 1 comment
Labels: build
#80 - ENH: Download integrity
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
Labels: enhancement
#80 - ENH: Download integrity
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
Labels: enhancement
#79 - FEAT: Verify download integrity
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
#79 - FEAT: Verify download integrity
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
#78 - ENH: Report worker status to supervisor periodically
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#78 - ENH: Report worker status to supervisor periodically
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#77 - TST: code cov
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
Labels: testing
#77 - TST: code cov
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
Labels: testing
#76 - DOC: issue template
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#75 - FEAT: Support chatglm-6b
Pull Request -
State: closed - Opened by Bojun-Feng over 1 year ago
#75 - FEAT: Support chatglm-6b
Pull Request -
State: closed - Opened by Bojun-Feng over 1 year ago
#74 - FEAT: Support Command Line Operation for Chat functionality
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
#74 - FEAT: Support Command Line Operation for Chat functionality
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
#73 - FEAT: async client
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#73 - FEAT: async client
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#72 - ENH: let users install libs like llama-cpp-python
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 1 comment
Labels: enhancement
#72 - ENH: let users install libs like llama-cpp-python
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 1 comment
Labels: enhancement
#71 - TST: CI
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#70 - FEAT: Generate through cmdline
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
#70 - FEAT: Generate through cmdline
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
#69 - ENH: unify gradio and fastapi
Issue -
State: closed - Opened by UranusSeven over 1 year ago
#69 - ENH: unify gradio and fastapi
Issue -
State: closed - Opened by UranusSeven over 1 year ago
#68 - ENH: disable stream by default
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#67 - BUG: fix mypy
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#66 - TST: asyncio mode auto
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#66 - TST: asyncio mode auto
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#65 - ENH: `stream=False` for API compatibility
Issue -
State: closed - Opened by UranusSeven over 1 year ago
#65 - ENH: `stream=False` for API compatibility
Issue -
State: closed - Opened by UranusSeven over 1 year ago
#64 - REF: refactor chat history for restful api
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#64 - REF: refactor chat history for restful api
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#63 - FEAT: localization language support
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#63 - FEAT: localization language support
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#62 - FEAT: Support generate from query via command line
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
#62 - FEAT: Support generate from query via command line
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
#61 - Feature: Generate and Chat through Command Line
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
#61 - Feature: Generate and Chat through Command Line
Pull Request -
State: closed - Opened by RayJi01 over 1 year ago
#60 - Fix stop reason
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#60 - Fix stop reason
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#59 - Rename some classes and files
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#59 - Rename some classes and files
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#58 - FEAT: generate & chat through cmdline
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 1 comment
#58 - FEAT: generate & chat through cmdline
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 1 comment
#57 - TST: fix mypy
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#57 - TST: fix mypy
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#56 - REF: change completion type for RESTful API
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#55 - TST: lint
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#54 - BUG: model.generate is not thread safe
Issue -
State: closed - Opened by aresnow1 over 1 year ago
- 1 comment
Labels: bug
#54 - BUG: model.generate is not thread safe
Issue -
State: closed - Opened by aresnow1 over 1 year ago
- 1 comment
Labels: bug
#53 - TST: setup CI
Issue -
State: closed - Opened by UranusSeven over 1 year ago
#53 - TST: setup CI
Issue -
State: closed - Opened by UranusSeven over 1 year ago
#52 - TST: add test and ensure coverage
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 2 comments
Labels: testing, stale
#52 - TST: add test and ensure coverage
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 2 comments
Labels: testing, stale
#51 - FEAT: support orca
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#51 - FEAT: support orca
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#50 - FEAT: Speech Recognition Whisper
Pull Request -
State: closed - Opened by Zhou1213CN over 1 year ago
Labels: feature
#50 - FEAT: Speech Recognition Whisper
Pull Request -
State: closed - Opened by Zhou1213CN over 1 year ago
Labels: feature
#49 - ENH: increase context length
Issue -
State: closed - Opened by UranusSeven over 1 year ago
#48 - BUG: fix controller cmdline
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#48 - BUG: fix controller cmdline
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#47 - BUG: gradio should call `generate` when `chat` is not available
Issue -
State: closed - Opened by UranusSeven over 1 year ago
Labels: bug
#47 - BUG: gradio should call `generate` when `chat` is not available
Issue -
State: closed - Opened by UranusSeven over 1 year ago
Labels: bug
#46 - BUG: list index out of range on controller start
Issue -
State: closed - Opened by UranusSeven over 1 year ago
#45 - REF: refactor model spec
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#45 - REF: refactor model spec
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#44 - ENH: Add checkbox to show stop reason & window size of chat history
Pull Request -
State: closed - Opened by aresnow1 over 1 year ago
#43 - BUG: list model return value has terminated models
Issue -
State: closed - Opened by UranusSeven over 1 year ago
#42 - ENH: cache model
Issue -
State: closed - Opened by UranusSeven over 1 year ago
Labels: enhancement
#41 - ENH: integrity verify after download
Issue -
State: closed - Opened by UranusSeven over 1 year ago
Labels: enhancement
#40 - FEAT: RESTful API
Pull Request -
State: closed - Opened by jiayini1119 over 1 year ago
#39 - FEAT: support chatglm-6b
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 1 comment
#38 - FEAT: local deployment
Pull Request -
State: closed - Opened by UranusSeven over 1 year ago
#37 - REF: refactor ModelSpec to support more built in models
Issue -
State: closed - Opened by UranusSeven over 1 year ago
#36 - ENH: support custom model
Issue -
State: closed - Opened by UranusSeven over 1 year ago
- 1 comment
Labels: enhancement, high priority