OoriData/Toolio issues and pull requests

#36 - Rearchitecting to take advantage of the latest in mlx_lm

Pull Request - State: open - Opened by uogbuji about 1 month ago - 17 comments

#35 - Scaled Dot Product Attention Error

Issue - State: closed - Opened by reemabdelrazek30 about 1 month ago - 2 comments

#34 - local_model_runner doesn't exist

Issue - State: closed - Opened by reemabdelrazek30 about 1 month ago - 3 comments

#33 - Re-integrate better into mlx_lm

Issue - State: open - Opened by uogbuji about 1 month ago - 1 comment

#31 - First pass at 'vendoring' llm_structured_output into Toolio

Pull Request - State: closed - Opened by uogbuji about 1 month ago - 2 comments

#30 - Receiving mlx.core.array getting text from a model manager

Issue - State: closed - Opened by chimezie about 2 months ago - 4 comments

#28 - Identified more problems affecting tool use performance

Pull Request - State: closed - Opened by uogbuji 2 months ago

#26 - Set up GitHub Actions publish to PyPI

Issue - State: open - Opened by uogbuji 3 months ago

#25 - Derive a rough subreddit/topic DB, for use in some Toolio demos

Issue - State: open - Opened by uogbuji 3 months ago

#24 - Load failed in TypingMind and big-AGI

Issue - State: open - Opened by vlbosch 4 months ago - 2 comments

#22 - ModuleNotFoundError: No module named 'mlx'

Issue - State: closed - Opened by emekaokoye 6 months ago - 3 comments

#19 - 18 prompt overriding

Pull Request - State: closed - Opened by uogbuji 6 months ago

#18 - Clarify the process of overriding prompts

Issue - State: closed - Opened by uogbuji 6 months ago

#17 - Process pool for multiple loaded LLMs, and a queuing system from the FastAPI/uvicorn workers

Issue - State: open - Opened by uogbuji 6 months ago

#12 - Weirdness with tokenization in Phi-3

Issue - State: open - Opened by uogbuji 7 months ago - 3 comments

#10 - AttributeError: 'ReusableKVCache' object has no attribute 'head_dim'

Issue - State: closed - Opened by uogbuji 7 months ago - 1 comment

#7 - Model type isn't a reliable way to determine e.g. whether the system role is supported

Issue - State: open - Opened by uogbuji 7 months ago - 1 comment

#6 - Support for gemma models

Pull Request - State: closed - Opened by uogbuji 7 months ago

#5 - Comply with OpenAI server by making schema optional.

Pull Request - State: closed - Opened by namin 7 months ago - 1 comment

#1 - Gemma support (re Jinja error: "System role not supported")

Issue - State: closed - Opened by uogbuji 7 months ago - 4 comments

Ecosyste.ms: Issues

GitHub / OoriData/Toolio issues and pull requests