Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / microsoft/aici issues and pull requests

#115 - Scaling performance as sequences exceeds core count

Issue - State: open - Opened by AaronFriel 9 days ago - 3 comments

#114 - Bump torch from 2.1.2 to 2.2.0 in /.devcontainer in the pip group across 1 directory

Pull Request - State: open - Opened by dependabot[bot] about 2 months ago
Labels: dependencies, python

#113 - Bump openssl from 0.10.62 to 0.10.66 in the cargo group across 1 directory

Pull Request - State: closed - Opened by dependabot[bot] 2 months ago
Labels: dependencies

#112 - Fix promptlib by using deprecated AST module

Pull Request - State: closed - Opened by s-zanella 3 months ago - 1 comment

#110 - [Fix] Uninstall transformer_engine in Dockerfile-vllm

Pull Request - State: closed - Opened by GindaChen 3 months ago

#105 - promptlib is broken

Issue - State: closed - Opened by renatolfc 4 months ago

#103 - Updated README to add citation

Pull Request - State: closed - Opened by emrekiciman 5 months ago

#102 - Updating README with recommended citation

Pull Request - State: closed - Opened by emrekiciman 5 months ago

#101 - update llama.cpp to b2757

Pull Request - State: open - Opened by mmoskal 5 months ago

#100 - crash

Issue - State: closed - Opened by pelikhan 5 months ago

#99 - Support for phi3 - llama.cpp update

Issue - State: open - Opened by superchargez 5 months ago - 2 comments

#98 - token length limit

Issue - State: closed - Opened by mmoskal 5 months ago
Labels: bug

#97 - Bump rustls from 0.22.2 to 0.22.4 in the cargo group across 1 directory

Pull Request - State: closed - Opened by dependabot[bot] 5 months ago
Labels: dependencies

#94 - graceful mid_process() timeout handling

Issue - State: closed - Opened by mmoskal 5 months ago

#93 - pytctrl backtracking is non-idempotent

Issue - State: open - Opened by matthai 5 months ago - 2 comments

#92 - remove pre/post callbacks

Pull Request - State: closed - Opened by mmoskal 5 months ago - 1 comment

#91 - guidance controller

Issue - State: open - Opened by mmoskal 5 months ago

#90 - support native controllers

Issue - State: open - Opened by mmoskal 5 months ago

#89 - Bump h2 from 0.3.24 to 0.3.26

Pull Request - State: closed - Opened by dependabot[bot] 6 months ago
Labels: dependencies

#88 - Exception when no token generated

Issue - State: open - Opened by matthai 6 months ago - 1 comment

#87 - confusing error for missing CUDA compute cap 8.0

Issue - State: open - Opened by vargonis 6 months ago - 2 comments
Labels: bug

#84 - Refactor AICI to use WebAssembly Component Model

Pull Request - State: open - Opened by AaronFriel 6 months ago - 18 comments

#82 - update llama.cpp to b2529

Pull Request - State: closed - Opened by mmoskal 6 months ago - 1 comment

#81 - better error on prompt len exceeded in rllm

Issue - State: open - Opened by mmoskal 6 months ago
Labels: bug, rLLM

#80 - Expose the server on 0.0.0.0 in order to be called from outside

Issue - State: open - Opened by anielennova 6 months ago - 1 comment

#79 - can't build pyctrl on WSL (windows 11)

Issue - State: open - Opened by superchargez 6 months ago - 1 comment

#78 - duplicate tokens in tokenizers

Issue - State: open - Opened by mmoskal 6 months ago - 1 comment

#77 - add logLevel and setLogLevel in jsctrl

Issue - State: closed - Opened by mmoskal 6 months ago
Labels: good first issue

#76 - add TokenSet.numSet/toString and tokenRepr in jsctrl

Pull Request - State: closed - Opened by kevinmingtarja 6 months ago - 2 comments

#75 - Server crashes with `index out of bounds`

Issue - State: open - Opened by samrat 6 months ago - 2 comments

#74 - JSON output doesn't conform to pattern

Issue - State: open - Opened by samrat 6 months ago - 3 comments
Labels: bug, good first issue

#72 - Update _gen.py

Pull Request - State: closed - Opened by eltociear 6 months ago - 1 comment

#71 - Question about FixedToken (insertion)?

Issue - State: closed - Opened by JohnPeng47 6 months ago

#70 - investigate Wasm component model for AICI functions

Issue - State: open - Opened by mmoskal 6 months ago - 2 comments

#67 - [RFC] drop pre/post callback, only leave mid

Issue - State: closed - Opened by mmoskal 6 months ago

#66 - [DO NOT MERGE] TLA+ type annotations

Pull Request - State: open - Opened by lemmy 6 months ago

#65 - Bump mio from 0.8.10 to 0.8.11

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago
Labels: dependencies

#64 - add TokenSet.num_set/repr in jsctrl

Issue - State: closed - Opened by mmoskal 7 months ago - 3 comments
Labels: good first issue

#63 - vLLM integration

Issue - State: open - Opened by emrekiciman 7 months ago - 1 comment
Labels: enhancement

#62 - Allow host to be specified in the commandline arg

Pull Request - State: closed - Opened by blmarket 7 months ago

#61 - Minor tweaks to README

Pull Request - State: closed - Opened by dluc 7 months ago - 2 comments

#59 - add "prompted virtualized repl agent" as pseudo model

Issue - State: closed - Opened by darvin 7 months ago - 2 comments
Labels: waiting for original poster

#58 - add more lr grammars

Issue - State: open - Opened by darvin 7 months ago - 1 comment
Labels: good first issue

#57 - allow passing binary data to controllers

Issue - State: open - Opened by mmoskal 7 months ago

#56 - better folder structure

Issue - State: closed - Opened by mmoskal 8 months ago - 2 comments

#55 - allow aici tool to download controllers from github

Issue - State: closed - Opened by mmoskal 8 months ago - 1 comment

#54 - have bump.sh update version field in cargo.toml

Issue - State: open - Opened by mmoskal 8 months ago
Labels: good first issue

#53 - Update README, walk through example end to end

Pull Request - State: closed - Opened by dluc 8 months ago - 1 comment

#52 - return non 500 on "instantiate" timeout

Issue - State: open - Opened by mmoskal 8 months ago

#51 - split out rllm common from rllm-cuda

Pull Request - State: closed - Opened by mmoskal 8 months ago

#50 - Warning(s) when starting rLLM-cpp

Issue - State: closed - Opened by dluc 8 months ago - 1 comment

#49 - Fix a few minor typos

Pull Request - State: closed - Opened by dluc 8 months ago - 1 comment

#48 - split out common rllm from rllm-cuda

Issue - State: closed - Opened by mmoskal 8 months ago

#47 - llama CPU phi2 model wrong generation

Issue - State: closed - Opened by mmoskal 8 months ago

#46 - GPU acceleration on mac M1

Issue - State: closed - Opened by mmoskal 8 months ago

#45 - Bump shlex from 1.2.0 to 1.3.0

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago - 1 comment
Labels: dependencies

#44 - use pyaici.cli.build_rust and pyaici.rest.upload_wasm

Issue - State: open - Opened by mmoskal 8 months ago - 1 comment

#43 - update comms.py for new interface

Issue - State: closed - Opened by mmoskal 8 months ago

#42 - aicirt native Windows support

Issue - State: open - Opened by mmoskal 8 months ago - 1 comment

#41 - allow JSON-encoded "files" to pyctrl/jsctrl

Issue - State: open - Opened by mmoskal 8 months ago

#40 - join post+pre into one RPC call to aicirt

Issue - State: closed - Opened by mmoskal 8 months ago - 1 comment

#40 - join post+pre into one RPC call to aicirt

Issue - State: closed - Opened by mmoskal 8 months ago - 1 comment

#39 - introduce new REST API for controller running

Issue - State: closed - Opened by mmoskal 8 months ago

#38 - document interface between aicirt and LLM engine

Issue - State: closed - Opened by mmoskal 8 months ago - 1 comment

#38 - document interface between aicirt and LLM engine

Issue - State: closed - Opened by mmoskal 8 months ago - 1 comment

#37 - rewrite promptlib to use pyctrl not declctrl

Issue - State: open - Opened by mmoskal 8 months ago

#36 - support for Python 3.8 in aici command line

Issue - State: closed - Opened by mmoskal 8 months ago

#35 - Bump h2 from 0.3.22 to 0.3.24

Pull Request - State: closed - Opened by dependabot[bot] 8 months ago
Labels: dependencies

#34 - integrate with llama.cpp

Issue - State: closed - Opened by mmoskal 8 months ago

#33 - add samples to jsctrl readme

Issue - State: open - Opened by mmoskal 8 months ago - 1 comment
Labels: good first issue

#32 - don't import numpy in aici cmd line

Issue - State: closed - Opened by mmoskal 8 months ago

#31 - Update README.md

Pull Request - State: closed - Opened by emrekiciman 8 months ago

#30 - Create separate devcontainer files for rllm and pyvm

Issue - State: closed - Opened by mmoskal 9 months ago

#29 - Allow tagging wasm modules

Issue - State: closed - Opened by mmoskal 9 months ago

#28 - prompt sharing for faster page attn

Issue - State: open - Opened by mmoskal 9 months ago
Labels: rLLM

#27 - implement separate stream for memory copy

Issue - State: open - Opened by mmoskal 9 months ago - 1 comment
Labels: rLLM

#26 - scheduler

Issue - State: open - Opened by mmoskal 9 months ago
Labels: rLLM

#25 - Bump zerocopy from 0.7.26 to 0.7.31 in /pyvm

Pull Request - State: closed - Opened by dependabot[bot] 9 months ago - 1 comment
Labels: dependencies

#22 - SeqId should start at 0 for every group

Issue - State: open - Opened by mmoskal 10 months ago

#21 - have aici_init() return max number of forks

Issue - State: open - Opened by mmoskal 10 months ago

#20 - check on pipelining

Issue - State: closed - Opened by mmoskal 10 months ago

#19 - very low temperature causes crash in sampling

Issue - State: open - Opened by mmoskal 11 months ago

#18 - rich AICI interface

Issue - State: closed - Opened by mmoskal 11 months ago

#17 - backtracking and fast-forward in vllm

Issue - State: closed - Opened by mmoskal 11 months ago - 2 comments

#15 - use processes not threads for workers

Issue - State: closed - Opened by mmoskal 11 months ago - 2 comments

#14 - make sure there's no race writing files in create_module()

Issue - State: closed - Opened by mmoskal 11 months ago

#13 - async side channel comms

Issue - State: closed - Opened by mmoskal 11 months ago

#12 - Bump rustix from 0.38.13 to 0.38.20 in /aicirt

Pull Request - State: closed - Opened by dependabot[bot] 11 months ago - 1 comment
Labels: dependencies

#11 - re-compile modules in cache when needed

Issue - State: closed - Opened by mmoskal 11 months ago

#10 - file c.y missing

Issue - State: closed - Opened by emrekiciman 11 months ago - 1 comment

#9 - gc unused module instances

Issue - State: open - Opened by mmoskal 11 months ago

#8 - Bump rustix from 0.38.13 to 0.38.19 in /aicirt

Pull Request - State: closed - Opened by dependabot[bot] 11 months ago - 1 comment
Labels: dependencies

#7 - `max_words`, `max_bytes` constraints on `Gen`

Issue - State: closed - Opened by mmoskal 11 months ago - 1 comment