Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / dottxt-ai/benchmarks issues and pull requests

#44 - Remove link to Outlines in README

Pull Request - State: closed - Opened by rlouf 4 months ago
Labels: documentation

#44 - Remove link to Outlines in README

Pull Request - State: closed - Opened by rlouf 4 months ago
Labels: documentation

#43 - Remove mention of Outlines in the README

Pull Request - State: closed - Opened by rlouf 4 months ago

#43 - Remove mention of Outlines in the README

Pull Request - State: closed - Opened by rlouf 4 months ago

#42 - Remove `outlines` from the README

Issue - State: closed - Opened by rlouf 4 months ago
Labels: documentation

#42 - Remove `outlines` from the README

Issue - State: closed - Opened by rlouf 4 months ago
Labels: documentation

#41 - Normalize runtime timings by the number of tokens

Issue - State: open - Opened by rlouf 4 months ago
Labels: enhancement

#41 - Normalize runtime timings by the number of tokens

Issue - State: open - Opened by rlouf 4 months ago
Labels: enhancement

#40 - Run the benchmarks nightly

Pull Request - State: closed - Opened by rlouf 4 months ago

#40 - Run the benchmarks nightly

Pull Request - State: closed - Opened by rlouf 4 months ago

#39 - Remove outlines from the benchmarks

Pull Request - State: closed - Opened by rlouf 4 months ago

#39 - Remove outlines from the benchmarks

Pull Request - State: closed - Opened by rlouf 4 months ago

#38 - Duplicate `outlines` timing code in `outlines-core`

Pull Request - State: closed - Opened by rlouf 4 months ago

#38 - Duplicate `outlines` timing code in `outlines-core`

Pull Request - State: closed - Opened by rlouf 4 months ago

#37 - Run the benchmarks nightly on `main`

Issue - State: closed - Opened by rlouf 4 months ago
Labels: enhancement

#37 - Run the benchmarks nightly on `main`

Issue - State: closed - Opened by rlouf 4 months ago
Labels: enhancement

#36 - Remove Outlines from the benchmarks

Issue - State: closed - Opened by rlouf 4 months ago
Labels: enhancement

#36 - Remove Outlines from the benchmarks

Issue - State: closed - Opened by rlouf 4 months ago
Labels: enhancement

#35 - Add 100 Samples Per Regex / JSON Schema

Pull Request - State: closed - Opened by lapp0 4 months ago - 7 comments

#35 - Add 100 Samples Per Regex / JSON Schema

Pull Request - State: closed - Opened by lapp0 4 months ago - 7 comments

#34 - Gather output types

Pull Request - State: closed - Opened by rlouf 4 months ago

#34 - Gather output types

Pull Request - State: closed - Opened by rlouf 4 months ago

#33 - Gather data in a single file

Pull Request - State: closed - Opened by rlouf 4 months ago
Labels: enhancement

#33 - Gather data in a single file

Pull Request - State: closed - Opened by rlouf 4 months ago
Labels: enhancement

#32 - Update Outlines version

Pull Request - State: closed - Opened by rlouf 4 months ago

#32 - Update Outlines version

Pull Request - State: closed - Opened by rlouf 4 months ago

#31 - Add outlines core

Pull Request - State: closed - Opened by rlouf 4 months ago

#31 - Add outlines core

Pull Request - State: closed - Opened by rlouf 4 months ago

#30 - Add `outlines-core` to the benchmark suite

Issue - State: closed - Opened by rlouf 4 months ago

#30 - Add `outlines-core` to the benchmark suite

Issue - State: closed - Opened by rlouf 4 months ago

#29 - Include setup time benchmark

Issue - State: closed - Opened by rlouf 4 months ago

#29 - Include setup time benchmark

Issue - State: closed - Opened by rlouf 4 months ago

#28 - Add long number case

Pull Request - State: closed - Opened by rlouf 4 months ago

#28 - Add long number case

Pull Request - State: closed - Opened by rlouf 4 months ago

#27 - Confirm that the index cache isn't being used

Issue - State: closed - Opened by brandonwillard 5 months ago
Labels: bug

#27 - Confirm that the index cache isn't being used

Issue - State: closed - Opened by brandonwillard 5 months ago
Labels: bug

#26 - Add new regex

Pull Request - State: closed - Opened by rlouf 5 months ago
Labels: enhancement

#26 - Add new regex

Pull Request - State: closed - Opened by rlouf 5 months ago
Labels: enhancement

#25 - Add logo

Pull Request - State: closed - Opened by rlouf 5 months ago

#25 - Add logo

Pull Request - State: closed - Opened by rlouf 5 months ago

#24 - Group regexes and JSON Schemas in one file

Issue - State: closed - Opened by rlouf 6 months ago
Labels: enhancement

#24 - Group regexes and JSON Schemas in one file

Issue - State: closed - Opened by rlouf 6 months ago
Labels: enhancement

#23 - Add complex JSON Schema

Pull Request - State: closed - Opened by rlouf 6 months ago

#23 - Add complex JSON Schema

Pull Request - State: closed - Opened by rlouf 6 months ago

#22 - Add Json Schema benchmark

Pull Request - State: closed - Opened by rlouf 6 months ago

#22 - Add Json Schema benchmark

Pull Request - State: closed - Opened by rlouf 6 months ago

#20 - Increase DFA size in GSM8K example

Pull Request - State: closed - Opened by rlouf 6 months ago

#20 - Increase DFA size in GSM8K example

Pull Request - State: closed - Opened by rlouf 6 months ago

#19 - Compare libraries when several sequences are generated

Issue - State: closed - Opened by rlouf 6 months ago
Labels: enhancement, help wanted

#19 - Compare libraries when several sequences are generated

Issue - State: closed - Opened by rlouf 6 months ago
Labels: enhancement, help wanted

#18 - Add JSON Schema with varying depths

Issue - State: open - Opened by rlouf 6 months ago
Labels: enhancement

#18 - Add JSON Schema with varying depths

Issue - State: open - Opened by rlouf 6 months ago
Labels: enhancement

#17 - Add GSM8K regex

Pull Request - State: closed - Opened by rlouf 6 months ago

#17 - Add GSM8K regex

Pull Request - State: closed - Opened by rlouf 6 months ago

#16 - Add regex that is challenging for Outlines

Issue - State: closed - Opened by rlouf 6 months ago
Labels: enhancement

#16 - Add regex that is challenging for Outlines

Issue - State: closed - Opened by rlouf 6 months ago
Labels: enhancement

#15 - Update the README

Pull Request - State: closed - Opened by rlouf 6 months ago

#15 - Update the README

Pull Request - State: closed - Opened by rlouf 6 months ago

#14 - Only show results when PR merged on `main`

Pull Request - State: closed - Opened by rlouf 6 months ago

#14 - Only show results when PR merged on `main`

Pull Request - State: closed - Opened by rlouf 6 months ago

#13 - Publish latest benchmarks using GitHub pages

Issue - State: open - Opened by rlouf 6 months ago
Labels: enhancement

#13 - Publish latest benchmarks using GitHub pages

Issue - State: open - Opened by rlouf 6 months ago
Labels: enhancement

#12 - Display timing differences in PR comments

Issue - State: open - Opened by rlouf 6 months ago
Labels: enhancement

#12 - Display timing differences in PR comments

Issue - State: open - Opened by rlouf 6 months ago
Labels: enhancement

#11 - Benchmark JSON Schema

Issue - State: closed - Opened by rlouf 6 months ago
Labels: enhancement

#11 - Benchmark JSON Schema

Issue - State: closed - Opened by rlouf 6 months ago
Labels: enhancement

#10 - Add URL regular expression

Pull Request - State: closed - Opened by rlouf 6 months ago

#9 - Use non-gated model / tokenizers

Issue - State: closed - Opened by rlouf 6 months ago
Labels: enhancement, help wanted

#8 - Add lm-format-enforcer benchmark

Pull Request - State: closed - Opened by rlouf 6 months ago

#7 - Fix the benchmarks for the Outlines library

Pull Request - State: closed - Opened by rlouf 6 months ago

#6 - Use HF secret token in CI

Pull Request - State: closed - Opened by rlouf 6 months ago

#5 - Move ASV config file

Pull Request - State: closed - Opened by rlouf 6 months ago

#4 - Move ASV config file

Pull Request - State: closed - Opened by rlouf 6 months ago

#3 - Move ASV config file

Pull Request - State: closed - Opened by rlouf 6 months ago

#2 - Move ASV config file

Pull Request - State: closed - Opened by rlouf 6 months ago

#1 - Set up and add benchmarks for the Outlines library

Pull Request - State: closed - Opened by rlouf 6 months ago