Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / eleutherai/tokengrams issues and pull requests

#22 - Fix bug in tokengrams python types

Pull Request - State: closed - Opened by luciaquirke 3 months ago

#21 - Example of text-generation from model

Issue - State: closed - Opened by dhowe 3 months ago - 1 comment

#20 - Update README and bump version

Pull Request - State: closed - Opened by luciaquirke 3 months ago

#19 - Add tokenization to readme

Pull Request - State: closed - Opened by luciaquirke 3 months ago

#18 - Add benchmark script and update README.md with results

Pull Request - State: closed - Opened by luciaquirke 3 months ago

#17 - Add tokenization util

Pull Request - State: closed - Opened by luciaquirke 3 months ago

#16 - Update readme and add benchmark script

Pull Request - State: closed - Opened by luciaquirke 4 months ago - 1 comment

#15 - Extract out PyO3 layer; add more IO methods to InMemoryIndex

Pull Request - State: closed - Opened by luciaquirke 4 months ago

#14 - Assert sorted after building table

Pull Request - State: closed - Opened by luciaquirke 4 months ago

#12 - [WIP] Add u32 token support for llama

Pull Request - State: closed - Opened by luciaquirke 4 months ago

#11 - Add sampler

Pull Request - State: closed - Opened by luciaquirke 4 months ago

#10 - Add sharded index with limited functionality

Pull Request - State: closed - Opened by luciaquirke 4 months ago

#9 - Kneser-ney smoothing

Pull Request - State: closed - Opened by luciaquirke 5 months ago

#9 - Kneser-ney smoothing

Pull Request - State: closed - Opened by luciaquirke 5 months ago

#8 - Add a pyproject.toml

Pull Request - State: closed - Opened by dashstander 5 months ago

#7 - Speed up count next

Pull Request - State: closed - Opened by luciaquirke 6 months ago

#6 - Error on pip install

Issue - State: closed - Opened by dhowe 7 months ago - 1 comment

#5 - Clean up names, fn privacy, docstrings; add unit tests CI

Pull Request - State: closed - Opened by luciaquirke 8 months ago

#4 - Clean up comments, fn privacy, and fn names

Pull Request - State: closed - Opened by luciaquirke 8 months ago

#3 - Add optional progress bar to index creation

Pull Request - State: closed - Opened by luciaquirke 8 months ago

#2 - Add n-gram sampling and a sorted check

Pull Request - State: closed - Opened by luciaquirke 8 months ago - 1 comment

#1 - GramCounter

Pull Request - State: closed - Opened by norabelrose 11 months ago