Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / simonw/ttok issues and pull requests

#14 - Add new OpenAI models to README

Pull Request - State: open - Opened by Xceron 8 days ago

#13 - Options for special token handling

Issue - State: closed - Opened by grantjenks 8 months ago - 3 comments
Labels: enhancement

#12 - Add allowed-special

Pull Request - State: closed - Opened by FergusFettes 9 months ago - 1 comment

#11 - Does `ttok` need an internet connection?

Issue - State: open - Opened by NightMachinery 10 months ago - 3 comments

#10 - ttok adds a 20 second delay when using llm-gpt4all when offline

Issue - State: open - Opened by learning4life 12 months ago - 1 comment

#9 - Support for other models via Hugging Face tokenizers

Pull Request - State: open - Opened by simonw about 1 year ago - 2 comments
Labels: enhancement

#8 - Ability to count tokens for models other than OpenAI

Issue - State: open - Opened by simonw about 1 year ago - 3 comments
Labels: enhancement

#7 - Option to turn token integers back into text

Issue - State: closed - Opened by simonw over 1 year ago - 6 comments
Labels: enhancement

#6 - Truncate => trim tokens

Issue - State: open - Opened by jefftriplett over 1 year ago

#5 - Verbose option

Issue - State: open - Opened by faroukfaiz10 over 1 year ago
Labels: enhancement

#4 - An additional option to view the actual tokenized text

Issue - State: closed - Opened by oostopitre over 1 year ago - 11 comments
Labels: enhancement

#3 - Mechanism for splitting rather than truncating

Issue - State: open - Opened by simonw over 1 year ago - 21 comments
Labels: enhancement

#2 - Add split option to split large input into smaller parts instead of truncating

Pull Request - State: open - Opened by c4pt0r over 1 year ago - 2 comments

#1 - Initial design

Issue - State: closed - Opened by simonw over 1 year ago - 3 comments
Labels: enhancement