Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / bhavnicksm/autotiktokenizer issues and pull requests

#17 - Bump version to 0.2.2 and update __init__.py to reflect the new version

Pull Request - State: closed - Opened by bhavnicksm about 2 months ago

#16 - Fix #10: Add local tokenizer support

Pull Request - State: closed - Opened by bhavnicksm about 2 months ago

#15 - update `from_pretrained` method

Pull Request - State: open - Opened by not-lain 2 months ago - 4 comments

#14 - add extra parameters to the `from_pretrained` method

Issue - State: open - Opened by not-lain 2 months ago - 3 comments

#13 - support local tiktokenizer loading

Pull Request - State: closed - Opened by not-lain 3 months ago - 1 comment

#12 - [BUG] Fix path to support windows machines

Pull Request - State: closed - Opened by not-lain 3 months ago

#11 - Autotiktokenizer does not work in windows

Issue - State: closed - Opened by not-lain 3 months ago

#10 - Load offline tokenizers with AutoTikTokenizer

Issue - State: closed - Opened by bhavnicksm 3 months ago - 5 comments

#9 - Add support for WordPiece Tokenizers + Aya Family

Pull Request - State: closed - Opened by bhavnicksm 3 months ago

#8 - Remove tokenizers dependency from AutoTikTokenizers

Pull Request - State: closed - Opened by bhavnicksm 3 months ago

#7 - Bump version to 0.1.2 and update package metadata

Pull Request - State: closed - Opened by bhavnicksm 3 months ago

#6 - Update README.md

Pull Request - State: closed - Opened by bhavnicksm 3 months ago

#5 - Update README.md

Pull Request - State: closed - Opened by bhavnicksm 3 months ago

#4 - Bump version to 0.1.1 and enhance _AutoTikTokenizer functionality

Pull Request - State: closed - Opened by bhavnicksm 3 months ago

#3 - Add logo + Bump version to v0.1.0

Pull Request - State: closed - Opened by bhavnicksm 3 months ago

#2 - Add version and author metadata to AutoTikTokenizer

Pull Request - State: closed - Opened by bhavnicksm 3 months ago

#1 - Initial Commit

Pull Request - State: closed - Opened by bhavnicksm 3 months ago