Hugging-Face-Supporter/tftokenizers issues and pull requests

#22 - Repository doesn't contain covert.py file

Issue - State: open - Opened by Captaindoggo over 1 year ago

#21 - Can't reproduce the exampe in the Readme

Issue - State: open - Opened by IlnarSelimcan over 1 year ago - 3 comments

#20 - Missing trace on some of the tokenizer functions

Issue - State: open - Opened by MarkusSagen almost 3 years ago
Labels: bug, enhancement

#19 - Remove dependencies

Pull Request - State: open - Opened by MarkusSagen almost 3 years ago

#18 - [Optional] Provide TFAutoModels for different head types

Issue - State: open - Opened by MarkusSagen almost 3 years ago
Labels: enhancement, good first issue, feature request

#17 - Reduce tensorflow noise

Issue - State: open - Opened by MarkusSagen almost 3 years ago

#16 - Use built in function to access special tokens and ids

Issue - State: open - Opened by MarkusSagen almost 3 years ago
Labels: bug, enhancement, feature request

#15 - Remove unneeded dependencies

Pull Request - State: closed - Opened by MarkusSagen almost 3 years ago

#14 - Include-more-bert-tokenizers

Pull Request - State: closed - Opened by MarkusSagen almost 3 years ago

#13 - Add support for KB-BERT

Issue - State: closed - Opened by MarkusSagen almost 3 years ago - 1 comment
Labels: feature request

#12 - Remove deprecated class `TFTokenizerBase`

Issue - State: open - Opened by MarkusSagen almost 3 years ago
Labels: enhancement, good first issue

#11 - Describe how more tokenizers can be added

Issue - State: open - Opened by MarkusSagen almost 3 years ago
Labels: documentation

#10 - BertTokenizer may not be optimal choice for converstion

Issue - State: open - Opened by MarkusSagen almost 3 years ago
Labels: bug, enhancement

#9 - Support sentence-transformers

Issue - State: closed - Opened by MarkusSagen almost 3 years ago
Labels: feature request

#8 - Provide examples for NER, QA, Classification examples

Issue - State: open - Opened by MarkusSagen almost 3 years ago
Labels: documentation, feature request

#7 - Support GPT-sw3

Issue - State: open - Opened by MarkusSagen almost 3 years ago
Labels: feature request

#6 - Support T5

Issue - State: open - Opened by MarkusSagen almost 3 years ago
Labels: feature request

#5 - Conversion to BERT models always makes lowercase

Issue - State: closed - Opened by MarkusSagen almost 3 years ago - 1 comment
Labels: bug

#4 - Tokenizers do not convert tokens correctly

Issue - State: closed - Opened by MarkusSagen almost 3 years ago - 2 comments
Labels: bug, enhancement, good first issue

#3 - Tokenizer's `model_max_length` is not consistent

Issue - State: open - Opened by MarkusSagen almost 3 years ago
Labels: bug

#2 - Enable more tokenizers, s.a. SentencePiece

Issue - State: open - Opened by MarkusSagen almost 3 years ago
Labels: enhancement, feature request

#1 - Load tokenizer with `from_pretrained`

Pull Request - State: closed - Opened by MarkusSagen about 3 years ago

Ecosyste.ms: Issues

GitHub / Hugging-Face-Supporter/tftokenizers issues and pull requests