Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / sugarme/tokenizer issues and pull requests
#24 - How to load self-made vocab.txt
Issue -
State: open - Opened by lierik about 2 years ago
- 3 comments
#23 - Use go:embed for pretrained gpt2 tokenizer, add missing json
Pull Request -
State: open - Opened by adayNU over 2 years ago
- 1 comment
#20 - Performance / Parallelization Support
Issue -
State: closed - Opened by JoeREISys over 2 years ago
- 3 comments
#19 - fatal error: concurrent map read and map write
Issue -
State: closed - Opened by daudcanugerah about 3 years ago
- 2 comments
#18 - Bump version?
Issue -
State: open - Opened by hugbubby over 3 years ago
#17 - BOS/EOS tokens
Issue -
State: open - Opened by trpstra almost 4 years ago
- 1 comment
#15 - int64
Issue -
State: open - Opened by sugarme about 4 years ago
Labels: enhancement
#14 - Truncation and Padding not working properly
Issue -
State: closed - Opened by sugarme about 4 years ago
Labels: bug
#13 - Wordpiece Decoder
Issue -
State: closed - Opened by sugarme about 4 years ago
- 1 comment
Labels: bug
#12 - Decoder using pointer to interface
Issue -
State: closed - Opened by sugarme about 4 years ago
Labels: bug
#11 - Add optional `addSpecialTokens` when encoding
Issue -
State: closed - Opened by sugarme about 4 years ago
Labels: enhancement
#10 - resolved #9 - setup pretrained subpackage
Pull Request -
State: closed - Opened by sugarme about 4 years ago
Labels: enhancement
#9 - pretrained tokenizers
Issue -
State: closed - Opened by sugarme about 4 years ago
Labels: enhancement
#8 - fixed #5 : fixed merging incorrectly at overflowings field.
Pull Request -
State: closed - Opened by sugarme about 4 years ago
Labels: bug
#7 - feat(resolved #4)
Pull Request -
State: closed - Opened by sugarme about 4 years ago
Labels: enhancement
#6 - fixed(fixed #5 - Truncate incorrectly due to method MergeWith)
Pull Request -
State: closed - Opened by sugarme about 4 years ago
Labels: bug
#5 - Encode - Truncation working incorrectly with DualEncodeInput
Issue -
State: closed - Opened by sugarme about 4 years ago
- 1 comment
Labels: bug
#4 - pointer receiver
Issue -
State: closed - Opened by sugarme about 4 years ago
Labels: enhancement
#3 - Update License, README, Travis CI, Go report badge and bump version
Issue -
State: closed - Opened by sugarme about 4 years ago
Labels: documentation, enhancement
#2 - serialization
Issue -
State: open - Opened by sugarme about 4 years ago
Labels: enhancement
#1 - Byte offsets
Pull Request -
State: closed - Opened by sugarme about 4 years ago
Labels: enhancement