Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / dqbd/tiktokenizer issues and pull requests

#28 - Can we automatically add input templates for our models?

Issue - State: open - Opened by tcxia 4 months ago

#28 - Can we automatically add input templates for our models?

Issue - State: open - Opened by tcxia 4 months ago

#27 - Add gpt-4o-mini

Pull Request - State: open - Opened by PeterDaveHello 4 months ago - 1 comment

#27 - Add gpt-4o-mini

Pull Request - State: open - Opened by PeterDaveHello 4 months ago - 1 comment

#26 - [feat] Add docker support

Pull Request - State: open - Opened by dimaioksha 6 months ago - 1 comment

#26 - [feat] Add docker support

Pull Request - State: open - Opened by dimaioksha 6 months ago - 1 comment

#25 - Add `gpt-4o` pricing on TokenViewer

Pull Request - State: open - Opened by kimwonj77 7 months ago - 1 comment

#25 - Add `gpt-4o` pricing on TokenViewer

Pull Request - State: open - Opened by kimwonj77 7 months ago - 1 comment

#24 - Add new `o200k_base` OpenAi encoding for `gpt-4o`

Issue - State: closed - Opened by kimwonj77 7 months ago - 1 comment

#24 - Add new `o200k_base` OpenAi encoding for `gpt-4o`

Issue - State: closed - Opened by kimwonj77 7 months ago - 1 comment

#23 - Added and uncommented open source models

Pull Request - State: open - Opened by philipshurpik 7 months ago - 1 comment

#23 - Added and uncommented open source models

Pull Request - State: open - Opened by philipshurpik 7 months ago - 1 comment

#22 - TOKENS 切割功能

Issue - State: open - Opened by msjsc001 7 months ago

#22 - TOKENS 切割功能

Issue - State: open - Opened by msjsc001 7 months ago

#21 - Store encoder selection in URL

Pull Request - State: closed - Opened by dqbd 9 months ago - 1 comment

#20 - Support transformers-based tokenizers

Pull Request - State: closed - Opened by darknoon 9 months ago - 1 comment

#20 - Support transformers-based tokenizers

Pull Request - State: closed - Opened by darknoon 9 months ago - 1 comment

#19 - changing tokenizer resets the textarea

Issue - State: closed - Opened by opyate 9 months ago - 1 comment

#19 - changing tokenizer resets the textarea

Issue - State: closed - Opened by opyate 9 months ago - 1 comment

#18 - update pricing and differentiate output tokens in price calculation

Pull Request - State: open - Opened by mahdizaferanchi 9 months ago - 1 comment

#18 - update pricing and differentiate output tokens in price calculation

Pull Request - State: open - Opened by mahdizaferanchi 9 months ago - 1 comment

#17 - token count is inconsistent with OpenAI tokenizer

Issue - State: open - Opened by GorvGoyl about 1 year ago - 1 comment

#17 - token count is inconsistent with OpenAI tokenizer

Issue - State: open - Opened by GorvGoyl about 1 year ago - 1 comment

#16 - Add new OpenAI models

Issue - State: closed - Opened by BjoernRave about 1 year ago - 1 comment

#16 - Add new OpenAI models

Issue - State: closed - Opened by BjoernRave about 1 year ago - 1 comment

#15 - How can I get the correct output at the edge?

Issue - State: closed - Opened by gablabelle over 1 year ago - 1 comment

#15 - How can I get the correct output at the edge?

Issue - State: closed - Opened by gablabelle over 1 year ago - 1 comment

#14 - Can't run the tiktokenizer from the app folder in next.js

Issue - State: open - Opened by gablabelle over 1 year ago - 2 comments

#14 - Can't run the tiktokenizer from the app folder in next.js

Issue - State: open - Opened by gablabelle over 1 year ago - 2 comments

#13 - Mind if the OpenAI Cookbook repo points to your Tiktokenizer app?

Issue - State: open - Opened by ted-at-openai over 1 year ago - 3 comments

#13 - Mind if the OpenAI Cookbook repo points to your Tiktokenizer app?

Issue - State: open - Opened by ted-at-openai over 1 year ago - 3 comments

#8 - Same token same color

Pull Request - State: open - Opened by IsaacBreen over 1 year ago - 1 comment

#8 - Same token same color

Pull Request - State: open - Opened by IsaacBreen over 1 year ago - 1 comment

#6 - Tweak Request: Don't clear prompt textbox when switching models.

Issue - State: closed - Opened by JonathanFly over 1 year ago - 4 comments

#5 - Add other BPE models

Pull Request - State: open - Opened by dqbd over 1 year ago - 3 comments

#4 - fix: remove the scale effect from button

Pull Request - State: closed - Opened by shadcn over 1 year ago - 2 comments

#3 - Use combobox for EncoderSelect

Pull Request - State: closed - Opened by shadcn over 1 year ago - 2 comments

#2 - TokenViewer shows "replacement characters" when entering CJK characters

Issue - State: closed - Opened by firede over 1 year ago - 1 comment

#1 - Quick suggestions

Issue - State: closed - Opened by transitive-bullshit over 1 year ago - 1 comment