latitudegames/GPT-3-Encoder issues and pull requests

#44 - TypeError: bpe(...).split is not a function

Issue - State: open - Opened by mdmuhtasimfuadfahim 11 months ago

#43 - It stuck when encoding large amount of text.

Issue - State: open - Opened by Alokkumar8 about 1 year ago

#42 - Does this work with GPT 4?

Issue - State: open - Opened by tgoulder4 over 1 year ago - 2 comments

#41 - 4.0 api

Issue - State: closed - Opened by 1529210412 over 1 year ago

#40 - Is there an alternative that doesn't use node.js's file system module?

Issue - State: open - Opened by zhiyi-zhang-duke over 1 year ago - 6 comments

#39 - encoder.json does not exist in chunks directory.

Issue - State: open - Opened by henryhu712 almost 2 years ago - 8 comments

#38 - Add a way to count tokens without encoding the whole text; improve performance; fix bugs

Pull Request - State: open - Opened by niieani almost 2 years ago

#37 - UTF-8 issue when decode back

Issue - State: open - Opened by industral almost 2 years ago - 1 comment

#36 - please add dependency to package.json

Issue - State: closed - Opened by wbxl2000 almost 2 years ago - 2 comments

#35 - The cache in bpe() may occupy a large amount of memory after long-time running.

Issue - State: open - Opened by binjie09 almost 2 years ago - 1 comment

#34 - Bump minimist from 1.2.5 to 1.2.8

Pull Request - State: open - Opened by dependabot[bot] almost 2 years ago
Labels: dependencies

#33 - Allow Browser Usage, countTokens convenience method

Pull Request - State: open - Opened by wesmcouch about 2 years ago - 3 comments

#32 - Does not work on front-end in Next.js projects

Issue - State: open - Opened by Johnrobmiller about 2 years ago - 6 comments

#31 - Cannot find module 'gpt-3-encoder' or its corresponding type declarations.

Pull Request - State: open - Opened by rossanodr about 2 years ago

#30 - Latpull docs, demo, browserify, countTokens, tokenStats

Pull Request - State: open - Opened by syonfox about 2 years ago - 2 comments

#29 - Bump json-schema and jsprim

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#28 - Bump node-notifier from 8.0.0 to 8.0.2

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#27 - Bump ansi-regex from 5.0.0 to 5.0.1

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#26 - Bump y18n from 4.0.0 to 4.0.3

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#25 - Bump path-parse from 1.0.6 to 1.0.7

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#24 - Bump tmpl from 1.0.4 to 1.0.5

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#23 - Bump ws from 7.3.1 to 7.5.9

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#22 - Bump lodash from 4.17.20 to 4.17.21

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#21 - Bump hosted-git-info from 2.8.8 to 2.8.9

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#20 - Some Updates RFC

Issue - State: open - Opened by syonfox about 2 years ago - 6 comments

#19 - Bump json5 from 2.1.3 to 2.2.3

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#18 - npm audit docs tests and bpe fix + countTokens properly added

Pull Request - State: closed - Opened by syonfox about 2 years ago - 1 comment

#17 - Add count tokens function

Pull Request - State: open - Opened by syonfox about 2 years ago - 2 comments

#16 - Update Encoder.js for NodeJs

Pull Request - State: open - Opened by sshadmand about 2 years ago - 1 comment

#15 - "TextEncoder is not defined" error when running tests in Node 12.22.0

Issue - State: open - Opened by sshadmand about 2 years ago - 1 comment

#14 - Bump qs from 6.5.2 to 6.5.3

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#13 - Bump decode-uri-component from 0.2.0 to 0.2.2

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago
Labels: dependencies

#12 - Fix bug in BPE cache

Pull Request - State: closed - Opened by andrew-healey over 2 years ago - 3 comments

#11 - Bump jsdom from 16.4.0 to 16.7.0

Pull Request - State: open - Opened by dependabot[bot] over 2 years ago
Labels: dependencies

#10 - Bump minimist from 1.2.5 to 1.2.6

Pull Request - State: closed - Opened by dependabot[bot] almost 3 years ago - 1 comment
Labels: dependencies

#9 - Unusable and does not match with token output from GPT-3

Issue - State: open - Opened by nullreferencez almost 3 years ago - 6 comments

#8 - TypeError: bpe(...).split is not a function

Issue - State: open - Opened by bramses about 3 years ago - 3 comments

#7 - New release

Issue - State: closed - Opened by kafkas over 3 years ago - 2 comments

#6 - Fix for Possible bug with BPE RegEx #5

Pull Request - State: closed - Opened by caleb-artifact almost 4 years ago

#5 - Possible bug with BPE RegEx

Issue - State: closed - Opened by caleb-artifact almost 4 years ago

#4 - Tokenization Count based on Model

Issue - State: closed - Opened by MentalGear almost 4 years ago - 3 comments

#3 - Typings and a few minor improvements

Pull Request - State: closed - Opened by kafkas over 4 years ago - 1 comment

#2 - Fix exports & decoding

Pull Request - State: closed - Opened by schnerd over 4 years ago

#1 - Input with emojis tokenizes differently than python impl

Issue - State: closed - Opened by schnerd over 4 years ago - 1 comment

GitHub / latitudegames/GPT-3-Encoder issues and pull requests