Skip to content

Issues: dqbd/tiktoken

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

31 Open 44 Closed
31 Open 44 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add gpt-4o support
#105 opened May 13, 2024 by huytool157
missing example code for js-tiktoken
#102 opened May 9, 2024 by coding22
How to support Llama 3?
#100 opened Apr 19, 2024 by wizd
Performance
#99 opened Apr 15, 2024 by steebchen
Add decode_with_offsets function (or PR guidance request)
#94 opened Mar 11, 2024 by Sam1320
An error occurred during the deployment of the Vercel edge function
#93 opened Mar 9, 2024 by bowencool
Cloudflare worker Uncaught ReferenceError: FinalizationRegistry is not defined
#92 opened Feb 13, 2024 by TranquilMarmot
1
'TextEncoder' is not defined - MongoDB Functions
#91 opened Feb 11, 2024 by georgeherby
1
Add support for the newest Open AI embeddings models
#90 opened Feb 9, 2024 by AleksTrpkovski
Memory access out of bounds
#84 opened Jan 17, 2024 by maxdeichmann
3
Crash on React Native: SyntaxError: Invalid RegExp: Invalid escape
#82 opened Dec 1, 2023 by julian-hecker
2
How to count tokens for functions defined in the prompt?
#78 opened Oct 21, 2023 by vrde
1
Support fine tunned models
#76 opened Oct 17, 2023 by italojs
1
Cannot find module error
#75 opened Oct 17, 2023 by thdoan
1
missing TiktokenModel for version 3.5-turbo-16k
#74 opened Sep 25, 2023 by hannahlaek-wt
1
gpt-3.5-turbo-instruct support
#73 opened Sep 22, 2023 by danny-avila
2
What does free actually do?
#72 opened Sep 19, 2023 by disbelief
9
Raise error when concurrent to call new Tiktoken
#70 opened Sep 12, 2023 by qkxie
2
Error: null pointer passed to rust
#69 opened Sep 6, 2023 by emeeks
3
NPM package is very huge
#68 opened Aug 29, 2023 by anzemur
5
WASM file is not included in Next.js Node runtime API routes
#67 opened Aug 22, 2023 by AaronFriel
When I look at cl100k_base.json, I don't see the special tokens like <|im_start|>, but when I add them manually I get an error from the wasm
#65 opened Aug 5, 2023 by Evertt
2
NPMJS repository versions are out of date
#63 opened Jul 17, 2023 by kjvenalainen
2
Fatal crash: BasicBlock requested for unrecognized address
#62 opened Jul 13, 2023 by SamStenner
1
When running 1.0.7 there is a Missing tiktoken_bg.wasm error on AWS Lambda typescript
#61 opened Jul 10, 2023 by haibh-wanosoft
3
ProTip! Updated in the last three days: updated:>2024-05-28.