Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

nuget.org : lofcz.forks.tiktoken

The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken. This fork contains a printable version of Explore()

Registry - JSON
purl: pkg:nuget/lofcz.forks.tiktoken
Keywords: chatgpt, openai, tiktoken, tokens, gpt-4, gpt-3.5-turbo, cl100k_base, p50k_base
License: MIT
Latest release: 3 months ago
First release: 3 months ago
Downloads: 282 total
Last synced: 28 days ago

Readme