npmjs.org : openai-tokenizer
A lightweight tokenizer for OpenAI's GPT model series. Uses OpenAI's tiktoken python package
Registry
-
Source
- JSON
- codemeta.json
purl: pkg:npm/openai-tokenizer
Keywords:
OpenAI
, GPT-3
, GPT-4
, GPT-3.5
, ChatGPT
, LLMs
, GPT
, tokenizer
License: Apache-2.0
Status: unpublished
Latest release: about 2 years ago
First release: about 2 years ago
Last synced: about 2 years ago
Loading...
Readme
Loading...