Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

gpt-tokenizer

A pure JavaScript BPE tokenizer with model metadata and pricing for GPT-5, GPT-4o, o-series, and other OpenAI models

Ecosystem
npmjs.org
Latest Release
4.0.0
16 days ago
Versions
35
Downloads
5,758,267 last month
Dependent Packages
36
Dependent Repos
22
    Loading...
    Readme
    Loading...
    Links
    Registry npmjs.org
    Source Repository
    Homepage Homepage
    JSON API View JSON
    CodeMeta codemeta.json
    Package Details
    PURL pkg:npm/gpt-tokenizer
    spec
    License MIT
    First Release over 3 years ago
    Last Synced about 17 hours ago
    Keywords
    BPE encoder decoder tokenizer GPT GPT-2 GPT-3 GPT-3.5 GPT-4 GPT-4.1 GPT-4o GPT-5 o1 o3 o4 gpt-oss tiktoken tokens LLM token counting API pricing NLP Natural Language Processing Text Generation OpenAI Machine Learning ml bpe gpt-2 gpt-3 gpt-4 gpt-4o gpt-5 gpt-o1 machine-learning openai
    Repository
    Stars 838 on GitHub
    Forks 60 on GitHub
    Docker Dependents 10
    Docker Downloads 27,936,047
    Commits 99
    Committers 12
    Avg per Author 8.25
    DDS 0.475
    commits.ecosyste.ms
    repos.ecosyste.ms
    Rankings on npmjs.org
    Overall Top 2.4%
    Downloads Top 0.5%
    Dependent packages Top 0.8%
    Dependent repos Top 2.6%
    Forks Top 5.1%
    Docker downloads Top 1.9%
    Funding
    https://github.com/sponsors/niieani