Top 0.5% downloads on npmjs.org
Top 0.8% dependent packages on npmjs.org
Top 2.6% dependent repos on npmjs.org
Top 5.1% forks on npmjs.org
Top 1.9% docker downloads on npmjs.org
npmjs.org : gpt-tokenizer
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
Registry
-
Source
- Homepage
- JSON
purl: pkg:npm/gpt-tokenizer
Keywords:
BPE
, encoder
, decoder
, tokenizer
, GPT
, GPT-2
, GPT-3
, GPT-3.5
, GPT-4
, GPT-4o
, NLP
, Natural Language Processing
, Text Generation
, OpenAI
, Machine Learning
, ml
, bpe
, gpt-2
, gpt-3
, gpt-4
, gpt-4o
, machine-learning
, openai
License: MIT
Latest release: 3 months ago
First release: about 2 years ago
Dependent packages: 36
Dependent repositories: 22
Downloads: 744,945 last month
Stars: 445 on GitHub
Forks: 36 on GitHub
Docker dependents: 10
Docker downloads: 27,936,047
Total Commits: 92
Committers: 12
Average commits per author: 7.667
Development Distribution Score (DDS): 0.511
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/niieani
Last synced: about 17 hours ago