npmjs.org : @lenml/tokenizers
a lightweight no-dependency fork of transformers.js (only tokenizers)
Registry
-
Source
- Homepage
- JSON
purl: pkg:npm/%40lenml/tokenizers
Keywords:
llama
, llama2
, llama3
, chatgpt
, mistral
, tokenizer
, transformers
, transformers.js
, gpt4
, gpt4o
, gpt3.5
, vicuna
, chatglm
, baichuan
, qwen
, transfomers
License: Apache-2.0
Latest release: 28 days ago
First release: over 1 year ago
Namespace: lenml
Downloads: 14,938 last month
Stars: 6 on GitHub
Forks: 0 on GitHub
Total Commits: 36
Committers: 2
Average commits per author: 18.0
Development Distribution Score (DDS): 0.444
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: about 17 hours ago