Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
npmjs.org : @lenml/tokenizers
a lightweight no-dependency fork of transformers.js (only tokenizers)
Registry
-
Source
- JSON
purl: pkg:npm/%40lenml/tokenizers
Keywords: llama, llama2, llama3, chatgpt, mistral, tokenizer, transformers, transformers.js, gpt4, gpt4o, gpt3.5, vicuna, chatglm, baichuan, qwen, transfomers
License: Apache-2.0
Latest release: 14 days ago
First release: about 1 month ago
Namespace: lenml
Downloads: 791 last month
Stars: 1 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 13 days ago