Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

@microsoft/tiktokenizer

Tokenizer for OpenAI large language models.

Ecosystem
npmjs.org
Latest Release
1.0.10
12 months ago
Versions
10
Downloads
303,991 last month
Dependent Repos
1
1.0.10
Published: 12 months ago
Registry - Download sha512-k6ujcOTZEEjvb...
1.0.9
Published: over 1 year ago
Registry - Download sha512-rl8G2WVLfLVxz...
1.0.8
Published: almost 2 years ago
Registry - Download sha512-40ZR0KP00OYpK...
1.0.7
Published: almost 2 years ago
Registry - Download sha512-ctiArdVjWLd5B...
1.0.6
Published: almost 2 years ago
Registry - Download sha512-Vi12N9vsU9jP3...
1.0.5
Published: about 2 years ago
Registry - Download sha512-9y9PTYMhm4gFF...
1.0.4
Published: over 2 years ago
Registry - Download sha512-M3jur8c4gwung...
1.0.3
Published: over 2 years ago
Registry - Download sha512-TSbKMJzVuAsmc...
1.0.2
Published: over 2 years ago
Registry - Download sha512-sjy92E+YE1zVA...
1.0.1
Published: over 2 years ago
Registry - Download sha512-x2fDzeVci/S/q...
Links
Registry npmjs.org
Source Repository
Homepage Homepage
JSON API View JSON
CodeMeta codemeta.json
Package Details
PURL pkg:npm/%40microsoft/tiktokenizer
spec
License MIT
Namespace microsoft
First Release over 2 years ago
Last Synced 1 day ago
Keywords
ai gpt llm openai tokenizer
Repository
Stars 130 on GitHub
Forks 27 on GitHub
repos.ecosyste.ms
Rankings on npmjs.org
Downloads Top 2.8%
Forks Top 5.3%