gpt_tokenizer
The implementation of BPE algorithm for sentence encode/decode
Ecosystem
pub.dev
pub.dev
Latest Release
about 2 years ago
0.1.1
about 2 years ago
Versions
2
2
Dependent Packages
1
1
Dependent Repos
1
1
Links
| Registry | pub.dev |
| Source | Repository |
| Docs | Documentation |
| JSON API | View JSON |
| CodeMeta | codemeta.json |
Package Details
| PURL |
pkg:pub/gpt_tokenizer
spec |
| License | |
| First Release | almost 3 years ago |
| Last Synced | 4 days ago |
Repository
| Stars | 10 on GitHub |
| Forks | 7 on GitHub |