pypi.org : tokenswift
Framework for Accelerating LLM Generation
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/tokenswift
Keywords:
deepseek
, inference
, llm-inference
, llm-serving
, llms
, qwen
, speculative-decoding
, transformer
License: Apache-2.0
Latest release: about 2 months ago
First release: about 2 months ago
Downloads: 126 last month
Stars: 85 on GitHub
Forks: 9 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 8 days ago
Loading...
Readme
Loading...