Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org : google-jetstream
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/google-jetstream
Keywords: gemma, gpt, gpu, inference, jax, large-language-models, llama, llama2, llm, llm-inference, llmops, mlops, model-serving, pytorch, tpu, transformer
License: Apache-2.0
Latest release: about 1 month ago
First release: 3 months ago
Downloads: 11,616 last month
Stars: 126 on GitHub
Forks: 15 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 5 days ago
zijunzhou
1 package11,616 downloads