Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org : google-jetstream
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/google-jetstream
Keywords: gemma, gpt, gpu, inference, jax, large-language-models, llama, llama2, llm, llm-inference, llmops, mlops, model-serving, pytorch, tpu, transformer
License: Apache-2.0
Latest release: 28 days ago
First release: 3 months ago
Downloads: 11,616 last month
Stars: 126 on GitHub
Forks: 15 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: about 8 hours ago