Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org : google-jetstream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

Registry - Source - Documentation - JSON
purl: pkg:pypi/google-jetstream
Keywords: gemma, gpt, gpu, inference, jax, large-language-models, llama, llama2, llm, llm-inference, llmops, mlops, model-serving, pytorch, tpu, transformer
License: Apache-2.0
Latest release: 13 days ago
First release: 3 months ago
Downloads: 11,616 last month
Stars: 126 on GitHub
Forks: 15 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 13 days ago

    Loading...
    Readme
    Loading...