proxy.golang.org : github.com/softmaxer/batchollama : v0.0.4
Run Ollama inference in batches, where each batch executes as prompts concurrently.
Registry -
Documentation -
Download -
JSON
purl: pkg:golang/github.com/softmaxer/[email protected]
Published:
Indexed:
Related tag:
v0.0.4
Loading...
Readme
Loading...