crates.io "batching" keyword
batched-fn 0.2.5
Middleware for serving deep learning models with batched prediction17 versions - Latest release: almost 2 years ago - 3 dependent repositories - 28.4 thousand downloads total - 21 stars on GitHub - 1 maintainer
batched-queue 0.1.0-alpha.1
A high-performance, highly-concurrent batched queue implementation for Rust.2 versions - Latest release: 10 months ago - 1.13 thousand downloads total - 0 stars on GitHub - 1 maintainer
vcf_batcher 0.2.1
Command-line tool to cut VCF (variant call files) into smaller batches, intended to be used for m...3 versions - Latest release: almost 3 years ago - 4.15 thousand downloads total - 3 stars on GitHub - 1 maintainer
scuffle-batching 0.1.6 💰
Optimized batching and dataloading for external services.13 versions - Latest release: 7 months ago - 8.46 thousand downloads total - 396 stars on GitHub - 1 maintainer
batch-aint-one 0.12.0
I got 99 problems, but a batch ain't one32 versions - Latest release: about 1 month ago - 66.5 thousand downloads total - 4 stars on GitHub - 1 maintainer
trustformers-serve 0.1.0-alpha.1
High-performance inference server for TrustformeRS models1 version - Latest release: 4 months ago - 24 downloads total - 1 maintainer
tokio-debouncer 0.3.1
A minimal async debouncer for signal batching in Tokio6 versions - Latest release: 10 months ago - 3.19 thousand downloads total - 4 stars on GitHub - 1 maintainer
batch_queue 0.1.0
A single-producer single-consumer Rust queue with smart batching1 version - Latest release: about 4 years ago - 1.77 thousand downloads total - 3 stars on GitHub - 1 maintainer
chunk_norris 0.2.1
A Rust library for splitting large text into smaller batches for LLM input.3 versions - Latest release: about 1 year ago - 2.36 thousand downloads total - 1 stars on GitHub - 1 maintainer
Related Keywords
rust
5
async
4
concurrency
2
server
2
llm
2
queue
2
batch
2
svelte
1
video
1
optimization
1
inference
1
signal
1
tokio
1
debounce
1
spsc
1
spsc-queue
1
nlp
1
text
1
tokenizer
1
text-processing
1
streaming
1
opensource
1
live
1
services
1
external
1
dataloading
1
variant_call_file
1
vcf
1
message-queue
1
concurrent
1
batched
1
batched-prediction
1
deep-learning
1
backpressure
1