Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

crates.io "data-engineering" keyword

evolution 0.1.0
🦖 Evolve your fixed length data files into Apache Arrow tables, fully parallelized!
1 version - Latest release: 6 months ago - 308 downloads total - 3 stars on GitHub - 1 maintainer
xvc-test-helper 0.6.6 💰
Unit test helper functions for Xvc
18 versions - Latest release: 3 months ago - 7 dependent packages - 5.45 thousand downloads total - 22 stars on GitHub - 1 maintainer
thepipelinetool_core 0.2.7
An *experimental* pipeline orchestration tool drawing on concepts from Apache Airflow
7 versions - Latest release: 22 days ago - 1 dependent package - 1.55 thousand downloads total - 20 stars on GitHub - 1 maintainer
thepipelinetool 0.2.5
readers used for thepipelinetool
16 versions - Latest release: 25 days ago - 1 dependent package - 3.64 thousand downloads total - 18 stars on GitHub - 1 maintainer
qsv 0.127.0
A high performance CSV data-wrangling toolkit.
155 versions - Latest release: 20 days ago - 51.8 thousand downloads total - 1,993 stars on GitHub - 1 maintainer
padder 1.1.0
Highly efficient data and string formatting library for Rust.
4 versions - Latest release: 10 days ago - 1.43 thousand downloads total - 3 stars on GitHub - 1 maintainer
xvc-workflow-tests 0.6.6 💰
Integration test suite for Xvc
14 versions - Latest release: 3 months ago - 4.49 thousand downloads total - 22 stars on GitHub - 1 maintainer
xvc-core 0.6.6 💰
Xvc core for common elements for all commands
20 versions - Latest release: 3 months ago - 5 dependent packages - 1 dependent repositories - 7.48 thousand downloads total - 22 stars on GitHub - 1 maintainer
xvc-file 0.6.6 💰
File tracking, versioning, upload and download functions for Xvc
19 versions - Latest release: 3 months ago - 3 dependent packages - 1 dependent repositories - 7.1 thousand downloads total - 22 stars on GitHub - 1 maintainer
xvc-walker 0.6.6 💰
Xvc parallel file system walker with ignore features
22 versions - Latest release: 3 months ago - 7 dependent packages - 1 dependent repositories - 9.41 thousand downloads total - 22 stars on GitHub - 1 maintainer
xvc-logging 0.6.6 💰
Logging crate for Xvc
17 versions - Latest release: 3 months ago - 10 dependent packages - 1 dependent repositories - 9.79 thousand downloads total - 22 stars on GitHub - 1 maintainer
xvc-pipeline 0.6.6 💰
Xvc data pipeline management
17 versions - Latest release: 3 months ago - 2 dependent packages - 1 dependent repositories - 6.2 thousand downloads total - 22 stars on GitHub - 1 maintainer
xvc-storage 0.6.6 💰
Xvc remote (and local) storage management
19 versions - Latest release: 3 months ago - 3 dependent packages - 1 dependent repositories - 7.07 thousand downloads total - 22 stars on GitHub - 1 maintainer
xvc-config 0.6.6 💰
Xvc configuration management
19 versions - Latest release: 3 months ago - 6 dependent packages - 1 dependent repositories - 8.02 thousand downloads total - 22 stars on GitHub - 1 maintainer
xvc 0.6.6 💰
An MLOps tool to manage data files and pipelines on top of Git
17 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 4.84 thousand downloads total - 22 stars on GitHub - 1 maintainer
xvc-ecs 0.6.6 💰
Entity-Component System for Xvc
18 versions - Latest release: 3 months ago - 6 dependent packages - 1 dependent repositories - 7.43 thousand downloads total - 22 stars on GitHub - 1 maintainer
pipemqtt 0.1.5
A pipebase plugin using rumqttc
5 versions - Latest release: over 2 years ago - 2.05 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipesns 0.1.5
A pipebase plugin using aws sns rust sdk
1 version - Latest release: over 2 years ago - 656 downloads total - 9 stars on GitHub - 1 maintainer
pipebuilder 0.2.2
CI for pipebase application
12 versions - Latest release: over 2 years ago - 3.96 thousand downloads total - 1 stars on GitHub - 1 maintainer
pipebuilder_common 0.2.2
lib for pipebuilder components
12 versions - Latest release: over 2 years ago - 3 dependent packages - 6.56 thousand downloads total - 1 stars on GitHub - 1 maintainer
pipebuilder_mock 0.1.0
pipebuilder api mock server
1 version - Latest release: over 2 years ago - 725 downloads total - 1 stars on GitHub - 1 maintainer
pipecsv 0.1.5
A pipebase plugin using csv serde
6 versions - Latest release: over 2 years ago - 2.41 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipes3 0.1.5
A pipebase plugin using aws s3 rust sdk
1 version - Latest release: over 2 years ago - 651 downloads total - 9 stars on GitHub - 1 maintainer
pipejson 0.1.6
A pipebase plugin using json serde
7 versions - Latest release: over 2 years ago - 2.78 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipebytes 0.1.5
A pipebase plugin using byteorder
6 versions - Latest release: over 2 years ago - 2 dependent packages - 3.27 thousand downloads total - 9 stars on GitHub - 1 maintainer
piperedis 0.1.6
A pipebase plugin using redis rust client
7 versions - Latest release: over 2 years ago - 2.72 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipeamqp 0.1.3
A pipebase plugin using lapin
4 versions - Latest release: over 2 years ago - 1.75 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipecql 0.2.2
A pipebase plugin using scylla
9 versions - Latest release: over 2 years ago - 3.36 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipemysql 0.2.3
A pipebase plugin using mysql_async
10 versions - Latest release: about 2 years ago - 3.7 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipereqwest 0.1.5
A pipebase plugin using reqwest
6 versions - Latest release: over 2 years ago - 2.36 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipebase 0.2.0
A tokio based runtime library for data integration app
13 versions - Latest release: over 2 years ago - 19 dependent packages - 12 thousand downloads total - 9 stars on GitHub - 1 maintainer
piperocksdb 0.1.5
A pipebase plugin using rocksdb rust wrapper
6 versions - Latest release: over 2 years ago - 2.48 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipegen 0.2.2
A generator for data integration app using pipebase framework
21 versions - Latest release: about 2 years ago - 2 dependent packages - 12.2 thousand downloads total - 9 stars on GitHub - 1 maintainer
cargo-pipe 0.2.2
A command-line tool to generate and build data integration app using pipebase framework
22 versions - Latest release: about 2 years ago - 7.27 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipekube 0.1.5
A pipebase plugin using kubernetes rust sdk
6 versions - Latest release: over 2 years ago - 2.36 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipesqs 0.1.5
A pipebase plugin using aws sqs rust sdk
1 version - Latest release: over 2 years ago - 647 downloads total - 9 stars on GitHub - 1 maintainer
pipederive 0.2.1
Proc macros for data integration app using pipebase framework
7 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 10.4 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipepsql 0.2.2
A pipebase plugin using tokio_postgres
9 versions - Latest release: over 2 years ago - 3.34 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipedynamodb 0.1.5
A pipebase plugin using aws dynamodb rust sdk
1 version - Latest release: over 2 years ago - 658 downloads total - 9 stars on GitHub - 1 maintainer
pipekafka 0.2.3
A pipebase plugin using rdkafka
8 versions - Latest release: over 2 years ago - 3.04 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipeavro 0.1.4
A pipebase plugin using avro-rs
5 versions - Latest release: over 2 years ago - 1.7 thousand downloads total - 9 stars on GitHub - 1 maintainer
pipewarp 0.1.5
A pipebase plugin using warp
6 versions - Latest release: over 2 years ago - 2.47 thousand downloads total - 9 stars on GitHub - 1 maintainer
dink 0.1.0
Threaded CDC to Delta lake, written in Rust, just like God intended it.
1 version - Latest release: 6 months ago - 303 downloads total - 1 maintainer
firelink 0.1.0
🔥 Efficiently linking CDC with Delta lake, all in Rust, just like God intended it.
1 version - Latest release: 6 months ago - 329 downloads total - 1 maintainer
datamixer 0.0.1
Datamixer client library (upcoming)
1 version - Latest release: about 1 year ago - 298 downloads total - 0 stars on GitHub - 1 maintainer
risingwave 0.1.0
A placeholder repo for RisingWave.
1 version - Latest release: about 2 years ago - 379 downloads total - 6,125 stars on GitHub - 1 maintainer