Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

Top 1.9% on crates.io
Top 3.1% downloads on crates.io
Top 0.9% dependent packages on crates.io
Top 2.8% dependent repos on crates.io
Top 1.3% forks on crates.io
Top 1.6% docker downloads on crates.io

crates.io : datafusion

DataFusion is an in-memory query engine that uses Apache Arrow as the memory model

Registry - Source - Homepage - Documentation - JSON
purl: pkg:cargo/datafusion
Keywords: sql, query, arrow, big-data, dataframe, datafusion, olap, python, query-engine, rust
License: Apache-2.0
Latest release: about 2 months ago
First release: over 6 years ago
Dependent packages: 86
Dependent repositories: 194
Downloads: 2,049,599 total
Stars: 5,217 on GitHub
Forks: 960 on GitHub
Docker dependents: 13
Docker downloads: 18,710,070
Total Commits: 7145
Committers: 582
Average commits per author: 12.277
Development Distribution Score (DDS): 0.873
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: about 14 hours ago

exon 0.21.0 💰
A platform for scientific data processing and analysis.
92 versions - Latest release: 25 days ago - 3 dependent packages - 1 dependent repositories - 33.2 thousand downloads total - 27 stars on GitHub - 1 maintainer
exon-common 0.21.0 💰
Common utilities for Exon
60 versions - Latest release: 25 days ago - 15 dependent packages - 23.4 thousand downloads total - 27 stars on GitHub - 1 maintainer
datafusion-functions-json 0.1.3
JSON functions for DataFusion
3 versions - Latest release: 28 days ago - 2.65 thousand downloads total - 10 stars on GitHub - 1 maintainer
datafusion-server 0.13.2
Web server library for session-based queries using Arrow and other large datasets as data sources.
28 versions - Latest release: about 1 month ago - 7.95 thousand downloads total - 6 stars on GitHub - 1 maintainer
Top 8.5% on crates.io
datafusion-cli 38.0.0
Command Line Client for DataFusion query engine.
33 versions - Latest release: about 1 month ago - 2 dependent packages - 1 dependent repositories - 32.6 thousand downloads total - 5,217 stars on GitHub - 4 maintainers
convergence-arrow 0.16.0
Utils for bridging Apache Arrow and PostgreSQL's wire protocol
17 versions - Latest release: about 1 month ago - 1 dependent package - 4 dependent repositories - 5.75 thousand downloads total - 83 stars on GitHub - 1 maintainer
zino-core 0.22.4
Core types and traits for zino.
107 versions - Latest release: about 1 month ago - 6 dependent packages - 36.5 thousand downloads total - 424 stars on GitHub - 1 maintainer
connectorx 0.3.3
Load data from databases to dataframes, the fastest way.
17 versions - Latest release: about 1 month ago - 1 dependent package - 4 dependent repositories - 10 thousand downloads total - 1,809 stars on GitHub - 2 maintainers
vegafusion-sql 1.6.9
VegaFusion SQL dialect generation and connection implementations
42 versions - Latest release: about 1 month ago - 2 dependent packages - 1 dependent repositories - 14.3 thousand downloads total - 1 maintainer
lance 0.10.18
A columnar data format that is 100x faster than Parquet for random access.
118 versions - Latest release: about 1 month ago - 4 dependent packages - 1 dependent repositories - 58.6 thousand downloads total - 2,901 stars on GitHub - 4 maintainers
lance-index 0.10.18
Lance indices implementation
56 versions - Latest release: about 1 month ago - 3 dependent packages - 36.9 thousand downloads total - 3,305 stars on GitHub - 1 maintainer
lance-datafusion 0.10.18
Internal utilities used by other lance modules to simplify working with datafusion
47 versions - Latest release: about 1 month ago - 2 dependent packages - 33.5 thousand downloads total - 3,305 stars on GitHub - 5 maintainers
tass 0.10.0
A pager for tabular data
10 versions - Latest release: about 1 month ago - 3.94 thousand downloads total - 16 stars on GitHub - 1 maintainer
micromegas 0.1.3
Micromegas is a scalable observability solution.
4 versions - Latest release: about 1 month ago - 1.05 thousand downloads total - 8 stars on GitHub - 1 maintainer
micromegas-analytics 0.1.3
analytics module of micromegas
4 versions - Latest release: about 1 month ago - 1 dependent package - 1.05 thousand downloads total - 8 stars on GitHub - 1 maintainer
exon-exome 💰
Exon X Exome
16 versions - Latest release: about 1 month ago - 4.41 thousand downloads total - 27 stars on GitHub - 1 maintainer
datafusion-catalogprovider-glue 0.4.0
Glue as a CatalogProvider for Datafusion
11 versions - Latest release: about 1 month ago - 1 dependent repositories - 3.64 thousand downloads total - 19 stars on GitHub - 1 maintainer
Top 4.9% on crates.io
deltalake 0.17.3
Native Delta Lake implementation in Rust
24 versions - Latest release: about 1 month ago - 5 dependent packages - 41 dependent repositories - 210 thousand downloads total - 1,844 stars on GitHub - 5 maintainers
deltalake-core 0.17.3
Native Delta Lake implementation in Rust
3 versions - Latest release: about 1 month ago - 6 dependent packages - 78.7 thousand downloads total - 1,844 stars on GitHub - 1 maintainer
Top 9.0% on crates.io
pgwire 0.22.0 💰
Postgresql wire protocol implemented as a library
34 versions - Latest release: about 1 month ago - 3 dependent packages - 10 dependent repositories - 102 thousand downloads total - 444 stars on GitHub - 1 maintainer
Top 7.2% on crates.io
datafusion-substrait 37.1.0
DataFusion Substrait Producer and Consumer
25 versions - Latest release: about 2 months ago - 3 dependent packages - 1 dependent repositories - 197 thousand downloads total - 5,217 stars on GitHub - 2 maintainers
Top 3.3% on crates.io
datafusion-proto 37.1.0
Protobuf serialization of DataFusion logical plan expressions
34 versions - Latest release: about 2 months ago - 9 dependent packages - 97 dependent repositories - 391 thousand downloads total - 5,217 stars on GitHub - 2 maintainers
Top 2.5% on crates.io
datafusion-physical-expr 37.1.0
Physical expression implementation for DataFusion query engine
33 versions - Latest release: about 2 months ago - 12 dependent packages - 128 dependent repositories - 1.24 million downloads total - 4,942 stars on GitHub - 2 maintainers
Top 2.8% on crates.io
polars-lazy 0.39.2 💰
Lazy query engine for the Polars DataFrame library
73 versions - Latest release: about 2 months ago - 8 dependent packages - 177 dependent repositories - 970 thousand downloads total - 22,355 stars on GitHub - 2 maintainers
datafusion-odata 37.2.0
OData protocol adapter for Apache Datafusion
10 versions - Latest release: 2 months ago - 4.86 thousand downloads total - 0 stars on GitHub - 2 maintainers
orc-rust 0.3.0
Implementation of Apache ORC file format using Apache Arrow in-memory format
10 versions - Latest release: 2 months ago - 4 dependent repositories - 16.3 thousand downloads total - 25 stars on GitHub - 2 maintainers
qv 0.9.6
quickly view your data
9 versions - Latest release: 2 months ago - 3.34 thousand downloads total - 240 stars on GitHub - 1 maintainer
datafusion_iceberg 0.3.0
Apache Iceberg integration for Datafusion
7 versions - Latest release: 3 months ago - 2.03 thousand downloads total - 0 stars on GitHub - 1 maintainer
datafusion-python 36.0.0
Apache DataFusion DataFrame and SQL Query Engine
15 versions - Latest release: 3 months ago - 1 dependent repositories - 12.1 thousand downloads total - 307 stars on GitHub - 1 maintainer
parquet2lance 0.4.1
Convert parquet files to lance
26 versions - Latest release: 3 months ago - 7.94 thousand downloads total - 2 stars on GitHub - 1 maintainer
datafusion-geo 0.1.0
Add geo functionality extension to datafusion query engine.
1 version - Latest release: 3 months ago - 366 downloads total - 2 stars on GitHub - 1 maintainer
dply 0.3.0
A command line data manipulation tool inspired by the dplyr grammar.
14 versions - Latest release: 3 months ago - 3.8 thousand downloads total - 38 stars on GitHub - 1 maintainer
tpctools 0.7.0
Utilities for generating and converting TPC-H and TPC-DS data sets
12 versions - Latest release: 3 months ago - 4.19 thousand downloads total - 24 stars on GitHub - 1 maintainer
exon-py 0.11.0 💰
Python bindings for Exon
1 version - Latest release: 3 months ago - 390 downloads total - 27 stars on GitHub - 1 maintainer
datafusion-federation 0.1.4
Datafusion federation.
5 versions - Latest release: 3 months ago - 1.93 thousand downloads total - 2 maintainers
optd-sqlplannertest 0.0.0
A Cascades optimizer framework
1 version - Latest release: 4 months ago - 424 downloads total - 290 stars on GitHub - 1 maintainer
datafusion-optd-cli 32.0.0
Command Line Client for DataFusion query engine with optd patch.
1 version - Latest release: 4 months ago - 1 dependent package - 391 downloads total - 290 stars on GitHub - 1 maintainer
optd-datafusion-bridge 0.0.0
A Cascades optimizer framework
1 version - Latest release: 4 months ago - 2 dependent packages - 444 downloads total - 290 stars on GitHub - 1 maintainer
optd-datafusion-repr 0.0.0
A Cascades optimizer framework
1 version - Latest release: 4 months ago - 3 dependent packages - 453 downloads total - 290 stars on GitHub - 1 maintainer
bdt 0.18.0
Utility for viewing, querying, converting, and comparing files in popular data formats (CSV, Parq...
22 versions - Latest release: 4 months ago - 7.24 thousand downloads total - 188 stars on GitHub - 1 maintainer
ballista-cli 0.12.0
Command Line Client for Ballista distributed query engine.
5 versions - Latest release: 4 months ago - 1.69 thousand downloads total - 1,295 stars on GitHub - 1 maintainer
Top 9.9% on crates.io
ballista 0.12.0
Ballista Distributed Compute
18 versions - Latest release: 4 months ago - 3 dependent packages - 4 dependent repositories - 8.72 thousand downloads total - 1,295 stars on GitHub - 3 maintainers
ballista-scheduler 0.12.0
Ballista Distributed Compute - Scheduler
9 versions - Latest release: 4 months ago - 1 dependent package - 4.51 thousand downloads total - 1,295 stars on GitHub - 2 maintainers
ballista-executor 0.12.0
Ballista Distributed Compute - Executor
9 versions - Latest release: 4 months ago - 1 dependent package - 4.23 thousand downloads total - 1,295 stars on GitHub - 2 maintainers
Top 9.4% on crates.io
ballista-core 0.12.0
Ballista Distributed Compute
9 versions - Latest release: 4 months ago - 3 dependent packages - 18 dependent repositories - 6.62 thousand downloads total - 1,295 stars on GitHub - 2 maintainers
datafusion-delta-sharing 0.1.0
Delta Sharing integaration for DataFusion
1 version - Latest release: 4 months ago - 287 downloads total - 3 stars on GitHub - 1 maintainer
edm-core 0.2.0
Core types and traits for edm.
3 versions - Latest release: 5 months ago - 3 dependent packages - 1.05 thousand downloads total - 1 maintainer
qpml 0.14.0
Query Plan Markup Language (QPML)
13 versions - Latest release: 5 months ago - 1 dependent repositories - 3.61 thousand downloads total - 46 stars on GitHub - 1 maintainer
Top 9.0% on crates.io
dbase 0.5.0
Read & Write .dbf in Rust
14 versions - Latest release: 5 months ago - 4 dependent packages - 179 dependent repositories - 220 thousand downloads total - 23 stars on GitHub - 1 maintainer
datafusion-extra 0.0.2
[WIP] DataClod
1 version - Latest release: 6 months ago - 262 downloads total - 1 stars on GitHub - 1 maintainer
dfq 0.1.1
A CLI tool for running SQLs over various data sources.
2 versions - Latest release: 6 months ago - 722 downloads total - 0 stars on GitHub - 1 maintainer
dataclod-server 0.0.2
[WIP] DataClod
1 version - Latest release: 7 months ago - 1 dependent package - 405 downloads total - 1 stars on GitHub - 1 maintainer
datafusion-util 0.0.2
[WIP] DataClod
2 versions - Latest release: 7 months ago - 1 dependent package - 752 downloads total - 1 stars on GitHub - 1 maintainer
dataclod-query 0.0.2
[WIP] DataClod
2 versions - Latest release: 7 months ago - 1 dependent package - 726 downloads total - 1 stars on GitHub - 1 maintainer
dataclot-server 0.0.1
[WIP] DataClot
2 versions - Latest release: 7 months ago - 1 dependent package - 656 downloads total - 1 maintainer
dataclot-query 0.1.0
[WIP] DataClot
3 versions - Latest release: 7 months ago - 1 dependent package - 1.01 thousand downloads total - 1 maintainer
exon-test 0.3.4-beta.9 💰
Exon test crate
3 versions - Latest release: 8 months ago - 3 dependent packages - 896 downloads total - 27 stars on GitHub - 1 maintainer
exon-benchmarks 0.3.3
Executable benchmarks for exon
18 versions - Latest release: 8 months ago - 4.4 thousand downloads total - 1 maintainer
vineyard-datafusion 0.17.2
Vineyard Rust SDK: arrow datafusion integration for DataFrame
2 versions - Latest release: 9 months ago - 639 downloads total - 802 stars on GitHub - 1 maintainer
ella 0.1.5
A streaming time-series datastore for low-latency applications.
6 versions - Latest release: 10 months ago - 2 dependent packages - 2.2 thousand downloads total - 1 stars on GitHub - 1 maintainer
ella-server 0.1.5
Client-server API for the ella datastore.
6 versions - Latest release: 10 months ago - 1 dependent package - 2.39 thousand downloads total - 1 stars on GitHub - 1 maintainer
ella-engine 0.1.5
Core engine implementation for the ella datastore.
6 versions - Latest release: 10 months ago - 2 dependent packages - 2.57 thousand downloads total - 1 stars on GitHub - 1 maintainer
ella-common 0.1.5
Shared types and traits for the ella datastore.
6 versions - Latest release: 10 months ago - 4 dependent packages - 2.94 thousand downloads total - 1 stars on GitHub - 1 maintainer
libquerier 0.1.1
Let everyone query some parquet
2 versions - Latest release: 11 months ago - 625 downloads total - 1 maintainer
tca 0.1.1-alpha.4 💰
A platform for scientific data processing and analysis.
2 versions - Latest release: about 1 year ago - 643 downloads total - 27 stars on GitHub - 1 maintainer
yummy-delta 0.0.8
Delta lake yummy library
1 version - Latest release: about 1 year ago - 1 dependent package - 633 downloads total - 30 stars on GitHub - 1 maintainer
prql-query 0.0.15
pq: query and transform data with PRQL
10 versions - Latest release: about 1 year ago - 2.96 thousand downloads total - 119 stars on GitHub - 1 maintainer
chaindexer 0.1.1
Blockchain indexer and query engine
2 versions - Latest release: over 1 year ago - 594 downloads total - 8 stars on GitHub - 1 maintainer
rapidash 0.1.0
compute engine for index and factor
1 version - Latest release: over 1 year ago - 399 downloads total - 4 stars on GitHub - 1 maintainer
parqbench 0.2.0
A utility for viewing parquet files built on egui.
4 versions - Latest release: over 1 year ago - 1.19 thousand downloads total - 1 maintainer
parquet-cat 0.1.1
A command-line tool to explore Parquet files on S3, with folder support
2 versions - Latest release: almost 2 years ago - 734 downloads total - 0 stars on GitHub - 1 maintainer
sqlfuzz 0.3.0
Generate random (and sometimes valid!) queries from any local Parquet, CSV, JSON, or Avro data set.
4 versions - Latest release: almost 2 years ago - 1.3 thousand downloads total - 26 stars on GitHub - 1 maintainer
sql-core 0.1.0 removed
sql-core
1 version - Latest release: almost 2 years ago
datafusion-tui 0.1.0
Terminal based, extensible, interactive data analysis tool using SQL
1 version - Latest release: about 2 years ago - 497 downloads total - 68 stars on GitHub - 1 maintainer
datafusion-objectstore-s3 0.2.1
S3 as an ObjectStore for Datafusion
3 versions - Latest release: about 2 years ago - 3 dependent packages - 4 dependent repositories - 2.81 thousand downloads total - 57 stars on GitHub - 1 maintainer
gitv 0.1.0
A git repos analyzing and visualizing tool built in Rust.
1 version - Latest release: about 2 years ago - 510 downloads total - 124 stars on GitHub - 1 maintainer
datafusion-bigtable 0.1.0
Bigtable data source for Apache Arrow Datafusion
1 version - Latest release: about 2 years ago - 523 downloads total - 20 stars on GitHub - 1 maintainer
arcon 0.2.1
A runtime for writing streaming applications
6 versions - Latest release: over 2 years ago - 2 dependent packages - 2 dependent repositories - 3.9 thousand downloads total - 172 stars on GitHub - 2 maintainers
dmt 0.4.0
sql runner
4 versions - Latest release: over 2 years ago - 1.61 thousand downloads total - 1 maintainer
qapro-rs 0.1.0 💰
quantaxis rust version
1 version - Latest release: over 2 years ago - 458 downloads total - 7,897 stars on GitHub - 1 maintainer
sql_csv 0.2.0
A tool which query csv files use SQL syntax
2 versions - Latest release: over 2 years ago - 764 downloads total - 1 maintainer
convergence-dynamodb 0.3.1
Utils for bridging DynamoDB and PostgreSQL's wire protocol
1 version - Latest release: almost 3 years ago - 454 downloads total - 83 stars on GitHub - 1 maintainer
octosql 0.0.1
WIP PoC rewrite of OctoSQL in Rust
1 version - Latest release: over 3 years ago - 484 downloads total - 11 stars on GitHub - 1 maintainer
know-thy-shell 0.1.12
Command line tool for know-thy-shell.info
12 versions - Latest release: almost 5 years ago - 6.34 thousand downloads total - 1 maintainer
kts-etl 0.1.12
Extract, transform and load data from your local environment.
11 versions - Latest release: almost 5 years ago - 1 dependent package - 4.09 thousand downloads total - 1 maintainer
kts-analyze 0.1.0
Various APIs on top of the arrow and datafusion crates
1 version - Latest release: almost 5 years ago - 2 dependent packages - 1.69 thousand downloads total - 1 maintainer