pypi.org "delta-lake" keyword
dbt-dataops-starrocks 1.4.3
The starrocks adapter plugin for dbt3 versions - Latest release: over 3 years ago - 17 downloads last month - 12,209 stars on GitHub - 1 maintainer
dbt-doris 1.0.0
The doris adapter plugin for dbt10 versions - Latest release: 8 months ago - 1 dependent repositories - 4.17 thousand downloads last month - 16,143 stars on GitHub - 1 maintainer
gamma-lake 0.2.0
High-performance feature store built on Delta Lake with optional Ray parallelism3 versions - Latest release: about 1 month ago - 291 downloads last month - 7 stars on GitHub - 3 maintainers
pydoris-client 1.0.4
Python interface to Doris3 versions - Latest release: almost 3 years ago - 10 downloads last month - 16,143 stars on GitHub - 1 maintainer
starrocks 1.3.4
Python SQLAlchemy Dialect for StarRocks with optional Alembic integration13 versions - Latest release: 3 months ago - 526 thousand downloads last month - 12,209 stars on GitHub - 5 maintainers
hops-deltalake 1.4.0
Native Delta Lake Python binding based on delta-rs with Pandas integration6 versions - Latest release: 9 months ago - 52 thousand downloads last month - 3,350 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
105 versions - Latest release: about 1 month ago - 47 dependent packages - 235 dependent repositories - 9.16 million downloads last month - 3,350 stars on GitHub - 5 maintainers
deltalake 1.6.6
Native Delta Lake Python binding based on delta-rs with Pandas integration105 versions - Latest release: about 1 month ago - 47 dependent packages - 235 dependent repositories - 9.16 million downloads last month - 3,350 stars on GitHub - 5 maintainers
pydoris-custom 1.1.0
Python interface to Doris (custom build with relaxed dependencies)1 version - Latest release: 11 months ago - 17.7 thousand downloads last month - 16,143 stars on GitHub - 1 maintainer
pydoris 1.2.0
Python interface to Doris11 versions - Latest release: 8 months ago - 2 dependent packages - 114 thousand downloads last month - 16,143 stars on GitHub - 2 maintainers
cdk-emrserverless-with-delta-lake 2.0.831
A construct for the quick demo of EMR Serverless.726 versions - Latest release: over 1 year ago - 1 dependent repositories - 1.68 thousand downloads last month - 11 stars on GitHub - 1 maintainer
weevr 1.20.1
Metadata-driven execution engine for Fabric/Spark data pipelines.36 versions - Latest release: 5 days ago - 1.15 thousand downloads last month - 11 stars on GitHub - 1 maintainer
beacondb 2.0.2
An embeddable, in-process analytical database for scientific data.9 versions - Latest release: 16 days ago - 535 downloads last month - 16 stars on GitHub - 1 maintainer
beacon-datalake-cli 0.2.0
Terminal client for the Beacon data lake: run SQL, explore tables/datasets, render results, and e...4 versions - Latest release: 4 months ago - 54 downloads last month - 16 stars on GitHub - 1 maintainer
pysail 0.7.2
Sail Python library46 versions - Latest release: 30 days ago - 31.3 thousand downloads last month - 3,454 stars on GitHub - 1 maintainer
Top 3.2% on pypi.org
45 versions - Latest release: 3 months ago - 6 dependent packages - 4 dependent repositories - 941 thousand downloads last month - 960 stars on GitHub - 6 maintainers
delta-sharing 1.4.2
Python Connector for Delta Sharing45 versions - Latest release: 3 months ago - 6 dependent packages - 4 dependent repositories - 941 thousand downloads last month - 960 stars on GitHub - 6 maintainers
delta-sharing-custom 1.1.1
Python Connector for Delta Sharing2 versions - Latest release: almost 2 years ago - 10 downloads last month - 960 stars on GitHub - 1 maintainer
fsdb-py 0.2.16
High-performance Delta Lake database with POSIX interface and Python bindings14 versions - Latest release: 11 months ago - 1.89 thousand downloads last month - 1 maintainer
datacoolie 0.2.0
Metadata-driven ETL framework that unifies engines, stays cloud-agnostic, and is currently batch-...11 versions - Latest release: 8 days ago - 115 downloads last month - 11 stars on GitHub - 1 maintainer
deltabridge 1.1.0
Thin Python wrapper for reading Delta tables from Azure Blob Storage with low and stable latency.2 versions - Latest release: 16 days ago - 26 downloads last month - 4 stars on GitHub - 1 maintainer
delta-arrow-reader 0.7.0
Read-only Delta Lake to Apache Arrow reader1 version - Latest release: 14 days ago - 0 downloads last month - 1 stars on GitHub - 1 maintainer
costlens 0.1.1
Estimate what a data pipeline will cost before you run it2 versions - Latest release: 2 months ago - 0 stars on GitHub - 1 maintainer
engineer-kit 0.3.4
Intent-driven, streaming-first REST ingestion with profiling, data quality, safe checkpoints, and...6 versions - Latest release: 3 months ago - 749 downloads last month - 0 stars on GitHub - 1 maintainer
alteryx2fabric 0.2.1
Toolkit for migrating Alteryx workflows to Microsoft Fabric (Lakehouse + Notebooks + Data Pipelin...2 versions - Latest release: 3 months ago - 239 downloads last month - 0 stars on GitHub - 1 maintainer
minilake 1.8.0
A local Databricks API emulator backed by DuckDB.12 versions - Latest release: 30 days ago - 655 downloads last month - 34 stars on GitHub - 1 maintainer
delta-audit 0.1.0
A lightweight, Spark-free Python library for inspecting, validating, and diagnosing Delta Lake ta...1 version - Latest release: 3 months ago - 22 downloads last month - 0 stars on GitHub - 1 maintainer
data-repository 0.1.0
A simple platform for complex data3 versions - Latest release: about 2 months ago - 225 downloads last month - 207 stars on GitHub - 2 maintainers
delta-engine 0.14.0
Framework for defining, validating, and evolving tables in a consistent, safe, and controlled way.15 versions - Latest release: about 2 months ago - 273 downloads last month - 0 stars on GitHub - 1 maintainer
deltafunnel 0.6.0
Lightweight, fast Delta Lake to SQL Server loads with DataFusion SQL and native TDS, without Spar...17 versions - Latest release: about 2 months ago - 372 downloads last month - 2 stars on GitHub - 1 maintainer
pylakekeeper 0.4.0
Official Lakekeeper client — generic-tables API and OAuth2 auth (static token / client_credential...4 versions - Latest release: about 1 month ago - 107 thousand downloads last month - 2 stars on GitHub - 1 maintainer
flowfile-duckdb 0.1.0
Query a Flowfile catalog from DuckDB / Superset — zero-copy, read-only.1 version - Latest release: 4 months ago - 0 stars on GitHub - 1 maintainer
pyfabric-dev 0.5.2
Local development framework for Microsoft Fabric notebooks: source-of-truth Python, generated .No...7 versions - Latest release: 5 months ago - 11 downloads last month - 1 stars on GitHub - 1 maintainer
cds-pyde-toolkit 1.5.6
A growing toolkit of data-engineering helper functions and CLI commands — starting with schema in...4 versions - Latest release: 4 months ago - 252 downloads last month - 1 maintainer
great-generator 0.1.6
Generate realistic synthetic data from schemas for data engineering, QA, testing, Pandas, and Spark.7 versions - Latest release: 4 months ago - 241 downloads last month - 7 stars on GitHub - 1 maintainer
clinical-tabular 0.1.1 💰
Production-ready tabular & temporal deep learning models for clinical decision support2 versions - Latest release: 4 months ago - 27 downloads last month - 44 stars on GitHub - 1 maintainer
pyde-toolkit 1.5.5
A growing toolkit of data-engineering helper functions and CLI commands — starting with schema in...6 versions - Latest release: 4 months ago - 459 downloads last month - 1 maintainer
sparkocr-vlm 0.1.0
Distributed VLM-based OCR on PySpark. DeepSeek-OCR-v2 + Qwen3-VL, with Delta Lake.1 version - Latest release: 5 months ago - 95 downloads last month - 0 stars on GitHub - 1 maintainer
iceguard 1.0.0 💰
Reliability library for Spark-on-AWS-Lambda lakehouse writes with timeout rollback, checkpoints, ...1 version - Latest release: 5 months ago - 106 downloads last month - 1 stars on GitHub - 1 maintainer
ematix-flow 1.0.0
Move data between databases, files, and streams from Python. Rust + Apache Arrow under the hood.21 versions - Latest release: 3 months ago - 173 downloads last month - 0 stars on GitHub - 1 maintainer
drift-spark 0.5.0
Spark-native embedding lifecycle — produce, CDC refresh, migrate, adapter.9 versions - Latest release: 5 months ago - 30 downloads last month - 8 stars on GitHub - 1 maintainer
onelake-tui 0.5.0
Unofficial TUI and client library for Microsoft Fabric OneLake4 versions - Latest release: 6 months ago - 10 downloads last month - 7 stars on GitHub - 1 maintainer
nosql-delta-bridge 0.1.4
NoSQL to Delta Lake ingestion with schema enforcement, type coercion, and a dead-letter queue. No...5 versions - Latest release: 6 months ago - 160 downloads last month - 0 stars on GitHub - 1 maintainer
roapi-http 0.6.0
Create full-fledged APIs for slowly moving datasets without writing a single line of code.17 versions - Latest release: over 4 years ago - 1 dependent repositories - 162 downloads last month - 3,433 stars on GitHub - 1 maintainer
Top 9.1% on pypi.org
13 versions - Latest release: 7 months ago - 1 dependent repositories - 594 downloads last month - 3,433 stars on GitHub - 1 maintainer
roapi 0.12.7
Create full-fledged APIs for slowly moving datasets without writing a single line of code.13 versions - Latest release: 7 months ago - 1 dependent repositories - 594 downloads last month - 3,433 stars on GitHub - 1 maintainer
columnq-cli 0.7.0
Create full-fledged APIs for slowly moving datasets without writing a single line of code.10 versions - Latest release: almost 2 years ago - 1 dependent repositories - 49 downloads last month - 3,433 stars on GitHub - 1 maintainer
databricks4py 0.3.0
Spark, Delta Lake, and Databricks utility library for Python2 versions - Latest release: 7 months ago - 9 downloads last month - 0 stars on GitHub - 1 maintainer
databricks-etl-monitor 0.1.0
Metadata-driven ETL Process Monitoring Framework for Databricks / Delta Lake6 versions - Latest release: 6 months ago - 37 downloads last month - 1 maintainer
h2o-connector-service 0.1.0a2
Python client SDK for the H2O Connector Service — create connectors, open connections, and stream...8 versions - Latest release: 6 months ago - 289 downloads last month - 1 maintainer
dbx-delphi 0.6.0
Probabilistic data test framework for Databricks — test terabyte-scale Delta Lake tables in secon...8 versions - Latest release: 4 months ago - 0 stars on GitHub - 1 maintainer
incrementalflow 0.1.0
The definitive framework for incremental data loading in PySpark and Delta Lake1 version - Latest release: 8 months ago - 7 downloads last month - 0 stars on GitHub - 1 maintainer
schemaxpy 0.2.11
Declarative schema management, governance, and migration for Databricks Unity Catalog. Version co...13 versions - Latest release: 8 months ago - 141 downloads last month - 8 stars on GitHub - 1 maintainer
delta-lake-maip 1.1.0
Delta Lake plugin for Machine-Actionable Integrity Protocol (MAIP) receipt generation1 version - Latest release: 18 days ago - 0 downloads last month - 0 stars on GitHub - 1 maintainer
koheesio 0.11.0
The steps-based Koheesio framework25 versions - Latest release: 3 months ago - 346 thousand downloads last month - 820 stars on GitHub - 1 maintainer
laketower 0.9.4
Oversee your lakehouse26 versions - Latest release: 6 months ago - 196 downloads last month - 12 stars on GitHub - 1 maintainer
handuflow 0.1.21
Spark + Delta Lake orchestration for medallion pipelines: CDC, SCD Type 2, data quality, lineage,...9 versions - Latest release: 9 months ago - 597 downloads last month - 1 maintainer
churnkit 1.3.4a5
Structured ML framework for customer churn prediction -- from exploration notebooks to production...575 versions - Latest release: 5 months ago - 2.92 thousand downloads last month - 0 stars on GitHub - 1 maintainer
drainage 0.1.7
High-performance data lake health analyzer for Delta Lake and Apache Iceberg5 versions - Latest release: about 1 year ago - 64 downloads last month - 65 stars on GitHub - 1 maintainer
lakelogic 1.75.0
A declarative, contract-driven medallion pipeline engine for data mesh architectures. Write once....83 versions - Latest release: 16 days ago - 4.06 thousand downloads last month - 5 stars on GitHub - 1 maintainer
delta-explain 0.7.0
Make Delta Lake pruning visible: partition pruning and data skipping diagnostics, as a CLI and a ...4 versions - Latest release: about 2 months ago - 135 downloads last month - 10 stars on GitHub - 1 maintainer
dataowl 0.3.0
Facts about Databricks data products for building dbt staging models.3 versions - Latest release: 21 days ago - 0 downloads last month - 0 stars on GitHub - 1 maintainer
lakehouse-engine 2.2.0
A configuration-driven Spark framework serving as the engine for several lakehouse algorithms and...25 versions - Latest release: 2 months ago - 1.85 thousand downloads last month - 293 stars on GitHub - 1 maintainer
delta-sharing-sso 0.2.0
A lightweight Python client for Delta Sharing tables, authenticated via Keycloak / OIDC single si...2 versions - Latest release: 29 days ago - 252 downloads last month - 0 stars on GitHub - 1 maintainer
duckalog 0.6.3
Python library and CLI to build DuckDB catalogs from declarative YAML/JSON configs14 versions - Latest release: 6 months ago - 104 downloads last month - 1 stars on GitHub - 1 maintainer
fabric-hydrate 1.0.1
A CLI tool to hydrate Microsoft Fabric Lakehouse metadata from Delta Lake schemas1 version - Latest release: 10 months ago - 9 downloads last month - 1 stars on GitHub - 1 maintainer
Top 0.9% on pypi.org
35 versions - Latest release: 23 days ago - 38 dependent packages - 90 dependent repositories - 27.7 million downloads last month - 9,040 stars on GitHub - 4 maintainers
delta-spark 4.4.1
Python APIs for using Delta Lake with Apache Spark35 versions - Latest release: 23 days ago - 38 dependent packages - 90 dependent repositories - 27.7 million downloads last month - 9,040 stars on GitHub - 4 maintainers
tablesleuth 0.6.1
TableSleuth - a Textual TUI for Open Table Format forensics (Iceberg, Delta Lake) with data profi...6 versions - Latest release: 8 months ago - 149 downloads last month - 9 stars on GitHub - 1 maintainer
delta-lake-utils 1.0.0
Production-grade utilities for Delta Lake management1 version - Latest release: 10 months ago - 11 downloads last month - 0 stars on GitHub - 1 maintainer
delta-fusion 1.1.3
High-performance Delta Lake query engine for Python7 versions - Latest release: 7 months ago - 55 downloads last month - 3 stars on GitHub - 1 maintainer
projectoneflow-framework 1.0.0
This Project is wrapper for projectoneflow ingestion patterns1 version - Latest release: 11 months ago - 18 downloads last month - 2 stars on GitHub - 1 maintainer
projectoneflow 1.0.0
This Project is data engineering framework which implements all data engineering ingestion patterns1 version - Latest release: 11 months ago - 14 downloads last month - 2 stars on GitHub - 1 maintainer
posixlake 0.4.0
High-performance Delta Lake database with POSIX interface and Python bindings16 versions - Latest release: 7 months ago - 18 downloads last month - 1 stars on GitHub - 1 maintainer
inc-join 0.1.3
This library implements an incremental join function to join 2 (usually large) incrementally refr...1 version - Latest release: 11 months ago - 13 downloads last month - 3 stars on GitHub - 1 maintainer
pyspark-streaming-base 0.2.1
This project provides a set of base classes that simplify the art of crafting bullet-proof Spark ...6 versions - Latest release: 7 months ago - 30 downloads last month - 5 stars on GitHub - 1 maintainer
kalyfo-spark-helper 0.1.1
A Spark helper class to create and configure optimized Spark sessions with Delta Lake support5 versions - Latest release: about 1 year ago - 44 downloads last month - 0 stars on GitHub - 1 maintainer
kalyfo-libs-spark-helper 0.1.1
A Spark helper class to create and configure optimized Spark sessions with Delta Lake support2 versions - Latest release: about 1 year ago
parql 1.1.1
Query Parquet files from the terminal with SQL — DuckDB-powered CLI for local, S3, GCS, and Azure...7 versions - Latest release: 4 months ago - 66 downloads last month - 1 stars on GitHub - 1 maintainer
layker 0.1.0
Lakehouse-Aligned YAML Kit for Engineering Rules1 version - Latest release: about 1 year ago - 16 downloads last month - 0 stars on GitHub - 1 maintainer
sqlxport 0.2.0
Export SQL query results to Parquet and CSV... and upload to S3 or MinIO2 versions - Latest release: over 1 year ago - 23 downloads last month - 15 stars on GitHub - 1 maintainer
sqlshell 5.0.5
A powerful SQL shell with GUI interface for data analysis38 versions - Latest release: 9 months ago - 127 downloads last month - 2 stars on GitHub - 1 maintainer
pdldb 0.1.11
A high-performance analytical data store combining Polars' processing speed with Delta Lake's ACI...10 versions - Latest release: over 1 year ago - 127 downloads last month - 2 stars on GitHub - 1 maintainer
deltaplan 0.2.0a4
Declarative plan/apply for Databricks SQL tables — Terraform-style diffs for Unity Catalog14 versions - Latest release: about 1 month ago - 1.24 thousand downloads last month - 1 stars on GitHub - 1 maintainer
sparkdq 0.12.1
A declarative PySpark framework for row- and aggregate-level data quality validation.24 versions - Latest release: 4 months ago - 1.88 thousand downloads last month - 78 stars on GitHub - 1 maintainer
eliza-dq 0.1.1
Fastest open-source data quality engine for Polars, SQL, and any DataFrame2 versions - Latest release: about 2 months ago - 160 downloads last month - 3 stars on GitHub - 1 maintainer
difflake 1.1.1
git diff, but for your data — powered by DuckDB. Any format, any scale, any cloud.3 versions - Latest release: 7 months ago - 100 downloads last month - 3 stars on GitHub - 1 maintainer
legend-delta 0.1.10
This project helps organizations define Legend data models that can be converted into efficient D...7 versions - Latest release: about 4 years ago - 25 downloads last month - 9 stars on GitHub - 1 maintainer
sparkforge 1.3.3
A simplified, production-ready data pipeline builder for Apache Spark and Delta Lake31 versions - Latest release: about 1 year ago - 1.23 thousand downloads last month - 0 stars on GitHub - 1 maintainer
dask-deltatable 0.4.0
Dask + Delta Table7 versions - Latest release: over 1 year ago - 1 dependent repositories - 18.4 thousand downloads last month - 53 stars on GitHub - 5 maintainers
dbl-waterbear 0.1.1
Automated provisioning of an industry Lakehouse with enterprise data model2 versions - Latest release: over 4 years ago - 1 dependent repositories - 19 downloads last month - 9 stars on GitHub - 1 maintainer
odbc2deltalake 0.14.2
56 versions - Latest release: 6 months ago - 962 downloads last month - 5 stars on GitHub - 1 maintainerdatabricks-excel-ingest-framework 0.1.0a20
Databricks-native Excel ingestion framework: validate, detect structure, extract metadata, and ma...10 versions - Latest release: 6 months ago - 92 downloads last month - 1 maintainer
databricks-dq-framework 1.0.39
Metadata-driven Data Quality Assessment Framework for Databricks / Delta Lake6 versions - Latest release: 6 months ago - 43 downloads last month - 1 maintainer
ntb-dq-framework 1.1.0
Data Quality framework for Databricks — rule-based checks across six dimensions with Delta table ...13 versions - Latest release: 4 months ago - 1.13 thousand downloads last month - 1 maintainer
delta-lake-reader 0.2.16
Lightweight wrapper for reading Delta tables without Spark18 versions - Latest release: almost 3 years ago - 1 dependent repositories - 13.8 thousand downloads last month - 47 stars on GitHub - 1 maintainer
deltadb 0.1.8
A native Rust library for Delta Lake, with bindings into Python8 versions - Latest release: about 2 years ago - 57 downloads last month - 2,729 stars on GitHub - 1 maintainer
Related Keywords
data-engineering
38
databricks
32
pyspark
28
spark
27
lakehouse
23
sql
22
etl
21
python
20
parquet
18
iceberg
17
data-quality
15
arrow
13
analytics
13
rust
13
datafusion
12
duckdb
12
database
11
big-data
10
pandas
9
cli
9
data-pipeline
8
s3
8
unity-catalog
8
delta
7
deltalake
7
polars
7
hudi
7
olap
7
schema
7
aws
6
datalake
6
snowflake
5
observability
5
redshift
5
data
5
blob-storage
5
microsoft-fabric
5
query-engine
5
agent
4
apache-spark
4
ai
4
fabric
4
yaml
4
rest-api
4
azure
4
ddl
4
bigquery
4
real-time
4
search
4
vector
4
paimon
4
metadata
3
data-validation
3
cdc
3
pandas-dataframe
3
machine-learning
3
data-sharing
3
pyarrow
3
static-datasets
3
etl-framework
3
query-frontends
3
query
3
in-memory-database
3
graphql
3
datasets
3
data-lakehouse
3
catalog
3
apache-iceberg
3
columnar
3
cloud-native
3
apache-arrow
3
onelake
3
acid
3
textual
2
data-profiling
2
data-lake
2
dbt
2
vectorized
2
star-schema
2
realtime-database
2
configuration
2
dq-framework
2
dataengineering
2
projectoneflow
2
Python
2
toolkit
2
medallion
2
mlops
2
gcs
2
validation
2
scd
2
incremental
2
time-travel
2
pipeline
2
healthcare
2
postgresql
2
testing
2
migration
2
medallion-architecture
2
data-governance
2