Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "data-engineering" keyword

airbyte-source-gitlab 4.0.2
Source implementation for GitLab.
8 versions - Latest release: about 1 month ago - 215 downloads last month - 13,821 stars on GitHub - 1 maintainer
panda-patrol 0.0.102
🐼 Patrol your data tests
40 versions - Latest release: 6 months ago - 1 dependent repositories - 102 downloads last month - 21 stars on GitHub - 1 maintainer
streamable 0.9.0
fluent iteration
26 versions - Latest release: 3 months ago - 481 downloads last month - 5 stars on GitHub - 1 maintainer
vectorflow-client 0.0.11
Use this Python client to embed documents with VectorFlow, an open source, high throughput, produ...
11 versions - Latest release: 6 months ago - 70 downloads last month - 640 stars on GitHub - 2 maintainers
vectorflow-ai 0.1.1
VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into v...
2 versions - Latest release: 8 months ago - 22 downloads last month - 640 stars on GitHub - 1 maintainer
neumai 0.0.40
Package containing connectors for Neum AI.
40 versions - Latest release: 5 months ago - 1 dependent package - 277 downloads last month - 785 stars on GitHub - 1 maintainer
Top 2.4% on pypi.org
ploomber 0.23.2
Write maintainable, production-ready pipelines using Jupyter or your favorite text editor. Develo...
115 versions - Latest release: 4 months ago - 5 dependent packages - 28 dependent repositories - 6.21 thousand downloads last month - 3,384 stars on GitHub - 2 maintainers
postql 1.0.3
Python wrapper for Postgres
3 versions - Latest release: 3 months ago - 25 downloads last month - 0 stars on GitHub - 1 maintainer
pyxmlparser 0.1.2
CLI interface to convert XML into various formats
4 versions - Latest release: about 5 years ago - 1 dependent repositories - 35 downloads last month - 2 stars on GitHub - 1 maintainer
kestra 0.12.0
Kestra is an infinitely scalable orchestration and scheduling platform, creating, running, schedu...
3 versions - Latest release: 7 months ago - 1 dependent repositories - 76.1 thousand downloads last month - 6,499 stars on GitHub - 1 maintainer
compars 0.0.0
DataFrame comparison done right (AKA the Bear-agnostic DataFrame comparison library)
1 version - Latest release: about 2 months ago - 34 downloads last month - 0 stars on GitHub - 1 maintainer
airbyte-source-file 0.5.0
Source implementation for File
7 versions - Latest release: 3 months ago - 130 downloads last month - 13,821 stars on GitHub - 1 maintainer
aws-parameters 0.1.8
Streamlined, efficient access to configuration values in AWS SSM Parameter Store and SecretsManager.
2 versions - Latest release: 10 months ago - 19 downloads last month - 0 stars on GitHub - 1 maintainer
dbt-airflow 2.10.0
A Python package that creates fine-grained Airflow tasks for dbt
29 versions - Latest release: 6 months ago - 1 dependent repositories - 853 downloads last month - 34 stars on GitHub - 1 maintainer
airbyte-source-harvest 1.0.1
Source implementation for Harvest.
7 versions - Latest release: about 1 month ago - 96 downloads last month - 13,821 stars on GitHub - 1 maintainer
nodestream 0.12.3
A Fast, Declarative ETL for Graph Databases.
73 versions - Latest release: about 1 month ago - 9 dependent packages - 1 dependent repositories - 353 downloads last month - 31 stars on GitHub - 3 maintainers
datazimmer 0.5.3
sscu-budapest utilities for scientific data engineering
38 versions - Latest release: 12 months ago - 4 dependent repositories - 1.8 thousand downloads last month - 3 stars on GitHub - 1 maintainer
abel-airflow 1.7.1.3.post3
Programmatically author, schedule and monitor data pipelines
1 version - Latest release: almost 8 years ago - 12 downloads last month - 34,947 stars on GitHub - 1 maintainer
airbyte-source-square 1.6.2
Source implementation for Square.
2 versions - Latest release: about 1 month ago - 49 downloads last month - 13,821 stars on GitHub - 1 maintainer
auptimizer 1.0.1
An automatic ML model optimization tool.
7 versions - Latest release: over 4 years ago - 1 dependent repositories - 57 downloads last month - 199 stars on GitHub - 1 maintainer
Top 5.9% on pypi.org
morph-kgc 2.7.0
Powerful [R2]RML engine to create RDF knowledge graphs from heterogeneous data sources.
32 versions - Latest release: 2 months ago - 2 dependent packages - 5 dependent repositories - 1.81 thousand downloads last month - 161 stars on GitHub - 1 maintainer
airbyte-source-mailchimp 2.0.3
Source implementation for Mailchimp.
7 versions - Latest release: about 1 month ago - 108 downloads last month - 13,821 stars on GitHub - 1 maintainer
files2db 0.1.1
Migration from local files to database made simple!
2 versions - Latest release: 4 months ago - 35 downloads last month - 0 stars on GitHub - 1 maintainer
airbyte-source-prestashop 1.0.4
Source implementation for PrestaShop.
2 versions - Latest release: about 1 month ago - 52 downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 1.9% on pypi.org
dagster-celery 1.0.5
Package for using Celery as Dagster's execution engine.
496 versions - Latest release: almost 2 years ago - 2 dependent packages - 13 dependent repositories - 122 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
Top 1.6% on pypi.org
dagster-aws 1.0.5
Package for AWS-specific Dagster framework solid and resource components.
545 versions - Latest release: almost 2 years ago - 3 dependent packages - 24 dependent repositories - 595 thousand downloads last month - 10,463 stars on GitHub - 1 maintainer
airbyte-source-instatus 0.1.0
Source implementation for Instatus.
3 versions - Latest release: 4 months ago - 208 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-merge 0.1.0
Source implementation for Merge.
3 versions - Latest release: 4 months ago - 153 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-nasa 0.2.0
Source implementation for Nasa.
3 versions - Latest release: 4 months ago - 133 downloads last month - 13,821 stars on GitHub - 1 maintainer
resp 0.1.2
Make the Redis Mass Insertion by using the REdis Serialization Protocol (RESP) simple.
1 version - Latest release: over 6 years ago - 4 dependent repositories - 220 downloads last month - 0 stars on GitHub - 1 maintainer
Top 0.4% on pypi.org
apache-airflow-providers-amazon 8.22.0
Provider package apache-airflow-providers-amazon for Apache Airflow
139 versions - Latest release: 23 days ago - 27 dependent packages - 184 dependent repositories - 4.28 million downloads last month - 34,947 stars on GitHub - 4 maintainers
Top 0.5% on pypi.org
apache-airflow-providers-cncf-kubernetes 8.2.0
Provider package apache-airflow-providers-cncf-kubernetes for Apache Airflow
130 versions - Latest release: about 1 month ago - 28 dependent packages - 124 dependent repositories - 3.07 million downloads last month - 34,947 stars on GitHub - 5 maintainers
Top 0.8% on pypi.org
apache-airflow-providers-celery 3.7.0
Provider package apache-airflow-providers-celery for Apache Airflow
62 versions - Latest release: about 1 month ago - 6 dependent packages - 69 dependent repositories - 668 thousand downloads last month - 33,967 stars on GitHub - 4 maintainers
genai_stack 0.2.6
End-to-End Secure & Private Generative AI for All
2 versions - Latest release: 7 months ago - 51 downloads last month - 121 stars on GitHub - 1 maintainer
Top 4.2% on pypi.org
getdaft 0.2.24
Distributed Dataframes for Multimodal Data
74 versions - Latest release: about 1 month ago - 5 dependent packages - 3 dependent repositories - 15.3 thousand downloads last month - 1,804 stars on GitHub - 1 maintainer
glue-utils 0.4.0
Reusable utilities for working with Glue PySpark jobs
22 versions - Latest release: 24 days ago - 4.81 thousand downloads last month - 1 stars on GitHub - 1 maintainer
superset-dywx 0.26.3
A modern, enterprise-ready business intelligence web application
1 version - Latest release: almost 6 years ago - 1 dependent repositories - 20 downloads last month - 58,575 stars on GitHub - 1 maintainer
Top 1.5% on pypi.org
apache-superset 4.0.0
A modern, enterprise-ready business intelligence web application
55 versions - Latest release: 2 months ago - 5 dependent packages - 22 dependent repositories - 165 thousand downloads last month - 58,575 stars on GitHub - 5 maintainers
airbyte-source-appsflyer 0.1.0
Source implementation for Appsflyer.
3 versions - Latest release: 4 months ago - 135 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-callrail 0.1.0
Source implementation for Callrail.
3 versions - Latest release: 4 months ago - 280 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-xero 0.2.5
Source implementation for xero.
4 versions - Latest release: 4 months ago - 226 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-weatherstack 0.1.0
Source implementation for Weatherstack.
3 versions - Latest release: 4 months ago - 137 downloads last month - 13,600 stars on GitHub - 1 maintainer
adcpipeline 0.2.1
A pipeline for a structured way of working
5 versions - Latest release: about 1 year ago - 1 dependent repositories - 145 downloads last month - 5 stars on GitHub - 2 maintainers
nodestream-plugin-shell 0.12.0
A plugin for nodestream providing pipeline shell execution.
3 versions - Latest release: 2 months ago - 31 downloads last month - 31 stars on GitHub - 3 maintainers
nodestream-plugin-neptune 0.12.0
A Fast, Declarative, and Extensible ETL Framework for Graph Databases.
5 versions - Latest release: 2 months ago - 167 downloads last month - 31 stars on GitHub - 1 maintainer
nodestream-plugin-neo4j 0.12.2
A Fast, Declarative, and Extensible ETL Framework for Graph Databases.
8 versions - Latest release: about 2 months ago - 153 downloads last month - 31 stars on GitHub - 1 maintainer
Top 5.0% on pypi.org
redun 0.17.0
Yet another redundant workflow engine.
19 versions - Latest release: 7 months ago - 1 dependent package - 5 dependent repositories - 4.3 thousand downloads last month - 489 stars on GitHub - 1 maintainer
Top 0.4% on pypi.org
prefect 2.18.3
Workflow orchestration and management.
283 versions - Latest release: about 1 month ago - 123 dependent packages - 767 dependent repositories - 1.68 million downloads last month - 13,720 stars on GitHub - 3 maintainers
prefect-client 2.19.1
Workflow orchestration and management.
46 versions - Latest release: 23 days ago - 10.3 thousand downloads last month - 13,585 stars on GitHub - 1 maintainer
Top 2.1% on pypi.org
dagster-snowflake 1.0.5
Package for Snowflake Dagster framework components.
542 versions - Latest release: almost 2 years ago - 2 dependent packages - 10 dependent repositories - 94.7 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
dagster-postgres 1.0.5
A Dagster integration for postgres
506 versions - Latest release: almost 2 years ago - 5 dependent packages - 63 dependent repositories - 621 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
dagster-prometheus 1.0.5
A Dagster integration for prometheus
495 versions - Latest release: almost 2 years ago - 1 dependent repositories - 22.1 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
dagster-pandas 1.0.5
Utilities and examples for working with pandas and dagster, an opinionated framework for expressi...
553 versions - Latest release: almost 2 years ago - 6 dependent packages - 58 dependent repositories - 3.12 million downloads last month - 9,299 stars on GitHub - 1 maintainer
Top 3.1% on pypi.org
dagster-shell 1.0.5
Package for Dagster shell ops.
453 versions - Latest release: almost 2 years ago - 2 dependent packages - 3 dependent repositories - 177 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 6.8% on pypi.org
dagster-pagerduty 2019.6.2
Package for pagerduty Dagster framework components.
522 versions - Latest release: about 5 years ago - 1 dependent repositories - 67.1 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 6.8% on pypi.org
dagster-datadog 1.0.5
Package for datadog Dagster framework components.
519 versions - Latest release: almost 2 years ago - 1 dependent repositories - 86 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 7.7% on pypi.org
dagster-github 1.0.5
A Github client resource for interacting with the github API with a github App
492 versions - Latest release: almost 2 years ago - 1 dependent repositories - 2.72 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 6.7% on pypi.org
dagster-databricks 1.0.5
Package for Databricks-specific Dagster framework op and resource components.
454 versions - Latest release: almost 2 years ago - 1 dependent repositories - 136 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 2.6% on pypi.org
dagster-pandera 1.0.5
Integration layer for dagster and pandera.
191 versions - Latest release: almost 2 years ago - 1 dependent package - 9 dependent repositories - 30.1 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 4.0% on pypi.org
dagster-managed-elements 0.23.6
Package for Managed elements with Dagster.
116 versions - Latest release: 23 days ago - 2 dependent packages - 2 dependent repositories - 4.47 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 8.2% on pypi.org
dagster-snowflake-pyspark 0.23.6
Package for integrating Snowflake and PySpark with Dagster.
99 versions - Latest release: 23 days ago - 1 dependent repositories - 2.6 thousand downloads last month - 10,463 stars on GitHub - 1 maintainer
Top 4.1% on pypi.org
dagster-gcp-pandas 0.23.6
Package for storing Pandas DataFrames in GCP.
93 versions - Latest release: 23 days ago - 5 dependent repositories - 35 thousand downloads last month - 10,463 stars on GitHub - 1 maintainer
Top 1.8% on pypi.org
dagster-duckdb 0.23.6
Package for DuckDB-specific Dagster framework op and resource components.
118 versions - Latest release: 23 days ago - 4 dependent packages - 63 dependent repositories - 25.6 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
Top 4.2% on pypi.org
dagster-fivetran 1.0.5
Package for integrating Fivetran with Dagster.
221 versions - Latest release: almost 2 years ago - 5 dependent repositories - 19.9 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
dagster-looker 0.23.6
An orchestration platform for the development, production, and observation of data assets.
4 versions - Latest release: 23 days ago - 972 downloads last month - 10,463 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
dagster-duckdb-polars 0.23.6
Package for storing Polars DataFrames in DuckDB.
92 versions - Latest release: 23 days ago - 1 dependent repositories - 2.91 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
dagster-deltalake-pandas 0.23.6
Package for storing Pandas DataFrames in Delta tables.
36 versions - Latest release: 23 days ago - 2.28 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 7.6% on pypi.org
dagster-embedded-elt 0.23.6
Package for performing ETL/ELT tasks with Dagster.
44 versions - Latest release: 23 days ago - 1 dependent repositories - 28 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
dagster-deltalake 0.23.6
Package for Deltalake-specific Dagster framework op and resource components.
36 versions - Latest release: 23 days ago - 2 dependent packages - 2.8 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 1.5% on pypi.org
dagster-pyspark 1.0.5
Package for PySpark Dagster framework components.
521 versions - Latest release: almost 2 years ago - 2 dependent packages - 34 dependent repositories - 212 thousand downloads last month - 10,463 stars on GitHub - 1 maintainer
Top 8.2% on pypi.org
dagster-duckdb-pyspark 0.23.6
Package for storing PySpark DataFrames in DuckDB.
118 versions - Latest release: 23 days ago - 1 dependent repositories - 2.06 thousand downloads last month - 10,463 stars on GitHub - 1 maintainer
dagster-openai 0.23.5
A Open AI client resource for interacting with Open AI API.
20 versions - Latest release: about 1 month ago - 1.89 thousand downloads last month - 10,463 stars on GitHub - 1 maintainer
dagster-polars 0.23.6
Dagster integration library for Polars
59 versions - Latest release: 23 days ago - 8.45 thousand downloads last month - 10,463 stars on GitHub - 2 maintainers
Top 0.9% on pypi.org
dagster-graphql 1.7.6
The GraphQL frontend to python dagster.
551 versions - Latest release: 23 days ago - 9 dependent packages - 160 dependent repositories - 608 thousand downloads last month - 10,463 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
dagster-ssh 1.0.5
Package for ssh Dagster framework components.
510 versions - Latest release: almost 2 years ago - 1 dependent repositories - 19 thousand downloads last month - 10,463 stars on GitHub - 1 maintainer
Top 4.3% on pypi.org
dagster-airflow 1.7.6
Airflow plugin for Dagster
547 versions - Latest release: 23 days ago - 7 dependent repositories - 8.8 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 1.9% on pypi.org
dagster-spark 1.0.5
Package for Spark Dagster framework components.
544 versions - Latest release: almost 2 years ago - 1 dependent package - 26 dependent repositories - 811 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
Top 4.1% on pypi.org
dagster-dask 1.0.5
Package for using Dask as Dagster's execution engine.
519 versions - Latest release: almost 2 years ago - 8 dependent repositories - 6.49 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 1.0% on pypi.org
dagit 1.7.6
Web UI for dagster.
577 versions - Latest release: 23 days ago - 12 dependent packages - 230 dependent repositories - 230 thousand downloads last month - 9,299 stars on GitHub - 2 maintainers
Top 7.7% on pypi.org
dagster-twilio 1.0.5
A Dagster integration for twilio
505 versions - Latest release: almost 2 years ago - 1 dependent repositories - 2.44 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 1.5% on pypi.org
dagster-k8s 1.0.5
A Dagster integration for k8s
495 versions - Latest release: almost 2 years ago - 5 dependent packages - 20 dependent repositories - 358 thousand downloads last month - 10,463 stars on GitHub - 1 maintainer
Top 3.0% on pypi.org
dagster-airbyte 1.0.5
Package for integrating Airbyte with Dagster.
201 versions - Latest release: almost 2 years ago - 32 dependent repositories - 41.3 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 5.5% on pypi.org
dagster-azure 1.0.5
Package for Azure-specific Dagster framework op and resource components.
453 versions - Latest release: almost 2 years ago - 1 dependent package - 1 dependent repositories - 88.2 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
dagster-dbt 1.0.5
A Dagster integration for dbt
476 versions - Latest release: almost 2 years ago - 4 dependent packages - 113 dependent repositories - 2.89 million downloads last month - 9,299 stars on GitHub - 1 maintainer
Top 3.5% on pypi.org
dagster-celery-k8s 1.0.5
A Dagster integration for celery-k8s-executor
442 versions - Latest release: almost 2 years ago - 5 dependent repositories - 144 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 5.7% on pypi.org
dagster-celery-docker 1.0.5
A Dagster integration for celery-docker
440 versions - Latest release: almost 2 years ago - 2 dependent repositories - 6.05 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 2.4% on pypi.org
dagster-docker 1.0.5
A Dagster integration for docker
382 versions - Latest release: almost 2 years ago - 2 dependent packages - 30 dependent repositories - 156 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 3.8% on pypi.org
dagster-mlflow 1.0.5
Package for mlflow Dagster framework components.
270 versions - Latest release: almost 2 years ago - 1 dependent package - 2 dependent repositories - 21.3 thousand downloads last month - 10,463 stars on GitHub - 1 maintainer
Top 6.4% on pypi.org
dagster-mysql 1.0.5
A Dagster integration for MySQL
364 versions - Latest release: almost 2 years ago - 1 dependent repositories - 22.3 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 2.0% on pypi.org
dagster-gcp 1.0.5
Package for GCP-specific Dagster framework op and resource components.
521 versions - Latest release: almost 2 years ago - 4 dependent packages - 21 dependent repositories - 165 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 7.8% on pypi.org
dagster-census 1.0.5
Package for integrating Census with Dagster.
171 versions - Latest release: almost 2 years ago - 1 dependent repositories - 13.3 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
dagster-msteams 1.0.5
A Microsoft Teams client resource for posting to Microsoft Teams
242 versions - Latest release: almost 2 years ago - 1 dependent repositories - 24.4 thousand downloads last month - 9,174 stars on GitHub - 1 maintainer
Top 4.8% on pypi.org
dagster-pipes 1.7.6
Toolkit for Dagster integrations with transform logic outside of Dagster
45 versions - Latest release: 23 days ago - 2 dependent packages - 1 dependent repositories - 752 thousand downloads last month - 9,174 stars on GitHub - 1 maintainer
Top 9.1% on pypi.org
dagster-datahub 1.0.5
Package for Datahub-specific Dagster framework solid and resource components.
136 versions - Latest release: almost 2 years ago - 2.82 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 1.3% on pypi.org
dagster-webserver 1.7.6
Web UI for dagster.
68 versions - Latest release: 23 days ago - 6 dependent packages - 106 dependent repositories - 493 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
Top 3.7% on pypi.org
dagster-snowflake-pandas 1.0.5
Package for integrating Snowflake and Pandas with Dagster.
166 versions - Latest release: almost 2 years ago - 8 dependent repositories - 50.4 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
dagster-deltalake-polars 0.23.6
Package for storing Polars DataFrames in Delta tables.
36 versions - Latest release: 23 days ago - 1.83 thousand downloads last month - 9,174 stars on GitHub - 1 maintainer
Top 2.7% on pypi.org
dagster-duckdb-pandas 0.23.6
Package for storing Pandas DataFrames in DuckDB.
118 versions - Latest release: 23 days ago - 1 dependent package - 15 dependent repositories - 86.3 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 5.2% on pypi.org
dagster-gcp-pyspark 0.23.6
Package for storing PySpark DataFrames in GCP
92 versions - Latest release: 23 days ago - 5 dependent repositories - 1.5 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 5.2% on pypi.org
dagster-wandb 0.23.6
Package for wandb Dagster components.
95 versions - Latest release: 23 days ago - 5 dependent repositories - 1.91 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Related Keywords
python 649 etl 534 data-integration 447 elt 429 data 422 pipeline 380 snowflake 345 data-analysis 342 data-science 340 bigquery 299 mysql 293 data-pipeline 293 redshift 292 postgresql 291 s3 288 data-collection 288 java 287 change-data-capture 287 mssql 286 self-hosted 282 data-pipelines 208 workflow 192 mlops 187 orchestration 181 scheduler 151 data-orchestrator 150 analytics 150 machine-learning 134 apache 114 workflow-engine 114 automation 110 airflow 102 dag 96 apache-airflow 90 workflow-orchestration 85 sql 72 integration 68 metadata 67 workflow-automation 65 database 65 dagster 64 airflow-provider 64 data-warehouse 55 trino 55 dataops 53 data-engineering-pipeline 51 data-structures 50 data-lineage 49 data-engineer 49 warehouse 49 data-analytics 40 data-visualization 35 superset 29 pipelines 29 sql-editor 29 react 29 flask 29 data-quality 29 data-viz 29 business-intelligence 29 business-analytics 29 bi 29 asf 29 apache-superset 29 pandas 25 data-ops 25 prefect 25 observability 24 infrastructure 23 ml-ops 20 spark 19 dataframe 17 dbt 16 kubernetes 15 etl-pipeline 14 aws 14 hacktoberfest 14 feature-engineering 13 postgres 13 dataquality 13 big-data 13 framework 12 pyspark 11 python3 10 airbyte 10 feature-store 10 data-lake 9 data-unit-tests 9 etl-framework 9 data-versioning 8 data engineering 8 batch-processing 8 data-profiling 8 connector-development-kit 8 llmops 8 cdk 8 llm 7 apache-spark 7 cloud 7 ml 7