Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "data-engineering" keyword

airbyte-source-stripe 5.3.8
Source implementation for Stripe.
27 versions - Latest release: 2 days ago - 1 dependent repositories - 1.92 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 4.5% on pypi.org
data-diff 0.11.2
Command-line tool and Python library to efficiently diff rows across two different databases.
75 versions - Latest release: 2 days ago - 1 dependent package - 2 dependent repositories - 44.7 thousand downloads last month - 2,846 stars on GitHub - 5 maintainers
Top 2.7% on pypi.org
apache-airflow-providers-tabular 1.5.1
Provider package apache-airflow-providers-tabular for Apache Airflow
22 versions - Latest release: 2 days ago - 3 dependent packages - 3 dependent repositories - 23.2 thousand downloads last month - 34,343 stars on GitHub - 3 maintainers
Top 0.8% on pypi.org
apache-airflow-providers-microsoft-azure 10.1.0
Provider package apache-airflow-providers-microsoft-azure for Apache Airflow
119 versions - Latest release: 2 days ago - 12 dependent packages - 42 dependent repositories - 552 thousand downloads last month - 34,343 stars on GitHub - 3 maintainers
Top 0.3% on pypi.org
apache-airflow-providers-google 10.18.0
Provider package apache-airflow-providers-google for Apache Airflow
131 versions - Latest release: 2 days ago - 25 dependent packages - 374 dependent repositories - 6.63 million downloads last month - 34,343 stars on GitHub - 3 maintainers
apache-airflow-providers-apache-iceberg 1.0.0
Provider package apache-airflow-providers-apache-iceberg for Apache Airflow
2 versions - Latest release: 2 days ago - 1 dependent package - 1.86 thousand downloads last month - 34,343 stars on GitHub - 1 maintainer
Top 0.4% on pypi.org
apache-airflow-providers-amazon 8.22.0
Provider package apache-airflow-providers-amazon for Apache Airflow
135 versions - Latest release: 2 days ago - 27 dependent packages - 184 dependent repositories - 4.6 million downloads last month - 34,343 stars on GitHub - 4 maintainers
airbyte-source-zendesk-support 2.6.4
Source implementation for Zendesk Support.
19 versions - Latest release: 2 days ago - 7 dependent repositories - 1.43 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-facebook-marketing 2.1.9
Source implementation for Facebook Marketing.
23 versions - Latest release: 3 days ago - 6.93 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-declarative-manifest 0.90.0
Base source implementation for low-code sources.
26 versions - Latest release: 3 days ago - 1.78 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 0.7% on pypi.org
airbyte-cdk 0.90.0
A framework for writing Airbyte Connectors.
410 versions - Latest release: 3 days ago - 266 dependent packages - 234 dependent repositories - 113 thousand downloads last month - 12,703 stars on GitHub - 1 maintainer
airbyte-source-tiktok-marketing 3.9.7
Source implementation for Tiktok Marketing.
5 versions - Latest release: 3 days ago - 198 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-salesforce 2.5.12
Source implementation for Salesforce.
33 versions - Latest release: 3 days ago - 7 dependent repositories - 1.11 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 7.4% on pypi.org
prefect-snowflake 0.27.6
Prefect integrations for interacting with Snowflake
19 versions - Latest release: 3 days ago - 1 dependent package - 2 dependent repositories - 133 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
Top 5.5% on pypi.org
prefect-shell 0.2.5
Prefect integrations for interacting with shell commands.
12 versions - Latest release: 3 days ago - 6 dependent packages - 6 dependent repositories - 130 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
Top 8.4% on pypi.org
prefect-ray 0.3.6
Prefect integrations with the Ray execution framework.
20 versions - Latest release: 3 days ago - 2 dependent packages - 2 dependent repositories - 5.4 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
Top 8.8% on pypi.org
prefect-kubernetes 0.3.10
Prefect integrations for interacting with Kubernetes.
26 versions - Latest release: 3 days ago - 1 dependent package - 1 dependent repositories - 33.6 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
prefect-gitlab 0.2.5
A Prefect collection for working with GitLab repositories.
8 versions - Latest release: 3 days ago - 39.6 thousand downloads last month - 14,512 stars on GitHub - 1 maintainer
Top 9.0% on pypi.org
prefect-github 0.2.5
Prefect integrations interacting with GitHub
12 versions - Latest release: 3 days ago - 3 dependent repositories - 149 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
Top 4.6% on pypi.org
prefect-gcp 0.5.12
Prefect integrations for interacting with Google Cloud Platform.
38 versions - Latest release: 3 days ago - 2 dependent packages - 39 dependent repositories - 319 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
Top 9.8% on pypi.org
prefect-email 0.3.5
Prefect integrations for interacting with email.
10 versions - Latest release: 3 days ago - 3 dependent repositories - 23.6 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
Top 9.2% on pypi.org
prefect-docker 0.5.2
Prefect integrations for interacting with Docker.
18 versions - Latest release: 3 days ago - 2 dependent packages - 2 dependent repositories - 115 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
Top 7.3% on pypi.org
prefect-dbt 0.5.0
Prefect integrations for working with dbt
16 versions - Latest release: 3 days ago - 5 dependent repositories - 137 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
Top 9.9% on pypi.org
prefect-databricks 0.2.7
Prefect integrations with Databricks
15 versions - Latest release: 3 days ago - 1 dependent repositories - 11.5 thousand downloads last month - 14,512 stars on GitHub - 1 maintainer
Top 4.9% on pypi.org
prefect-dask 0.2.9
Prefect integrations with the Dask execution framework.
14 versions - Latest release: 3 days ago - 9 dependent packages - 6 dependent repositories - 94.4 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
prefect-bitbucket 0.2.5
Prefect integrations for working with Bitbucket repositories.
8 versions - Latest release: 3 days ago - 434 downloads last month - 14,512 stars on GitHub - 1 maintainer
Top 9.6% on pypi.org
prefect-azure 0.3.10
Prefect integrations with Microsoft Azure services
25 versions - Latest release: 3 days ago - 1 dependent package - 1 dependent repositories - 9.88 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
Top 3.9% on pypi.org
prefect-aws 0.4.17
Prefect integrations for interacting with Amazon Web Services.
41 versions - Latest release: 3 days ago - 4 dependent packages - 82 dependent repositories - 1.12 million downloads last month - 14,512 stars on GitHub - 2 maintainers
Top 7.0% on pypi.org
prefect-sqlalchemy 0.4.3
Prefect integrations for working with databases
15 versions - Latest release: 3 days ago - 1 dependent package - 27 dependent repositories - 81.5 thousand downloads last month - 14,512 stars on GitHub - 2 maintainers
prefect-slack 0.2.6
Prefect integrations with Slack
10 versions - Latest release: 3 days ago - 2 dependent repositories - 154 thousand downloads last month - 14,512 stars on GitHub - 3 maintainers
prefect-client 2.19.1
Workflow orchestration and management.
41 versions - Latest release: 3 days ago - 9.98 thousand downloads last month - 13,585 stars on GitHub - 1 maintainer
Top 4.1% on pypi.org
dagster-gcp-pandas 0.23.6
Package for storing Pandas DataFrames in GCP.
90 versions - Latest release: 3 days ago - 5 dependent repositories - 29.2 thousand downloads last month - 10,389 stars on GitHub - 1 maintainer
dagster-deltalake-pandas 0.23.6
Package for storing Pandas DataFrames in Delta tables.
33 versions - Latest release: 3 days ago - 2.18 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 8.2% on pypi.org
dagster-snowflake-pyspark 0.23.6
Package for integrating Snowflake and PySpark with Dagster.
96 versions - Latest release: 3 days ago - 1 dependent repositories - 2.18 thousand downloads last month - 10,389 stars on GitHub - 1 maintainer
Top 4.3% on pypi.org
dagster-airflow 1.7.6
Airflow plugin for Dagster
544 versions - Latest release: 3 days ago - 7 dependent repositories - 10.3 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 4.0% on pypi.org
dagster-managed-elements 0.23.6
Package for Managed elements with Dagster.
113 versions - Latest release: 3 days ago - 2 dependent packages - 2 dependent repositories - 4.26 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
dagster-polars 0.23.6
Dagster integration library for Polars
56 versions - Latest release: 3 days ago - 6.74 thousand downloads last month - 10,389 stars on GitHub - 2 maintainers
dagster-deltalake-polars 0.23.6
Package for storing Polars DataFrames in Delta tables.
33 versions - Latest release: 3 days ago - 1.47 thousand downloads last month - 9,174 stars on GitHub - 1 maintainer
dagster-looker 0.23.6
An orchestration platform for the development, production, and observation of data assets.
1 version - Latest release: 3 days ago - 436 downloads last month - 10,389 stars on GitHub - 1 maintainer
Top 1.8% on pypi.org
dagster-duckdb 0.23.6
Package for DuckDB-specific Dagster framework op and resource components.
115 versions - Latest release: 3 days ago - 4 dependent packages - 63 dependent repositories - 23.3 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
Top 2.7% on pypi.org
dagster-duckdb-pandas 0.23.6
Package for storing Pandas DataFrames in DuckDB.
115 versions - Latest release: 3 days ago - 1 dependent package - 15 dependent repositories - 186 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
dagster-duckdb-polars 0.23.6
Package for storing Polars DataFrames in DuckDB.
89 versions - Latest release: 3 days ago - 1 dependent repositories - 2.98 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
dagster-deltalake 0.23.6
Package for Deltalake-specific Dagster framework op and resource components.
33 versions - Latest release: 3 days ago - 2 dependent packages - 2.72 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 7.6% on pypi.org
dagster-embedded-elt 0.23.6
Package for performing ETL/ELT tasks with Dagster.
41 versions - Latest release: 3 days ago - 1 dependent repositories - 22.6 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 8.2% on pypi.org
dagster-duckdb-pyspark 0.23.6
Package for storing PySpark DataFrames in DuckDB.
115 versions - Latest release: 3 days ago - 1 dependent repositories - 1.81 thousand downloads last month - 10,389 stars on GitHub - 1 maintainer
Top 5.2% on pypi.org
dagster-gcp-pyspark 0.23.6
Package for storing PySpark DataFrames in GCP
89 versions - Latest release: 3 days ago - 5 dependent repositories - 1.41 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 5.2% on pypi.org
dagster-wandb 0.23.6
Package for wandb Dagster components.
92 versions - Latest release: 3 days ago - 5 dependent repositories - 1.6 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 1.3% on pypi.org
dagster-webserver 1.7.6
Web UI for dagster.
65 versions - Latest release: 3 days ago - 6 dependent packages - 106 dependent repositories - 434 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
airbyte-source-amazon-seller-partner 4.2.4
Source implementation for Amazon Seller Partner.
15 versions - Latest release: 3 days ago - 540 downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 0.9% on pypi.org
dagster-graphql 1.7.6
The GraphQL frontend to python dagster.
548 versions - Latest release: 3 days ago - 9 dependent packages - 160 dependent repositories - 553 thousand downloads last month - 10,389 stars on GitHub - 1 maintainer
Top 4.8% on pypi.org
dagster-pipes 1.7.6
Toolkit for Dagster integrations with transform logic outside of Dagster
42 versions - Latest release: 3 days ago - 2 dependent packages - 1 dependent repositories - 738 thousand downloads last month - 9,174 stars on GitHub - 1 maintainer
Top 1.0% on pypi.org
dagit 1.7.6
Web UI for dagster.
574 versions - Latest release: 3 days ago - 12 dependent packages - 230 dependent repositories - 194 thousand downloads last month - 9,299 stars on GitHub - 2 maintainers
Top 0.8% on pypi.org
dagster 1.7.6
Dagster is an orchestration platform for the development, production, and observation of data ass...
598 versions - Latest release: 3 days ago - 94 dependent packages - 286 dependent repositories - 892 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
airbyte-source-hubspot 4.1.4
Source implementation for HubSpot.
24 versions - Latest release: 3 days ago - 520 downloads last month - 13,821 stars on GitHub - 1 maintainer
glue-utils 0.4.0
Reusable utilities for working with Glue PySpark jobs
20 versions - Latest release: 4 days ago - 2.57 thousand downloads last month - 1 stars on GitHub - 1 maintainer
Top 3.4% on pypi.org
meltano 3.4.2
Meltano is your CLI for ELT+: Open Source, Flexible, and Scalable. Move, transform, and test your...
273 versions - Latest release: 4 days ago - 1 dependent package - 42 dependent repositories - 35.4 thousand downloads last month - 1,598 stars on GitHub - 1 maintainer
mlrun-pipelines-kfp-v1-8-experiment 0.2.2
MLRun Pipelines package for providing KFP 1.8 compatibility
6 versions - Latest release: 4 days ago - 5.32 thousand downloads last month - 1,318 stars on GitHub - 2 maintainers
Top 5.5% on pypi.org
phidata 2.4.9
Memory, knowledge and tools for LLMs.
395 versions - Latest release: 4 days ago - 6 dependent repositories - 19 thousand downloads last month - 2,881 stars on GitHub - 1 maintainer
airbyte-source-confluence 0.2.4
Source implementation for Confluence.
4 versions - Latest release: 4 days ago - 172 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-open-exchange-rates 0.2.5
Source implementation for Open Exchange Rates.
3 versions - Latest release: 4 days ago - 103 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-insightly 0.2.5
Source implementation for Insightly.
3 versions - Latest release: 4 days ago - 111 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-pokeapi 0.2.1
Source implementation for pokeapi.
14 versions - Latest release: 4 days ago - 764 downloads last month - 13,821 stars on GitHub - 1 maintainer
ddeutil-io 0.1.4
Data Developer & Engineer IO Utility Objects
8 versions - Latest release: 4 days ago - 346 downloads last month - 0 stars on GitHub - 1 maintainer
Top 3.2% on pypi.org
lakefs-client 1.23.0
lakeFS API
154 versions - Latest release: 5 days ago - 4 dependent packages - 5 dependent repositories - 22.1 thousand downloads last month - 4,054 stars on GitHub - 1 maintainer
Top 6.3% on pypi.org
lakefs-sdk 1.23.0
lakeFS API
38 versions - Latest release: 5 days ago - 3 dependent packages - 1 dependent repositories - 10.8 thousand downloads last month - 4,054 stars on GitHub - 1 maintainer
Top 5.6% on pypi.org
sf-hamilton 1.62.0
Hamilton, the micro-framework for creating dataframes.
160 versions - Latest release: 5 days ago - 6 dependent packages - 3 dependent repositories - 14.2 thousand downloads last month - 1,312 stars on GitHub - 2 maintainers
sf-hamilton-sdk 0.4.0
Hamilton SDK for reading and writing to the Hamilton backend APIs that support the UI.
5 versions - Latest release: 5 days ago - 1 dependent package - 662 downloads last month - 1,312 stars on GitHub - 1 maintainer
Top 8.0% on pypi.org
vdk-trino 0.4.1290280218
Versatile Data Kit SDK plugin provides support for trino database and trino transformation templa...
51 versions - Latest release: 5 days ago - 11 dependent repositories - 456 downloads last month - 409 stars on GitHub - 1 maintainer
airbyte-source-shopify 2.1.0
Source CDK implementation for Shopify.
29 versions - Latest release: 6 days ago - 7 dependent repositories - 1.49 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-persistiq 0.2.1
Source implementation for Persistiq.
2 versions - Latest release: 6 days ago - 24 downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 3.6% on pypi.org
dlt 0.4.11
dlt is an open-source python-first scalable data loading library that does not require any backen...
88 versions - Latest release: 6 days ago - 5 dependent packages - 23 dependent repositories - 507 thousand downloads last month - 1,736 stars on GitHub - 2 maintainers
airbyte-source-coinmarketcap 0.1.2
Source implementation for coinmarketcap.
2 versions - Latest release: 6 days ago - 25 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-lemlist 0.2.2
Source implementation for Lemlist.
3 versions - Latest release: 6 days ago - 97 downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 6.3% on pypi.org
great-expectations-experimental 0.1.20240513031
Always know what to expect from your data.
502 versions - Latest release: 6 days ago - 1 dependent package - 1 dependent repositories - 255 thousand downloads last month - 9,129 stars on GitHub - 4 maintainers
Top 5.0% on pypi.org
pydbtools 5.5.18
A python package to query data via amazon athena and bring it into a pandas df using aws-wrangler.
39 versions - Latest release: 6 days ago - 2 dependent packages - 4 dependent repositories - 6.9 thousand downloads last month - 6 stars on GitHub - 6 maintainers
bigfunctions 0.6
Supercharge BigQuery with BigFunctions
6 versions - Latest release: 6 days ago - 383 downloads last month - 515 stars on GitHub - 1 maintainer
airbyte-source-jira 2.0.0
Source implementation for Jira.
7 versions - Latest release: 6 days ago - 415 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-pivotal-tracker 0.2.0
Source implementation for pivotal-tracker.
2 versions - Latest release: 7 days ago - 24 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-zendesk-talk 1.0.0
Source implementation for Zendesk Talk.
6 versions - Latest release: 7 days ago - 203 downloads last month - 13,821 stars on GitHub - 1 maintainer
mlrun-pipelines-kfp-v2-experiment 0.2.0
MLRun Pipelines package for providing KFP 2.* compatibility
4 versions - Latest release: 7 days ago - 1.05 thousand downloads last month - 1,318 stars on GitHub - 1 maintainer
mlrun-pipelines-kfp-common-experiment 0.2.0
MLRun Pipelines package for providing KFP 1.8 compatibility
5 versions - Latest release: 7 days ago - 5.88 thousand downloads last month - 1,318 stars on GitHub - 1 maintainer
ddeutil 0.3.4
Data Developer & Engineer Core Utility Objects
11 versions - Latest release: 7 days ago - 2 dependent packages - 1 dependent repositories - 574 downloads last month - 0 stars on GitHub - 1 maintainer
Top 9.1% on pypi.org
quickstart-vdk 0.2.1287193961
Versatile Data Kit SDK packaging containing common plugins to get started quickly using it.
614 versions - Latest release: 8 days ago - 1 dependent repositories - 6 thousand downloads last month - 409 stars on GitHub - 1 maintainer
airbyte-source-lever-hiring 0.3.0
Source implementation for lever-hiring.
2 versions - Latest release: 9 days ago - 21 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-s3 4.5.14
Source implementation for S3.
24 versions - Latest release: 9 days ago - 541 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-chargebee 0.5.1
Source implementation for Chargebee.
8 versions - Latest release: 10 days ago - 173 downloads last month - 13,821 stars on GitHub - 1 maintainer
vdk-postgres 0.0.1285721801
Versatile Data Kit SDK plugin provides support for PostgreSQL database and postgres transformatio...
23 versions - Latest release: 10 days ago - 2 dependent repositories - 135 downloads last month - 409 stars on GitHub - 1 maintainer
airbyte-source-intercom 0.6.5
Source implementation for Intercom Yaml.
9 versions - Latest release: 10 days ago - 78 downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 3.8% on pypi.org
dbt-trino 1.8.0
The trino adapter plugin for dbt (data build tool)
34 versions - Latest release: 10 days ago - 8 dependent packages - 9 dependent repositories - 101 thousand downloads last month - 183 stars on GitHub - 4 maintainers
datasurface 0.0.16
Automate the governance, management and movement of data within your enterprise
11 versions - Latest release: 10 days ago - 155 downloads last month - 0 stars on GitHub - 1 maintainer
dagster-openai 0.23.5
A Open AI client resource for interacting with Open AI API.
17 versions - Latest release: 10 days ago - 1.3 thousand downloads last month - 10,389 stars on GitHub - 1 maintainer
Top 3.6% on pypi.org
vdk-core 0.3.1284553848
Versatile Data Kit SDK Core
210 versions - Latest release: 11 days ago - 35 dependent packages - 9 dependent repositories - 6.01 thousand downloads last month - 409 stars on GitHub - 1 maintainer
vdk-oracle 0.1.1284357447
Support for VDK Managed Oracle connection
21 versions - Latest release: 11 days ago - 330 downloads last month - 409 stars on GitHub - 1 maintainer
sageworks 0.6.2 💰
SageWorks: A Python WorkBench for creating and deploying AWS SageMaker Models
129 versions - Latest release: 11 days ago - 1.73 thousand downloads last month - 37 stars on GitHub - 1 maintainer
Top 2.4% on pypi.org
snowflake-snowpark-python 1.16.0
Snowflake Snowpark for Python
28 versions - Latest release: 11 days ago - 30 dependent packages - 181 dependent repositories - 1.87 million downloads last month - 231 stars on GitHub - 4 maintainers
Top 4.2% on pypi.org
getdaft 0.2.24
Distributed Dataframes for Multimodal Data
71 versions - Latest release: 12 days ago - 5 dependent packages - 3 dependent repositories - 13.9 thousand downloads last month - 1,761 stars on GitHub - 1 maintainer
airbyte-source-paypal-transaction 2.5.3
Source implementation for Paypal Transaction.
8 versions - Latest release: 12 days ago - 128 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-typeform 1.2.8
Source implementation for Typeform.
6 versions - Latest release: 12 days ago - 7 dependent repositories - 151 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-twilio 0.11.2
Source implementation for Twilio.
4 versions - Latest release: 12 days ago - 39 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-mixpanel 2.2.2
Source implementation for Mixpanel.
5 versions - Latest release: 12 days ago - 44 downloads last month - 13,821 stars on GitHub - 1 maintainer
Related Keywords
python 641 etl 530 data-integration 443 elt 425 data 416 pipeline 375 snowflake 341 data-analysis 338 data-science 336 bigquery 295 mysql 289 data-pipeline 289 redshift 288 postgresql 287 s3 284 data-collection 284 java 283 change-data-capture 283 mssql 281 self-hosted 278 data-pipelines 208 workflow 189 mlops 184 orchestration 181 scheduler 151 data-orchestrator 150 analytics 150 machine-learning 130 apache 114 workflow-engine 114 automation 110 airflow 102 dag 96 apache-airflow 90 workflow-orchestration 85 sql 71 integration 68 metadata 67 workflow-automation 65 database 65 dagster 64 airflow-provider 64 trino 55 data-warehouse 55 dataops 53 data-engineering-pipeline 51 data-structures 50 warehouse 49 data-lineage 49 data-engineer 49 data-analytics 40 data-visualization 35 flask 29 data-viz 29 business-intelligence 29 business-analytics 29 pipelines 29 bi 29 react 29 data-quality 29 asf 29 apache-superset 29 sql-editor 29 superset 29 pandas 25 prefect 25 data-ops 25 observability 24 infrastructure 23 ml-ops 20 spark 19 dataframe 17 dbt 15 etl-pipeline 14 aws 14 hacktoberfest 14 big-data 13 feature-engineering 13 dataquality 13 postgres 13 kubernetes 12 framework 12 pyspark 11 python3 10 feature-store 10 airbyte 10 data-lake 9 etl-framework 9 data-unit-tests 9 llmops 8 data engineering 8 data-versioning 8 batch-processing 8 data-profiling 8 cdk 8 connector-development-kit 8 athena 7 cli 7 quality 7 ml 7