Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "data-engineering" keyword

Top 2.0% on pypi.org
dagster-gcp 1.0.5
Package for GCP-specific Dagster framework op and resource components.
517 versions - Latest release: over 1 year ago - 4 dependent packages - 21 dependent repositories - 131 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 2.4% on pypi.org
dagster-docker 1.0.5
A Dagster integration for docker
378 versions - Latest release: over 1 year ago - 2 dependent packages - 30 dependent repositories - 131 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
dagster-dbt 1.0.5
A Dagster integration for dbt
473 versions - Latest release: over 1 year ago - 4 dependent packages - 113 dependent repositories - 1.85 million downloads last month - 9,299 stars on GitHub - 1 maintainer
Top 1.6% on pypi.org
dagster-aws 1.0.5
Package for AWS-specific Dagster framework solid and resource components.
540 versions - Latest release: over 1 year ago - 3 dependent packages - 24 dependent repositories - 563 thousand downloads last month - 10,330 stars on GitHub - 1 maintainer
Top 0.8% on pypi.org
dagster 1.7.5
Dagster is an orchestration platform for the development, production, and observation of data ass...
597 versions - Latest release: 5 days ago - 94 dependent packages - 286 dependent repositories - 886 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
Top 1.0% on pypi.org
dagit 1.7.5
Web UI for dagster.
573 versions - Latest release: 5 days ago - 12 dependent packages - 230 dependent repositories - 198 thousand downloads last month - 9,299 stars on GitHub - 2 maintainers
airbyte-source-shopify 2.1.0
Source CDK implementation for Shopify.
29 versions - Latest release: about 4 hours ago - 7 dependent repositories - 1.49 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
awswrangler 3.7.3
Pandas on AWS.
151 versions - Latest release: 22 days ago - 44 dependent packages - 185 dependent repositories - 43.9 million downloads last month - 3,704 stars on GitHub - 5 maintainers
airbyte-source-persistiq 0.2.1
Source implementation for Persistiq.
2 versions - Latest release: about 5 hours ago - 24 downloads last month - 13,821 stars on GitHub - 1 maintainer
arrow_pd_parser 2.0.0
MoJ arrow-pd-parser
24 versions - Latest release: 6 months ago - 1 dependent repositories - 4.37 thousand downloads last month - 7 stars on GitHub - 2 maintainers
Top 1.4% on pypi.org
argo-workflows 6.5.6
Argo Workflows API
75 versions - Latest release: 25 days ago - 11 dependent packages - 143 dependent repositories - 191 thousand downloads last month - 13,883 stars on GitHub - 2 maintainers
apache-airflow-providers-teradata 2.1.0
Provider package apache-airflow-providers-teradata for Apache Airflow
23 versions - Latest release: 8 days ago - 1 dependent package - 33.8 thousand downloads last month - 34,343 stars on GitHub - 1 maintainer
Top 0.5% on pypi.org
apache-airflow-providers-sqlite 3.8.0
Provider package apache-airflow-providers-sqlite for Apache Airflow
59 versions - Latest release: 8 days ago - 8 dependent packages - 364 dependent repositories - 4.31 million downloads last month - 34,343 stars on GitHub - 4 maintainers
Top 0.6% on pypi.org
apache-airflow-providers-slack 8.7.0
Provider package apache-airflow-providers-slack for Apache Airflow
72 versions - Latest release: 8 days ago - 10 dependent packages - 76 dependent repositories - 2.65 million downloads last month - 34,343 stars on GitHub - 4 maintainers
Top 0.7% on pypi.org
apache-airflow-providers-sftp 4.10.0
Provider package apache-airflow-providers-sftp for Apache Airflow
78 versions - Latest release: 8 days ago - 11 dependent packages - 35 dependent repositories - 976 thousand downloads last month - 34,343 stars on GitHub - 4 maintainers
apache-airflow-providers-qdrant 1.1.0
Provider package apache-airflow-providers-qdrant for Apache Airflow
4 versions - Latest release: 8 days ago - 1 dependent package - 2.08 thousand downloads last month - 34,343 stars on GitHub - 1 maintainer
Top 0.4% on pypi.org
apache-airflow-providers-postgres 5.10.2
Provider package apache-airflow-providers-postgres for Apache Airflow
76 versions - Latest release: 2 months ago - 23 dependent packages - 152 dependent repositories - 1.98 million downloads last month - 34,343 stars on GitHub - 4 maintainers
Top 0.9% on pypi.org
apache-airflow-providers-microsoft-mssql 3.6.1
Provider package apache-airflow-providers-microsoft-mssql for Apache Airflow
55 versions - Latest release: 3 months ago - 9 dependent packages - 27 dependent repositories - 1.07 million downloads last month - 34,343 stars on GitHub - 4 maintainers
Top 0.8% on pypi.org
apache-airflow-providers-microsoft-azure 10.0.0
Provider package apache-airflow-providers-microsoft-azure for Apache Airflow
118 versions - Latest release: about 1 month ago - 12 dependent packages - 42 dependent repositories - 552 thousand downloads last month - 34,343 stars on GitHub - 4 maintainers
Top 0.3% on pypi.org
apache-airflow-providers-http 4.10.1
Provider package apache-airflow-providers-http for Apache Airflow
67 versions - Latest release: about 1 month ago - 22 dependent packages - 511 dependent repositories - 7.35 million downloads last month - 34,343 stars on GitHub - 4 maintainers
Top 0.3% on pypi.org
apache-airflow-providers-google 10.17.0
Provider package apache-airflow-providers-google for Apache Airflow
130 versions - Latest release: about 1 month ago - 25 dependent packages - 374 dependent repositories - 6.63 million downloads last month - 34,343 stars on GitHub - 4 maintainers
apache-airflow-providers-fab 1.1.0
Provider package apache-airflow-providers-fab for Apache Airflow
16 versions - Latest release: 8 days ago - 2 dependent packages - 1.47 million downloads last month - 34,343 stars on GitHub - 1 maintainer
Top 0.6% on pypi.org
apache-airflow-providers-docker 3.11.0
Provider package apache-airflow-providers-docker for Apache Airflow
89 versions - Latest release: 8 days ago - 13 dependent packages - 64 dependent repositories - 379 thousand downloads last month - 34,343 stars on GitHub - 4 maintainers
Top 0.9% on pypi.org
apache-airflow-providers-databricks 6.4.0
Provider package apache-airflow-providers-databricks for Apache Airflow
90 versions - Latest release: 8 days ago - 6 dependent packages - 23 dependent repositories - 5.81 million downloads last month - 34,343 stars on GitHub - 4 maintainers
Top 0.5% on pypi.org
apache-airflow-providers-cncf-kubernetes 8.2.0
Provider package apache-airflow-providers-cncf-kubernetes for Apache Airflow
126 versions - Latest release: 8 days ago - 28 dependent packages - 124 dependent repositories - 2.71 million downloads last month - 34,343 stars on GitHub - 5 maintainers
Top 1.0% on pypi.org
apache-airflow-providers-apache-spark 4.8.0
Provider package apache-airflow-providers-apache-spark for Apache Airflow
67 versions - Latest release: 8 days ago - 6 dependent packages - 69 dependent repositories - 184 thousand downloads last month - 34,343 stars on GitHub - 4 maintainers
Top 0.4% on pypi.org
apache-airflow-providers-amazon 8.21.0
Provider package apache-airflow-providers-amazon for Apache Airflow
134 versions - Latest release: 8 days ago - 27 dependent packages - 184 dependent repositories - 4.66 million downloads last month - 34,343 stars on GitHub - 4 maintainers
Top 0.2% on pypi.org
apache-airflow 2.9.1
Programmatically author, schedule and monitor data pipelines
193 versions - Latest release: 8 days ago - 314 dependent packages - 1,554 dependent repositories - 23.2 million downloads last month - 34,343 stars on GitHub - 1 maintainer
airbyte-serverless 0.23
Airbyte made easy (no UI, no database, no cluster)
20 versions - Latest release: 5 months ago - 1 dependent package - 4.93 thousand downloads last month - 113 stars on GitHub - 1 maintainer
airbyte-lib 0.1.0
AirbyteLib
3 versions - Latest release: 3 months ago - 73 downloads last month - 144 stars on GitHub - 1 maintainer
Top 0.7% on pypi.org
airbyte-cdk 0.88.2
A framework for writing Airbyte Connectors.
407 versions - Latest release: 4 days ago - 266 dependent packages - 234 dependent repositories - 119 thousand downloads last month - 12,703 stars on GitHub - 1 maintainer
Top 1.8% on pypi.org
apache-airflow-providers-discord 3.7.0
Provider package apache-airflow-providers-discord for Apache Airflow
43 versions - Latest release: 8 days ago - 3 dependent packages - 16 dependent repositories - 23.5 thousand downloads last month - 34,343 stars on GitHub - 4 maintainers
diver 0.2.3
diver is a series of tools to speed up common feature-set investigation, conditioning and encodin...
20 versions - Latest release: about 4 years ago - 1 dependent repositories - 136 downloads last month - 1 stars on GitHub - 1 maintainer
Top 9.8% on pypi.org
meerschaum 2.1.7 💰
Sync Time-Series Pipes with Meerschaum
390 versions - Latest release: 4 months ago - 1 dependent repositories - 3.12 thousand downloads last month - 106 stars on GitHub - 1 maintainer
sbss 0.0.1
Similarity-Based Stratified Splitting Algorithm
1 version - Latest release: 5 months ago - 21 downloads last month - 1 stars on GitHub - 1 maintainer
airbyte-source-lemlist 0.2.2
Source implementation for Lemlist.
3 versions - Latest release: about 13 hours ago - 97 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-coinmarketcap 0.1.2
Source implementation for coinmarketcap.
2 versions - Latest release: about 13 hours ago - 25 downloads last month - 13,821 stars on GitHub - 1 maintainer
snowflake-dbml-generator 0.1.2
Automatically generate DBML files from Snowflake databases.
3 versions - Latest release: 9 days ago - 362 downloads last month - 5 stars on GitHub - 1 maintainer
dpyp 1.0.0
A pandas convenience wrapper for small-scale data pipelines
1 version - Latest release: 22 days ago - 200 downloads last month - 2 stars on GitHub - 1 maintainer
sf-hamilton-sdk 0.3.3
Hamilton SDK for reading and writing to the Hamilton backend APIs that support the UI.
2 versions - Latest release: 19 days ago - 184 downloads last month - 1,312 stars on GitHub - 1 maintainer
dw-hamilton-sdk 0.3.2
Hamilton SDK for reading and writing to the Hamilton backend APIs that support the UI.
1 version - Latest release: 22 days ago - 154 downloads last month - 1,312 stars on GitHub - 1 maintainer
compars 0.0.0
DataFrame comparison done right (AKA the Bear-agnostic DataFrame comparison library)
1 version - Latest release: 24 days ago - 156 downloads last month - 0 stars on GitHub - 1 maintainer
grizzlys 0.0.1
Python DataFrames powered by Julia
2 versions - Latest release: 30 days ago - 0 stars on GitHub - 1 maintainer
airbyte-source-declarative-manifest 0.87.0
Base source implementation for low-code sources.
22 versions - Latest release: 7 days ago - 1.32 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-avni 0.1.0
Source implementation for Avni.
1 version - Latest release: about 2 months ago - 177 downloads last month - 13,759 stars on GitHub - 1 maintainer
llmt 0.0.5
LLMT aims to make it easy to programatically connect OpenAI and HuggingFace models to your data p...
5 versions - Latest release: 24 days ago - 413 downloads last month - 4 stars on GitHub - 1 maintainer
lamatic-airbyte-cdk 0.1.0
A framework for writing Airbyte Connectors.
1 version - Latest release: about 2 months ago - 181 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-microsoft-sharepoint 0.2.3
Source implementation for Microsoft SharePoint.
4 versions - Latest release: 20 days ago - 182 downloads last month - 13,821 stars on GitHub - 1 maintainer
nodestream-plugin-shell 0.12.0
A plugin for nodestream providing pipeline shell execution.
3 versions - Latest release: about 1 month ago - 183 downloads last month - 29 stars on GitHub - 3 maintainers
nodestream-plugin-neptune 0.12.0
A Fast, Declarative, and Extensible ETL Framework for Graph Databases.
4 versions - Latest release: about 1 month ago - 204 downloads last month - 29 stars on GitHub - 1 maintainer
airbyte-source-zoom 1.1.0
Source implementation for Zoom.
1 version - Latest release: 2 months ago - 22 downloads last month - 13,821 stars on GitHub - 1 maintainer
parallel-simulations 0.0.1
Helper class to orchestrate in parallel Monte Carlo simulations for an arbitrary number of models...
1 version - Latest release: 2 months ago - 10 downloads last month - 0 stars on GitHub - 1 maintainer
nodestream-plugin-neo4j 0.12.2
A Fast, Declarative, and Extensible ETL Framework for Graph Databases.
7 versions - Latest release: 22 days ago - 311 downloads last month - 29 stars on GitHub - 1 maintainer
dagster-openai 0.23.5
A Open AI client resource for interacting with Open AI API.
16 versions - Latest release: 5 days ago - 1.16 thousand downloads last month - 10,330 stars on GitHub - 1 maintainer
glue-utils 0.3.1
Reusable utilities for working with Glue PySpark jobs
18 versions - Latest release: 1 day ago - 2.06 thousand downloads last month - 1 stars on GitHub - 1 maintainer
postql 1.0.3
Python wrapper for Postgres
3 versions - Latest release: 3 months ago - 52 downloads last month - 0 stars on GitHub - 1 maintainer
airbyte-source-linkedin-ads 2.1.1
Source implementation for Linkedin Ads.
7 versions - Latest release: 7 days ago - 355 downloads last month - 13,821 stars on GitHub - 1 maintainer
vdk-storage 0.1.1190994517
Library for access to different managed storages
4 versions - Latest release: 3 months ago - 15 downloads last month - 409 stars on GitHub - 1 maintainer
vdk-confluence-data-source 0.1.1190994517
VDK data source plugin for Confluence
3 versions - Latest release: 3 months ago - 24 downloads last month - 409 stars on GitHub - 1 maintainer
airbyte-source-intercom 0.6.5
Source implementation for Intercom Yaml.
9 versions - Latest release: 4 days ago - 78 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-bing-ads 2.6.1
Source implementation for Bing Ads.
8 versions - Latest release: 7 days ago - 224 downloads last month - 13,755 stars on GitHub - 1 maintainer
airbyte-source-google-analytics-v4 0.3.1
Source implementation for Google Analytics V4.
4 versions - Latest release: 20 days ago - 83 downloads last month - 13,803 stars on GitHub - 1 maintainer
airbyte-source-s3 4.5.14
Source implementation for S3.
24 versions - Latest release: 4 days ago - 541 downloads last month - 13,821 stars on GitHub - 1 maintainer
files2db 0.1.1
Migration from local files to database made simple!
2 versions - Latest release: 3 months ago - 16 downloads last month - 0 stars on GitHub - 1 maintainer
llama-index-readers-airbyte-zendesk-support 0.1.3
llama-index readers airbyte_zendesk_support integration
5 versions - Latest release: 3 months ago - 18 downloads last month - 13,781 stars on GitHub - 1 maintainer
airbyte-source-azure-blob-storage 0.4.1
Source implementation for Azure Blob Storage.
6 versions - Latest release: 16 days ago - 237 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-smartsheets 1.1.2
Source implementation for Smartsheets.
1 version - Latest release: 3 months ago - 19 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-pipedrive 2.2.2
Source implementation for Pipedrive.
1 version - Latest release: 3 months ago - 6 downloads last month - 13,816 stars on GitHub - 1 maintainer
airbyte-source-monday 2.1.2
Source implementation for Monday.
8 versions - Latest release: 13 days ago - 142 downloads last month - 13,794 stars on GitHub - 1 maintainer
airbyte-source-slack 1.1.1
Source implementation for Slack.
11 versions - Latest release: 7 days ago - 221 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-microsoft-onedrive 0.2.0
Source implementation for Microsoft OneDrive.
6 versions - Latest release: about 2 months ago - 107 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-xero 0.2.5
Source implementation for Xero.
1 version - Latest release: 3 months ago - 17 downloads last month - 13,772 stars on GitHub - 1 maintainer
airbyte-source-mixpanel 2.2.2
Source implementation for Mixpanel.
5 versions - Latest release: 7 days ago - 44 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-paypal-transaction 2.5.3
Source implementation for Paypal Transaction.
8 versions - Latest release: 7 days ago - 128 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-mailchimp 2.0.3
Source implementation for Mailchimp.
7 versions - Latest release: 7 days ago - 268 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-marketo 1.4.0
Source implementation for Marketo.
5 versions - Latest release: 15 days ago - 97 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-google-drive 0.0.10
Source implementation for Google Drive.
3 versions - Latest release: about 1 month ago - 98 downloads last month - 13,781 stars on GitHub - 1 maintainer
airbyte-source-youtube-analytics 0.1.4
Source implementation for Youtube Analytics.
1 version - Latest release: 3 months ago - 15 downloads last month - 13,767 stars on GitHub - 1 maintainer
airbyte-source-zapier-supported-storage 0.1.3
Source implementation for Zapier Supported Storage.
2 versions - Latest release: 24 days ago - 8 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-iterable 0.5.1
Source implementation for Iterable.
7 versions - Latest release: 7 days ago - 259 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-apify-dataset 2.1.5
Source implementation for Apify Dataset.
2 versions - Latest release: 13 days ago - 26 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-freshdesk 3.1.0
Source implementation for Freshdesk.
3 versions - Latest release: about 2 months ago - 94 downloads last month - 13,794 stars on GitHub - 1 maintainer
airbyte-source-instagram 3.0.7
Source implementation for Instagram.
6 versions - Latest release: 7 days ago - 53 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-facebook-marketing 2.1.8
Source implementation for Facebook Marketing.
22 versions - Latest release: 7 days ago - 641 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-google-ads 3.4.2
Source implementation for Google Ads.
15 versions - Latest release: 7 days ago - 174 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-gitlab 4.0.2
Source implementation for GitLab.
8 versions - Latest release: 7 days ago - 221 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-zenefits 0.2.4
Source implementation for Zenefits.
2 versions - Latest release: 14 days ago - 18 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-zendesk-sell 0.2.0
Source implementation for Zendesk Sell.
1 version - Latest release: 3 months ago - 4 downloads last month - 13,767 stars on GitHub - 1 maintainer
airbyte-source-zendesk-sunshine 0.2.4
Source implementation for Zendesk Sunshine.
2 versions - Latest release: 24 days ago - 8 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-zenloop 0.1.14
Source implementation for Zenloop.
3 versions - Latest release: 20 days ago - 76 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-webflow 0.1.3
Source implementation for Webflow.
1 version - Latest release: 3 months ago - 13 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-workramp 0.1.0
Source implementation for Workramp.
1 version - Latest release: 3 months ago - 13 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-weatherstack 0.1.0
Source implementation for Weatherstack.
1 version - Latest release: 3 months ago - 4 downloads last month - 13,600 stars on GitHub - 1 maintainer
airbyte-source-tyntec-sms 0.1.0
Source implementation for Tyntec Sms.
1 version - Latest release: 3 months ago - 5 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-workable 0.1.0
Source implementation for Workable.
1 version - Latest release: 3 months ago - 7 downloads last month - 13,755 stars on GitHub - 1 maintainer
airbyte-source-visma-economic 0.2.4
Source implementation for Visma Economic.
2 versions - Latest release: 13 days ago - 25 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-us-census 0.1.3
Source implementation for Us Census.
1 version - Latest release: 3 months ago - 4 downloads last month - 13,781 stars on GitHub - 1 maintainer
airbyte-source-whisky-hunter 0.1.0
Source implementation for Whisky Hunter.
1 version - Latest release: 3 months ago - 6 downloads last month - 13,816 stars on GitHub - 1 maintainer
airbyte-source-wrike 0.2.1
Source implementation for Wrike.
2 versions - Latest release: 12 days ago - 19 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-xkcd 0.1.1
Source implementation for Xkcd.
1 version - Latest release: 3 months ago - 9 downloads last month - 13,821 stars on GitHub - 1 maintainer
Related Keywords
python 627 etl 527 data-integration 441 elt 424 data 402 pipeline 363 snowflake 341 data-analysis 338 data-science 322 bigquery 295 data-pipeline 289 mysql 289 redshift 288 postgresql 287 s3 284 data-collection 284 java 283 change-data-capture 283 mssql 281 self-hosted 278 data-pipelines 206 mlops 182 workflow 175 orchestration 167 analytics 149 scheduler 149 data-orchestrator 148 machine-learning 129 apache 113 airflow 101 workflow-engine 101 automation 97 dag 95 apache-airflow 89 workflow-orchestration 84 sql 71 integration 67 metadata 66 database 65 workflow-automation 64 airflow-provider 63 dagster 63 trino 55 data-warehouse 55 dataops 53 data-engineering-pipeline 51 data-structures 50 data-engineer 50 warehouse 49 data-lineage 49 data-analytics 40 data-visualization 35 data-quality 30 asf 29 bi 29 business-analytics 29 business-intelligence 29 data-viz 29 flask 29 react 29 sql-editor 29 superset 29 apache-superset 29 pipelines 29 pandas 25 spark 20 dataframe 17 dbt 15 hacktoberfest 14 aws 14 dataquality 14 data-ops 14 etl-pipeline 14 big-data 13 prefect 13 feature-engineering 13 postgres 13 framework 12 observability 12 kubernetes 12 pyspark 11 infrastructure 11 feature-store 10 airbyte 10 data-unit-tests 10 python3 10 etl-framework 9 data-lake 9 data-profiling 9 data-versioning 8 llmops 8 cdk 8 connector-development-kit 8 ml-ops 8 data engineering 8 batch-processing 8 data-profilers 7 apache-spark 7 dataunittest 7 ml 7