Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "etl" keyword

plum-project 1.0.0
A python data job framework to simplify development and operations.
5 versions - Latest release: 3 days ago - 121 downloads last month - 1 maintainer
airbyte-source-stripe 5.3.8
Source implementation for Stripe.
27 versions - Latest release: 3 days ago - 1 dependent repositories - 1.92 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
zetl 3.4.1
A simple ETL framework for Python, SQL and BAT files which uses a Postgres database for activity ...
40 versions - Latest release: 3 days ago - 927 downloads last month - 0 stars on GitHub - 1 maintainer
Top 2.7% on pypi.org
apache-airflow-providers-tabular 1.5.1
Provider package apache-airflow-providers-tabular for Apache Airflow
22 versions - Latest release: 3 days ago - 3 dependent packages - 3 dependent repositories - 23.2 thousand downloads last month - 34,343 stars on GitHub - 3 maintainers
Top 0.8% on pypi.org
apache-airflow-providers-microsoft-azure 10.1.0
Provider package apache-airflow-providers-microsoft-azure for Apache Airflow
119 versions - Latest release: 3 days ago - 12 dependent packages - 42 dependent repositories - 552 thousand downloads last month - 34,343 stars on GitHub - 3 maintainers
Top 0.3% on pypi.org
apache-airflow-providers-google 10.18.0
Provider package apache-airflow-providers-google for Apache Airflow
131 versions - Latest release: 3 days ago - 25 dependent packages - 374 dependent repositories - 6.63 million downloads last month - 34,343 stars on GitHub - 3 maintainers
apache-airflow-providers-apache-iceberg 1.0.0
Provider package apache-airflow-providers-apache-iceberg for Apache Airflow
2 versions - Latest release: 3 days ago - 1 dependent package - 1.86 thousand downloads last month - 34,343 stars on GitHub - 1 maintainer
Top 0.4% on pypi.org
apache-airflow-providers-amazon 8.22.0
Provider package apache-airflow-providers-amazon for Apache Airflow
135 versions - Latest release: 3 days ago - 27 dependent packages - 184 dependent repositories - 4.6 million downloads last month - 34,343 stars on GitHub - 4 maintainers
horizon-hwm-store 0.1.6
onETL Plugin for Horizon store
3 versions - Latest release: 3 days ago - 82 downloads last month - 3 stars on GitHub - 3 maintainers
pypeman 0.5.6
Minimalistic but pragmatic ESB / ETL / EAI in Python
17 versions - Latest release: 3 days ago - 1 dependent repositories - 420 downloads last month - 8 stars on GitHub - 2 maintainers
dbt_coves 1.7.10
CLI tool for dbt users adopting analytics engineering best practices.
200 versions - Latest release: 3 days ago - 6.21 thousand downloads last month - 204 stars on GitHub - 1 maintainer
airbyte-source-zendesk-support 2.6.4
Source implementation for Zendesk Support.
19 versions - Latest release: 3 days ago - 7 dependent repositories - 1.43 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
superlinked 3.46.0
The Superlinked vector computing library
64 versions - Latest release: 4 days ago - 3.39 thousand downloads last month - 148 stars on GitHub - 1 maintainer
airbyte-source-facebook-marketing 2.1.9
Source implementation for Facebook Marketing.
23 versions - Latest release: 4 days ago - 6.93 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-declarative-manifest 0.90.0
Base source implementation for low-code sources.
26 versions - Latest release: 4 days ago - 1.78 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 0.7% on pypi.org
airbyte-cdk 0.90.0
A framework for writing Airbyte Connectors.
411 versions - Latest release: 4 days ago - 266 dependent packages - 234 dependent repositories - 109 thousand downloads last month - 12,703 stars on GitHub - 1 maintainer
airbyte-source-tiktok-marketing 3.9.7
Source implementation for Tiktok Marketing.
5 versions - Latest release: 4 days ago - 198 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-salesforce 2.5.12
Source implementation for Salesforce.
33 versions - Latest release: 4 days ago - 7 dependent repositories - 1.11 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
ricco 1.4.2
A handy ETL&GEOM kit
55 versions - Latest release: 4 days ago - 1 dependent repositories - 371 downloads last month - 1 stars on GitHub - 1 maintainer
warn-transformer 1.3.133
Consolidate, enrich and analyze the data gathered by warn-scraper
157 versions - Latest release: 4 days ago - 1 dependent repositories - 2.13 thousand downloads last month - 3 stars on GitHub - 1 maintainer
Top 4.1% on pypi.org
dagster-gcp-pandas 0.23.6
Package for storing Pandas DataFrames in GCP.
90 versions - Latest release: 4 days ago - 5 dependent repositories - 28.5 thousand downloads last month - 10,392 stars on GitHub - 1 maintainer
dagster-deltalake-pandas 0.23.6
Package for storing Pandas DataFrames in Delta tables.
33 versions - Latest release: 4 days ago - 2.02 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 8.2% on pypi.org
dagster-snowflake-pyspark 0.23.6
Package for integrating Snowflake and PySpark with Dagster.
96 versions - Latest release: 4 days ago - 1 dependent repositories - 2.18 thousand downloads last month - 10,389 stars on GitHub - 1 maintainer
Top 4.3% on pypi.org
dagster-airflow 1.7.6
Airflow plugin for Dagster
544 versions - Latest release: 4 days ago - 7 dependent repositories - 9.84 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 4.0% on pypi.org
dagster-managed-elements 0.23.6
Package for Managed elements with Dagster.
113 versions - Latest release: 4 days ago - 2 dependent packages - 2 dependent repositories - 3.99 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
dagster-polars 0.23.6
Dagster integration library for Polars
56 versions - Latest release: 4 days ago - 6.74 thousand downloads last month - 10,389 stars on GitHub - 2 maintainers
dagster-deltalake-polars 0.23.6
Package for storing Polars DataFrames in Delta tables.
33 versions - Latest release: 4 days ago - 1.4 thousand downloads last month - 9,174 stars on GitHub - 1 maintainer
dagster-looker 0.23.6
An orchestration platform for the development, production, and observation of data assets.
1 version - Latest release: 4 days ago - 443 downloads last month - 10,392 stars on GitHub - 1 maintainer
Top 1.8% on pypi.org
dagster-duckdb 0.23.6
Package for DuckDB-specific Dagster framework op and resource components.
115 versions - Latest release: 4 days ago - 4 dependent packages - 63 dependent repositories - 22.4 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
Top 2.7% on pypi.org
dagster-duckdb-pandas 0.23.6
Package for storing Pandas DataFrames in DuckDB.
115 versions - Latest release: 4 days ago - 1 dependent package - 15 dependent repositories - 185 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
dagster-duckdb-polars 0.23.6
Package for storing Polars DataFrames in DuckDB.
89 versions - Latest release: 4 days ago - 1 dependent repositories - 2.85 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
dagster-deltalake 0.23.6
Package for Deltalake-specific Dagster framework op and resource components.
33 versions - Latest release: 4 days ago - 2 dependent packages - 2.5 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 7.6% on pypi.org
dagster-embedded-elt 0.23.6
Package for performing ETL/ELT tasks with Dagster.
41 versions - Latest release: 4 days ago - 1 dependent repositories - 22.1 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 8.2% on pypi.org
dagster-duckdb-pyspark 0.23.6
Package for storing PySpark DataFrames in DuckDB.
115 versions - Latest release: 4 days ago - 1 dependent repositories - 1.71 thousand downloads last month - 10,392 stars on GitHub - 1 maintainer
Top 5.2% on pypi.org
dagster-gcp-pyspark 0.23.6
Package for storing PySpark DataFrames in GCP
89 versions - Latest release: 4 days ago - 5 dependent repositories - 1.33 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 5.2% on pypi.org
dagster-wandb 0.23.6
Package for wandb Dagster components.
92 versions - Latest release: 4 days ago - 5 dependent repositories - 1.53 thousand downloads last month - 9,191 stars on GitHub - 1 maintainer
Top 1.3% on pypi.org
dagster-webserver 1.7.6
Web UI for dagster.
65 versions - Latest release: 4 days ago - 6 dependent packages - 106 dependent repositories - 421 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
airbyte-source-amazon-seller-partner 4.2.4
Source implementation for Amazon Seller Partner.
15 versions - Latest release: 4 days ago - 540 downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 3.3% on pypi.org
dbt-databricks 1.7.15
The Databricks adapter plugin for dbt
110 versions - Latest release: 4 days ago - 10 dependent packages - 40 dependent repositories - 934 thousand downloads last month - 179 stars on GitHub - 4 maintainers
Top 0.9% on pypi.org
dagster-graphql 1.7.6
The GraphQL frontend to python dagster.
548 versions - Latest release: 4 days ago - 9 dependent packages - 160 dependent repositories - 553 thousand downloads last month - 10,389 stars on GitHub - 1 maintainer
Top 4.8% on pypi.org
dagster-pipes 1.7.6
Toolkit for Dagster integrations with transform logic outside of Dagster
42 versions - Latest release: 4 days ago - 2 dependent packages - 1 dependent repositories - 693 thousand downloads last month - 9,174 stars on GitHub - 1 maintainer
Top 1.0% on pypi.org
dagit 1.7.6
Web UI for dagster.
574 versions - Latest release: 4 days ago - 12 dependent packages - 230 dependent repositories - 188 thousand downloads last month - 9,299 stars on GitHub - 2 maintainers
Top 0.8% on pypi.org
dagster 1.7.6
Dagster is an orchestration platform for the development, production, and observation of data ass...
598 versions - Latest release: 4 days ago - 94 dependent packages - 286 dependent repositories - 866 thousand downloads last month - 9,299 stars on GitHub - 1 maintainer
airbyte-source-hubspot 4.1.4
Source implementation for HubSpot.
24 versions - Latest release: 4 days ago - 520 downloads last month - 13,821 stars on GitHub - 1 maintainer
pramen-py 1.8.8
Pramen transformations written in python
30 versions - Latest release: 5 days ago - 451 downloads last month - 22 stars on GitHub - 3 maintainers
glue-utils 0.4.0
Reusable utilities for working with Glue PySpark jobs
20 versions - Latest release: 5 days ago - 2.57 thousand downloads last month - 1 stars on GitHub - 1 maintainer
Top 7.3% on pypi.org
sqlmesh 0.96.0
Efficient data transformation and modeling framework that is backwards compatible with dbt.
345 versions - Latest release: 5 days ago - 1 dependent package - 1 dependent repositories - 30.1 thousand downloads last month - 1,222 stars on GitHub - 6 maintainers
airbyte-source-confluence 0.2.4
Source implementation for Confluence.
4 versions - Latest release: 5 days ago - 172 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-open-exchange-rates 0.2.5
Source implementation for Open Exchange Rates.
3 versions - Latest release: 5 days ago - 103 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-insightly 0.2.5
Source implementation for Insightly.
3 versions - Latest release: 5 days ago - 111 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-pokeapi 0.2.1
Source implementation for pokeapi.
14 versions - Latest release: 5 days ago - 764 downloads last month - 13,821 stars on GitHub - 1 maintainer
kflow 1.0.143
KLog.co package for ETLs
141 versions - Latest release: 5 days ago - 1.36 thousand downloads last month - 1 maintainer
data-horizon 0.2.0
Horizon REST API + client
5 versions - Latest release: 6 days ago - 192 downloads last month - 8 stars on GitHub - 3 maintainers
Top 5.6% on pypi.org
sf-hamilton 1.62.0
Hamilton, the micro-framework for creating dataframes.
160 versions - Latest release: 6 days ago - 6 dependent packages - 3 dependent repositories - 14.2 thousand downloads last month - 1,312 stars on GitHub - 2 maintainers
sf-hamilton-sdk 0.4.0
Hamilton SDK for reading and writing to the Hamilton backend APIs that support the UI.
5 versions - Latest release: 6 days ago - 1 dependent package - 662 downloads last month - 1,312 stars on GitHub - 1 maintainer
pysparkify 0.27.0
Spark based ETL
18 versions - Latest release: 6 days ago - 1.01 thousand downloads last month - 1 stars on GitHub - 1 maintainer
Top 8.0% on pypi.org
vdk-trino 0.4.1290280218
Versatile Data Kit SDK plugin provides support for trino database and trino transformation templa...
52 versions - Latest release: 6 days ago - 11 dependent repositories - 510 downloads last month - 409 stars on GitHub - 1 maintainer
airbyte-source-shopify 2.1.0
Source CDK implementation for Shopify.
29 versions - Latest release: 7 days ago - 7 dependent repositories - 1.49 thousand downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-persistiq 0.2.1
Source implementation for Persistiq.
2 versions - Latest release: 7 days ago - 24 downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 3.6% on pypi.org
dlt 0.4.11
dlt is an open-source python-first scalable data loading library that does not require any backen...
88 versions - Latest release: 7 days ago - 5 dependent packages - 23 dependent repositories - 507 thousand downloads last month - 1,736 stars on GitHub - 2 maintainers
logprep 11.3.0
Logprep allows to collect, process and forward log messages from various data sources.
36 versions - Latest release: 7 days ago - 500 downloads last month - 24 stars on GitHub - 3 maintainers
airbyte-source-coinmarketcap 0.1.2
Source implementation for coinmarketcap.
2 versions - Latest release: 7 days ago - 25 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-lemlist 0.2.2
Source implementation for Lemlist.
3 versions - Latest release: 7 days ago - 97 downloads last month - 13,821 stars on GitHub - 1 maintainer
Top 9.4% on pypi.org
koza 0.6.0
Data transformation framework for LinkML data models
31 versions - Latest release: 7 days ago - 5 dependent repositories - 597 downloads last month - 42 stars on GitHub - 4 maintainers
airbyte-source-jira 2.0.0
Source implementation for Jira.
7 versions - Latest release: 7 days ago - 415 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-pivotal-tracker 0.2.0
Source implementation for pivotal-tracker.
2 versions - Latest release: 8 days ago - 24 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-zendesk-talk 1.0.0
Source implementation for Zendesk Talk.
6 versions - Latest release: 8 days ago - 203 downloads last month - 13,821 stars on GitHub - 1 maintainer
qualysetl 0.8.150
Qualys API Best Practices Series - ETL Blueprint Example Code within Python Virtual Environment
119 versions - Latest release: 8 days ago - 1 dependent repositories - 987 downloads last month - 1 maintainer
airflow-providers-wherobots 0.1.2
Airflow extension for communicating with Wherobots Cloud
3 versions - Latest release: 8 days ago - 403 downloads last month - 0 stars on GitHub - 1 maintainer
Top 9.1% on pypi.org
quickstart-vdk 0.2.1287193961
Versatile Data Kit SDK packaging containing common plugins to get started quickly using it.
614 versions - Latest release: 9 days ago - 1 dependent repositories - 6 thousand downloads last month - 409 stars on GitHub - 1 maintainer
dataforge-core 1.0.1
Command line compiler for dataforge core projects
3 versions - Latest release: 10 days ago - 367 downloads last month - 25 stars on GitHub - 2 maintainers
airbyte-source-lever-hiring 0.3.0
Source implementation for lever-hiring.
2 versions - Latest release: 10 days ago - 21 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-s3 4.5.14
Source implementation for S3.
25 versions - Latest release: 10 days ago - 541 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-chargebee 0.5.1
Source implementation for Chargebee.
8 versions - Latest release: 11 days ago - 173 downloads last month - 13,821 stars on GitHub - 1 maintainer
tablite 2023.11.6
multiprocessing enabled out-of-memory data analysis library for tabular data.
175 versions - Latest release: 11 days ago - 1 dependent repositories - 1.27 thousand downloads last month - 36 stars on GitHub - 1 maintainer
vdk-postgres 0.0.1285721801
Versatile Data Kit SDK plugin provides support for PostgreSQL database and postgres transformatio...
23 versions - Latest release: 11 days ago - 2 dependent repositories - 135 downloads last month - 409 stars on GitHub - 1 maintainer
airbyte-source-intercom 0.6.5
Source implementation for Intercom Yaml.
9 versions - Latest release: 11 days ago - 78 downloads last month - 13,821 stars on GitHub - 1 maintainer
sparecores-data 0.1.3
Structured data collected by sparecores-crawler.
2 versions - Latest release: 11 days ago - 1 dependent package - 290 downloads last month - 1 stars on GitHub - 1 maintainer
dagster-openai 0.23.5
A Open AI client resource for interacting with Open AI API.
17 versions - Latest release: 11 days ago - 1.25 thousand downloads last month - 10,392 stars on GitHub - 1 maintainer
Top 3.6% on pypi.org
vdk-core 0.3.1284553848
Versatile Data Kit SDK Core
210 versions - Latest release: 11 days ago - 35 dependent packages - 9 dependent repositories - 6.01 thousand downloads last month - 409 stars on GitHub - 1 maintainer
vdk-oracle 0.1.1284357447
Support for VDK Managed Oracle connection
21 versions - Latest release: 12 days ago - 330 downloads last month - 409 stars on GitHub - 1 maintainer
linkml-map 0.3.6
a framework for specifying and executing mappings between data models
3 versions - Latest release: 12 days ago - 321 downloads last month - 13 stars on GitHub - 1 maintainer
airbyte-source-paypal-transaction 2.5.3
Source implementation for Paypal Transaction.
9 versions - Latest release: 13 days ago - 238 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-typeform 1.2.8
Source implementation for Typeform.
6 versions - Latest release: 13 days ago - 7 dependent repositories - 151 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-twilio 0.11.2
Source implementation for Twilio.
5 versions - Latest release: 13 days ago - 190 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-mixpanel 2.2.2
Source implementation for Mixpanel.
7 versions - Latest release: 13 days ago - 44 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-iterable 0.5.1
Source implementation for Iterable.
14 versions - Latest release: 13 days ago - 659 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-snapchat-marketing 0.6.1
Source implementation for Snapchat Marketing.
7 versions - Latest release: 14 days ago - 129 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-surveymonkey 0.3.1
Source implementation for Surveymonkey.
5 versions - Latest release: 14 days ago - 45 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-slack 1.1.1
Source implementation for Slack.
11 versions - Latest release: 14 days ago - 221 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-mailchimp 2.0.3
Source implementation for Mailchimp.
7 versions - Latest release: 14 days ago - 268 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-pinterest 1.3.3
Source implementation for Pinterest.
7 versions - Latest release: 14 days ago - 125 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-notion 3.0.1
Source implementation for Notion.
10 versions - Latest release: 14 days ago - 184 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-instagram 3.0.7
Source implementation for Instagram.
7 versions - Latest release: 14 days ago - 53 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-harvest 1.0.1
Source implementation for Harvest.
7 versions - Latest release: 14 days ago - 198 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-google-ads 3.4.2
Source implementation for Google Ads.
16 versions - Latest release: 14 days ago - 174 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-google-search-console 1.4.2
Source implementation for Google Search Console.
3 versions - Latest release: 14 days ago - 202 downloads last month - 13,755 stars on GitHub - 1 maintainer
airbyte-source-gitlab 4.0.2
Source implementation for GitLab.
8 versions - Latest release: 14 days ago - 221 downloads last month - 13,821 stars on GitHub - 1 maintainer
airbyte-source-bing-ads 2.6.1
Source implementation for Bing Ads.
8 versions - Latest release: 14 days ago - 224 downloads last month - 13,755 stars on GitHub - 1 maintainer
airbyte-source-github 1.7.2
Source implementation for GitHub.
15 versions - Latest release: 14 days ago - 297 downloads last month - 13,821 stars on GitHub - 1 maintainer
Related Keywords
python 617 data-engineering 530 elt 453 data-integration 445 data 410 pipeline 365 snowflake 349 bigquery 317 data-analysis 317 redshift 299 postgresql 298 s3 293 data-pipeline 290 mysql 288 change-data-capture 287 java 284 data-collection 284 self-hosted 280 mssql 278 data-science 244 data-pipelines 207 workflow 163 mlops 161 orchestration 159 scheduler 154 data-orchestrator 150 analytics 125 sql 109 machine-learning 104 dag 99 airflow 99 apache-airflow 92 automation 90 workflow-engine 87 apache 85 workflow-orchestration 85 database 80 integration 69 metadata 68 workflow-automation 67 airflow-provider 65 dagster 64 dataops 53 trino 50 data-warehouse 50 data-structures 49 data-lineage 48 data-engineering-pipeline 48 data-engineer 48 warehouse 47 pandas 37 postgres 31 aws 29 csv 28 spark 28 etl-pipeline 24 etl-framework 24 extract 22 singer 22 pipelines 21 ethereum 19 load 19 gcp 18 blockchain-analytics 18 export 17 python3 17 erc20 15 erc721 15 transaction 15 ETL 14 dataframe 14 google-cloud 14 transform 14 cli 13 erc20-tokens 13 sqlite 12 dbt 11 framework 11 analysis 11 json 11 api 11 hacktoberfest 10 docker 10 workflows 10 airbyte 10 neo4j 9 graph 9 kafka 9 elasticsearch 9 big-data 9 cdk 9 cloud 9 sling 8 sqlalchemy 8 processing 8 connector-development-kit 8 blockchain 7 data-ingestion 7 declarative 7 pyspark 7