conda-forge.org "data-engineering" keyword
redun 0.8.16
Yet another redundant workflow engine6 versions - Latest release: about 4 years ago - 34.2 thousand downloads total - 608 stars on GitHub
feast 0.26.0
The Open Source Feature Store for AI/ML1 version - Latest release: almost 4 years ago - 39.9 thousand downloads total - 7,351 stars on GitHub
mage-ai 0.7.5
🧙 Build, run, and manage data pipelines for integrating and transforming data.22 versions - Latest release: almost 4 years ago - 8,838 stars on GitHub
awswrangler 2.17.0
An open-source Python package that extends the power of Pandas library to AWS connecting DataFram...81 versions - Latest release: about 4 years ago - 1 dependent repositories - 813 thousand downloads total - 4,123 stars on GitHub
apache-airflow-providers-telegram 3.0.0
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows7 versions - Latest release: over 4 years ago - 46.7 thousand downloads total - 47,269 stars on GitHub
airflow-with-statsd 2.4.3
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...41 versions - Latest release: almost 4 years ago - 799 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-postgres 5.2.2
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows15 versions - Latest release: about 4 years ago - 89.4 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-jira 3.0.1
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows9 versions - Latest release: over 4 years ago - 25.9 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-qubole 3.2.1
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows11 versions - Latest release: about 4 years ago - 41.3 thousand downloads total - 47,269 stars on GitHub
airflow-with-apache-webhdfs 2.4.3
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...22 versions - Latest release: almost 4 years ago - 1 dependent package - 623 thousand downloads total - 47,269 stars on GitHub
Top 5.2% on conda-forge.org
102 versions - Latest release: about 4 years ago - 19 dependent packages - 29 dependent repositories - 9,679 stars on GitHub
xonsh 0.13.3 💰
Xonsh is a Python-powered, cross-platform, Unix-gazing shell shell language and command prompt. T...102 versions - Latest release: about 4 years ago - 19 dependent packages - 29 dependent repositories - 9,679 stars on GitHub
dagster_pandas 0.6.7
An orchestration platform for the development, production, and observation of data assets.5 versions - Latest release: almost 7 years ago - 1 dependent package - 16,303 stars on GitHub
dagster-pandas 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 4 dependent packages - 16,303 stars on GitHub
dagster-github 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster_gcp 0.6.5
An orchestration platform for the development, production, and observation of data assets.1 version - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagstermill 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...112 versions - Latest release: almost 4 years ago - 530 thousand downloads total - 16,303 stars on GitHub
dagster-celery 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 2 dependent packages - 16,303 stars on GitHub
dagster-census 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...12 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster_postgres 0.6.5
An orchestration platform for the development, production, and observation of data assets.2 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster-dask 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-dbt 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...106 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-twilio 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 671 thousand downloads total - 16,303 stars on GitHub
dagster-graphql 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 6 dependent packages - 1.03 million downloads total - 16,303 stars on GitHub
dagster_snowflake 0.6.5
An orchestration platform for the development, production, and observation of data assets.2 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster-postgres 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster_twilio 0.6.5
An orchestration platform for the development, production, and observation of data assets.2 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster-slack 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-prometheus 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster_spark 0.6.5
An orchestration platform for the development, production, and observation of data assets.2 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster-pyspark 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...112 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-celery-docker 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...98 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster_ssh 0.6.5
An orchestration platform for the development, production, and observation of data assets.2 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster-datadog 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster_bash 0.6.5
An orchestration platform for the development, production, and observation of data assets.2 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster_slack 0.6.5
An orchestration platform for the development, production, and observation of data assets.2 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster-snowflake 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...108 versions - Latest release: almost 4 years ago - 1 dependent package - 583 thousand downloads total - 16,303 stars on GitHub
dagster-shell 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...103 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
Top 7.6% on conda-forge.org
119 versions - Latest release: almost 4 years ago - 60 dependent packages - 2 dependent repositories - 16,303 stars on GitHub
dagster 1.0.17
Dagster lets you define pipelines in terms of the data flow between reusable, logical components,...119 versions - Latest release: almost 4 years ago - 60 dependent packages - 2 dependent repositories - 16,303 stars on GitHub
dagster-cron 0.11.15
An orchestration platform for the development, production, and observation of data assets.44 versions - Latest release: over 5 years ago - 280 thousand downloads total - 16,303 stars on GitHub
dagster_papertrail 0.6.5
An orchestration platform for the development, production, and observation of data assets.2 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster_dask 0.6.5
An orchestration platform for the development, production, and observation of data assets.1 version - Latest release: almost 7 years ago - 4.17 thousand downloads total - 16,303 stars on GitHub
dagster-airflow 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...110 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-managed-elements 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...3 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-mysql 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...82 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-pandera 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...34 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagit 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...118 versions - Latest release: almost 4 years ago - 2 dependent repositories - 16,303 stars on GitHub
dagster-aws 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...55 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster_dbt 0.6.5
An orchestration platform for the development, production, and observation of data assets.2 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster-docker 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...86 versions - Latest release: almost 4 years ago - 500 thousand downloads total - 16,303 stars on GitHub
dagster-fivetran 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...56 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-mlflow 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...70 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster_graphql 0.6.7
An orchestration platform for the development, production, and observation of data assets.5 versions - Latest release: almost 7 years ago - 2 dependent packages - 16,303 stars on GitHub
dagster-msteams 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...56 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster_ge 0.6.7
An orchestration platform for the development, production, and observation of data assets.5 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster-papertrail 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 668 thousand downloads total - 16,303 stars on GitHub
dagster-pagerduty 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-ssh 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster_cron 0.6.5
An orchestration platform for the development, production, and observation of data assets.2 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster-duckdb-pyspark 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...5 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-spark 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...114 versions - Latest release: almost 4 years ago - 1 dependent package - 16,303 stars on GitHub
dagster_datadog 0.6.5
An orchestration platform for the development, production, and observation of data assets.1 version - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster-celery-k8s 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...98 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-duckdb 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...5 versions - Latest release: almost 4 years ago - 2 dependent packages - 16,303 stars on GitHub
dagster-ge 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...103 versions - Latest release: almost 4 years ago - 508 thousand downloads total - 16,303 stars on GitHub
dagster-snowflake-pandas 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...12 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-duckdb-pandas 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...5 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-k8s 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...109 versions - Latest release: almost 4 years ago - 1 dependent package - 16,303 stars on GitHub
dagster_aws 0.6.6
An orchestration platform for the development, production, and observation of data assets.2 versions - Latest release: almost 7 years ago - 16,303 stars on GitHub
dagster_pagerduty 0.6.4
An orchestration platform for the development, production, and observation of data assets.1 version - Latest release: almost 7 years ago - 4.21 thousand downloads total - 16,303 stars on GitHub
dagster-airbyte 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...47 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-gcp 1.0.17
Dagster is a system for building modern data applications. Combining an elegant programming model...112 versions - Latest release: almost 4 years ago - 16,303 stars on GitHub
dagster-bash 0.7.16
An orchestration platform for the development, production, and observation of data assets.11 versions - Latest release: over 6 years ago - 16,303 stars on GitHub
Top 4.9% on conda-forge.org
133 versions - Latest release: almost 4 years ago - 8 dependent packages - 41 dependent repositories - 1.1 million downloads total - 24,084 stars on GitHub
prefect 2.6.7
Prefect is a workflow management system, designed for modern infrastructure and powered by the op...133 versions - Latest release: almost 4 years ago - 8 dependent packages - 41 dependent repositories - 1.1 million downloads total - 24,084 stars on GitHub
apache-airflow-providers-discord 3.0.0
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows7 versions - Latest release: over 4 years ago - 43.5 thousand downloads total - 47,269 stars on GitHub
airflow-with-docker 1.10.11
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...15 versions - Latest release: over 6 years ago - 131 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-apache-sqoop 3.0.0
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows8 versions - Latest release: over 4 years ago - 36.9 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-snowflake 3.3.0
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows18 versions - Latest release: about 4 years ago - 108 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-segment 3.0.0
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows6 versions - Latest release: over 4 years ago - 34.9 thousand downloads total - 47,269 stars on GitHub
airflow-with-kubernetes 1.10.15
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...18 versions - Latest release: over 5 years ago - 158 thousand downloads total - 47,269 stars on GitHub
airflow-with-mysql 1.10.11
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...14 versions - Latest release: over 6 years ago - 47,269 stars on GitHub
apache-airflow-providers-yandex 3.1.0
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows8 versions - Latest release: about 4 years ago - 47,269 stars on GitHub
airflow-with-jenkins 1.10.15
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...18 versions - Latest release: over 5 years ago - 47,269 stars on GitHub
airflow-with-vertica 1.10.15
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...19 versions - Latest release: over 5 years ago - 180 thousand downloads total - 47,269 stars on GitHub
airflow-with-azure-mgmt-containerinstance 1.10.11
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...11 versions - Latest release: over 6 years ago - 75.9 thousand downloads total - 47,269 stars on GitHub
airflow-with-password 2.4.3
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...41 versions - Latest release: almost 4 years ago - 47,269 stars on GitHub
apache-airflow-providers-apache-drill 2.2.1
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows7 versions - Latest release: about 4 years ago - 48.6 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-sftp 4.1.0
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows16 versions - Latest release: about 4 years ago - 90.4 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-openfaas 3.0.0
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows7 versions - Latest release: over 4 years ago - 35.6 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-opsgenie 4.0.0
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows9 versions - Latest release: over 4 years ago - 45.3 thousand downloads total - 47,269 stars on GitHub
airflow-with-salesforce 1.10.15
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...19 versions - Latest release: over 5 years ago - 179 thousand downloads total - 47,269 stars on GitHub
airflow-with-postgres 1.10.15
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...19 versions - Latest release: over 5 years ago - 185 thousand downloads total - 47,269 stars on GitHub
airflow-with-segment 1.10.15
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...5 versions - Latest release: over 5 years ago - 64.5 thousand downloads total - 47,269 stars on GitHub
airflow-with-cassandra 1.10.15
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...18 versions - Latest release: over 5 years ago - 47,269 stars on GitHub
airflow-with-grpc 1.10.15
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...5 versions - Latest release: over 5 years ago - 64.6 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-tableau 3.0.1
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows4 versions - Latest release: over 4 years ago - 37.8 thousand downloads total - 47,269 stars on GitHub
airflow-with-jdbc 1.10.11
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...15 versions - Latest release: over 6 years ago - 131 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-neo4j 3.1.0
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows10 versions - Latest release: about 4 years ago - 56.6 thousand downloads total - 47,269 stars on GitHub
apache-airflow-providers-salesforce 5.1.0
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows13 versions - Latest release: about 4 years ago - 67.5 thousand downloads total - 47,269 stars on GitHub
airflow-with-ssh 1.10.15
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...19 versions - Latest release: over 5 years ago - 184 thousand downloads total - 47,269 stars on GitHub
airflow-with-kerberos 2.4.3
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler...25 versions - Latest release: almost 4 years ago - 641 thousand downloads total - 47,269 stars on GitHub
Related Keywords
python
197
data-science
196
etl
188
mlops
186
workflow
185
orchestration
184
data-pipelines
183
data-integration
183
scheduler
182
data-orchestrator
182
machine-learning
126
workflow-engine
123
elt
122
dag
122
automation
122
apache
122
apache-airflow
121
airflow
121
workflow-orchestration
121
analytics
62
hacktoberfest
62
dagster
61
metadata
61
workflow-automation
61
data
7
pandas
4
pipeline
4
pipelines
4
dataframe
3
data-quality
3
parquet
2
serialization
2
artificial-intelligence
2
spark
2
data-analysis
2
data-versioning
2
dbt
2
data-analytics
2
ml
2
data-version-control
2
sql
2
aws
2
mysql
2
dataquality
2
vscode
2
pycharm
2
papermill
2
notebooks
2
jupyter-notebooks
2
jupyter
2
xonsh
2
shell
2
data-viz
1
flask
1
data-visualization
1
react
1
sql-editor
1
superset
1
amazon-athena
1
amazon-sagemaker-notebook
1
features
1
business-intelligence
1
business-analytics
1
bi
1
asf
1
apache-superset
1
pipeline-tests
1
pipeline-testing
1
pipeline-debt
1
exploratorydataanalysis
1
exploratory-data-analysis
1
exploratory-analysis
1
eda
1
dataunittest
1
datacleaning
1
datacleaner
1
feature-store
1
big-data
1
transformation
1
reverse-etl
1
trino
1
snowflake
1
rdbms
1
postgresql
1
postgres
1
oracle-database
1
dataengineering
1
databricks-sql
1
database
1
data-quality-monitoring
1
data-diffing
1
redshift
1
ray
1
modin
1
lambda
1
glue-catalog
1
emr
1
aws-lambda
1
aws-glue
1
athena
1