Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
conda-forge.org : dagster-celery-k8s
Dagster lets you define pipelines in terms of the data flow between reusable, logical components, then test locally and run anywhere. With a unified view of pipelines and the assets they produce, Dagster can schedule and orchestrate Pandas, Spark, SQL, or anything else that Python can invoke. Dagster is designed for data platform engineers, data engineers, and full-stack data scientists. Building a data platform with Dagster makes your stakeholders more independent and your systems more robust. Developing data pipelines with Dagster makes testing easier and deploying faster.
Registry
-
Source
- Homepage
- JSON
purl: pkg:conda/dagster-celery-k8s
Keywords: analytics, dagster, data-engineering, data-integration, data-orchestrator, data-pipelines, data-science, etl, metadata, mlops, orchestration, python, scheduler, workflow, workflow-automation
License: Apache-2.0
Latest release: over 1 year ago
First release: almost 4 years ago
Stars: 6,905 on GitHub
Forks: 870 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: about 6 hours ago