Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

Top 7.6% on conda-forge.org
Top 1.3% dependent packages on conda-forge.org
Top 5.2% forks on conda-forge.org

conda-forge.org : dagster

Dagster lets you define pipelines in terms of the data flow between reusable, logical components, then test locally and run anywhere. With a unified view of pipelines and the assets they produce, Dagster can schedule and orchestrate Pandas, Spark, SQL, or anything else that Python can invoke. Dagster is designed for data platform engineers, data engineers, and full-stack data scientists. Building a data platform with Dagster makes your stakeholders more independent and your systems more robust. Developing data pipelines with Dagster makes testing easier and deploying faster.

Registry - Source - JSON
purl: pkg:conda/dagster
Keywords: analytics, dagster, data-engineering, data-integration, data-orchestrator, data-pipelines, data-science, etl, metadata, mlops, orchestration, python, scheduler, workflow, workflow-automation
License: Apache-2.0
Latest release: over 1 year ago
First release: over 4 years ago
Dependent packages: 60
Dependent repositories: 2
Stars: 6,905 on GitHub
Forks: 870 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: about 6 hours ago

    Loading...
    Readme
    Loading...