An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

proxy.golang.org "data-engineering" keyword

View the packages on the proxy.golang.org package registry that are tagged with the "data-engineering" keyword.

Top 1.4% on proxy.golang.org
github.com/feast-dev/feast/sdk/go v0.9.4
The Open Source Feature Store for AI/ML
18 versions - Latest release: over 3 years ago - 6 dependent packages - 17 dependent repositories - 6,405 stars on GitHub
Top 1.4% on proxy.golang.org
github.com/benthosdev/benthos/v4 v4.77.0 💰
Fancy stream processing made operationally mundane
172 versions - Latest release: about 11 hours ago - 36 dependent packages - 9 dependent repositories - 5,853 stars on GitHub
Top 0.5% on proxy.golang.org
github.com/argoproj/argo-workflows/v3 v3.7.6
Workflow Engine for Kubernetes
161 versions - Latest release: 28 days ago - 95 dependent packages - 102 dependent repositories - 16,215 stars on GitHub
Top 7.1% on proxy.golang.org
github.com/sqlpipe/sqlpipe v0.0.0-20221008180221-f66450a1c4b8
SQLpipe makes it easy to move the result of one query from one database to another.
2 versions - Latest release: about 3 years ago - 95 stars on GitHub
Top 3.0% on proxy.golang.org
github.com/treeverse/lakefs v1.74.4
lakeFS - Data version control for your data lake | Git for data
257 versions - Latest release: 13 days ago - 1 dependent package - 1 dependent repositories - 4,999 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/zero-one-group/geni v0.0.42
A Clojure dataframe library that runs on Spark
20 versions - Latest release: about 2 years ago - 292 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/treeverse/lakefs/modules/cache
lakeFS - Data version control for your data lake | Git for data
Latest release: about 20 hours ago - 4,999 stars on GitHub
Top 1.3% on proxy.golang.org
github.com/Jeffail/benthos/v3 v3.65.0 💰
Fancy stream processing made operationally mundane
99 versions - Latest release: almost 4 years ago - 13 dependent packages - 9 dependent repositories - 5,851 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/evidence-dev/evidence v2.2.1+incompatible
Business intelligence as code: build fast, interactive data visualizations in SQL and markdown
2 versions - Latest release: almost 3 years ago - 5,420 stars on GitHub
Top 2.0% on proxy.golang.org
github.com/rudderlabs/rudder-server v1.62.1
Privacy and Security focused Segment-alternative, in Golang and React
401 versions - Latest release: 2 months ago - 7 dependent packages - 1 dependent repositories - 4,310 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/RisingWaveLabs/risingwave v2.7.0+incompatible
Streaming data platform for real-time stream processing, low-latency serving, and Iceberg table m...
115 versions - Latest release: 24 days ago - 8,464 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/apecloud/myduckserver
Copyright 2024-2025 ApeCloud, Ltd. Licensed under the Apache License, Version 2.0 (the "License"...
Latest release: 3 days ago - 484 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/meltano/meltano v4.0.8+incompatible
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-...
298 versions - Latest release: 20 days ago - 2,232 stars on GitHub
Top 6.1% on proxy.golang.org
github.com/benthosdev/connect/public/bundle/free/v4 v4.72.0 💰
Fancy stream processing made operationally mundane
14 versions - Latest release: about 1 month ago - 8,165 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/GoogleCloudPlatform/public-datasets-pipelines v5.2.0+incompatible
Cloud-native, data onboarding architecture for Google Cloud Datasets
32 versions - Latest release: about 3 years ago - 165 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/great-expectations/great_expectations v0.7.10
Always know what to expect from your data.
26 versions - Latest release: over 6 years ago - 10,884 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/s3/v7 v7.9.13
The open source ELT framework powered by Apache Arrow
40 versions - Latest release: 13 days ago - 6,245 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/Eventual-Inc/Daft v0.7.1
Distributed DataFrame for Python designed for the cloud, powered by Rust
154 versions - Latest release: 19 days ago - 1,810 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/gcp v0.9.8
The open source ELT framework powered by Apache Arrow
7 versions - Latest release: over 3 years ago - 6,245 stars on GitHub
Top 4.2% on proxy.golang.org
github.com/apache/incubator-devlake v1.0.2
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragment...
290 versions - Latest release: 7 months ago - 1 dependent package - 2,837 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/ConduitIO/conduit v0.14.0
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
775 versions - Latest release: 7 months ago - 561 stars on GitHub
Top 3.9% on proxy.golang.org
github.com/conduitio/conduit v0.14.0
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
973 versions - Latest release: 7 months ago - 1 dependent package - 1 dependent repositories - 561 stars on GitHub
Top 5.9% on proxy.golang.org
github.com/Conduitio/conduit v0.14.0
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
265 versions - Latest release: 7 months ago - 561 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/file/v5 v5.4.29
The open source ELT framework powered by Apache Arrow
28 versions - Latest release: 19 days ago - 6,220 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/gcs/v5 v5.4.34
The open source ELT framework powered by Apache Arrow
32 versions - Latest release: 13 days ago - 6,245 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/opendatadiscovery/odd-platform v0.6.0-beta-2
First open-source data discovery and observability platform. We make a life for data practitioner...
1 version - Latest release: over 3 years ago - 1,317 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/test/v4 v4.8.9
The open source ELT framework powered by Apache Arrow
35 versions - Latest release: 19 days ago - 6,220 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/risingwavelabs/risingwave v2.7.0+incompatible
Streaming data platform for real-time stream processing, low-latency serving, and Iceberg table m...
115 versions - Latest release: 24 days ago - 8,464 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/xkcd v1.5.31
The open source ELT framework powered by Apache Arrow
31 versions - Latest release: 19 days ago - 6,220 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/aws v0.13.24
The open source ELT framework powered by Apache Arrow
19 versions - Latest release: over 3 years ago - 6,239 stars on GitHub
github.com/piyushsingariya/kaku v0.0.0-20230727050722-6795340c7033
Alternative to Airbyte, Singer, Meltano
1 version - Latest release: over 2 years ago - 3 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/argoproj/argo-workflows/v2 v2.12.13
Workflow Engine for Kubernetes
117 versions - Latest release: over 4 years ago - 16,110 stars on GitHub
Top 6.6% on proxy.golang.org
github.com/gear5sh/gear5/drivers/postgres
high performance better alternative to Airbyte, Singer, Meltano
Latest release: 6 days ago - 16 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/postgresql/v8 v8.13.3
The open source ELT framework powered by Apache Arrow
35 versions - Latest release: 19 days ago - 6,245 stars on GitHub
Top 6.3% on proxy.golang.org
github.com/ab180/lrmr v0.5.3
Less-Resilient MapReduce framework for Go
139 versions - Latest release: over 2 years ago - 32 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/jitsucom/bulker v1.0.2
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake,...
14 versions - Latest release: about 2 years ago - 198 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/hackernews/v3 v3.8.6
The open source ELT framework powered by Apache Arrow
30 versions - Latest release: 19 days ago - 6,220 stars on GitHub
Top 9.8% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/bigquery v0.0.0-20240120022832-5d8cd113b225
The open source ELT framework powered by Apache Arrow
8 versions - Latest release: almost 2 years ago - 6,245 stars on GitHub
Top 3.9% on proxy.golang.org
github.com/cloudquery/cloudquery v6.11.2+incompatible
The open source ELT framework powered by Apache Arrow
319 versions - Latest release: about 1 year ago - 10 dependent packages - 6,245 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/cli/v6 v6.33.0
The open source ELT framework powered by Apache Arrow
71 versions - Latest release: 19 days ago - 6,245 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/okta v0.6.6
The open source ELT framework powered by Apache Arrow
5 versions - Latest release: over 3 years ago - 6,245 stars on GitHub
Top 5.7% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/file v0.0.0-20240124172713-41d4fe688626
The open source ELT framework powered by Apache Arrow
246 versions - Latest release: almost 2 years ago - 6,220 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/heroku v0.1.1-pre.0
The open source ELT framework powered by Apache Arrow
2 versions - Latest release: over 3 years ago - 6,245 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/mysql/v5 v5.5.6
The open source ELT framework powered by Apache Arrow
32 versions - Latest release: 19 days ago - 6,239 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/meilisearch/v2 v2.5.22
The open source ELT framework powered by Apache Arrow
21 versions - Latest release: 19 days ago - 6,239 stars on GitHub
Top 6.4% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/transformer/basic v1.4.0
The open source ELT framework powered by Apache Arrow
6 versions - Latest release: 12 months ago - 6,239 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/terraform v0.5.6
The open source ELT framework powered by Apache Arrow
5 versions - Latest release: over 3 years ago - 6,220 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/clickhouse/v6 v6.2.7
The open source ELT framework powered by Apache Arrow
22 versions - Latest release: 8 months ago - 6,245 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/mongodb/v2 v2.7.6
The open source ELT framework powered by Apache Arrow
32 versions - Latest release: 13 days ago - 6,220 stars on GitHub
Top 7.5% on proxy.golang.org
github.com/benmizrahi/gobig
GoBig - A Golang distributed data processing engine
Latest release: 7 days ago - 0 stars on GitHub
Top 5.7% on proxy.golang.org
github.com/manishjalui11/csv-diff v1.0.0
> A fast and flexible command-line tool to compare CSV files using composite keys and generate cl...
1 version - Latest release: 8 months ago - 1 stars on GitHub
Top 6.6% on proxy.golang.org
github.com/redpanda-data/connect/v3 v3.65.0 💰
Fancy stream processing made operationally mundane
99 versions - Latest release: almost 4 years ago - 8,474 stars on GitHub
Top 6.3% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/transformer/jsonflattener v1.1.4
The open source ELT framework powered by Apache Arrow
4 versions - Latest release: about 1 year ago - 6,220 stars on GitHub
Top 8.6% on proxy.golang.org
github.com/saucam/airflow-runner v0.1.0
1 version - Latest release: almost 4 years ago - 2 stars on GitHub
Top 3.6% on proxy.golang.org
github.com/bacalhau-project/bacalhau v1.8.0
Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute ove...
258 versions - Latest release: 7 months ago - 4 dependent packages - 1 dependent repositories - 836 stars on GitHub
Top 5.7% on proxy.golang.org
github.com/nessi-dev/nessi v1.0.0
A Python-based data processing and analysis tool built with PySpark and Delta Lake
2 versions - Latest release: 8 months ago - 0 stars on GitHub
Top 5.9% on proxy.golang.org
github.com/Multiwoven/multiwoven v0.94.0
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
126 versions - Latest release: 15 days ago - 1,622 stars on GitHub
Top 7.6% on proxy.golang.org
github.com/scaleway/cq-source-scaleway v1.0.0
CloudQuery Provider for Scaleway
2 versions - Latest release: almost 3 years ago - 5 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/googlecloudplatform/public-datasets-pipelines v5.2.0+incompatible
Cloud-native, data onboarding architecture for Google Cloud Datasets
32 versions - Latest release: about 3 years ago - 165 stars on GitHub
Top 5.4% on proxy.golang.org
github.com/tosh223/msb v0.9.2
A data lineage tool detects table dependencies from rendered SQL statements.
28 versions - Latest release: over 1 year ago - 30 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/kevin-hanselman/dud v0.4.5
A lightweight CLI tool for versioning data alongside source code and building data pipelines.
10 versions - Latest release: over 1 year ago - 212 stars on GitHub
Top 6.1% on proxy.golang.org
github.com/realdatadriven/etlx v1.4.14
This project is an ETL / ELT Framework powered by DuckDB, designed to seamlessly integrate and pr...
120 versions - Latest release: 24 days ago - 20 stars on GitHub
Top 5.3% on proxy.golang.org
github.com/DAGWorks-Inc/hamilton v1.89.0-incubating-RC1
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting da...
2 versions - Latest release: 3 months ago - 2,269 stars on GitHub
Top 5.3% on proxy.golang.org
github.com/dagworks-inc/hamilton v1.89.0-incubating-RC1
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting da...
2 versions - Latest release: 3 months ago - 2,269 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/dagster-io/dagster v0.2.8
An orchestration platform for the development, production, and observation of data assets.
7 versions - Latest release: about 7 years ago - 14,215 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/azblob/v4 v4.4.34
The open source ELT framework powered by Apache Arrow
33 versions - Latest release: 19 days ago - 6,245 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/phidatahq/phidata v2.7.10+incompatible
Build AI Assistants with function calling and connect LLMs to external tools.
315 versions - Latest release: 11 months ago - 2,881 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/airbnb/superset v2021.41.0+incompatible
Apache Superset is a Data Visualization and Data Exploration Platform
115 versions - Latest release: over 4 years ago - 51,074 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/duckdb/v5 v5.10.12
The open source ELT framework powered by Apache Arrow
11 versions - Latest release: 9 months ago - 6,239 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/datazip-inc/olake-ui v0.2.6
Frontend & BFF (Backend for frontend) for Olake. This includes the UI code and backend code for s...
20 versions - Latest release: 8 days ago - 24 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/digitalocean v0.6.5
The open source ELT framework powered by Apache Arrow
4 versions - Latest release: over 3 years ago - 6,220 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/growthbook/growthbook v4.2.0+incompatible
Open Source Feature Flagging and A/B Testing Platform
52 versions - Latest release: about 2 months ago - 7,021 stars on GitHub
Top 6.8% on proxy.golang.org
github.com/redpanda-data/connect v1.20.4 💰
Fancy stream processing made operationally mundane
295 versions - Latest release: over 6 years ago - 8,474 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/cloudquery/cloudquery/cli v0.32.12
The open source ELT framework powered by Apache Arrow
13 versions - Latest release: over 3 years ago - 6,245 stars on GitHub
Top 5.8% on proxy.golang.org
github.com/snowflakedb/snowpark-python v1.44.0
Snowflake Snowpark Python API
66 versions - Latest release: 26 days ago - 317 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/cloudflare v0.1.7
The open source ELT framework powered by Apache Arrow
6 versions - Latest release: over 3 years ago - 6,245 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/clickhouse/v7 v7.3.8
The open source ELT framework powered by Apache Arrow
17 versions - Latest release: 19 days ago - 6,245 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/elasticsearch/v3 v3.5.32
The open source ELT framework powered by Apache Arrow
31 versions - Latest release: 19 days ago - 6,245 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/bigquery/v4 v4.6.3
The open source ELT framework powered by Apache Arrow
35 versions - Latest release: 19 days ago - 6,220 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/github v0.1.10
The open source ELT framework powered by Apache Arrow
8 versions - Latest release: over 3 years ago - 6,220 stars on GitHub
Top 6.8% on proxy.golang.org
github.com/redpanda-data/connect/public/bundle/enterprise/v4 v4.72.0 💰
Fancy stream processing made operationally mundane
14 versions - Latest release: about 1 month ago - 8,474 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/fuzz v0.0.15
The open source ELT framework powered by Apache Arrow
1 version - Latest release: over 3 years ago - 6,245 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/kafka/v5 v5.6.3
The open source ELT framework powered by Apache Arrow
30 versions - Latest release: 19 days ago - 6,245 stars on GitHub
Top 6.8% on proxy.golang.org
github.com/redpanda-data/connect/public/bundle/free/v4 v4.72.0 💰
Package free imports all free, open source plugin implementations that ship with Redpanda Connect...
14 versions - Latest release: about 1 month ago - 8,474 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/neo4j/v5 v5.4.30
The open source ELT framework powered by Apache Arrow
29 versions - Latest release: 19 days ago - 6,220 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/test/v2 v2.8.27
The open source ELT framework powered by Apache Arrow
31 versions - Latest release: 19 days ago - 6,245 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/mssql/v5 v5.2.6
The open source ELT framework powered by Apache Arrow
30 versions - Latest release: 19 days ago - 6,245 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/azure v0.13.4
The open source ELT framework powered by Apache Arrow
8 versions - Latest release: over 3 years ago - 6,220 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/snowflake/v4 v4.5.5
The open source ELT framework powered by Apache Arrow
26 versions - Latest release: 4 months ago - 6,220 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/v6 v6.33.0
CloudQuery uses a monorepo approach with a separate Go module per component. Visit our GitHub rep...
76 versions - Latest release: 19 days ago - 6,220 stars on GitHub
Top 8.7% on proxy.golang.org
github.com/cloudquery/cloudquery/scaffold v0.0.0-20240124172713-41d4fe688626
The open source ELT framework powered by Apache Arrow
860 versions - Latest release: almost 2 years ago - 6,245 stars on GitHub
Top 6.1% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/transformer/test v1.1.28
The open source ELT framework powered by Apache Arrow
30 versions - Latest release: 19 days ago - 6,220 stars on GitHub
Top 6.8% on proxy.golang.org
github.com/redpanda-data/connect/v4 v4.76.1 💰
Fancy stream processing made operationally mundane
171 versions - Latest release: 15 days ago - 8,474 stars on GitHub
Top 6.0% on proxy.golang.org
github.com/pureml-inc/pureml v0.3.6
Developer platform for production ML.
11 versions - Latest release: over 2 years ago - 107 stars on GitHub
Top 5.9% on proxy.golang.org
github.com/multiwoven/multiwoven v0.93.0
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
125 versions - Latest release: 22 days ago - 1,624 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/test v1.1.4
The open source ELT framework powered by Apache Arrow
6 versions - Latest release: over 3 years ago - 6,220 stars on GitHub
Top 5.8% on proxy.golang.org
github.com/jitsucom/bulker/jitsubase v0.0.0-20240119080811-2fb2a0d61cc2
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake,...
48 versions - Latest release: almost 2 years ago - 1 dependent repositories - 198 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/k8s v0.6.4
The open source ELT framework powered by Apache Arrow
1 version - Latest release: over 3 years ago - 6,245 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/gremlin/v2 v2.6.28
The open source ELT framework powered by Apache Arrow
27 versions - Latest release: 13 days ago - 6,220 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/oracle v0.0.0-20240124210342-78045f586b9d
The open source ELT framework powered by Apache Arrow
2 versions - Latest release: almost 2 years ago - 6,245 stars on GitHub