Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

proxy.golang.org "data-engineering" keyword

Top 4.4% on proxy.golang.org
github.com/benthosdev/benthos v1.20.4 💰
Fancy stream processing made operationally mundane
295 versions - Latest release: almost 5 years ago - 5,853 stars on GitHub
Top 1.4% on proxy.golang.org
github.com/benthosdev/benthos/v4 v4.27.0 💰
Fancy stream processing made operationally mundane
40 versions - Latest release: 20 days ago - 19 dependent packages - 9 dependent repositories - 5,853 stars on GitHub
Top 7.8% on proxy.golang.org
github.com/artie-labs/transfer v1.25.8
Real-time data replication from OLTP to OLAP dbs
175 versions - Latest release: 2 days ago - 1 dependent repositories - 31 stars on GitHub
Top 7.4% on proxy.golang.org
github.com/usedatabrew/blink v1.16.8
OpenSource data platform to build event-driven systems. It's like Deebezium for golang :)
74 versions - Latest release: 3 days ago - 3 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/jitsucom/bulker/connectors/firebase v0.0.0-20240119080811-2fb2a0d61cc2
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake,...
2 versions - Latest release: 4 months ago - 91 stars on GitHub
github.com/jitsucom/bulker/sync-sidecar v0.0.0-20240119080811-2fb2a0d61cc2
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake,...
24 versions - Latest release: 4 months ago - 83 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/feast-dev/feast v0.36.1
Feature Store for Machine Learning
124 versions - Latest release: about 1 month ago - 4,083 stars on GitHub
Top 3.9% on proxy.golang.org
github.com/conduitio/conduit v0.10.0
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
544 versions - Latest release: 18 days ago - 1 dependent package - 1 dependent repositories - 252 stars on GitHub
Top 5.8% on proxy.golang.org
github.com/jitsucom/bulker/jitsubase v0.0.0-20240119080811-2fb2a0d61cc2
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake,...
48 versions - Latest release: 4 months ago - 1 dependent repositories - 61 stars on GitHub
Top 9.3% on proxy.golang.org
github.com/jitsucom/bulker/sync-controller
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake,...
Latest release: 26 days ago - 95 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/dataplane-app/dataplane v0.7.5
Dataplane is an Airflow inspired data platform with additional data mesh capability to automate, ...
33 versions - Latest release: 7 months ago - 204 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/mlrun/mlrun v1.6.1
Machine Learning automation and tracking
520 versions - Latest release: 2 months ago - 925 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/cloudquery/cloudquery/cli v0.32.12
The open source high performance data integration platform built for developers.
13 versions - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 3.0% on proxy.golang.org
github.com/treeverse/lakefs v1.19.0
lakeFS - Data version control for your data lake | Git for data
180 versions - Latest release: 29 days ago - 1 dependent package - 1 dependent repositories - 3,284 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/dagster-io/dagster v0.2.8
An orchestration platform for the development, production, and observation of data assets.
7 versions - Latest release: over 5 years ago - 9,443 stars on GitHub
Top 4.9% on proxy.golang.org
github.com/dataform-co/dataform v0.1.0
Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift
71 versions - Latest release: about 5 years ago - 640 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/ConduitIO/conduit v0.10.0
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
442 versions - Latest release: 18 days ago - 252 stars on GitHub
Top 7.5% on proxy.golang.org
github.com/benmizrahi/gobig
GoBig - A Golang distributed data processing engine
Latest release: 2 days ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/brexhq/substation v1.2.0
Substation is a cloud native data pipeline and transformation toolkit written in Go.
27 versions - Latest release: about 1 month ago - 161 stars on GitHub
Top 3.6% on proxy.golang.org
github.com/bacalhau-project/bacalhau v1.3.0
Compute over Data framework for public, transparent, and optionally verifiable computation
204 versions - Latest release: about 2 months ago - 3 dependent packages - 1 dependent repositories - 306 stars on GitHub
Top 9.7% on proxy.golang.org
github.com/bacalhau-project/bacalhau/apps/job-info-consumer/consumer v0.0.0-20240125091916-849dab55b6fd
Compute over Data framework for public, transparent, and optionally verifiable computation
14 versions - Latest release: 4 months ago - 554 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/benthosdev/benthos-captain v0.1.0
A Kubernetes Operator to orchestrate Benthos pipelines
2 versions - Latest release: 4 months ago - 30 stars on GitHub
Top 9.4% on proxy.golang.org
github.com/piyushsingariya/shift/drivers/postgres
Shift is a high performance better alternative to Airbyte, Singer, Meltano
Latest release: 3 days ago - 7 stars on GitHub
Top 9.7% on proxy.golang.org
github.com/piyushsingariya/shift/drivers/hubspot v0.0.0-20231015093324-0ecaae21e861
Shift is a high performance better alternative to Airbyte, Singer, Meltano
1 version - Latest release: 7 months ago - 7 stars on GitHub
Top 9.1% on proxy.golang.org
github.com/piyushsingariya/shift v0.0.0-20231015093324-0ecaae21e861
Shift is a high performance better alternative to Airbyte, Singer, Meltano
1 version - Latest release: 7 months ago - 1 dependent repositories - 5 stars on GitHub
Top 9.7% on proxy.golang.org
github.com/piyushsingariya/shift/drivers/google-sheets v0.0.0-20231015093324-0ecaae21e861
Shift is a high performance better alternative to Airbyte, Singer, Meltano
1 version - Latest release: 7 months ago - 6 stars on GitHub
Top 1.4% on proxy.golang.org
github.com/feast-dev/feast/sdk/go v0.9.4
Feature Store for Machine Learning
18 versions - Latest release: almost 2 years ago - 6 dependent packages - 17 dependent repositories - 4,083 stars on GitHub
github.com/piyushsingariya/kaku v0.0.0-20230727050722-6795340c7033
Alternative to Airbyte, Singer, Meltano
1 version - Latest release: 10 months ago - 3 stars on GitHub
Top 7.7% on proxy.golang.org
github.com/sudohainguyen/self
Latest release: 6 days ago - 0 stars on GitHub
Top 3.3% on proxy.golang.org
github.com/filecoin-project/bacalhau v1.3.0
Compute over Data framework for public, transparent, and optionally verifiable computation
204 versions - Latest release: about 2 months ago - 3 dependent packages - 3 dependent repositories - 237 stars on GitHub
github.com/ovidiugiorgi/csv2opensearch v0.0.0-20230903113555-2f0d0b588b13
Import CSV files into OpenSearch
3 versions - Latest release: 8 months ago - 4 stars on GitHub
Top 5.7% on proxy.golang.org
github.com/memphisdev/memphis v1.4.3
Memphis.dev is an intelligent, frictionless message broker. Made to enable developers to build re...
27 versions - Latest release: 4 months ago - 2,872 stars on GitHub
Top 1.3% on proxy.golang.org
github.com/Jeffail/benthos/v3 v3.65.0 💰
Fancy stream processing made operationally mundane
99 versions - Latest release: about 2 years ago - 13 dependent packages - 9 dependent repositories - 5,851 stars on GitHub
Top 8.6% on proxy.golang.org
github.com/saucam/airflow-runner v0.1.0
1 version - Latest release: over 2 years ago - 2 stars on GitHub
Top 1.5% on proxy.golang.org
github.com/Jeffail/benthos v1.20.4 💰
Fancy stream processing made operationally mundane
295 versions - Latest release: almost 5 years ago - 8 dependent packages - 6 dependent repositories - 5,851 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/rdagumampan/yuniql v1.3.15
Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS...
14 versions - Latest release: almost 2 years ago - 401 stars on GitHub
github.com/n0rdy/pippin v0.0.4
Go library for creating and managing data pipelines
2 versions - Latest release: 6 months ago - 0 stars on GitHub
Top 7.1% on proxy.golang.org
github.com/sqlpipe/sqlpipe v0.0.0-20221008180221-f66450a1c4b8
SQLpipe makes it easy to move the result of one query from one database to another.
2 versions - Latest release: over 1 year ago - 33 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/datafold/data-diff v0.11.1
Compare tables within or across databases
59 versions - Latest release: 3 months ago - 2,657 stars on GitHub
Top 9.5% on proxy.golang.org
github.com/piyushsingariya/kaku/drivers/google-sheets
Shift is a high performance better alternative to Airbyte, Singer, Meltano
Latest release: 12 days ago - 7 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/PuremlHQ/PureML/packages/purebackend v0.0.0-20230228183052-559f631db95b
Developer platform for production ML.
1 version - Latest release: about 1 year ago - 107 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/puremlhq/pureml v0.3.6
Developer platform for production ML.
11 versions - Latest release: about 1 year ago - 107 stars on GitHub
Top 8.4% on proxy.golang.org
github.com/stefanicjuraj/learn-go
learning golang programming language during data engineering internship
Latest release: 12 days ago - 0 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/dataplane-app/dataplane/app v0.7.5
Dataplane is an Airflow inspired data platform with additional data mesh capability to automate, ...
32 versions - Latest release: 7 months ago - 204 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/kevin-hanselman/dud v0.4.4
A lightweight CLI tool for versioning data alongside source code and building data pipelines.
9 versions - Latest release: 4 months ago - 127 stars on GitHub
Top 7.6% on proxy.golang.org
github.com/scaleway/cq-source-scaleway v1.0.0
CloudQuery Provider for Scaleway
2 versions - Latest release: about 1 year ago - 4 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/PuremlHQ/PureML v0.3.6
Developer platform for production ML.
11 versions - Latest release: about 1 year ago - 107 stars on GitHub
Top 6.0% on proxy.golang.org
github.com/PureML-Inc/PureML v0.2.3
Developer platform for production ML.
7 versions - Latest release: about 1 year ago - 107 stars on GitHub
Top 6.0% on proxy.golang.org
github.com/pureml-inc/pureml v0.3.6
Developer platform for production ML.
11 versions - Latest release: about 1 year ago - 107 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/PureML-Inc/PureML/packages/purebackend v0.0.0-20230218144505-250e8001829b
Track, version, compare and review your data and models.
1 version - Latest release: about 1 year ago - 106 stars on GitHub
Top 4.2% on proxy.golang.org
github.com/apache/incubator-devlake v0.20.0
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragment...
246 versions - Latest release: 2 months ago - 1 dependent package - 1,966 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/bacalhau-project/amplify v1.0.1
Bacalhau Amplify: automatic enrichment, enhancement, and explanation of your data
45 versions - Latest release: about 1 year ago - 9 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/airbnb/superset v2021.41.0+incompatible
Apache Superset is a Data Visualization and Data Exploration Platform
112 versions - Latest release: over 2 years ago - 51,074 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/natun-ai/natun v0.3.2
Transform your pythonic research to an artifact that engineers can deploy easily.
2 versions - Latest release: 3 months ago - 64 stars on GitHub
Top 6.5% on proxy.golang.org
github.com/beneath-hq/beneath v1.0.0-rc.5
Beneath is a serverless real-time data platform ⚡️
3 versions - Latest release: about 3 years ago - 1 dependent repositories - 76 stars on GitHub
Top 7.5% on proxy.golang.org
github.com/raptor-ml/raptor/api/proto/gen/go v0.0.0-20230629150952-f7dc91871913
Transform your pythonic research to an artifact that engineers can deploy easily.
1 version - Latest release: 11 months ago - 1 dependent package - 135 stars on GitHub
Top 6.5% on proxy.golang.org
github.com/raptor-ml/raptor v0.3.2
Transform your pythonic research to an artifact that engineers can deploy easily.
8 versions - Latest release: 3 months ago - 1 dependent repositories - 64 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/apache/incubator-airflow v1.8.2
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
1 version - Latest release: over 6 years ago - 33,577 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/gojek/feast/sdk/go v0.9.4
Feature Store for Machine Learning
18 versions - Latest release: almost 2 years ago - 4,083 stars on GitHub
Top 7.7% on proxy.golang.org
github.com/samjbobb/mammoth v1.0.8
Synchronize Postgres to Snowflake in near-real time with one simple application
9 versions - Latest release: 6 months ago - 10 stars on GitHub
Top 6.1% on proxy.golang.org
github.com/realtimedatalake/rtdl v0.2.0
rtdl makes it easy to build and maintain a real-time data lake
6 versions - Latest release: almost 2 years ago - 41 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/airbnb/airflow v1.8.2
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
1 version - Latest release: over 6 years ago - 33,542 stars on GitHub
Top 9.4% on proxy.golang.org
github.com/moabukar/everything-tech
A collection of online resources to help you on your Tech journey.
Latest release: 25 days ago - 413 stars on GitHub
Top 6.3% on proxy.golang.org
github.com/ab180/lrmr v0.5.3
Less-Resilient MapReduce framework for Go
139 versions - Latest release: 9 months ago - 32 stars on GitHub
Top 4.5% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/neo4j v0.0.0-20240120022832-5d8cd113b225
The open source high performance data integration platform built for developers.
1,060 versions - Latest release: 4 months ago - 4,383 stars on GitHub
Top 5.4% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/elasticsearch v0.0.0-20240120022832-5d8cd113b225
The open source high performance data integration platform built for developers.
271 versions - Latest release: 4 months ago - 5,096 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/k8s v0.6.4
The open source high performance data integration platform built for developers.
1 version - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 4.5% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/snyk v0.0.0-20231013213247-1ecef25b6cfe
The open source high performance data integration platform built for developers.
1,171 versions - Latest release: 7 months ago - 4,383 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/csv v0.0.0-20230420102154-845a8a0f344d
The open source high performance data integration platform built for developers.
688 versions - Latest release: about 1 year ago - 4,383 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/scripts/v1-migration v0.0.0-20221103100058-f03e55a72cbe
The open source high performance data integration platform built for developers.
2 versions - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/postgresql v0.0.0-20240120022832-5d8cd113b225
The open source high performance data integration platform built for developers.
1,940 versions - Latest release: 4 months ago - 4,383 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/s3 v0.0.0-20240124172713-41d4fe688626
The open source high performance data integration platform built for developers.
1,248 versions - Latest release: 4 months ago - 4,383 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/fuzz v0.0.15
The open source high performance data integration platform built for developers.
1 version - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 5.4% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/jira v0.0.0-20231108091623-5e7dc12d8e54
The open source high performance data integration platform built for developers.
160 versions - Latest release: 6 months ago - 5,096 stars on GitHub
Top 5.4% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/gremlin v0.0.0-20240120022832-5d8cd113b225
The open source high performance data integration platform built for developers.
387 versions - Latest release: 4 months ago - 5,096 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/datadog v0.0.0-20240120022832-5d8cd113b225
The open source high performance data integration platform built for developers.
396 versions - Latest release: 4 months ago - 5,012 stars on GitHub
Top 3.9% on proxy.golang.org
github.com/cloudquery/cloudquery v0.32.3
The open source high performance data integration platform built for developers.
317 versions - Latest release: over 1 year ago - 7 dependent packages - 4,383 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/digitalocean v0.6.5
The open source high performance data integration platform built for developers.
4 versions - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/cloudflare v0.1.7
The open source high performance data integration platform built for developers.
6 versions - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/gcp v0.9.8
The open source high performance data integration platform built for developers.
7 versions - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/heroku v0.1.1-pre.0
The open source high performance data integration platform built for developers.
2 versions - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/oracle v0.0.0-20240124210342-78045f586b9d
The open source high performance data integration platform built for developers.
2 versions - Latest release: 4 months ago - 5,377 stars on GitHub
Top 9.4% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/gitlab
The open source high performance data integration platform built for developers.
Latest release: 26 days ago - 5,387 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/azure v0.13.4
The open source high performance data integration platform built for developers.
8 versions - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/mssql v0.0.0-20240124172713-41d4fe688626
The open source high performance data integration platform built for developers.
1,632 versions - Latest release: 4 months ago - 4,383 stars on GitHub
Top 9.8% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/bigquery v0.0.0-20240120022832-5d8cd113b225
The open source high performance data integration platform built for developers.
8 versions - Latest release: 4 months ago - 5,373 stars on GitHub
Top 5.4% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/vercel v0.0.0-20230706100108-ff1469b82f6a
The open source high performance data integration platform built for developers.
1 version - Latest release: 10 months ago - 5,096 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/test v1.1.4
The open source high performance data integration platform built for developers.
6 versions - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 9.5% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/kafka v0.0.0-20240125114714-a8d71793ee2e
The open source high performance data integration platform built for developers.
2 versions - Latest release: 4 months ago - 5,381 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/aws/views/athena v0.0.0-20240125114714-a8d71793ee2e
The open source high performance data integration platform built for developers.
15 versions - Latest release: 4 months ago - 5,374 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/gandi v0.0.0-20230701042655-edb7ed838968
The open source high performance data integration platform built for developers.
1,283 versions - Latest release: 11 months ago - 4,383 stars on GitHub
Top 9.9% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/pagerduty v0.0.0-20240120022832-5d8cd113b225
The open source high performance data integration platform built for developers.
19 versions - Latest release: 4 months ago - 5,366 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/aws v0.13.24
The open source high performance data integration platform built for developers.
19 versions - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 9.4% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/awspricing
The open source high performance data integration platform built for developers.
Latest release: 26 days ago - 5,387 stars on GitHub
Top 5.4% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/source/alicloud v0.0.0-20240120022832-5d8cd113b225
The open source high performance data integration platform built for developers.
367 versions - Latest release: 4 months ago - 5,096 stars on GitHub
Top 9.3% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/snowflake
The open source high performance data integration platform built for developers.
Latest release: 26 days ago - 5,394 stars on GitHub
Top 5.4% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/mongodb v0.0.0-20240124172713-41d4fe688626
The open source high performance data integration platform built for developers.
337 versions - Latest release: 4 months ago - 5,096 stars on GitHub
Top 5.7% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/file v0.0.0-20240124172713-41d4fe688626
The open source high performance data integration platform built for developers.
246 versions - Latest release: 4 months ago - 5,175 stars on GitHub
Top 9.7% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/duckdb v0.0.0-20240124172713-41d4fe688626
The open source high performance data integration platform built for developers.
20 versions - Latest release: 4 months ago - 5,374 stars on GitHub
Top 9.4% on proxy.golang.org
github.com/cloudquery/cloudquery/plugins/destination/azblob
The open source high performance data integration platform built for developers.
Latest release: 26 days ago - 5,387 stars on GitHub