Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

proxy.golang.org "etl" keyword

Top 6.1% on proxy.golang.org
github.com/ldsec/medco-loader v1.0.0
DEPRECATED REPOSITORY (MedCo v =< 1.0.0), see https://github.com/ldsec/medco
6 versions - Latest release: about 4 years ago - 3 dependent packages - 0 stars on GitHub
Top 4.4% on proxy.golang.org
github.com/benthosdev/benthos v1.20.4 💰
Fancy stream processing made operationally mundane
295 versions - Latest release: almost 5 years ago - 5,853 stars on GitHub
Top 1.4% on proxy.golang.org
github.com/benthosdev/benthos/v4 v4.27.0 💰
Fancy stream processing made operationally mundane
40 versions - Latest release: 20 days ago - 19 dependent packages - 9 dependent repositories - 5,853 stars on GitHub
Top 9.7% on proxy.golang.org
github.com/mariomac/pipes v0.11.0
Complex data processing flows in Go
14 versions - Latest release: 21 days ago - 6 dependent packages - 1 dependent repositories - 4 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/AdikaStyle/go-df v0.0.0-20210408154331-da1d25dd82d9
Dataframes for Golang
1 version - Latest release: about 3 years ago - 11 stars on GitHub
Top 2.0% on proxy.golang.org
github.com/rudderlabs/rudder-server v1.25.0
Privacy and Security focused Segment-alternative, in Golang and React
201 versions - Latest release: 5 days ago - 7 dependent packages - 1 dependent repositories - 3,691 stars on GitHub
Top 7.8% on proxy.golang.org
github.com/artie-labs/transfer v1.25.8
Real-time data replication from OLTP to OLAP dbs
175 versions - Latest release: 2 days ago - 1 dependent repositories - 31 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/coralproject/sponge v0.0.0-20160726185531-477d6df5980b
The import layer will contain strategies for pulling data from existing systems into Coral.
1 version - Latest release: almost 8 years ago - 3 stars on GitHub
Top 7.4% on proxy.golang.org
github.com/usedatabrew/blink v1.16.8
OpenSource data platform to build event-driven systems. It's like Deebezium for golang :)
74 versions - Latest release: 3 days ago - 3 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/reugn/go-streams/examples
A lightweight stream processing library for Go
Latest release: about 17 hours ago - 1,367 stars on GitHub
Top 2.0% on proxy.golang.org
github.com/reugn/go-streams v0.10.0
Package streams specifies interfaces to be implemented by the streaming connectors and operators.
14 versions - Latest release: 4 months ago - 11 dependent packages - 4 dependent repositories - 1,653 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/reugn/go-streams/nats v0.0.0-20231216092528-70c164944912
Package nats provides NATS streaming connectors.
7 versions - Latest release: 5 months ago - 1 dependent repositories - 1,367 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/reugn/go-streams/pulsar v0.1.2
Package pulsar implements the Apache Pulsar connector.
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 1,356 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/reugn/go-streams/aerospike v0.1.2
Package aerospike implements the Aerospike database connector.
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 1,356 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/reugn/go-streams/redis v0.1.2
Package redis implements the Redis Pub/Sub connector.
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 1,356 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/reugn/go-streams/ws v0.1.2
Package ws implements the WebSocket connector.
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 1,356 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/jitsucom/bulker/connectors/firebase v0.0.0-20240119080811-2fb2a0d61cc2
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake,...
2 versions - Latest release: 4 months ago - 91 stars on GitHub
Top 3.5% on proxy.golang.org
github.com/jf-tech/omniparser v1.0.4 💰
omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, t...
14 versions - Latest release: over 1 year ago - 1 dependent package - 2 dependent repositories - 551 stars on GitHub
github.com/jitsucom/bulker/sync-sidecar v0.0.0-20240119080811-2fb2a0d61cc2
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake,...
24 versions - Latest release: 4 months ago - 83 stars on GitHub
Top 3.9% on proxy.golang.org
github.com/conduitio/conduit v0.10.0
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
544 versions - Latest release: 18 days ago - 1 dependent package - 1 dependent repositories - 252 stars on GitHub
Top 5.8% on proxy.golang.org
github.com/jitsucom/bulker/jitsubase v0.0.0-20240119080811-2fb2a0d61cc2
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake,...
48 versions - Latest release: 4 months ago - 1 dependent repositories - 61 stars on GitHub
Top 9.3% on proxy.golang.org
github.com/jitsucom/bulker/sync-controller
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake,...
Latest release: 26 days ago - 95 stars on GitHub
Top 9.5% on proxy.golang.org
github.com/goto/optimus v0.12.0
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation...
122 versions - Latest release: 11 days ago - 1 dependent package - 1 dependent repositories - 2 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/dataplane-app/dataplane v0.7.5
Dataplane is an Airflow inspired data platform with additional data mesh capability to automate, ...
33 versions - Latest release: 7 months ago - 204 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/cloudquery/cloudquery/cli v0.32.12
The open source high performance data integration platform built for developers.
13 versions - Latest release: over 1 year ago - 4,383 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/catalyst-cooperative/pudl v2024.2.6+incompatible 💰
The Public Utility Data Liberation Project provides analysis-ready energy system data to climate ...
10 versions - Latest release: 3 months ago - 343 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/rwynn/monstache/v6 v6.7.17
package main provides the monstache binary
53 versions - Latest release: 5 months ago - 1,117 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/ropensci/elastic v1.2.0
R client for the Elasticsearch HTTP API
15 versions - Latest release: about 3 years ago - 244 stars on GitHub
Top 7.2% on proxy.golang.org
github.com/koltyakov/cq-source-sharepoint v1.8.2
🔌 CloudQuery SharePoint Source Plugin
17 versions - Latest release: 12 months ago - 15 stars on GitHub
Top 6.4% on proxy.golang.org
github.com/m-lab/etl/appengine/queue_pusher v2.4.3+incompatible
Package pushqueue provides a microservice that accepts HTTP requests, creates a Task from given p...
1 version - Latest release: over 1 year ago - 17 stars on GitHub
Top 7.5% on proxy.golang.org
github.com/m-lab/etl v2.4.3+incompatible
M-Lab ingestion pipeline
3 versions - Latest release: almost 4 years ago - 1 dependent repositories - 17 stars on GitHub
Top 7.7% on proxy.golang.org
github.com/m-lab/annotation-service v0.6.2
Annotation integration service for M-Lab data
1 version - Latest release: over 5 years ago - 1 dependent package - 5 dependent repositories - 3 stars on GitHub
Top 8.6% on proxy.golang.org
github.com/m-lab/etl-gardener v0.0.0-20231212214928-9ff5c25e9ae2
Gardener provides services for maintaining and reprocessing mlab data.
12 versions - Latest release: 5 months ago - 1 dependent repositories - 9 stars on GitHub
Top 7.6% on proxy.golang.org
github.com/m-lab/etl-schema v3.15.2+incompatible
All schema and views related to the etl pipeline and public bigquery tables.
17 versions - Latest release: over 3 years ago - 4 stars on GitHub
Top 8.6% on proxy.golang.org
github.com/m-lab/downloader v0.0.0-20230825152147-91ef559cc281
Service to download meta data sources for archive.
2 versions - Latest release: 9 months ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/m-lab/etl-embargo v0.0.0-20200127174439-8f1fad71d1df
Package embargo performs embargo for all sidestream data. For all data that are more than one yea...
1 version - Latest release: over 4 years ago - 0 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/dagster-io/dagster v0.2.8
An orchestration platform for the development, production, and observation of data assets.
7 versions - Latest release: over 5 years ago - 9,443 stars on GitHub
Top 4.9% on proxy.golang.org
github.com/dataform-co/dataform v0.1.0
Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift
71 versions - Latest release: about 5 years ago - 640 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/reugn/go-streams/kafka v0.1.2
Package kafka implements the Apache Kafka connector.
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 1,356 stars on GitHub
github.com/slingdata-io/sling-cli v1.2.9
Sling is a CLI tool that extracts data from a source storage/database and loads it in a target st...
427 versions - Latest release: 15 days ago - 1 dependent package - 19 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/ConduitIO/conduit v0.10.0
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
442 versions - Latest release: 18 days ago - 252 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/brexhq/substation v1.2.0
Substation is a cloud native data pipeline and transformation toolkit written in Go.
27 versions - Latest release: about 1 month ago - 161 stars on GitHub
Top 7.0% on proxy.golang.org
github.com/hofstadter-io/cuetils v0.4.0 💰
CLI and library for diff, patch, and ETL operations on CUE, JSON, and Yaml
13 versions - Latest release: over 2 years ago - 1 dependent package - 67 stars on GitHub
Top 9.4% on proxy.golang.org
github.com/turbot/steampipe-export
Steampipe Export is a zero-ETL CLI to fetch data from cloud services and APIs. Hundreds of plugin...
Latest release: 3 days ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/breeze0806/go-datax v0.1.8
go-etl是一个集数据源抽取,转化,加载,同步校验的工具集,提供强大的数据同步,数据转化甚至数据校验的功能。
9 versions - Latest release: 3 months ago - 63 stars on GitHub
Top 8.5% on proxy.golang.org
github.com/datablast-analytics/blast v0.11.1
Blast is a data orchestration tool that can run SQL and Python against Google BigQuery and Snowfl...
26 versions - Latest release: about 1 year ago - 31 stars on GitHub
Top 9.5% on proxy.golang.org
github.com/nucleuscloud/neosync/cli
A developer-first way to create high-fidelity synthetic data or anonymize sensitive data and sync...
Latest release: 3 days ago - 421 stars on GitHub
github.com/GabeCordo/etl-framework v0.1.5
A platform for deploying, monitoring, load balancing, and scaling extract-transform-load (ETL) ba...
28 versions - Latest release: 9 months ago - 1 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/erkkah/sslr v1.2.0
A simple stupid logical replication tool for PostgreSQL using only a read-only connection. No ext...
3 versions - Latest release: over 3 years ago - 4 stars on GitHub
github.com/goto/optimus/sdk v0.0.0-20240116111629-39f1c209722a
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation...
33 versions - Latest release: 4 months ago - 1 dependent package - 1 dependent repositories - 2 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/go-pkgz/flow v1.3.1 💰
Package flow provides support for very basic FBP / pipelines. Each handler represents async stage...
6 versions - Latest release: over 3 years ago - 21 stars on GitHub
Top 9.1% on proxy.golang.org
github.com/instill-ai/visual-data-preparation v0.31.0-beta 💰
🔮 Instill Core is an open-source no-/low-code data, AI, and pipelines orchestration platform
54 versions - Latest release: 6 days ago - 1,769 stars on GitHub
Top 4.7% on proxy.golang.org
gopkg.in/rwynn/monstache.v2 v2.14.0
a go daemon that syncs MongoDB to Elasticsearch in realtime. you know, for search.
10 versions - Latest release: about 7 years ago - 1,117 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/csv2db/csv2db v1.6.1
The CSV to database command line loader
13 versions - Latest release: about 1 month ago - 127 stars on GitHub
Top 7.8% on proxy.golang.org
github.com/jinsyin/datalink v0.0.2
⚡ 大数据集成框架 | DataLink is a lightweight data integration framework build on top of DataX, Spark and...
2 versions - Latest release: about 1 month ago - 2 stars on GitHub
Top 3.0% on proxy.golang.org
github.com/rwynn/monstache v4.12.3+incompatible
package main provides the monstache binary
113 versions - Latest release: over 5 years ago - 1 dependent package - 4 dependent repositories - 1,116 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/smooks/smooks v1.7.1
Extensible data integration Java framework for building XML and non-XML fragment-based applications
14 versions - Latest release: over 5 years ago - 377 stars on GitHub
Top 7.5% on proxy.golang.org
github.com/jurelou/forensibus v0.0.0-20230611162142-89257aec11a6
Copyright © 2023 JURELOU
26 versions - Latest release: 11 months ago - 16 stars on GitHub
Top 3.0% on proxy.golang.org
github.com/odpf/optimus/sdk v0.0.0-20230329213652-f146fcf2f440
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation...
25 versions - Latest release: about 1 year ago - 4 dependent packages - 1 dependent repositories - 691 stars on GitHub
Top 9.0% on proxy.golang.org
sensorbucket.nl/sensorbucket v1.1.0
IoT data processing gateway, for uniform consumption of many data formats
10 versions - Latest release: 5 months ago - 1 stars on GitHub
github.com/sensorbucket/sensorbucket v1.1.0
IoT data processing gateway, for uniform consumption of many data formats
1 version - Latest release: 5 months ago - 2 stars on GitHub
Top 4.7% on proxy.golang.org
gopkg.in/rwynn/monstache.v1 v1.3.1
a go daemon that syncs MongoDB to Elasticsearch in realtime. you know, for search.
1 version - Latest release: over 7 years ago - 1,117 stars on GitHub
Top 4.7% on proxy.golang.org
gopkg.in/rwynn/monstache.v4 v4.12.3
package main provides the monstache binary
38 versions - Latest release: over 5 years ago - 1,117 stars on GitHub
Top 4.7% on proxy.golang.org
gopkg.in/rwynn/monstache.v3 v3.26.6
package main provides the monstache binary
95 versions - Latest release: almost 4 years ago - 1,164 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/GabeCordo/etl v0.1.2
A software orchestration framework for extract-transform-load process deployment and scaling.
21 versions - Latest release: 9 months ago - 1 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/rwynn/monstache/v3 v3.26.6
a go daemon that syncs MongoDB to Elasticsearch in realtime. you know, for search.
95 versions - Latest release: almost 4 years ago - 1,118 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/rwynn/monstache/v5 v5.7.12
package main provides the monstache binary
49 versions - Latest release: 8 months ago - 1,117 stars on GitHub
github.com/gabecordo/etl-framework v0.1.5
A platform for deploying, monitoring, load balancing, and scaling extract-transform-load (ETL) ba...
28 versions - Latest release: 9 months ago - 1 stars on GitHub
Top 3.0% on proxy.golang.org
github.com/odpf/optimus v0.7.1
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation...
84 versions - Latest release: 10 months ago - 4 dependent packages - 1 dependent repositories - 690 stars on GitHub
Top 3.8% on proxy.golang.org
github.com/pbnjay/grate v0.0.0-20231006022435-3f8e65d74a14
Package grate opens tabular data files (such as spreadsheets and delimited plaintext files) and a...
2 versions - Latest release: 7 months ago - 5 dependent packages - 3 dependent repositories - 112 stars on GitHub
Top 8.0% on proxy.golang.org
github.com/hkpeaks/peaks-framework v0.0.0-20230522013116-0f6481d89829
The Peaks Consolidation is equipped with state-of-the-art algorithms and data structures that sup...
1 version - Latest release: 12 months ago - 92 stars on GitHub
Top 7.0% on proxy.golang.org
github.com/kylemclaren/mongo-transporter v0.0.0-20180630213930-d8c20467239f
Sync data between two MongoDB deployments
1 version - Latest release: almost 6 years ago - 5 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/gabecordo/etl v0.1.2
A software orchestration framework for extract-transform-load process deployment and scaling.
21 versions - Latest release: 9 months ago - 1 stars on GitHub
Top 9.3% on proxy.golang.org
github.com/blinklabs-io/cargo
Blockchain sync for the cult of Cardano
Latest release: 7 days ago - 6 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/viant/bqwt v0.0.0-20191030163741-b454b1be099b
BigQuery Windowed Tables
1 version - Latest release: over 4 years ago - 4 stars on GitHub
Top 1.3% on proxy.golang.org
github.com/Jeffail/benthos/v3 v3.65.0 💰
Fancy stream processing made operationally mundane
99 versions - Latest release: about 2 years ago - 13 dependent packages - 9 dependent repositories - 5,851 stars on GitHub
Top 1.5% on proxy.golang.org
github.com/Jeffail/benthos v1.20.4 💰
Fancy stream processing made operationally mundane
295 versions - Latest release: almost 5 years ago - 8 dependent packages - 6 dependent repositories - 5,851 stars on GitHub
Top 9.5% on proxy.golang.org
github.com/nownabe/go-bqloader/examples/pre_configured_handlers v0.0.0-20240104223113-931ff499699d
bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.
1 version - Latest release: 4 months ago - 21 stars on GitHub
Top 10.0% on proxy.golang.org
go.nownabe.dev/bqloader v1.3.11
Package bqloader is a simple ETL framework running on Cloud Functions to load data from Cloud Sto...
22 versions - Latest release: 4 months ago - 1 dependent repositories - 21 stars on GitHub
Top 9.8% on proxy.golang.org
github.com/nownabe/go-bqloader/examples/quickstart v0.0.0-20240104223113-931ff499699d
bqloader is a simple ETL framework to load data from Cloud Storage into BigQuery.
1 version - Latest release: 4 months ago - 21 stars on GitHub
Top 8.0% on proxy.golang.org
github.com/hw2499/etl-engine v1.2.3
etl engine 轻量级 跨平台 ETL引擎 数据抽取-转换-装载 Lightweight cross-platform ETL engine data Extractor-Transfo...
17 versions - Latest release: 6 months ago - 26 stars on GitHub
Top 7.8% on proxy.golang.org
github.com/ilivestrong/recipe-stats-calculator
processes a huge json file, analyse it, computes results and render as json
Latest release: 8 days ago - 0 stars on GitHub
Top 6.0% on proxy.golang.org
github.com/raystack/optimus v0.7.1
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation...
72 versions - Latest release: 10 months ago - 2 dependent packages - 707 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/livelace/girie v1.5.1
girie ("go" + "kirie") is a tool for data/metadata extraction from web pages.
6 versions - Latest release: about 2 years ago - 1 stars on GitHub
Top 6.0% on proxy.golang.org
github.com/raystack/optimus/sdk v0.0.0-20230725205201-5874457c7bbe
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation...
1 version - Latest release: 10 months ago - 2 dependent packages - 716 stars on GitHub
Top 7.7% on proxy.golang.org
github.com/instill-ai/cli v0.4.0 💰
📺 Instill AI's official command line tool
5 versions - Latest release: 2 months ago - 15 stars on GitHub
Top 6.1% on proxy.golang.org
github.com/maxim2266/csvplus v0.3.3
Package csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream p...
10 versions - Latest release: almost 6 years ago - 1 dependent package - 2 dependent repositories - 67 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/michaelbironneau/analyst v0.0.0-20180704152941-abd831de7a77
A declarative, SQL-like DSL for data integration tasks.
1 version - Latest release: almost 6 years ago - 15 stars on GitHub
Top 5.0% on proxy.golang.org
github.com/uber/storagetapper v1.1.0-beta
StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical repl...
2 versions - Latest release: about 4 years ago - 317 stars on GitHub
Top 7.1% on proxy.golang.org
github.com/sqlpipe/sqlpipe v0.0.0-20221008180221-f66450a1c4b8
SQLpipe makes it easy to move the result of one query from one database to another.
2 versions - Latest release: over 1 year ago - 33 stars on GitHub
Top 7.1% on proxy.golang.org
github.com/MaxHalford/tuna v0.0.0-20190124141118-f150c5cccea4 💰
:fish: A streaming ETL for fish
1 version - Latest release: over 5 years ago - 13 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/maxhalford/tuna v0.0.0-20190124141118-f150c5cccea4
:fish: A streaming ETL for fish
1 version - Latest release: over 5 years ago - 13 stars on GitHub
Top 2.8% on proxy.golang.org
github.com/NVIDIA/aistore v1.3.22
AIStore: scalable storage for AI applications
10 versions - Latest release: 3 months ago - 2 dependent packages - 7 dependent repositories - 769 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/NVIDIA/AIStore v1.3.22
AIStore: scalable storage for AI applications
8 versions - Latest release: 3 months ago - 768 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/appbaseio/abc v0.4.0
Power of appbase.io via CLI, with nifty imports from your favorite data sources
4 versions - Latest release: over 6 years ago - 447 stars on GitHub
Top 4.9% on proxy.golang.org
github.com/nvidia/aistore v1.3.22
AIStore: scalable storage for AI applications
10 versions - Latest release: 3 months ago - 769 stars on GitHub
Top 5.0% on proxy.golang.org
github.com/NVIDIA/aistore/cmd/aisfs v0.0.0-20230823232831-005c2ad57ef8
Package aisfs - command-line mounting utility for aisfs. Package aisfs - command-line mounting u...
186 versions - Latest release: 9 months ago - 770 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/dataplane-app/dataplane/app v0.7.5
Dataplane is an Airflow inspired data platform with additional data mesh capability to automate, ...
32 versions - Latest release: 7 months ago - 204 stars on GitHub
Top 7.0% on proxy.golang.org
github.com/licaonfee/selina v0.23.0
Package selina pipeline library
29 versions - Latest release: over 1 year ago - 17 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/goombaio/workflow v0.0.0-20181006234036-fe0d708a90fd
Package workflow implements a workflow engine that manages business processes. A workflow consis...
1 version - Latest release: over 5 years ago - 3 stars on GitHub