Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
proxy.golang.org "deduplication" keyword
Top 8.2% on proxy.golang.org
1 version - Latest release: almost 2 years ago - 0 stars on GitHub
github.com/lil5/go-slice-dedup v1.0.0
Remove duplicates for a slice with the use of generics1 version - Latest release: almost 2 years ago - 0 stars on GitHub
Top 1.6% on proxy.golang.org
43 versions - Latest release: 4 months ago - 3 dependent packages - 2 dependent repositories - 19,650 stars on GitHub
github.com/restic/restic v0.16.4
Package restic gives a (very brief) introduction to the structure of source code. The packages a...43 versions - Latest release: 4 months ago - 3 dependent packages - 2 dependent repositories - 19,650 stars on GitHub
Top 8.2% on proxy.golang.org
2 versions - Latest release: over 3 years ago - 3 stars on GitHub
github.com/OSPG/godedupe v0.0.0-20201108184222-237ef267599f
Improved and modern fdupes alternative2 versions - Latest release: over 3 years ago - 3 stars on GitHub
Top 8.2% on proxy.golang.org
2 versions - Latest release: over 3 years ago - 3 stars on GitHub
github.com/ospg/godedupe v0.0.0-20201108184222-237ef267599f
Improved and modern fdupes alternative2 versions - Latest release: over 3 years ago - 3 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 2 years ago - 2 stars on GitHub
github.com/mterron/swuniq v1.0.1
A command-line tool for deduplicating entries in a file or stream with constant memory usage1 version - Latest release: over 2 years ago - 2 stars on GitHub
github.com/tsileo/blobfs v0.0.0-20200420060622-1580a9dcb8df
New project: https://git.sr.ht/~tsileo/blobfs1 version - Latest release: about 4 years ago - 13 stars on GitHub
github.com/trytriangles/oshash v1.0.0
Fast and cheap partial file hashing provided as a CLI tool and a zero-dependency Go library.1 version - Latest release: over 2 years ago - 1 stars on GitHub
Top 9.2% on proxy.golang.org
1 version - Latest release: 4 months ago - 0 stars on GitHub
github.com/mirkobrombin/dabadee v0.4.0
DaBaDee is a simple deduplication tool/storage for files. It uses SHA256* to hash the files and s...1 version - Latest release: 4 months ago - 0 stars on GitHub
Top 8.0% on proxy.golang.org
7 versions - Latest release: almost 2 years ago - 5 dependent packages - 6 dependent repositories - 14 stars on GitHub
github.com/lkarlslund/stringdedup v0.6.2
String deduplication package for Go7 versions - Latest release: almost 2 years ago - 5 dependent packages - 6 dependent repositories - 14 stars on GitHub
Top 6.5% on proxy.golang.org
13 versions - Latest release: about 1 year ago - 42 stars on GitHub
github.com/lobocv/simpleflow v1.2.0
Generic simple workflows and concurrency patterns13 versions - Latest release: about 1 year ago - 42 stars on GitHub
Top 8.2% on proxy.golang.org
5 versions - Latest release: about 7 years ago - 3,661 stars on GitHub
github.com/openvenues/libpostal v1.0.0
A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP...5 versions - Latest release: about 7 years ago - 3,661 stars on GitHub
Top 6.5% on proxy.golang.org
10 versions - Latest release: almost 3 years ago - 812 stars on GitHub
github.com/dpc/rdedup v3.2.1+incompatible
Data deduplication engine, supporting optional compression and public key encryption.10 versions - Latest release: almost 3 years ago - 812 stars on GitHub
github.com/yunussandikci/squeuelite-go v0.0.6
SQLite based message queue implementation with the support of deduplication, delay and priority f...6 versions - Latest release: 8 months ago - 0 stars on GitHub
gitlab.com/gozora/dedupfs v0.5.4
Provides de-duplicated archive that is presentable by net/http package.10 versions - Latest release: almost 2 years ago - 1 dependent repositories - 0 stars on GitLab.com
Top 8.0% on proxy.golang.org
Latest release: about 1 month ago - 1 stars on GitHub
github.com/orcastor/xdelta
🔃 用于提取文件间差异数据，并且用于在两个端点之间进行差异化的文件同步。核心采用 rsync 算法，并且支持多轮同步以及就地构造文件。Latest release: about 1 month ago - 1 stars on GitHub
Top 0.4% on proxy.golang.org
61 versions - Latest release: 10 months ago - 481 dependent packages - 3,798 dependent repositories - 5,560 stars on GitHub
github.com/prometheus/alertmanager v0.26.0
Prometheus Alertmanager61 versions - Latest release: 10 months ago - 481 dependent packages - 3,798 dependent repositories - 5,560 stars on GitHub
Top 5.2% on proxy.golang.org
63 versions - Latest release: 3 months ago - 5,876 stars on GitHub
github.com/prometheus/Alertmanager v0.27.0
Prometheus Alertmanager63 versions - Latest release: 3 months ago - 5,876 stars on GitHub
Top 4.3% on proxy.golang.org
63 versions - Latest release: 3 months ago - 5,563 stars on GitHub
github.com/Prometheus/alertmanager v0.27.0
Prometheus Alertmanager63 versions - Latest release: 3 months ago - 5,563 stars on GitHub
Top 7.8% on proxy.golang.org
1 version - Latest release: almost 5 years ago - 1 dependent package - 2 dependent repositories - 16 stars on GitHub
github.com/indyjo/cafs v0.1.0
Package cafs specifies a content-addressable file storage with support for de-duplication and rem...1 version - Latest release: almost 5 years ago - 1 dependent package - 2 dependent repositories - 16 stars on GitHub
Top 8.2% on proxy.golang.org
4 versions - Latest release: 10 months ago - 29 stars on GitHub
github.com/donatj/imgdedup v0.4.0
CLI tool for image duplicate detection4 versions - Latest release: 10 months ago - 29 stars on GitHub
Top 5.0% on proxy.golang.org
43 versions - Latest release: 3 months ago - 733 stars on GitHub
github.com/cupcakearmy/autorestic v1.8.2 💰
Copyright © 2021 NAME HERE <EMAIL ADDRESS> Licensed under the Apache License, Version 2.0 (the "...43 versions - Latest release: 3 months ago - 733 stars on GitHub
Top 1.2% on proxy.golang.org
77 versions - Latest release: about 2 months ago - 33 dependent packages - 39 dependent repositories - 3,318 stars on GitHub
github.com/kopia/kopia v0.17.0
Command-line tool for creating and accessing backups. Usage: Use 'kopia help' to see more details.77 versions - Latest release: about 2 months ago - 33 dependent packages - 39 dependent repositories - 3,318 stars on GitHub
Top 9.1% on proxy.golang.org
Latest release: about 1 month ago - 2 stars on GitHub
github.com/samber/go-singleflightx 💰
🧬 x/sync/singleflight but with generics, batching and nullable resultLatest release: about 1 month ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
4 versions - Latest release: 6 months ago - 1 stars on GitHub
github.com/hattya/hiiragi v0.0.0-20231222133901-c4de588f23af
A command line tool to create hard links for duplicate files4 versions - Latest release: 6 months ago - 1 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 6 years ago - 10 stars on GitHub
github.com/juntaki/bucketsync v0.0.0-20180117093325-6bb0f7c2d237
S3 backed FUSE Filesystem written in Go with dedup and encryption.1 version - Latest release: over 6 years ago - 10 stars on GitHub
Top 9.4% on proxy.golang.org
1 version - Latest release: over 2 years ago - 2 stars on GitHub
github.com/aarondwi/together v0.1.0
Batch your call. Easily backpressure. Enjoy the performance.1 version - Latest release: over 2 years ago - 2 stars on GitHub
github.com/veqryn/slog-dedup v0.3.0
Package slogdedup provides structured logging (slog) deduplication for use with json logging (or ...5 versions - Latest release: 7 months ago - 8 stars on GitHub
Top 9.0% on proxy.golang.org
16 versions - Latest release: over 3 years ago - 0 stars on GitHub
github.com/mgnsk/evcache v1.6.0
Package evcache provides an in-memory ordered cache with optional eventually consistent LFU order...16 versions - Latest release: over 3 years ago - 0 stars on GitHub
Top 9.0% on proxy.golang.org
21 versions - Latest release: over 2 years ago - 0 stars on GitHub
github.com/mgnsk/evcache/v2 v2.3.7
Package evcache provides a sync.Map wrapper with specific concurrency guarantees.21 versions - Latest release: over 2 years ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: almost 7 years ago - 4 stars on GitHub
github.com/amoghe/dedup v0.0.0-20170809003932-18ff2712cbb8
Deduplicator1 version - Latest release: almost 7 years ago - 4 stars on GitHub
Top 9.0% on proxy.golang.org
22 versions - Latest release: 7 months ago - 2 dependent packages - 3 stars on GitHub
github.com/mgnsk/evcache/v3 v3.1.14
Package evcache implements a concurrent key-value cache with capacity overflow eviction, item exp...22 versions - Latest release: 7 months ago - 2 dependent packages - 3 stars on GitHub
Top 8.6% on proxy.golang.org
27 versions - Latest release: about 1 year ago - 0 stars on GitHub
paepcke.de/fsdd v0.1.39
package fsdd allows ypu to deduplicate data via hardlinks27 versions - Latest release: about 1 year ago - 0 stars on GitHub
Top 9.7% on proxy.golang.org
2 versions - Latest release: about 2 months ago - 1 stars on GitHub
github.com/hekmon/deduper v1.0.0
Analyse 2 paths to found identical files and hard link them to save space2 versions - Latest release: about 2 months ago - 1 stars on GitHub
Top 8.2% on proxy.golang.org
2 versions - Latest release: almost 7 years ago - 157 stars on GitHub
github.com/f483/dejavu v1.0.0
Package dejavu offers quick detection of already witnessed data. Limited memory of witnessed dat...2 versions - Latest release: almost 7 years ago - 157 stars on GitHub
Top 8.2% on proxy.golang.org
2 versions - Latest release: almost 7 years ago - 157 stars on GitHub
github.com/F483/dejavu v1.0.0
Package dejavu offers quick detection of already witnessed data. Limited memory of witnessed dat...2 versions - Latest release: almost 7 years ago - 157 stars on GitHub
Top 9.9% on proxy.golang.org
1 version - Latest release: 5 months ago - 1 stars on GitHub
github.com/studio1767/s3backup v0.0.0-20231231035218-4ad94f096c4d
Run client side encrypted backups using AWS S3. Tools to backup, restore and manage job configura...1 version - Latest release: 5 months ago - 1 stars on GitHub
github.com/deckarep/gorganize v0.0.0-20171106020144-e6629f759da3
Just some durrdy code to move files around and organize shit...mostly photos and videos.1 version - Latest release: over 6 years ago - 1 stars on GitHub
Top 6.5% on proxy.golang.org
27 versions - Latest release: 4 months ago - 1,186 stars on GitHub
github.com/rustic-rs/rustic v0.7.0
rustic - fast, encrypted, and deduplicated backups powered by Rust27 versions - Latest release: 4 months ago - 1,186 stars on GitHub
github.com/go-utils/dedupe v1.0.1
Package dedupe - Deduplication among various types of slices8 versions - Latest release: about 4 years ago - 3 dependent packages - 2 dependent repositories - 1 stars on GitHub
Related Keywords
golang
14
go
12
dedupe
6
filesystem
5
backup
5
hacktoberfest
4
cache
4
sync
4
agecache
3
capacity
3
eventually-consistent
3
dedup
3
expiry
3
fetch
3
encryption
3
command-line
3
slack
3
pagerduty
3
opsgenie
3
generics
3
notifications
3
monitoring
3
map
3
alertmanager
3
email
3
restic
3
fifo
2
hardlink
2
command-line-tool
2
duplicate-values
2
duplicates
2
history
2
memory
2
batching
2
probabilistic
2
modern
2
cli
2
linux
2
deduping
2
fuse
2
deduplicate
2
s3
1
backpressure
1
high-throughput
1
oltp
1
scatter-gather
1
golang-library
1
json
1
logging
1
structured-logging
1
slog
1
rust
1
zip
1
photo-collection
1
organization
1
md5
1
file-management
1
archived
1
content-hash
1
aws-s3
1
aws-iam
1
age-encryption
1
hardlinks
1
hardlinking
1
deduplicator
1
inode
1
harddisk
1
filesystem-utils
1
drive
1
analyzer
1
ttl-cache
1
ttl
1
realloc
1
compressor
1
compression
1
record-linkage
1
nlp
1
natural-language-processing
1
machine-learning
1
international
1
c
1
address-parser
1
address
1
workerpool
1
worflows
1
timeseries
1
counter
1
concurrency
1
xxhash
1
string
1
storage
1
hashing
1
blobstash
1
uniq
1
sliding-window
1
filter
1
secure-by-default
1
slice
1
duplicate
1
array
1