Ecosyste.ms: Packages

proxy.golang.org : github.com/gholt/ring

Package ring provides a way to distribute replicas of partitioned items to nodes. An example would be a distributed storage system, storing duplicate copies of each file on different drives, servers, or even data centers based on the assignments given by the Ring. See https://github.com/gholt/ring/blob/master/BASIC_HASH_RING.md for a introduction to consistent hashing and hashing rings. There is a lower-level package github.com/gholt/ring/lowring that underpins this package. It is provided in case you don't need the extra layer this package provides or you would like to create your own extra layer. Node: A single unit within a distributed system. For example, a server or a single drive within a server. Partition: A numeric value from a range of values. Replicas of these partitions are assigned to nodes to indicate each node's responsibilities, such as which data to store or which requests to process. Mapping these data items or requests to partitions is usually done by hashing the name or some other identifier to obtain a number and then using the modulus operator with the overall partition count. Replica: A copy of a partition. Object storage systems often use 3 replicas, for example. Ring: Stores the assignments of replicas of partitions to nodes. Builder: A program to build and maintain a ring. Capacity: The relative size of a node as compared to other nodes. For example, the amount of disk space available on the node. Desire: The number of additional, or fewer, partitions a node would like to have assigned in order to reach a balance with the rest of the nodes in a ring. Tier: Represents the relationship of nodes to one another. For example, a geographic tier might have two values, east and west, and each node would be associated with one of those regions. There can be multiple levels of tiers, such as disk, server, zone, datacenter, region, etc. See the Example (Tiers) for a more in-depth code discussion. Last Moved: The record of when a given replica of a partition was last reassigned to a different node. The builder uses this information restrict future movements of that replica and of the other replicas for that partition. For example, it might only move 2 of 5 replicas of a partition within an hour, unless absolutely necessary, such as a failed node. Each has their strengths and weaknesses. This package uses more memory than many other ring implementations and it is slower to create and modify the ring. But, it is usually much faster to use once loaded and provides precise node placements. https://github.com/gholt/ring/blob/master/PARTITION_RING_VS_HASH_RING.md has more discussion on the trade offs. Other interesting ideas in this space: Amazon's original 2007 Dynamo paper - http://www.allthingsdistributed.com/files/amazon-dynamo-sosp2007.pdf Jump consistent hashing - http://arxiv.org/abs/1406.2294 - dgryski implementation https://github.com/dgryski/go-jump - also dgryski shared key-value store https://github.com/dgryski/go-shardedkv Multi-probe consistent hashing http://arxiv.org/pdf/1505.00062.pdf - dgryski implementation https://github.com/dgryski/go-mpchash GreenCHT replication scheme http://storageconference.us/2015/Papers/16.Zhao.pdf Below are examples for overall usage of this package, and more in-depth discussions as well. If you're directly reading the code, all the examples are in files named *example_test.go

Registry - Source - Documentation - JSON
purl: pkg:golang/github.com/gholt/ring
Keywords: consistent-hashing, go, ring
License: BSD-3-Clause
Latest release: almost 6 years ago
First release: almost 6 years ago
Namespace: github.com/gholt
Dependent repositories: 1
Stars: 128 on GitHub
Forks: 10 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 25 days ago

• Readme
• Versions 1
• Dependent Packages 0
• Maintainers 0