Ecosyste.ms: Packages

proxy.golang.org : github.com/joomcode/redispipe

Package redispipe - high throughput Redis connector with implicit pipelining. https://redis.io/topics/pipelining Pipelining improves maximum throughput that redis can serve, and reduces CPU usage both on redis server and on client. Mostly it comes from saving system CPU consumption. But it is not always possible to use pipelining explicitly: usually there are dozens of concurrent goroutines, each sends just one request at a time. To handle usual workload, pipelining has to be implicit. All known Golang redis connectors use connection-per-request working model with a connection pool, and provide only explicit pipelining. This showed far from optimal performance under highly concurrent load. This connector was created as implicitly pipelined from the ground up to achieve maximum performance in a highly concurrent environment. It writes all requests to a single connection to redis, and continuously reads answers from another goroutine. Note that it trades a bit of latency for throughput, and therefore may be not optimal for non-concurrent usage. - fast, - thread-safe: no need to lock around connection, no need to "return to pool", etc, - pipelining is implicit, - transactions supported (but without WATCH), - hook for custom logging, - hook for request timing reporting. - by default, it is not allowed to send blocking calls, because it will block the whole pipeline: `BLPOP`, `BRPOP`, `BRPOPLPUSH`, `BZPOPMIN`, `BZPOPMAX`, `XREAD`, `XREADGROUP`, `SAVE`. However, you could set `ScriptMode: true` option to enable these commands. `ScriptMode: true` also turns default `WritePause` to -1 (meaning it almost disables forced batching). - `WATCH` is also forbidden by default: it is useless and even harmful when concurrent goroutines use the same connection. It is also allowed with `ScriptMode: true`, but you should be sure you use connection only from single goroutine. - `SUBSCRIBE` and `PSUBSCRIBE` commands are forbidden. They switch the connection work mode to a completely different mode of communication, therefore it could not be combined with regular commands. This connector doesn't implement subscribing mode. - root package is empty - common functionality is in redis subpackage - singe connection is in redisconn subpackage - cluster support is in rediscluster subpackage Both redisconn.Connect and rediscluster.NewCluster creates implementations of redis.Sender. redis.Sender provides asynchronous api for sending request/requests/transactions. That api accepts redis.Future interface implementations as an argument and fulfills it asynchronously. Usually you don't need to provide your own redis.Future implementation, but rather use synchronous wrappers. To use convenient synchronous api, one should wrap "sender" with one of wrappers: - redis.Sync{sender} - provides simple synchronouse api, - redis.SyncCtx{sender} - provides same api, but all methods accept context.Context, and methods return immediately if that context is closed, - redis.ChanFutured{sender} - provides api with future through channel closing. Types accepted as command arguments: nil, []byte, string, int (and all other integer types), float64, float32, bool. All arguments are converted to redis bulk strings as usual (ie string and bytes - as is; numbers - in decimal notation). bool converted as "0/1", nil converted to empty string. In difference to other redis packages, no custom types are used for request results. Results are de-serialized into plain go types and are returned as interface{}: IO, connection, and other errors are not returned separately but as result (and has same *errorx.Error underlying type).

Registry - Source - Documentation - JSON
purl: pkg:golang/github.com/joomcode/redispipe
Keywords: go, pipeline, redis
License: MIT
Latest release: about 4 years ago
First release: over 5 years ago
Namespace: github.com/joomcode
Dependent packages: 34
Dependent repositories: 31
Stars: 237 on GitHub
Forks: 15 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 17 days ago

• Readme
• Versions 4
• Dependent Packages 34
• Maintainers 0
• Related Packages 2