Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
proxy.golang.org : github.com/vertebrateresequencing/muxfys
Package muxfys is a pure Go library that lets you in-process temporarily fuse-mount remote file systems or object stores as a "filey" system. Currently only support for S3-like systems has been implemented. It has high performance, and is easy to use with nothing else to install, and no root permissions needed (except to initially install/configure fuse: on old linux you may need to install fuse-utils, and for macOS you'll need to install osxfuse; for both you must ensure that 'user_allow_other' is set in /etc/fuse.conf or equivalent). It allows "multiplexing": you can mount multiple different buckets (or sub directories of the same bucket) on the same local directory. This makes commands you want to run against the files in your buckets much simpler, eg. instead of mounting s3://publicbucket, s3://myinputbucket and s3://myoutputbucket to separate mount points and running: You could multiplex the 3 buckets (at the desired paths) on to the directory you will work from and just run: When using muxfys, you 1) mount, 2) do something that needs the files in your S3 bucket(s), 3) unmount. Then repeat 1-3 for other things that need data in your S3 buckets. To add support for a new kind of remote file system or object store, simply implement the RemoteAccessor interface and supply an instance of that to RemoteConfig.
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/vertebrateresequencing/muxfys
Keywords: fuse-filesystem, golang, multiplexer, s3
License: GPL-3.0
Latest release: over 5 years ago
First release: about 7 years ago
Namespace: github.com/vertebrateresequencing
Stars: 20 on GitHub
Forks: 2 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 4 days ago