proxy.golang.org : github.com/pbnjay/anydata
Package anydata provides a toolkit to transparently fetch data files, cache them locally, and automatically decompress and/or extract records from them. It does so through the use of Fetcher and Wrapper interfaces. The "formats" and "filters" sub-packages include a variety of techniques that will parse and extract records and fields and interoperate well. Current support includes opening files from local paths and the following URL schemes: Transparent decompression is enabled for files (including remote URLs) ending in: Extracting files from .tar and .zip archives is also supported through the use of URL fragments (#) specifying the archive extraction path. This is supported for the following extensions: Archives referenced multiple times are only downloaded once and re-used as necessary. For example, the following 4 resource strings will result in only 2 FTP downloads: To add support for new URL schemes, implement the Fetcher interface and use RegisterFetcher before any calls to GetFetcher. You will likely also want to use Put/GetCachedFile to reduce network roundtrips as well. To add support for new archive or compression formats, implement the Wrapper interface and call RegisterWrapper. List matching lines from a species taxonomy inside a remote tarball.
Registry
-
Source
- Documentation
- JSON
- codemeta.json
purl: pkg:golang/github.com/pbnjay/anydata
License: MIT
Latest release: about 10 years ago
First release: about 10 years ago
Namespace: github.com/pbnjay
Stars: 5 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 3 months ago