Top 2.8% dependent packages on proxy.golang.org
Top 2.5% dependent repos on proxy.golang.org
proxy.golang.org : github.com/nlnwa/gowarc
Package gowarc provides a framework for handling WARC files, enabling their parsing, creation, and validation. The WARC format offers a standard way to structure, manage and store billions of resources collected from the web and elsewhere. It is used to build applications for harvesting, managing, accessing, mining and exchanging content. For more details, visit the WARC specification: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/ The WarcRecordBuilder, initialized via NewRecordBuilder, is the primary tool for creating WARC records. By default, the WarcRecordBuilder generates a record id and calculates the 'Content-Length' and 'WARC-Block-Digest'. Use WarcFileWriter, initialized with NewWarcFileWriter, to write WARC files. To parse single WARC records, use the Unmarshaler initialized with NewUnmarshaler. To read entire WARC files, employ the WarcFileReader initialized through NewWarcFileReader. The gowarc package supports validation during both the creation and parsing of WARC records. Control over the scope of validation and the handling of validation errors can be achieved by setting the appropriate options in the WarcRecordBuilder, Unmarshaler, or WarcFileReader.
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/nlnwa/gowarc
License: Apache-2.0
Latest release: about 1 year ago
First release: almost 4 years ago
Namespace: github.com/nlnwa
Dependent packages: 4
Dependent repositories: 4
Stars: 5 on GitHub
Forks: 2 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 30 days ago