Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
Top 0.1% forks on proxy.golang.org
proxy.golang.org : github.com/apache/arrow/go/parquet
Package parquet provides an implementation of Apache Parquet for Go. Apache Parquet is an open-source columnar data storage format using the record shredding and assembly algorithm to accomodate complex data structures which can then be used to efficiently store the data. This implementation is a native go implementation for reading and writing the parquet file format. You can download the library via: In addition, two cli utilities are provided: This top level parquet package contains the basic common types and reader/writer properties along with some utilities that are used throughout the other modules. The file module contains the functions for directly reading/writing parquet files including Column Readers and Column Writers. The metadata module contains the types for managing the lower level file/rowgroup/column metadata inside of a ParquetFile including inspecting the statistics. The pqarrow module contains helper functions and types for converting directly between Parquet and Apache Arrow formats. The schema module contains the types for manipulating / inspecting / creating parquet file schemas. The Parquet Primitive Types and their corresponding Go types are Boolean (bool), Int32 (int32), Int64 (int64), Int96 (parquet.Int96), Float (float32), Double (float64), ByteArray (parquet.ByteArray) and FixedLenByteArray (parquet.FixedLenByteArray). The encoding types supported in this package are: Plain, Plain/RLE Dictionary, Delta Binary Packed (only integer types), Delta Byte Array (only ByteArray), Delta Length Byte Array (only ByteArray) Tip: Some platforms don't necessarily support all kinds of encodings. If you're not sure what to use, just use Plain and Dictionary encoding.
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/apache/arrow/go/parquet
Keywords: arrow
License: Apache-2.0,BSD-2-Clause,BSD-3-Clause,Artistic-1.0-cl8
Latest release: 17 days ago
Namespace: github.com/apache/arrow/go
Stars: 11,607 on GitHub
Forks: 2,870 on GitHub
Docker dependents: 2
Docker downloads: 375
See more repository details: repos.ecosyste.ms
Last synced: 17 days ago