An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "bigdata" keyword

diet-pandas 0.5.0
Automated memory optimization for Pandas DataFrames. Same Pandas taste, half the calories (RAM).
8 versions - Latest release: 10 months ago - 59 downloads last month - 3 stars on GitHub - 1 maintainer
cuallee 0.15.4
Python library for data validation on DataFrame APIs including Snowflake/Snowpark, Apache/PySpark...
96 versions - Latest release: about 1 year ago - 1 dependent package - 1 dependent repositories - 79.7 thousand downloads last month - 250 stars on GitHub - 2 maintainers
rayforce-py 2.3.1
Python bindings for RayforceDB
57 versions - Latest release: 2 days ago - 2.56 thousand downloads last month - 15 stars on GitHub - 2 maintainers
Top 1.3% on pypi.org
vaex-core 4.19.0
Core of vaex
104 versions - Latest release: about 1 year ago - 16 dependent packages - 64 dependent repositories - 28.2 thousand downloads last month - 8,512 stars on GitHub - 1 maintainer
Top 4.4% on pypi.org
nflx-genie-client 3.6.19
Genie Python Client.
104 versions - Latest release: over 1 year ago - 2 dependent repositories - 141 thousand downloads last month - 1,765 stars on GitHub - 3 maintainers
Top 0.3% on pypi.org
avro 1.12.2
Avro is a serialization and RPC framework.
36 versions - Latest release: about 2 months ago - 59 dependent packages - 1,066 dependent repositories - 12.2 million downloads last month - 3,305 stars on GitHub - 9 maintainers
Top 1.4% on pypi.org
cytoolz 1.1.0
Cython implementation of Toolz: High performance functional utilities
28 versions - Latest release: 12 months ago - 162 dependent packages - 11,437 dependent repositories - 7.23 million downloads last month - 1,113 stars on GitHub - 4 maintainers
pysparkproxy 0.0.17
Seamlessly execute pyspark code on remote clusters
9 versions - Latest release: almost 8 years ago - 1 dependent repositories - 21 downloads last month - 5 stars on GitHub - 1 maintainer
databend 1.2.895
The multi-modal data warehouse built for the AI era. Unified analytics for structured data, JSON,...
296 versions - Latest release: 6 months ago - 803 downloads last month - 9,455 stars on GitHub - 3 maintainers
Top 1.5% on pypi.org
vaex-server 0.10.0
Webserver and client for vaex for a remote dataset
22 versions - Latest release: 8 months ago - 3 dependent packages - 51 dependent repositories - 10.4 thousand downloads last month - 8,512 stars on GitHub - 1 maintainer
Top 1.6% on pypi.org
vaex-ml 0.19.0
Machine learning support for vaex
35 versions - Latest release: 8 months ago - 2 dependent packages - 47 dependent repositories - 9.96 thousand downloads last month - 8,512 stars on GitHub - 1 maintainer
vaex-contrib 0.2.0
Community contributed modules to vaex
4 versions - Latest release: 8 months ago - 1 dependent repositories - 20 downloads last month - 8,512 stars on GitHub - 1 maintainer
Top 6.2% on pypi.org
vaex-graphql 0.3.0
GraphQL support for accessing vaex DataFrame
4 versions - Latest release: 8 months ago - 9 dependent repositories - 127 downloads last month - 8,512 stars on GitHub - 1 maintainer
Top 1.4% on pypi.org
vaex 4.19.0
Out-of-Core DataFrames to visualize and explore big tabular datasets
59 versions - Latest release: 8 months ago - 24 dependent packages - 90 dependent repositories - 8.6 thousand downloads last month - 8,512 stars on GitHub - 1 maintainer
Top 1.6% on pypi.org
vaex-astro 0.10.0
Astronomy related transformations and FITS file support
19 versions - Latest release: 8 months ago - 2 dependent packages - 51 dependent repositories - 10.9 thousand downloads last month - 8,508 stars on GitHub - 1 maintainer
Top 2.2% on pypi.org
uproot 5.7.7
ROOT I/O in pure Python and NumPy.
337 versions - Latest release: 2 days ago - 83 dependent packages - 240 dependent repositories - 760 thousand downloads last month - 270 stars on GitHub - 3 maintainers
ukv 0.12.1
Python bindings for Unum's UStore.
23 versions - Latest release: over 3 years ago - 86 downloads last month - 642 stars on GitHub - 1 maintainer
ustore 1.33
Python bindings for Unum's UStore.
21 versions - Latest release: over 4 years ago - 1 dependent repositories - 24 downloads last month - 642 stars on GitHub - 1 maintainer
lakesoul 2.0.0
Python APIs for using LakeSoul
4 versions - Latest release: about 1 month ago - 140 downloads last month - 3,256 stars on GitHub - 1 maintainer
Top 1.1% on pypi.org
vispy 0.17.0
Interactive visualization in Python
46 versions - Latest release: about 1 month ago - 73 dependent packages - 287 dependent repositories - 686 thousand downloads last month - 3,604 stars on GitHub - 3 maintainers
cybershuttle-sdk 0.0.1a4
Python SDK for Apache Airavata Cybershuttle
3 versions - Latest release: about 3 years ago - 11 downloads last month - 155 stars on GitHub - 1 maintainer
airavata-jupyter-magic 1.0.5
Jupyter magics for running notebook cells on remote HPC resources. Powered by Apache Airavata.
11 versions - Latest release: over 1 year ago - 20 downloads last month - 155 stars on GitHub - 1 maintainer
legend-pydataobj 2.0.3
LEGEND Python Data Objects
66 versions - Latest release: 4 months ago - 3 dependent packages - 6.29 thousand downloads last month - 1 stars on GitHub - 1 maintainer
csv-cdc 0.1.3
A high-performance CSV Change Data Capture tool
4 versions - Latest release: over 1 year ago - 21 downloads last month - 0 stars on GitHub - 1 maintainer
Top 1.5% on pypi.org
vaex-viz 0.6.0
Visualization for vaex
25 versions - Latest release: 8 months ago - 3 dependent packages - 54 dependent repositories - 14.8 thousand downloads last month - 8,512 stars on GitHub - 1 maintainer
grapetree 3.0.0
Web interface of GrapeTree, which is a program for phylogenetic analysis.
17 versions - Latest release: 7 days ago - 1 dependent repositories - 75 downloads last month - 91 stars on GitHub - 3 maintainers
marmot-sdk 0.3.0 💰
Python SDK for Marmot — read the catalog and self-document automation, agents, and pipelines.
2 versions - Latest release: 3 months ago - 19 downloads last month - 618 stars on GitHub - 1 maintainer
shantay 0.6.0
investigating the EU's DSA transparency database
6 versions - Latest release: 9 months ago - 19 downloads last month - 3 stars on GitHub - 1 maintainer
arvados-user-activity 3.2.1
Summarize user activity on an Arvados cluster from audit logs
6 versions - Latest release: 7 months ago - 527 downloads last month - 410 stars on GitHub - 1 maintainer
arvados-cluster-activity 3.2.1
Summarize Arvados cluster activity from audit logs and Prometheus metrics
6 versions - Latest release: 7 months ago - 276 downloads last month - 410 stars on GitHub - 1 maintainer
wendelin.core 0.13
Out-of-core NumPy arrays
16 versions - Latest release: over 7 years ago - 2 dependent repositories - 67 downloads last month - 1 maintainer
spark-celery 0.2
A helper to allow Python Celery tasks to do work in a Spark job
3 versions - Latest release: almost 4 years ago - 1 dependent repositories - 144 downloads last month - 27 stars on GitHub - 1 maintainer
pytispark 2.0
TiSpark support for python
8 versions - Latest release: over 7 years ago - 1 dependent repositories - 179 downloads last month - 890 stars on GitHub - 3 maintainers
arvados-pam 2.0.4
Arvados PAM module
32 versions - Latest release: about 6 years ago - 14 downloads last month - 420 stars on GitHub - 1 maintainer
arvados-tools 3.2.1b2
A single package to install all Arvados client tools
2 versions - Latest release: 6 months ago - 24 downloads last month - 420 stars on GitHub - 1 maintainer
Top 9.4% on pypi.org
pyoptimus 0.1.0
Optimus is the missing framework for cleaning and pre-processing data in a distributed fashion.
32 versions - Latest release: almost 4 years ago - 1 dependent repositories - 55 downloads last month - 1,535 stars on GitHub - 2 maintainers
gigapipe 0.1.22
Gigapipe Python Client
13 versions - Latest release: about 4 years ago - 1 dependent repositories - 42 downloads last month - 1 maintainer
harlequin-databend 0.1.22
A Harlequin adapter for Databend.
5 versions - Latest release: over 2 years ago - 31 downloads last month - 9,452 stars on GitHub - 1 maintainer
quantms-utils 0.0.30
Python scripts and helpers for the quantMS workflow
30 versions - Latest release: 5 months ago - 46 downloads last month - 7 stars on GitHub - 1 maintainer
arvados-fuse 3.2.1
Arvados FUSE driver
513 versions - Latest release: 7 months ago - 890 downloads last month - 420 stars on GitHub - 1 maintainer
crunchstat-summary 3.2.1
Report resource usage from Arvados Crunch logs
30 versions - Latest release: 7 months ago - 595 downloads last month - 410 stars on GitHub - 1 maintainer
hdxcli 1.0.83
Hydrolix command line utility to do CRUD operations on projects, tables, transforms and other res...
48 versions - Latest release: about 1 year ago - 76 downloads last month - 9 stars on GitHub - 1 maintainer
Top 0.4% on pypi.org
avro-python3 1.10.2
Avro is a serialization and RPC framework.
12 versions - Latest release: over 5 years ago - 37 dependent packages - 742 dependent repositories - 6.83 million downloads last month - 3,063 stars on GitHub - 8 maintainers
Top 1.5% on pypi.org
vaex-jupyter 0.9.0
Jupyter notebook and Jupyter lab support for vaex
24 versions - Latest release: 8 months ago - 4 dependent packages - 50 dependent repositories - 11.3 thousand downloads last month - 8,509 stars on GitHub - 1 maintainer
Top 1.5% on pypi.org
vaex-hdf5 0.15.0
hdf5 file support for vaex
37 versions - Latest release: 8 months ago - 4 dependent packages - 58 dependent repositories - 19.6 thousand downloads last month - 8,509 stars on GitHub - 1 maintainer
Top 4.3% on pypi.org
resiliparse 1.0.9
A collection of robust and fast processing tools for parsing and analyzing (not only) web archive...
82 versions - Latest release: 3 months ago - 2 dependent packages - 4 dependent repositories - 1.25 million downloads last month - 150 stars on GitHub - 1 maintainer
Top 3.3% on pypi.org
fastwarc 1.0.9
The world's fastest WARC parsing library written in Rust with bindings for Python.
88 versions - Latest release: 3 months ago - 6 dependent packages - 5 dependent repositories - 1.22 million downloads last month - 150 stars on GitHub - 1 maintainer
Top 5.5% on pypi.org
jupyterlab-visualpython 3.0.2 💰
GUI-based Python code generator for Jupyter Lab as an extension
23 versions - Latest release: over 2 years ago - 4 dependent repositories - 263 downloads last month - 920 stars on GitHub - 1 maintainer
Top 8.3% on pypi.org
visualpython 3.0.2 💰
Visual Python is a GUI-based Python code generator, developed on the Jupyter Notebook as an exten...
89 versions - Latest release: over 2 years ago - 1 dependent repositories - 192 downloads last month - 920 stars on GitHub - 1 maintainer
package-lab-vr-demo-success 99.99.99
disclaimer, This package is used for security research and demonstrations. It might contain dange...
1 version - Latest release: over 4 years ago - 1 dependent repositories - 17 downloads last month - 3,419 stars on GitHub - 1 maintainer
vector-lake 0.0.5
S3 vector database for bigdata
5 versions - Latest release: 10 months ago - 680 downloads last month - 59 stars on GitHub - 1 maintainer
dlopes7-avro 1.12.0
Avro is a serialization and RPC framework.
1 version - Latest release: almost 3 years ago - 10 downloads last month - 2,874 stars on GitHub - 1 maintainer
airavata-django-portal-sdk 1.8.4
The Airavata Django Portal SDK is a library that makes it easier to develop Airavata Django Porta...
33 versions - Latest release: about 3 years ago - 3 dependent repositories - 108 downloads last month - 0 stars on GitHub - 3 maintainers
akudu 0.0.1
Asyncio Client for Apache Kudu Database Engine (Storage System).
1 version - Latest release: over 3 years ago - 47 downloads last month - 1 stars on GitHub - 1 maintainer
iterdict 0.2.0
Dict that lazily populates itself with items from the iterator it was constructed with as keys ar...
2 versions - Latest release: over 14 years ago - 1 dependent repositories - 12 downloads last month - 2 stars on GitHub - 1 maintainer
django-mass-migration 0.3.9
Django app for long-running data migrations
22 versions - Latest release: over 1 year ago - 84 downloads last month - 4 stars on GitHub - 1 maintainer
pysparkify 0.27.0
Spark based ETL
18 versions - Latest release: over 2 years ago - 41 downloads last month - 1 stars on GitHub - 1 maintainer
elixirnote 4.0.0a30
go from data to knowledge
4 versions - Latest release: almost 4 years ago - 21 downloads last month - 10 stars on GitHub - 1 maintainer
mextractor 6.0.2 💰
mextractor can extract media metadata to YAML and read them
20 versions - Latest release: almost 2 years ago - 119 downloads last month - 6 stars on GitHub - 1 maintainer
mister 0.0.2
Approachable map/reduce jobs
2 versions - Latest release: almost 8 years ago - 1 dependent repositories - 19 downloads last month - 0 stars on GitHub - 1 maintainer
robotframework-dynamodbsqllibrary 0.3.1
An Amazon AWS DynamoDB big data testing library for Robot Framework with SQL-like DSL
9 versions - Latest release: over 3 years ago - 2 dependent repositories - 985 downloads last month - 3 stars on GitHub - 1 maintainer
risk-command-center 1.0.37
Risk Command Center, manage your risk easly.
2 versions - Latest release: over 4 years ago - 1 dependent repositories - 35 downloads last month - 11 stars on GitHub - 1 maintainer
zqytest 1.0.1
belongs to zqy.
1 version - Latest release: over 9 years ago - 1 dependent repositories - 11 downloads last month - 1 maintainer
Top 4.8% on pypi.org
optimuspyspark 2.2.32
Optimus is the missing framework for cleaning and pre-processing data in a distributed fashion wi...
83 versions - Latest release: about 6 years ago - 8 dependent repositories - 2.92 thousand downloads last month - 1,536 stars on GitHub - 2 maintainers
lemuras 1.2.3
A small Python library to deal with big tables
6 versions - Latest release: over 6 years ago - 1 dependent repositories - 51 downloads last month - 2 stars on GitHub - 1 maintainer
omni-json-db 3.0.0 💰
A powerful KV JSON DB + Graph DB with Time-Travel, concurrency and compression. The NoSQL alterna...
24 versions - Latest release: about 2 months ago - 319 downloads last month - 16 stars on GitHub - 1 maintainer
dtshare 1.0.3
Open financial data
2 versions - Latest release: over 6 years ago - 1 dependent repositories - 52 downloads last month - 525 stars on GitHub - 1 maintainer
Top 2.7% on pypi.org
uproot3 3.14.4
ROOT I/O in pure Python and Numpy.
5 versions - Latest release: over 5 years ago - 15 dependent packages - 30 dependent repositories - 677 thousand downloads last month - 313 stars on GitHub - 1 maintainer
pybda 0.1.0
Analysis of big biological data sets for distributed HPC clusters.
6 versions - Latest release: about 7 years ago - 1 dependent repositories - 46 downloads last month - 9 stars on GitHub - 1 maintainer
Top 10.0% on pypi.org
timehash 1.2
Module to encode and decode timestamps to/from TimeHashes
3 versions - Latest release: almost 5 years ago - 2 dependent repositories - 22.7 thousand downloads last month - 45 stars on GitHub - 1 maintainer
cwlab 0.4.1
A platform-agnostic, cloud-ready framework for simplified deployment of the Common Workflow Langu...
10 versions - Latest release: over 5 years ago - 1 dependent repositories - 52 downloads last month - 36 stars on GitHub - 1 maintainer
lettria 6.0.2
Lettria official SDK for python
31 versions - Latest release: about 3 years ago - 1 dependent repositories - 1.35 thousand downloads last month - 12 stars on GitHub - 1 maintainer
bart-extract-ga 0.1.1
Extract event views to Google Analytics
2 versions - Latest release: almost 6 years ago - 1 dependent repositories - 60 downloads last month - 0 stars on GitHub - 1 maintainer
datacatalog-tag-manager 2.2.0
A package to manage Google Cloud Data Catalog tags, loading metadata from external sources
15 versions - Latest release: almost 6 years ago - 1 dependent repositories - 55 downloads last month - 18 stars on GitHub - 1 maintainer
Top 5.5% on pypi.org
arvados-python-client 3.2.1
Arvados client library
699 versions - Latest release: 7 months ago - 11 dependent repositories - 4.8 thousand downloads last month - 410 stars on GitHub - 1 maintainer
fdict 0.8.1
Easy out-of-core computing of recursive dict
9 versions - Latest release: about 9 years ago - 1 dependent package - 1 dependent repositories - 461 downloads last month - 7 stars on GitHub - 1 maintainer
athenacli 1.7.0
CLI for Athena Database. With auto-completion and syntax highlighting.
25 versions - Latest release: 6 months ago - 1 dependent repositories - 1.53 thousand downloads last month - 228 stars on GitHub - 3 maintainers
Top 4.3% on pypi.org
vaex-arrow 0.5.1
Arrow support for vaex
12 versions - Latest release: over 6 years ago - 1 dependent package - 17 dependent repositories - 375 downloads last month - 8,428 stars on GitHub - 1 maintainer
Top 9.6% on pypi.org
vaex-ui 0.3.0
Graphical user interface for vaex based on Qt
7 versions - Latest release: about 7 years ago - 3 dependent repositories - 54 downloads last month - 8,505 stars on GitHub - 1 maintainer
vaex-distributed 0.3.0
Distributed dataset for vaex
3 versions - Latest release: over 7 years ago - 1 dependent repositories - 52 downloads last month - 8,424 stars on GitHub - 1 maintainer
Top 4.8% on pypi.org
uproot4 4.0.0
ROOT I/O in pure Python and NumPy.
30 versions - Latest release: almost 6 years ago - 10 dependent packages - 11 dependent repositories - 4.56 thousand downloads last month - 199 stars on GitHub - 2 maintainers
Top 3.7% on pypi.org
pybloom-live 4.0.0
Bloom filter: A Probabilistic data structure
7 versions - Latest release: almost 4 years ago - 5 dependent packages - 65 dependent repositories - 484 thousand downloads last month - 165 stars on GitHub - 1 maintainer
propius 0.1.2
Extracts similar items over a big data using correlation between items over sparse data structures
1 version - Latest release: over 5 years ago - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
bigartm9 0.9.2
BigARTM: the state-of-the-art platform for topic modeling
1 version - Latest release: almost 4 years ago - 18 downloads last month - 675 stars on GitHub - 1 maintainer
Top 5.0% on pypi.org
bigartm 0.9.2
BigARTM: the state-of-the-art platform for topic modeling
1 version - Latest release: almost 7 years ago - 1 dependent package - 11 dependent repositories - 405 downloads last month - 675 stars on GitHub - 2 maintainers
bigartm10 0.10.1
BigARTM: the state-of-the-art platform for topic modeling
1 version - Latest release: almost 7 years ago - 1 dependent repositories - 193 downloads last month - 675 stars on GitHub - 2 maintainers
zqybxqqwetest 1.0.1
belongs to zqy.
1 version - Latest release: over 9 years ago - 1 dependent repositories - 26 downloads last month - 1 maintainer
pyspark-spy 1.0.2
Collect and aggregate on spark events for profitz. In 🐍 way!
3 versions - Latest release: over 5 years ago - 1 dependent repositories - 205 downloads last month - 11 stars on GitHub - 1 maintainer
foobar22 1.2.0
This package is used for security research and demonstrations. It might contain dangerous code sn...
1 version - Latest release: over 4 years ago - 2 dependent repositories - 625 stars on GitHub
taospyudf 0.0.11
taos python udf
9 versions - Latest release: over 3 years ago - 374 downloads last month - 23,837 stars on GitHub - 1 maintainer
datacatalog-util 0.11.6
A package to manage Google Cloud Data Catalog helper commands and scripts
21 versions - Latest release: almost 6 years ago - 1 dependent repositories - 96 downloads last month - 22 stars on GitHub - 1 maintainer
zqy 1.0.5
belongs to zqy.
4 versions - Latest release: about 9 years ago - 1 dependent repositories - 47 downloads last month - 1 maintainer
bendlog 0.1.0
Utilities for analyzing Databend logs
1 version - Latest release: 9 months ago - 32 downloads last month - 9,287 stars on GitHub - 1 maintainer
Top 9.9% on pypi.org
arvados-cwl-runner 3.2.1
Arvados Common Workflow Language runner
371 versions - Latest release: 7 months ago - 5 dependent repositories - 1.84 thousand downloads last month - 410 stars on GitHub - 1 maintainer
Top 8.1% on pypi.org
datafaker 0.7.6
A tool for generating batch test data or stream data.
51 versions - Latest release: about 5 years ago - 2 dependent repositories - 578 downloads last month - 644 stars on GitHub - 1 maintainer
dpark 0.5.0
Python clone of Spark, MapReduce like computing framework supporting iterative algorithms.
19 versions - Latest release: about 8 years ago - 1 dependent repositories - 91 downloads last month - 2,680 stars on GitHub - 2 maintainers
bdtool 9.0.0
script of managing some bigdata technology stack
11 versions - Latest release: over 4 years ago - 1 dependent repositories - 25 downloads last month - 0 stars on GitHub - 1 maintainer
panel-vegafusion 0.0.3
Build interactive big data apps with Altair and Vega easily using Panel + VegaFusion.
3 versions - Latest release: over 4 years ago - 1 dependent repositories - 22 downloads last month - 17 stars on GitHub - 1 maintainer
bart-simulator 0.2.1
Send event views to Google Analytics and Generator customers or products
4 versions - Latest release: almost 6 years ago - 1 dependent repositories - 59 downloads last month - 0 stars on GitHub - 1 maintainer
zqybxqtest 1.0.1
belongs to zqy.
1 version - Latest release: over 9 years ago - 1 dependent repositories - 11 downloads last month - 1 maintainer