pypi.org "apache-spark" keyword
View the packages on the pypi.org package registry that are tagged with the "apache-spark" keyword.
Top 3.3% on pypi.org
16 versions - Latest release: over 1 year ago - 3 dependent packages - 11 dependent repositories - 603 thousand downloads last month - 610 stars on GitHub - 1 maintainer
quinn 0.10.3
Pyspark helper methods to maximize developer efficiency16 versions - Latest release: over 1 year ago - 3 dependent packages - 11 dependent repositories - 603 thousand downloads last month - 610 stars on GitHub - 1 maintainer
google-dataproc-templates 0.1.0
Google Dataproc templates written in Python13 versions - Latest release: over 2 years ago - 165 downloads last month - 131 stars on GitHub - 3 maintainers
Top 0.2% on pypi.org
143 versions - Latest release: 13 days ago - 360 dependent packages - 5,089 dependent repositories - 20.4 million downloads last month - 17,453 stars on GitHub - 13 maintainers
mlflow 3.1.1
MLflow is an open source platform for the complete machine learning lifecycle143 versions - Latest release: 13 days ago - 360 dependent packages - 5,089 dependent repositories - 20.4 million downloads last month - 17,453 stars on GitHub - 13 maintainers
Top 0.6% on pypi.org
104 versions - Latest release: 13 days ago - 49 dependent packages - 70 dependent repositories - 18.5 million downloads last month - 17,453 stars on GitHub - 8 maintainers
mlflow-skinny 3.1.1
MLflow is an open source platform for the complete machine learning lifecycle104 versions - Latest release: 13 days ago - 49 dependent packages - 70 dependent repositories - 18.5 million downloads last month - 17,453 stars on GitHub - 8 maintainers
livyc 0.0.14 💰
Apache Livy Client11 versions - Latest release: about 3 years ago - 31 downloads last month - 3 stars on GitHub - 1 maintainer
Top 6.9% on pypi.org
13 versions - Latest release: 2 months ago - 1 dependent repositories - 501 thousand downloads last month - 758 stars on GitHub - 1 maintainer
sparkmeasure 0.25.0
Python API for sparkMeasure, a tool for performance troubleshooting of Apache Spark workloads.13 versions - Latest release: 2 months ago - 1 dependent repositories - 501 thousand downloads last month - 758 stars on GitHub - 1 maintainer
sparkmanager 0.7.3
A pyspark management framework21 versions - Latest release: over 5 years ago - 1 dependent repositories - 72 downloads last month - 0 stars on GitHub - 1 maintainer
Top 3.7% on pypi.org
38 versions - Latest release: almost 5 years ago - 2 dependent packages - 146 dependent repositories - 91.9 thousand downloads last month - 117 stars on GitHub - 1 maintainer
pyspark-stubs 3.0.0 💰
A collection of the Apache Spark stub files38 versions - Latest release: almost 5 years ago - 2 dependent packages - 146 dependent repositories - 91.9 thousand downloads last month - 117 stars on GitHub - 1 maintainer
fasttrackml 0.6.0
An experiment tracking server focused on speed and scalability25 versions - Latest release: about 1 year ago - 370 downloads last month - 105 stars on GitHub - 1 maintainer
pysparql 0.0.6
Query a SPARQL endpoint and manage the result with Spark2 versions - Latest release: over 4 years ago - 1 dependent repositories - 28 downloads last month - 0 stars on GitHub - 1 maintainer
Top 3.3% on pypi.org
24 versions - Latest release: 3 months ago - 2 dependent packages - 3 dependent repositories - 879 thousand downloads last month - 5,144 stars on GitHub - 1 maintainer
synapseml 1.0.11
Synapse Machine Learning24 versions - Latest release: 3 months ago - 2 dependent packages - 3 dependent repositories - 879 thousand downloads last month - 5,144 stars on GitHub - 1 maintainer
miss-lightgbm-mmlspark 1.0.0
Microsoft ML for Spark1 version - Latest release: about 1 year ago - 22 downloads last month - 5,144 stars on GitHub - 1 maintainer
dcborow-mmlspark 0.14.dev1
Microsoft ML for Spark1 version - Latest release: over 5 years ago - 1 dependent repositories - 82 downloads last month - 4,986 stars on GitHub - 1 maintainer
nozberkman-mmlspark 1.0.0
Microsoft ML for Spark1 version - Latest release: almost 4 years ago - 1 dependent repositories - 34 downloads last month - 4,472 stars on GitHub - 1 maintainer
Top 6.3% on pypi.org
81 versions - Latest release: 13 days ago - 3 dependent packages - 1 dependent repositories - 202 thousand downloads last month - 4,745 stars on GitHub - 1 maintainer
lakefs-sdk 1.61.0
lakeFS API81 versions - Latest release: 13 days ago - 3 dependent packages - 1 dependent repositories - 202 thousand downloads last month - 4,745 stars on GitHub - 1 maintainer
Top 3.2% on pypi.org
178 versions - Latest release: 7 months ago - 4 dependent packages - 5 dependent repositories - 154 thousand downloads last month - 4,745 stars on GitHub - 1 maintainer
lakefs-client 1.44.0
[legacy] lakeFS API178 versions - Latest release: 7 months ago - 4 dependent packages - 5 dependent repositories - 154 thousand downloads last month - 4,745 stars on GitHub - 1 maintainer
lakefs 0.11.1
lakeFS Python SDK Wrapper26 versions - Latest release: about 1 month ago - 1 dependent package - 49.5 thousand downloads last month - 4,745 stars on GitHub - 1 maintainer
pysparkgateway 0.0.22
Connect Pyspark to remote clusters18 versions - Latest release: over 4 years ago - 1 dependent repositories - 6.69 thousand downloads last month - 3 stars on GitHub - 1 maintainer
sparkdq 0.10.0
A declarative PySpark framework for row- and aggregate-level data quality validation.17 versions - Latest release: about 1 month ago - 211 downloads last month - 46 stars on GitHub - 1 maintainer
flintrock 2.1.0
A command-line tool for launching Apache Spark clusters.14 versions - Latest release: over 1 year ago - 1 dependent repositories - 415 downloads last month - 642 stars on GitHub - 1 maintainer
mlflow-tmp 2.2.26
MLflow: A Platform for ML Development and Productionization25 versions - Latest release: about 2 years ago - 140 downloads last month - 21,092 stars on GitHub - 1 maintainer
mlflow-devlibx 1.22.8
MLflow: A Platform for ML Development and Productionization9 versions - Latest release: over 3 years ago - 1 dependent repositories - 63 downloads last month - 21,092 stars on GitHub - 1 maintainer
mlflow-by-johnsnowlabs-v2 2.44.0
MLflow: A Platform for ML Development and Productionization9 versions - Latest release: almost 2 years ago - 78 downloads last month - 21,092 stars on GitHub - 1 maintainer
qubole-ml 1.9.1
MLflow: An ML Workflow Tool2 versions - Latest release: almost 5 years ago - 1 dependent repositories - 16 downloads last month - 21,092 stars on GitHub - 1 maintainer
mlflow-stonewise 1.30.1
MLflow: A Platform for ML Development and Productionization1 version - Latest release: over 2 years ago - 25 downloads last month - 21,092 stars on GitHub - 1 maintainer
lmcmlflow 1.17.1
MLflow: A Platform for ML Development and Productionization3 versions - Latest release: about 4 years ago - 1 dependent repositories - 13 downloads last month - 21,092 stars on GitHub - 1 maintainer
mlflow-no-ssl 2.16.3
MLflow is an open source platform for the complete machine learning lifecycle1 version - Latest release: 10 months ago - 36 downloads last month - 21,092 stars on GitHub - 1 maintainer
mlflow-saagie 2.9.2
MLflow: A Platform for ML Development and Productionization - forked for Saagie8 versions - Latest release: over 1 year ago - 1 dependent repositories - 46 downloads last month - 21,092 stars on GitHub - 1 maintainer
mlflow-tracing 3.1.0
MLflow Tracing SDK is an open-source, lightweight Python package that only includes the minimum s...4 versions - Latest release: 25 days ago - 781 downloads last month - 21,092 stars on GitHub - 5 maintainers
mlflow-by-johnsnowlabs 2.40.0
MLflow: A Platform for ML Development and Productionization35 versions - Latest release: over 1 year ago - 215 downloads last month - 16,113 stars on GitHub - 1 maintainer
mlflow-by-ckl 2.81.0
MLflow: A Platform for ML Development and Productionization44 versions - Latest release: about 1 year ago - 287 downloads last month - 16,113 stars on GitHub - 1 maintainer
mlflow-ste 1.10.1.dev0
MLflow: An ML Workflow Tool1 version - Latest release: almost 5 years ago - 1 dependent repositories - 19 downloads last month - 16,107 stars on GitHub - 1 maintainer
Top 7.5% on pypi.org
22 versions - Latest release: over 2 years ago - 1 dependent repositories - 913 downloads last month - 1,899 stars on GitHub - 1 maintainer
feathr 1.0.0
An Enterprise-Grade, High Performance Feature Store22 versions - Latest release: over 2 years ago - 1 dependent repositories - 913 downloads last month - 1,899 stars on GitHub - 1 maintainer
sparkora 0.0.1
Exploratory data analysis toolkit for Pyspark1 version - Latest release: over 3 years ago - 1 dependent repositories - 20 downloads last month - 53 stars on GitHub - 1 maintainer
Top 3.1% on pypi.org
8 versions - Latest release: over 6 years ago - 14 dependent repositories - 336 thousand downloads last month - 1,078 stars on GitHub - 5 maintainers
spark-sklearn 0.3.0
Integration tools for running scikit-learn on Spark8 versions - Latest release: over 6 years ago - 14 dependent repositories - 336 thousand downloads last month - 1,078 stars on GitHub - 5 maintainers
dead-salmon-brain 0.0.7
Dead Salmon Brain is a cluster computing system for analysing A/B experiments7 versions - Latest release: about 3 years ago - 1 dependent repositories - 215 downloads last month - 15 stars on GitHub - 1 maintainer
openaivec 0.8.10
Generative mutation for tabular calculation59 versions - Latest release: 19 days ago - 664 downloads last month - 13 stars on GitHub - 1 maintainer
Top 6.6% on pypi.org
19 versions - Latest release: about 8 years ago - 16 dependent repositories - 2.06 thousand downloads last month - 40 stars on GitHub - 3 maintainers
spylon 0.3.0
Utilities to work with Scala/Java code with py4j19 versions - Latest release: about 8 years ago - 16 dependent repositories - 2.06 thousand downloads last month - 40 stars on GitHub - 3 maintainers
graphframes-latest 0.8.3
GraphFrames: DataFrame-based Graphs1 version - Latest release: almost 2 years ago - 32 thousand downloads last month - 1,061 stars on GitHub - 1 maintainer
sparkql 0.10.0
sparkql: Apache Spark SQL DataFrame schema management for sensible humans20 versions - Latest release: almost 2 years ago - 1 dependent repositories - 6.92 thousand downloads last month - 13 stars on GitHub - 1 maintainer
laktory 0.8.0
An ETL and DataOps framework for building a lakehouse91 versions - Latest release: 9 days ago - 9.12 thousand downloads last month - 13 stars on GitHub - 1 maintainer
pypair 3.0.9 💰
Pairwise association measures of statistical variable types11 versions - Latest release: almost 4 years ago - 1 dependent repositories - 195 downloads last month - 22 stars on GitHub - 1 maintainer
aim-mlflow 0.2.1
Aim-MLflow integration4 versions - Latest release: about 2 years ago - 1 dependent repositories - 967 downloads last month - 20,464 stars on GitHub - 1 maintainer
spark-connect-proxy 0.0.11
A reverse proxy server which allows secure connectivity to a Spark Connect server8 versions - Latest release: 6 months ago - 53 downloads last month - 9 stars on GitHub - 1 maintainer
dbnet 0.2.5
DbNet.24 versions - Latest release: over 5 years ago - 1 dependent repositories - 60 downloads last month - 7 stars on GitHub - 1 maintainer
Top 7.6% on pypi.org
11 versions - Latest release: about 2 years ago - 2 dependent repositories - 413 downloads last month - 339 stars on GitHub - 1 maintainer
sparktorch 0.2.0
Distributed training of PyTorch networks on Apache Spark with ML Pipeline support11 versions - Latest release: about 2 years ago - 2 dependent repositories - 413 downloads last month - 339 stars on GitHub - 1 maintainer
sparkflow 0.7.0
Deep learning on Spark with Tensorflow13 versions - Latest release: about 6 years ago - 1 dependent repositories - 36 downloads last month - 296 stars on GitHub - 1 maintainer
Top 5.0% on pypi.org
5 versions - Latest release: about 10 years ago - 5 dependent repositories - 1.08 thousand downloads last month - 1,154 stars on GitHub - 3 maintainers
sparkit-learn 0.2.6
Scikit-learn on PySpark5 versions - Latest release: about 10 years ago - 5 dependent repositories - 1.08 thousand downloads last month - 1,154 stars on GitHub - 3 maintainers
spark-privacy-preserver 0.3.1
Anonymizing Library for Apache Spark4 versions - Latest release: almost 5 years ago - 1 dependent repositories - 24 downloads last month - 30 stars on GitHub - 3 maintainers
Top 3.8% on pypi.org
69 versions - Latest release: over 2 years ago - 1 dependent package - 34 dependent repositories - 45.8 thousand downloads last month - 269 stars on GitHub - 2 maintainers
pysparkling 0.6.2
Pure Python implementation of the Spark RDD interface.69 versions - Latest release: over 2 years ago - 1 dependent package - 34 dependent repositories - 45.8 thousand downloads last month - 269 stars on GitHub - 2 maintainers
mlflow-databricks-artifacts 2.0.1
Plugin to create and access MLflow-managed artifacts on Databricks3 versions - Latest release: over 2 years ago - 1 dependent repositories - 3.16 thousand downloads last month - 20,464 stars on GitHub - 2 maintainers
pyspark-analyzer 4.4.0
A comprehensive PySpark DataFrame profiler for generating detailed statistics and data quality re...16 versions - Latest release: 16 days ago - 1.27 thousand downloads last month - 0 stars on GitHub - 1 maintainer
mlflowcollab 0.0.4
Gebruik MLFlow op een centrale locatie1 version - Latest release: about 3 years ago - 1 dependent repositories - 8 downloads last month - 20,464 stars on GitHub - 1 maintainer
exelog 0.0.1
Enabling meticulous logging for Spark Applications1 version - Latest release: over 3 years ago - 1 dependent repositories - 8 downloads last month - 5 stars on GitHub - 1 maintainer
blind 0.0.1
Blind Client: The easiest ML tracking library1 version - Latest release: over 3 years ago - 2 dependent repositories - 27 downloads last month - 20,464 stars on GitHub - 1 maintainer
Top 9.0% on pypi.org
14 versions - Latest release: almost 4 years ago - 1 dependent repositories - 142 downloads last month - 92 stars on GitHub - 1 maintainer
jupyterlab-sparkmonitor 4.1.0
Spark Monitor Extension for Jupyter Lab14 versions - Latest release: almost 4 years ago - 1 dependent repositories - 142 downloads last month - 92 stars on GitHub - 1 maintainer
pyjaws 0.1.7
PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows10 versions - Latest release: almost 2 years ago - 1 dependent repositories - 28 downloads last month - 43 stars on GitHub - 1 maintainer
Top 7.8% on pypi.org
3 versions - Latest release: over 7 years ago - 1 dependent repositories - 293 downloads last month - 623 stars on GitHub - 1 maintainer
dist-keras 0.2.1
Distributed Deep learning with Apache Spark with Keras.3 versions - Latest release: over 7 years ago - 1 dependent repositories - 293 downloads last month - 623 stars on GitHub - 1 maintainer
k8s-spark-helper-liangdao-data 0.0.3
Run spark task in k8s3 versions - Latest release: over 2 years ago - 13 downloads last month - 2,914 stars on GitHub - 1 maintainer
mmtfpyspark 0.3.6
Methods for parallel and distributed analysis and mining of the Protein Data Bank using MMTF and ...10 versions - Latest release: over 6 years ago - 1 dependent repositories - 48 downloads last month - 67 stars on GitHub - 2 maintainers
pyspark-connectors 0.3.0
The easy and quickly way to connect and integrate the Spark project with many others data sources.9 versions - Latest release: about 1 year ago - 46 downloads last month - 6 stars on GitHub - 1 maintainer
pyspark-asyncactions 0.0.4 💰
A proof of concept asynchronous actions for PySpark using concurent.futures4 versions - Latest release: almost 5 years ago - 1 dependent repositories - 5.04 thousand downloads last month - 47 stars on GitHub - 1 maintainer
pyspark3d 0.3.1
Spark extension for processing large-scale 3D data sets4 versions - Latest release: over 6 years ago - 1 dependent repositories - 28 downloads last month - 30 stars on GitHub - 1 maintainer
pyspark-regression 4.1.0
A tool for regression testing Spark Dataframes in Python6 versions - Latest release: about 2 months ago - 18.1 thousand downloads last month - 1 stars on GitHub - 1 maintainer
chopin2 1.0.9
Supervised Classification with Hyperdimensional Computing13 versions - Latest release: about 1 year ago - 1 dependent repositories - 26 downloads last month - 12 stars on GitHub - 1 maintainer
cleanflow 1.3.3a1
A a framework for cleaning, pre-processing and exploring data in a scalable and distributed manner.11 versions - Latest release: about 7 years ago - 38 downloads last month - 1 stars on GitHub - 1 maintainer
sparkhistogram 0.4
Sparkhistogram contains helper functions for generating data histograms with the Spark DataFrame ...4 versions - Latest release: about 1 year ago - 1 dependent repositories - 155 downloads last month - 449 stars on GitHub - 1 maintainer
tpcds-pyspark 1.0.6
TPCDS_PySpark is a TPC-DS workload generator implemented in Python designed to run at scale using...6 versions - Latest release: about 1 month ago - 96 downloads last month - 449 stars on GitHub - 1 maintainer
test-cpu-parallel 1.0.5
test-CPU-parallel is a basic CPU workload generator.2 versions - Latest release: almost 2 years ago - 16 downloads last month - 449 stars on GitHub - 1 maintainer
patek 0.5.2
A collection of utilities and tools for accelerating pyspark development and productivity.7 versions - Latest release: over 2 years ago - 124 downloads last month - 0 stars on GitHub - 1 maintainer
spark-pipeline 0.0.4
Data Science oriented tools, mostly for Apache Spark2 versions - Latest release: about 5 years ago - 1 dependent repositories - 7 downloads last month - 9 stars on GitHub - 1 maintainer
gdmix-workflow 0.3.0
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.5 versions - Latest release: over 4 years ago - 1 dependent repositories - 12 downloads last month - 2,912 stars on GitHub - 1 maintainer
parallel-simulations 0.0.1
Helper class to orchestrate in parallel Monte Carlo simulations for an arbitrary number of models...1 version - Latest release: over 1 year ago - 6 downloads last month - 0 stars on GitHub - 1 maintainer
pybda 0.1.0
Analysis of big biological data sets for distributed HPC clusters.6 versions - Latest release: almost 6 years ago - 1 dependent repositories - 26 downloads last month - 9 stars on GitHub - 1 maintainer
svm 0.1.0
Version manager for Apache Spark2 versions - Latest release: over 7 years ago - 14 dependent repositories - 988 downloads last month - 1 stars on GitHub - 1 maintainer
eleflow-spark-integrations 0.0.1a2
The easy and quickly way to connect and integrate the Spark project with many others data sources.2 versions - Latest release: about 3 years ago - 6 stars on GitHub
Top 6.8% on pypi.org
2 versions - Latest release: over 2 years ago - 40 stars on GitHub
dataproc-templates 0.0.2
Dataproc templates written in Python2 versions - Latest release: over 2 years ago - 40 stars on GitHub
jennytest 0.2.9 removed
Data quality and profiling tool powered by Apache Spark.5 versions - Latest release: almost 5 years ago - 39 downloads last month
Related Keywords
spark
31
machine-learning
31
pyspark
28
ml
23
ai
23
databricks
21
python
19
mlflow
19
model-management
18
data-science
9
data-engineering
9
big-data
9
scala
8
deep-learning
7
data-quality
6
azure
6
apache
4
dataframe
4
mlops
4
cognitive-services
4
database
4
http
4
lightgbm
4
synapse
4
opencv
4
microsoft
4
onnx
4
model-deployment
4
data-lake
3
tensorflow
3
data-version-control
3
data-versioning
3
statistics
3
azure-storage
3
azure-blob-storage
3
aws-s3
3
apache-sparksql
3
lakeFS API
3
OpenAPI
3
OpenAPI-Generator
3
gcp
3
jupyter-notebook
3
machine learning
3
bigdata
3
oracle
3
object-storage
3
lakefs
3
hadoop-filesystem
3
google-cloud-storage
3
performance-testing
3
performance-monitoring
3
performance-analysis
3
jupyter-notebooks
3
golang
3
go
3
git-for-data
3
datalakes
3
sql
3
datalake
3
pipedrive
2
activecampaign
2
googlesheet
2
restapi
2
connectors
2
bigquery
2
workflow
2
machinelearning
2
analytics
2
dataframes
2
scikit-learn
2
jupyter
2
python3
2
google-cloud-dataproc
2
kubernetes
2
kubernetes-controller
2
kubernetes-crd
2
kubernetes-operator
2
data-analysis
2
data
2
preprocessing
2
scientific-computing
2
integrator
2
connector
2
cosmosdb
2
nosql
2
sqlserver
2
orchestration
2
mysql
2
postgres
2
mariadb
2
google-cloud
2
google-cloud-platform
2
aws
2
monitoring
2
metrics
2
deep learning
2
distributed-computing
2
pipeline
2
pytorch
2
data-pipeline
2