conda-forge.org "spark" keyword
datacompy 0.8.3
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!9 versions - Latest release: about 4 years ago - 1 dependent repositories - 146 thousand downloads total - 669 stars on GitHub
h2o-py 3.38.0.2
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gra...31 versions - Latest release: about 4 years ago - 7,521 stars on GitHub
r-h2o 3.38.0.1
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gra...11 versions - Latest release: about 4 years ago - 97.3 thousand downloads total - 7,521 stars on GitHub
pixiedust 1.1.19
Python Helper library for Jupyter Notebooks3 versions - Latest release: almost 6 years ago - 1 dependent repositories - 80.6 thousand downloads total - 1,042 stars on GitHub
r-sparkr 3.3.1
Apache Spark - A unified analytics engine for large-scale data processing9 versions - Latest release: about 4 years ago - 44,392 stars on GitHub
splink 1.0.6
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends16 versions - Latest release: over 5 years ago - 119 thousand downloads total - 2,551 stars on GitHub
delta-sharing-python 0.5.2
An open protocol for secure data sharing6 versions - Latest release: about 4 years ago - 960 stars on GitHub
sqlglot 10.0.6
Python SQL Parser and Transpiler131 versions - Latest release: almost 4 years ago - 2 dependent packages - 1.11 million downloads total - 9,765 stars on GitHub
fugue 0.7.3
Fugue is a unified interface for distributed computing that lets users execute Python, pandas, an...8 versions - Latest release: about 4 years ago - 4 dependent repositories - 2,166 stars on GitHub
mage-ai 0.7.5
🧙 Build, run, and manage data pipelines for integrating and transforming data.22 versions - Latest release: almost 4 years ago - 8,843 stars on GitHub
traceml 1.0.0
Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards fo...1 version - Latest release: over 4 years ago - 12.6 thousand downloads total - 533 stars on GitHub
flytekitplugins-spark 1.0.5
Spark 3 plugin for Flytekit: `flytekitplugins-spark` PyPI: [https://pypi.org/project/flytekitplu...1 version - Latest release: over 4 years ago - 2.36 thousand downloads total - 321 stars on GitHub
flytekitplugins-athena 1.2.4
Athena plugin for Flytekit: `flytekitplugins-athena` PyPI: [https://pypi.org/project/flytekitplu...8 versions - Latest release: almost 4 years ago - 20.9 thousand downloads total - 321 stars on GitHub
flytekit 1.1.0
Flytekit Python is the Python Library for easily authoring, testing, deploying, and interacting w...4 versions - Latest release: over 4 years ago - 8 dependent packages - 139 thousand downloads total - 321 stars on GitHub
flytekitplugins-awsbatch 1.2.4
AWS Batch plugin for Flytekit: `flytekitplugins-awsbatch` PyPI: [https://pypi.org/project/flytek...9 versions - Latest release: almost 4 years ago - 22.8 thousand downloads total - 321 stars on GitHub
flytekitplugins-modin 1.2.4
Modin plugin for Flytekit: `flytekitplugins-modin` PyPI: [https://pypi.org/project/flytekitplugi...9 versions - Latest release: almost 4 years ago - 23 thousand downloads total - 321 stars on GitHub
flytekitplugins-sqlalchemy 1.2.4
SQLAlchemy plugin for Flytekit: `flytekitplugins-sqlalchemy` PyPI: [https://pypi.org/project/fly...8 versions - Latest release: almost 4 years ago - 20.9 thousand downloads total - 321 stars on GitHub
flytekitplugins-pandera 1.2.4
Pandera plugin for Flytekit: `flytekitplugins-pandera` PyPI: [https://pypi.org/project/flytekitp...7 versions - Latest release: almost 4 years ago - 18.7 thousand downloads total - 321 stars on GitHub
graphframes 0.6
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs1 version - Latest release: almost 6 years ago - 3 dependent repositories - 1,212 stars on GitHub
sagemaker_pyspark 1.4.2
A Spark library for Amazon SageMaker.12 versions - Latest release: over 5 years ago - 48 thousand downloads total - 301 stars on GitHub
pyspark-test 0.2.0
Testing library for pyspark, inspired from pandas testing module but for pyspark, to help users w...2 versions - Latest release: about 5 years ago - 12.7 thousand downloads total - 21 stars on GitHub
flytekitplugins-data-fsspec 1.2.4
`fsspec` powered data-plugins for Flytekit: `flytekitplugins-data-fsspec` PyPI: [https://pypi.or...8 versions - Latest release: almost 4 years ago - 20.6 thousand downloads total - 321 stars on GitHub
visions 0.7.5
Type System for Data Analysis in Python12 versions - Latest release: almost 5 years ago - 2 dependent packages - 13 dependent repositories - 513 thousand downloads total - 223 stars on GitHub
mleap 0.21.0
MLeap: Deploy ML Pipelines to Production9 versions - Latest release: about 4 years ago - 1 dependent package - 109 thousand downloads total - 1,545 stars on GitHub
elephas 2.1.0 💰
Distributed Deep learning with Keras & Spark4 versions - Latest release: over 5 years ago - 19.8 thousand downloads total - 1,574 stars on GitHub
koalas 1.8.2
Koalas: pandas API on Apache Spark42 versions - Latest release: about 5 years ago - 1 dependent package - 459 thousand downloads total - 3,371 stars on GitHub
tensorflowonspark 2.2.5
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.10 versions - Latest release: about 4 years ago - 33.6 thousand downloads total - 3,848 stars on GitHub
hdijupyterutils 0.20.0
Jupyter magics and kernels for working with remote Spark clusters10 versions - Latest release: over 4 years ago - 4 dependent packages - 1 dependent repositories - 1,366 stars on GitHub
jupyter_enterprise_gateway 3.0.0
Jupyter Enterprise Gateway A lightweight, multi-tenant, scalable and secure gateway that enables ...23 versions - Latest release: about 4 years ago - 668 stars on GitHub
glow 1.0.1
Glow is an open-source toolkit for working with genomic data at biobank-scale and beyond. The too...2 versions - Latest release: over 5 years ago - 3 dependent repositories - 8.26 thousand downloads total - 309 stars on GitHub
zappy 0.2.0
Distributed processing with NumPy and Zarr2 versions - Latest release: almost 8 years ago - 1 dependent repositories - 9 stars on GitHub
autovizwidget 0.20.0
Jupyter magics and kernels for working with remote Spark clusters12 versions - Latest release: over 4 years ago - 3 dependent packages - 1 dependent repositories - 1,366 stars on GitHub
sparkmagic 0.20.0
Jupyter magics and kernels for working with remote Spark clusters17 versions - Latest release: over 4 years ago - 2 dependent repositories - 1,366 stars on GitHub
sparkhpc 0.3.post4
launching and controlling spark on hpc clusters1 version - Latest release: over 7 years ago - 5.54 thousand downloads total - 23 stars on GitHub
r-sparkxgb 0.1.1
R interface for XGBoost on Spark2 versions - Latest release: over 5 years ago - 43.5 thousand downloads total - 46 stars on GitHub
Related Keywords
python
21
data-science
17
data
10
hacktoberfest
10
mlops
9
workflows
8
sdk
8
pypi
8
flyte-tasks
8
flyte
8
machine-learning
8
extensible
8
automation
8
pyspark
6
pandas
6
big-data
6
jupyter-notebook
5
sql
4
kernel
4
jupyter
4
cluster
4
scala
4
r
4
dask
4
deep-learning
3
distributed
3
notebook
3
dataframe
3
tensorflow
3
distributed-computing
3
java
3
kerberos
3
sql-query
3
dataframes
3
livy
3
pandas-dataframe
3
numpy
3
magic
3
duckdb
2
apache-spark
2
data-engineering
2
data-pipelines
2
gbm
2
naive-bayes
2
h2o-automl
2
automl
2
snowflake
2
hadoop
2
h2o
2
ensemble-learning
2
random-forest
2
pca
2
opensource
2
gpu
2
transformers
1
artificial-intelligence
1
data-integration
1
dbt
1
elt
1
etl
1
orchestration
1
pipeline
1
python-notebook
1
scikit-learn
1
slurm
1
lsf
1
hpc-cluster
1
tsql
1
trino
1
transpiler
1
sqlparser
1
sqlite
1
redshift
1
presto
1
postgres
1
parser
1
pixiedust
1
scala-notebooks
1
visualization
1
connected-components
1
graphs
1
network-motif
1
network-motifs
1
networks
1
distributed-systems
1
data-practitioners
1
jdbc
1
yahoo
1
featured
1
type-system
1
type-inference
1
data-analysis
1
zarr
1
pywren
1
human-cell-atlas
1
beam
1
neural-networks
1
keras
1
pydata
1
mlflow
1