pypi.org "data-parallelism" keyword
Top 0.3% on pypi.org
136 versions - Latest release: 8 days ago - 109 dependent packages - 3,724 dependent repositories - 1.26 million downloads last month - 43,349 stars on GitHub - 3 maintainers
deepspeed 0.20.0
DeepSpeed library136 versions - Latest release: 8 days ago - 109 dependent packages - 3,724 dependent repositories - 1.26 million downloads last month - 43,349 stars on GitHub - 3 maintainers
pipegoose 0.2.0
Large scale 4D parallelism pre-training for 🤗 transformers for Mixture of Experts *(still work in...2 versions - Latest release: about 3 years ago - 19 downloads last month - 88 stars on GitHub - 1 maintainer
custom-colossalai 0.4.9.3
An integrated large-scale model training system with efficient parallelization techniques16 versions - Latest release: over 1 year ago - 37 downloads last month - 41,425 stars on GitHub - 1 maintainer
Top 1.7% on pypi.org
39 versions - Latest release: over 1 year ago - 9 dependent packages - 63 dependent repositories - 6.2 thousand downloads last month - 41,425 stars on GitHub - 1 maintainer
colossalai 0.5.0
An integrated large-scale model training system with efficient parallelization techniques39 versions - Latest release: over 1 year ago - 9 dependent packages - 63 dependent repositories - 6.2 thousand downloads last month - 41,425 stars on GitHub - 1 maintainer
colossalai-nightly 2025.7.12
An integrated large-scale model training system with efficient parallelization techniques116 versions - Latest release: over 1 year ago - 99 downloads last month - 41,425 stars on GitHub - 1 maintainer
paddle-fleet 0.1.1
Distributed Training Package Based on PaddlePaddle1 version - Latest release: almost 7 years ago - 1 dependent repositories - 41 downloads last month - 484 stars on GitHub - 1 maintainer
fleet-x 0.0.8
飞桨大模型开发套件,提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。9 versions - Latest release: about 6 years ago - 1 dependent repositories - 84 downloads last month - 484 stars on GitHub - 1 maintainer
fleet-lightning 0.0.3
飞桨大模型开发套件,提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。4 versions - Latest release: over 6 years ago - 1 dependent repositories - 56 downloads last month - 484 stars on GitHub - 1 maintainer
Top 7.8% on pypi.org
3 versions - Latest release: about 9 years ago - 1 dependent repositories - 145 downloads last month - 622 stars on GitHub - 1 maintainer
dist-keras 0.2.1
Distributed Deep learning with Apache Spark with Keras.3 versions - Latest release: about 9 years ago - 1 dependent repositories - 145 downloads last month - 622 stars on GitHub - 1 maintainer
veloce 0.0.1rc2
Veloce: An instant distributed computing library based on Ray stack3 versions - Latest release: over 4 years ago - 1 dependent repositories - 16 downloads last month - 17 stars on GitHub - 1 maintainer
adeepspeed 0.9.2
DeepSpeed library1 version - Latest release: over 3 years ago - 51 downloads last month - 43,108 stars on GitHub - 1 maintainer
Related Keywords
model-parallelism
10
deep-learning
9
pipeline-parallelism
9
large-scale
6
inference
5
distributed-computing
4
distributed-training
3
benchmark
3
cloud
3
distributed-algorithm
3
elastic
3
fleet-api
3
lightning
3
paddlecloud
3
paddlepaddle
3
pretraining
3
self-supervised-learning
3
unsupervised-learning
3
ai
3
big-model
3
pytorch
3
mixture-of-experts
3
machine-learning
3
foundation-models
3
heterogeneous-training
3
hpc
3
billion-parameters
2
compression
2
gpu
2
trillion-parameters
2
zero
2
distributed-optimizers
2
parameter-server
1
ray
1
sparsity
1
Keras
1
Deep Learning
1
Machine Learning
1
Theano
1
Tensorflow
1
Distributed
1
Apache Spark
1
apache-spark
1
data-science
1
hadoop
1
keras
1
optimization-algorithms
1
tensorflow
1
heterogeneity
1
distributed
1
3d-parallelism
1
huggingface-transformers
1
large-scale-language-modeling
1
megatron
1
megatron-lm
1
moe
1
sequence-parallelism
1
tensor-parallelism
1
transformers
1
zero-1
1
online-training
1
batch-training
1
easy-to-use
1