Ecosyste.ms: Packages

data-parallelism 9 pipeline-parallelism 9 deep-learning 8 pytorch 5 large-scale 5 distributed-training 4 inference 4 unsupervised-learning 3 self-supervised-learning 3 pretraining 3 paddlepaddle 3 mixture-of-experts 3 paddlecloud 3 lightning 3 fleet-api 3 elastic 3 distributed-algorithm 3 distributed-computing 3 cloud 3 benchmark 3 tensor-parallelism 2 zero 2 trillion-parameters 2 machine-learning 2 gpu 2 compression 2 billion-parameters 2 hpc 2 heterogeneous-training 2 foundation-models 2 big-model 2 ai 2 ray 1 parameter-server 1 heterogeneity 1 distributed 1 stable-diffusion 1 seq2seq 1 reinforcement-learning 1 sparsity 1 online-training 1 batch-training 1 easy-to-use 1 parallelism 1 checkpointing 1 gpipe 1 3d-parallelism 1 distributed-optimizers 1 huggingface-transformers 1 large-scale-language-modeling 1 megatron 1 megatron-lm 1 moe 1 sequence-parallelism 1 transformers 1 zero-1 1 diffusion-models 1 fedavg 1 federated-learning 1 flan-t5-xxl 1 flax 1 gemma 1 image-captioning 1 jax 1 large-language-models 1 llama 1 maml 1 meta-learning 1 mistral 1 mlsys 1 ppo 1