Ecosyste.ms: Packages

deep-learning 9 model-parallelism 9 data-parallelism 8 large-scale 5 pytorch 5 inference 4 machine-learning 4 distributed-training 3 benchmark 3 cloud 3 distributed-algorithm 3 elastic 3 tensor-parallelism 3 fleet-api 3 lightning 3 paddlecloud 3 paddlepaddle 3 pretraining 3 self-supervised-learning 3 unsupervised-learning 3 mixture-of-experts 3 zero 2 trillion-parameters 2 gpu 2 compression 2 billion-parameters 2 bloom 2 chatbot 2 distributed-systems 2 falcon 2 gpt 2 guanaco 2 language-models 2 large-language-models 2 llama 2 llama2 2 neural-networks 2 nlp 2 pretrained-models 2 transformer 2 volunteer-computing 2 ai 2 big-model 2 distributed-computing 2 foundation-models 2 heterogeneous-training 2 hpc 2 gpipe 1 checkpointing 1 parallelism 1 zero-1 1 transformers 1 sequence-parallelism 1 moe 1 megatron-lm 1 megatron 1 large-scale-language-modeling 1 huggingface-transformers 1 distributed-optimizers 1 3d-parallelism 1 easy-to-use 1 batch-training 1 online-training 1