**DeepSpeed**[220] is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. DeepSpeed enables world's most powerful language models like MT-530B and BLOOM. It is an easy-to-use deep learning optimization software suite that powers unprecedented scale and speed for both training and inference.