====== Pytorch: DeepSpeed ======

  * https://www.deepspeed.ai/
  * https://github.com/microsoft/DeepSpeed

{{tag>Microsoft DeepSpeed ZeRO ZeRO-Offload distributed_computing 1-bit_adam}}