====== DiLoCo =======

  * [[https://arxiv.org/abs/2506.10911|NoLoCo: No-all-reduce Low Communication Training Method for Large Models 2025-06-12]]