Don't Use Large Mini-Batches, Use Local SGD
https://arxiv.org/abs/1808.07217
Batch Size
,
Batch
,
Distributed Computing
,
2020
,
Local SGD
,
Post Local SGD