====== TorchShard ====== * https://medium.com/pytorch/torchshard-a31fcbfdc354 {{tag>pytorch model_parallel memory_optimization}}