distributed_computing

문서의 이전 판입니다!

목차

Distributed Computing
- Distribued SGD
- Streaming processing

Distributed Computing

Neural MMO v1.3: A Massively Multiagent Game Environment for Training and Evaluating Neural Networks, 2020-02
- OpenAI, NeuralMMO
Dota 2 with Large Scale Deep Reinforcement Learning, 2019-12
- OpenAI, OpenAI Five, Dota
PyTorch Multi-GPU 제대로 학습하기-당근마켓

Distribued SGD

ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters
- Microsoft, DeepSpeed, pytorch, Language Model
NCCL
- Nvidia
https://www.fast.ai/2018/08/10/fastai-diu-imagenet/

Streaming processing

https://github.com/robinhood/faust

distributed_computing.1587918537.txt.gz · 마지막으로 수정됨: 2024/03/23 02:37 (바깥 편집)