Out of the Box

이 문서는 읽기 전용입니다. 원본을 볼 수는 있지만 바꿀 수는 없습니다. 문제가 있다고 생각하면 관리자에게 문의하세요.

====== Distributed Computing ======

  * [[https://arxiv.org/pdf/2001.12004.pdf|Neural MMO v1.3: A Massively Multiagent Game Environment
for Training and Evaluating Neural Networks, 2020-02]]
    * OpenAI, NeuralMMO
  * [[https://arxiv.org/pdf/1912.06680.pdf|Dota 2 with Large Scale Deep Reinforcement Learning, 2019-12]]
    * OpenAI, OpenAI Five, Dota
  * [[https://medium.com/daangn/pytorch-multi-gpu-%ED%95%99%EC%8A%B5-%EC%A0%9C%EB%8C%80%EB%A1%9C-%ED%95%98%EA%B8%B0-27270617936b|PyTorch Multi-GPU 제대로 학습하기-당근마켓]]

  * http://mpi4py.scipy.org/docs/usrman/index.html
  * https://ray.readthedocs.io/en/latest/
    * https://ray-project.github.io/
    * https://modin.readthedocs.io/en/latest/
    * https://arrow.apache.org/docs/index.html
      * https://arrow.apache.org/
      * https://ray-project.github.io/2017/10/15/fast-python-serialization-with-ray-and-arrow.html


===== Distribued SGD =====

  * [[https://www.microsoft.com/en-us/research/blog/zero-deepspeed-new-system-optimizations-enable-training-models-with-over-100-billion-parameters/|ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters]]
    * Microsoft, DeepSpeed, pytorch, Language Model
  * [[https://devblogs.nvidia.com/fast-multi-gpu-collectives-nccl/|NCCL]]
    * Nvidia
  * https://www.fast.ai/2018/08/10/fastai-diu-imagenet/
  * [[http://seba1511.net/dist_blog/#ref-gorila|An Introduction to Distributed Deep Learning, 2016-12]]

===== Streaming processing =====

  * https://github.com/robinhood/faust