Bringing HPC Techniques to Deep Learning - Baidu Research

Research
1

http://research.baidu.com/bringing-hpc-techniques-deep-learning/

Interesting read from Baidu Research about applying the ring allreduce algorithm to neural networks multi-GPU training.

2

really interesting - thanks @guillaumekln - potential linear scale-up for multi-gpu:

scaling.png800×600 13.9 KB