voir sur tomshardware.com : Baidu's 'Ring Allreduce' Library Increases Machine Learning Efficiency Across Many GPU Nodes