Stochastic Gradient Descent

Adaptive multi-hierarchical signSGD for communication-efficient distributed optimization

In this work, we investigate a communication-efficient multi-hierarchical signSGD (MH-signSGD) algorithm with an adaptive learning …

Haibo Yang, Xin Zhang, Minghong Fang, Jia Liu