Message Compression

Adaptive multi-hierarchical signSGD for communication-efficient distributed optimization
In this work, we investigate a communication-efficient multi-hierarchical signSGD (MH-signSGD) algorithm with an adaptive learning …
Haibo Yang, Xin Zhang, Minghong Fang, Jia Liu
PDF Cite
Compressed distributed gradient descent: Communication-efficient consensus over networks
Network consensus optimization has received in- creasing attention in recent years and has found important appli- cations in many …
Xin Zhang, Jia Liu, Zhengyuan Zhu, Elizabeth S. Bentley
PDF Cite