Decentralized Learning

PRECISION: Decentralized Constrained Min-Max Learning with Low Communication and Sample Complexities
Recently, min-max optimization problems have received increasing attention due to their wide range of applications in machine learning …
Zhuqing Liu, Xin Zhang, Songtao Lu, Jia Liu
PDF Cite
Prometheus: Taming Sample and Communication Complexities in Constrained Decentralized Stochastic Bilevel Learning
In recent years, decentralized bilevel optimization has gained significant attention thanks to its versatility in modeling a wide range …
Zhuqing Liu, Xin Zhang, Prashant Khanduri, Songtao Lu, Jia Liu
PDF Cite
INTERACT: Achieving Low Sample and Communication Complexities in Decentralized Bilevel Learning over Networks
In recent years, decentralized bilevel optimization problems have received increasing attention in the networking and machine learning …
Zhuqing Liu, Xin Zhang, Prashant Khanduri, Songtao Lu, Jia Liu
PDF Cite
NET-FLEET: Achieving linear convergence speedup for fully decentralized federated learning with heterogeneous data
Federated learning (FL) has received a surge of interest in recent years thanks to its benefits in data privacy protection, efficient …
Xin Zhang, Minghong Fang, Zhuqing Liu, Haibo Yang, Jia Liu, Zhengyuan Zhu
PDF Cite
GT-STORM: Taming sample, communication, and memory complexities in decentralized non-convex learning
Decentralized nonconvex optimization has received increasing attention in recent years in machine learning due to its advantages in …
Xin Zhang, Jia Liu, Zhengyuan Zhu, Elizabeth Serena Bentley
PDF Cite
Low Sample and Communication Complexities in Decentralized Learning: A Triple Hybrid Approach
Decentralized optimization has received increasing attention in recent years, due to its advantages in system robustness, data privacy …
Xin Zhang, Jia Liu, Zhengyuan Zhu, Elizabeth Serena Bentley
PDF Cite
Private and communication-efficient edge learning: a sparse differential gaussian-masking distributed SGD approach
With rise of machine learning (ML) and the proliferation of smart mobile devices, recent years have witnessed a surge of interest in …
Xin Zhang, Minghong Fang, Jia Liu, Zhengyuan Zhu
PDF Cite
Compressed distributed gradient descent: Communication-efficient consensus over networks
Network consensus optimization has received in- creasing attention in recent years and has found important appli- cations in many …
Xin Zhang, Jia Liu, Zhengyuan Zhu, Elizabeth S. Bentley
PDF Cite