The algorithm we study in the context of the above system model is
dual averaging [1]}, [2]}.
We first describe the distributed dual averaging without stale gradients
(i.e., when \(T_{c}=0\) ). Then, we explain the delayed-gradient-based
variant.
