This paper investigates the asymptotic and non-asymptotic behavior of the quantized primal dual algorithm in network utility maximization problems, in which a group of agents maximize the sum of their individual concave objective functions under linear constraints. In the asymptotic scenario, we use the information theoretic notion of differential entropy power to establish universal lower bounds on the exponential convergence rates of joint primal dual, primal and dual variables under optimum achieving quantization schemes. These results provide trade offs between the speed of exponential convergence, the agents objective functions, the communication bit rates, and the number of agents and constraints. In the non-asymptotic scenario, we obtain lower bounds on the mean square distance of joint primal dual, primal and dual variables from the optimal solution for any finite time instance. These bounds hold regardless of the quantization scheme used.
In @cite_0 , we studied the convergence behavior of the PD algorithm in a quadratic NUM problem under quantized communications. In the current paper, the objective functions of agents belong to the class of concave and twice continuously differentiable functions. This complicates our analysis as the PD update rule becomes non-linear in primal variables. Here, we study the impact of quantized communications on the convergence behavior of variables in both regimes.
@cite_0
2962776448
This paper examines the effect of quantized communications on the convergence behavior of the primal-dual algorithm in quadratic network utility maximization problems with linear equality constraints. In our set-up, it is assumed that the primal variables are updated by individual agents, whereas the dual variables are updated by a central entity, called system, which has access to the parameters quantifying the system-wide constraints. The notion of differential entropy power is used to establish a universal lower bound on the rate of exponential mean square convergence of the primal-dual algorithm under quantized message passing between agents and the system. The lower bound is controlled by the average aggregate data rate under the quantization, the curvature of the utility functions of agents, the number of agents and the number of constraints. An adaptive quantization scheme is proposed under which the primal-dual algorithm converges to the optimal solution despite quantized communications between agents and the system. Finally, the rate of exponential convergence of the primal-dual algorithm under the proposed quantization scheme is numerically studied.