Proximal nested primal-dual gradient algorithms for distributed constraint-coupled composite optimization
Authors: 
Jingwang Li, Qing An, Housheng SuAuthors Info & Claims
References
[1]
T. Yang, X. Yi, J. Wu, Y. Yuan, D. Wu, Z. Meng, Y. Hong, H. Wang, Z. Lin, K.H. Johansson, A survey of distributed optimization, Annu. Rev. Control 47 (2019) 278–305.
[2]
J. Li, L. Ji, H. Li, Optimal consensus control for unknown second-order multi-agent systems: using model-free reinforcement learning method, Appl. Math. Comput. 410 (2021) 126451.
[3]
W. Guo, W. He, L. Shi, W. Sun, X. Lu, Fixed-time consensus tracking for nonlinear stochastically disturbed multi-agent systems via discontinuous protocols, Appl. Math. Comput. 400 (2021) 126046.
[4]
H. Iiduka, Distributed optimization for network resource allocation with nonsmooth utility functions, IEEE Trans. Control Netw. Syst. 6 (4) (2018) 1354–1365.
[5]
Y. Chen, A. Bernstein, A. Devraj, S. Meyn, Model-free primal-dual methods for network optimization with application to real-time optimal power flow, 2020 American Control Conference (ACC), IEEE, 2020, pp. 3140–3147.
[6]
A. Cherukuri, J. Cortés, Initialization-free distributed coordination for economic dispatch under varying loads and generator commitment, Automatica 74 (2016) 183–193.
[7]
S.S. Kia, Distributed optimal in-network resource allocation algorithm design via a control theoretic approach, Syst. Control Lett. 107 (2017) 49–57.
[8]
P. Yi, Y. Hong, F. Liu, Initialization-free distributed algorithms for optimal resource allocation with feasibility constraints and application to economic dispatch of power systems, Automatica 74 (2016) 259–269.
[9]
Y. Zhu, W. Ren, W. Yu, G. Wen, Distributed resource allocation over directed graphs via continuous-time algorithms, IEEE Trans. Syst. Man Cybern.Syst. 51 (2) (2019) 1097–1106.
[10]
J. Zhang, K. You, K. Cai, Distributed dual gradient tracking for resource allocation in unbalanced networks, IEEE Trans. Signal Process. 68 (2020) 2186–2198.
[11]
Z. Zhao, J. Guo, C.S. Lai, H. Xiao, K. Zhou, L.L. Lai, Distributed model predictive control strategy for islands multimicrogrids based on noncooperative game, IEEE Trans. Ind. Inf. 17 (6) (2020) 3803–3814.
[12]
C.E. Luis, M. Vukosavljev, A.P. Schoellig, Online trajectory generation with distributed model predictive control for multi-robot motion planning, IEEE Rob. Autom. Lett. 5 (2) (2020) 604–611.
[13]
J. Wang, C. Yang, J. Xia, Z.-G. Wu, H. Shen, Observer-based sliding mode control for networked fuzzy singularly perturbed systems under weighted try-once-discard protocol, IEEE Trans. Fuzzy Syst. (2021).
[14]
H. Shen, X. Hu, J. Wang, J. Cao, W. Qian, Non-fragile H ∞ synchronization for Markov jump singularly perturbed coupled neural networks subject to double-layer switching regulation, IEEE Trans. Neural Netw. Learn. Syst. (2021).
[15]
A. Nedić, A. Olshevsky, W. Shi, Improved convergence rates for distributed resource allocation, 2018 IEEE Conference on Decision and Control, IEEE, 2018, pp. 172–177.
[16]
J. Wang, N. Elia, Control approach to distributed optimization, 2010 48th Annual Allerton Conference on Communication, Control, and Computing, IEEE, 2010, pp. 557–561.
[17]
W. Shi, Q. Ling, G. Wu, W. Yin, Extra: an exact first-order algorithm for decentralized consensus optimization, SIAM J. Optim. 25 (2) (2015) 944–966.
[18]
J. Li, H. Su, Nested primal-dual gradient algorithms for distributed constraint-coupled optimization, 2022, arXiv preprint: 2205.11119,
[19]
K. Sakurama, M. Miura, Distributed constraint optimization on networked multi-agent systems, Appl. Math. Comput. 292 (2017) 272–281.
[20]
S. Liang, X. Zeng, G. Chen, Y. Hong, Distributed sub-optimal resource allocation via a projected form of singular perturbation, Automatica 121 (2020) 109180.
[21]
X. Li, X. Yi, L. Xie, Distributed online optimization for multi-agent networks with coupled inequality constraints, IEEE Trans. Automat. Control 66 (8) (2020) 3575–3591.
[22]
J. Li, H. Su, Implicit tracking-based distributed constraint-coupled optimization, IEEE Trans. Control Netw. Syst. (2022),.
[23]
A. Falsone, I. Notarnicola, G. Notarstefano, M. Prandini, Tracking-ADMM for distributed constraint-coupled optimization, Automatica 117 (2020) 108962.
[24]
D.P. Bertsekas, J.N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods, Prentice-Hall, Inc., 1989.
[25]
M. Zhu, S. Martínez, Discrete-time dynamic average consensus, Automatica 46 (2) (2010) 322–329.
[26]
Y. Su, Q. Wang, C. Sun, Distributed primal-dual method for convex optimization with coupled constraints, IEEE Trans. Signal Process. 70 (2022) 523–535.
[27]
A. Falsone, M. Prandini, A distributed dual proximal minimization algorithm for constraint-coupled optimization problems, IEEE Control Syst. Lett. 5 (1) (2020) 259–264.
[28]
A. Camisa, I. Notarnicola, G. Notarstefano, Distributed primal decomposition for large-scale milps, IEEE Trans. Automat. Control 67 (1) (2021) 413–420.
[29]
A. Camisa, I. Notarnicola, G. Notarstefano, Distributed stochastic dual subgradient for constraint-coupled optimization, IEEE Control Syst. Lett. 6 (2021) 644–649.
[30]
T. Chang, M. Hong, X. Wang, Multi-agent distributed optimization via inexact consensus ADMM, IEEE Trans. Signal Process. 63 (2) (2014) 482–497.
[31]
S.A. Alghunaim, K. Yuan, A.H. Sayed, A proximal diffusion strategy for multiagent optimization with sparse affine constraints, IEEE Trans. Automat. Control 65 (11) (2019) 4554–4567.
[32]
Y. Nesterov, Lectures on Convex optimization, Vol. 137, Springer, 2018.
[33]
X. Chen, W. Liu, X. Mao, Z. Yang, Distributed high-dimensional regression under a quantile loss function, J. Mach. Learn. Res. 21 (2020).
[34]
E. Camponogara, D. Jia, B.H. Krogh, S. Talukdar, Distributed model predictive control, IEEE Control Syst. Mag. 22 (1) (2002) 44–52.
[35]
Y. Zheng, S.E. Li, K. Li, F. Borrelli, J.K. Hedrick, Distributed model predictive control for heterogeneous vehicle platoons under unidirectional topologies, IEEE Trans. Control Syst. Technol. 25 (3) (2016) 899–910.
[36]
S.A. Alghunaim, E.K. Ryu, K. Yuan, A.H. Sayed, Decentralized proximal gradient algorithms with linear convergence rates, IEEE Trans. Automat. Control 66 (6) (2020) 2787–2794.
[37]
G. Qu, N. Li, Harnessing smoothness to accelerate distributed optimization, IEEE Trans. Control Netw. Syst. 5 (3) (2017) 1245–1260.
[38]
A. Nedić, A. Olshevsky, W. Shi, Achieving geometric convergence for distributed optimization over time-varying graphs, SIAM J. Optim. 27 (4) (2017) 2597–2633.
[39]
Q. Ling, W. Shi, G. Wu, A. Ribeiro, DLM: decentralized linearized alternating direction method of multipliers, IEEE Trans. Signal Process. 63 (15) (2015) 4051–4064.
[40]
J. Xu, S. Zhu, Y.C. Soh, L. Xie, Augmented distributed gradient methods for multi-agent optimization under uncoordinated constant stepsizes, 2015 54th IEEE Conference on Decision and Control, IEEE, 2015, pp. 2055–2060.
[41]
A. Nedić, A. Olshevsky, W. Shi, C.A. Uribe, Geometrically convergent distributed optimization with uncoordinated step-sizes, 2017 American Control Conference, IEEE, 2017, pp. 3950–3955.
[42]
P.D. Lorenzo, G. Scutari, Next: in-network nonconvex optimization, IEEE Trans. Signal Inf. Process. Netw. 2 (2) (2016) 120–136.
[43]
G. Scutari, Y. Sun, Distributed nonconvex constrained optimization over time-varying digraphs, Math. Program. 176 (1) (2019) 497–544.
[44]
K. Yuan, B. Ying, X. Zhao, A.H. Sayed, Exact diffusion for distributed optimization and learning-Part I: algorithm development, IEEE Trans. Signal Process. 67 (3) (2018) 708–723.
[45]
Z. Li, W. Shi, M. Yan, A decentralized proximal-gradient method with network independent step-sizes and separated convergence rates, IEEE Trans. Signal Process. 67 (17) (2019) 4494–4506.
[46]
L. Xiao, S. Boyd, Fast linear iterations for distributed averaging, Syst. Control Lett. 53 (1) (2004) 65–78.
[47]
S.S. Ram, A. Nedić, V.V. Veeravalli, A new class of distributed optimization algorithms: application to regression of distributed data, Optim. Methods Softw. 27 (1) (2012) 71–88.
[48]
P. Erdos, A. Rényi, On the evolution of random graphs, Math. Inst.Hungarian Acad. Sci. 5 (1) (1960) 17–60.
Index Terms
- Proximal nested primal-dual gradient algorithms for distributed constraint-coupled composite optimization
Index terms have been assigned to the content through auto-classification.
Recommendations
A subgradient proximal method for solving a class of monotone multivalued variational inequality problems
AbstractIt is well known that the algorithms with using a proximal operator can be not convergent for monotone variational inequality problems in the general case. Malitsky (Optim. Methods Softw. 33 (1) 140–164, ??) proposed a proximal extrapolated ...
Inexact proximal stochastic gradient method for convex composite optimization
We study an inexact proximal stochastic gradient (IPSG) method for convex composite optimization, whose objective function is a summation of an average of a large number of smooth convex functions and a convex, but possibly nonsmooth, function. Variance ...
Accelerated primal-dual methods with adaptive parameters for composite convex optimization with linear constraints
AbstractIn this paper, we introduce two accelerated primal-dual methods tailored to address linearly constrained composite convex optimization problems, where the objective function is expressed as the sum of a possibly nondifferentiable function and a ...
Highlights- We extend a class of Nesterov's accelerated scheme for solving unconstrained optimization problems to handle composite convex optimization with linear constraints.
- Propose an accelerated linearized augmented Lagrangian method (ALALM) ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2022.
Publisher
Elsevier Science Inc.
United States
Publication History
Published: 01 May 2023
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 17 Feb 2025