Abstract
This paper addresses the distributed adaptive optimization problem over second-order multi-agent networks (MANs) with nonuniform gradient gains. A general convex function consisting of a sum of local differentiable convex functions is chosen as the team objective function. First, based on the local information of each agent’s neighborhood, a novel distributed adaptive optimization algorithm with nonuniform gradient gains is designed, where these gains only have relations with agents’ own states. And then, the original closed-loop system is changed into an equivalent one by taking a coordination transformation. Moreover, it is proved that the states including positions and velocities of all agents are bounded by constructing a Lyapunov function provided that the initial values are given. By the theory of Lyapunov stability, it is shown that all agents can finally reach an agreement and their position states converge to the optimal solution of the team objective function asymptotically. Finally, the effectiveness of the obtained theoretical results is demonstrated by several simulation examples.
Similar content being viewed by others
References
Yi P and Hong Y, Distributed cooperative optimization and its applications, Sci. Sin. Math., 2016, 46: 1547–1564.
Fang H, Shang C, and Chen J, An optimization-based shared control framework with applications in multi-robot systems, Sci. China Ser. F-Inf. Sci., 2018, 61(1): 014201, https://doi.org/10.1007/s11432-017-9263-6.
Ram S, Nedić A, and Veeravalli V, A new class of distributed optimization algorithms: Application to regression of distributed data, Optim. Methods Softw., 2012, 27(1): 71–88.
Nedić A and Ozdaglar A, Distributed subgradient methods for multiagent optimization, IEEE Transactions on Automatic Control, 2009, 54(1): 48–61.
Nedić A and Olshevsky A, Distributed optimization over time-varying directed graphs, IEEE Transactions on Automatic Control, 2015, 60(3): 601–615.
Nedić A, Ozdaglar A, and Parrilo P A, Constrained consensus and optimization in multi-agent networks, IEEE Transactions on Automatic Control, 2010, 55(4): 922–938.
Lin P, Ren W, and Song Y, Distributed multi-agent optimization subject to nonidentical constraints and communication delays, Automatica, 2016, 65: 120–131.
Lin P, Ren W, and Gao H, Distributed velocity-constrained consensus of discrete-time multi-agent systems with nonconvex constraints, switching topologies, and delays, IEEE Transactions on Automatic Control, 2017, 62(11): 5788–5794.
Lin P, Ren W, Yang C, et al., Distributed consensus of second-order multi-agent systems with nonconvex velocity and control input constraints, IEEE Transactions on Automatic Control, 2018, 63(4): 1171–1176.
Mo L and Lin P, Distribued consensus of second-order multiagent systems with nonconvex input constraints, International Journal of Nonlinear & Robust Control, 2018, 28: 3657–3664.
Mo L, Guo S, and Yu Y, Mean-square consensus of heterogeneous multi-agent systems with nonconvex constraints, Markovian switching topologies and delays, Neurocomputing, 2018, 291: 167–174.
Lin P, Ren W, Yang C, et al., Distributed optimization with nonconvex velocity constraints, nonuniform position constraints and nonuniform stepsizes, IEEE Transactions on Automatic Control, 2019, 64(6): 2575–2582.
Lin P, Ren W, Yang C, et al., Distributed continuous-time and discrete-time optimization with nonuniform unbounded convex constraint sets and nonuniform stepsizes, IEEE Transactions on Automatic Control, 2019, 64(12): 5148–5155.
Lu J and Tang C Y, Zero-gradient-sum algorithms for distributed convex optimization: The continuous-time case, IEEE Transactions on Automatic Control, 2012, 57(9): 2348–2354.
Varagnolo D, Zanella F, Cenedese A, et al, Newton-Raphson consensus for distributed convex optimization, IEEE Transactions on Automatic Control, 2016, 61(4): 994–1009.
Shi G, Johansson K, and Hong Y, Reaching an optimal consensus: Dynamical systems that compute intersections of convex sets, IEEE Transactions on Automatic Control, 2013, 58(3): 610–622.
Qiu Z, Liu S, and Xie L, Distributed constrained optimal consensus of multi-agent systems, Automatica, 2016, 68: 209–216.
Gharesifard B and Cortés J, Distributed continuous-time convex optimization on weight-balanced digraphs, IEEE Transactions on Automatic Control, 2014, 59(3): 781–786.
Kia S and Cortés J, Distributed convex optimization via continuous time coordination algorithms with discrete-time communication, Automatica, 2015 55: 254–264.
Lin P, Ren W, and Farrell J A, Distributed continuous-time optimization: Nonuniform gradient gains, finite-time convergence, and convex constraint set, IEEE Transactions on Automatic Control, 2017, 62(5): 2239–2253.
Ren W, On consensus algorithms for double-integrator dynamics, IEEE Transactions on Automatic Control, 2008, 53(6): 1503–1509.
Rahili S, Ren W, and Lin P, Distributed convex optimization of time-varying cost functions for double-integrator systems using nonsmooth algorithms, Proceedings of American Control Conference, America, 2015, 68–73.
Zhang Y and Hong Y, Distributed optimization design for second-order multi-agent systems, Proceedings of the 33rd Chinese Control Conference, Nanjing, China, 2014, 28–30.
Liu Q and Wang J, A second-order multi-agent network for bound-constrained distributed optimization, IEEE Transactions on Automatic Control, 2015, 60(12): 3310–3315.
Mo L and Lin P, Distributed continuous-time optimization over second-order multi-agent networks with nonuniform gains, Proceedings of the 31st Chinese Control and Decision Conference, Nanchang, China, 2019, 35–38.
Godsil C and Royle G, Algebraic Graph Theory, Springer-Verlag, New York, 2001.
Li S, Yang J, and Chen W, Generalized extended state observer based control for systems with mismatched uncertainties, IEEE Transactions on Automatic Control, 2012, 59(12): 4792–4802.
Tang Y, Deng Z, and Hong Y, Optimal output consensus of high-order multiagent systems with embedded technique, IEEE Transactions on Cybernetics, 2018, 99: 1–12.
Boyd S and Vandenberghe L, Convex Optimization, Cambridge University Press, London, UK, 2004.
Facchiner F and Pang J, Finite-Dimensional Inequalities and Complementarity Problems, Springer-Verlag, New York, 2003.
Tran N T, Wang Y, and Liu X, Distributed optimization problem for second-order multi-agent networks with only position interaction, Proceedings of the 35th Chinese Control Conference, Chengdu, China, 2016, 1934–1768.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is supported by the National Natural Science Foundation of China under Grant Nos. 61973329 and 61772063, and the Beijing Natural Science Foundation under Grant Nos. Z180005 and 9192008.
This paper was recommended for publication by Editor YOU Keyou.
Rights and permissions
About this article
Cite this article
Mo, L., Liu, X., Cao, X. et al. Distributed Second-Order Continuous-Time Optimization via Adaptive Algorithm with Nonuniform Gradient Gains. J Syst Sci Complex 33, 1914–1932 (2020). https://doi.org/10.1007/s11424-020-9021-3
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-020-9021-3