Abstract
In this paper, we propose a new sequential quadratic optimization algorithm for solving two-block nonconvex optimization with linear equality and generalized box constraints. First, the idea of the splitting algorithm is embedded in the method for solving the quadratic optimization approximation subproblem of the discussed problem, and then, the subproblem is decomposed into two independent low-dimension quadratic optimization subproblems to generate a search direction for the primal variable. Second, a deflection of the steepest descent direction of the augmented Lagrangian function with respect to the dual variable is considered as the search direction of the dual variable. Third, using the augmented Lagrangian function as the merit function, a new primal–dual iterative point is generated by Armijo line search. Under mild conditions, the global convergence of the proposed algorithm is proved. Finally, the proposed algorithm is applied to solve a series of mid-to-large-scale economic dispatch problems for power systems. Comparing the numerical results demonstrates that the proposed algorithm possesses superior numerical effects and good robustness.
Similar content being viewed by others
References
Douglas, J., Rachford, H.H.: On the numerical solution of the heat conduction problem in two and three space variables. Trans. Am. Math. Soc. 82(2), 421–439 (1956)
Lions, P.L., Mercier, B.: Splitting algorithms for the sum of two nonlinear operators. SIAM J. Numer. Anal. 16(6), 964–979 (1979)
Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning with the alternating direction method of multipliers. Found. Trends Mach. Learn. 3(1), 1–122 (2011)
He, B.S., Yuan, X.M.: On the \({\rm O}(1/n)\) convergence rate of the Douglas–Rachford alternating direction method. SIAM J. Numer. Anal. 50(2), 700–709 (2012)
He, B.S., Yuan, X.M.: On non-ergodic convergence rate of Douglas–Rachford alternating direction method of multipliers. Numer. Math. 130(3), 567–577 (2015)
He, B.S., Ma, F., Yuan, X.M.: Convergence study on the symmetric version of ADMM with larger step sizes. SIAM J. Imaging Sci. 9(3), 1467–1501 (2016)
He, B.S., Liu, H., Wang, Z.R., Yuan, X.M.: A strictly contractive Peaceman–Rachford splitting method for convex programming. SIAM J. Optim. 24(3), 1011–1040 (2014)
Monteiro, R.D.C., Svaiter, B.F.: Iteration-complexity of block-decomposition algorithms and the alternating direction method of multipliers. SIAM J. Optim. 23(1), 475–507 (2013)
Goldfarb, D., Ma, S.Q., Scheinberg, K.: Fast alternating linearization methods for minimizing the sum of two convex functions. Math. Program. 141(1–2), 349–382 (2013)
Goldstein, T., O’Donoghue, B., Setzer, S., Baraniuk, R.: Fast alternating direction optimization methods. SIAM J. Imaging Sci. 7(3), 1588–1623 (2014)
Hong, M.Y., Luo, Z.Q., Razaviyayn, M.: Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems. SIAM J. Optim. 26(1), 3836–3840 (2014)
Li, G.Y., Pong, T.K.: Global convergence of splitting methods for nonconvex composite optimization. SIAM J. Optim. 25(4), 2434–2460 (2015)
Wang, Y., Yin, W.T., Zeng, J.S.: Global convergence of ADMM in nonconvex nonsmooth optimization. J. Sci. Comput. 78(1), 29–63 (2019)
Wilson, R.B.: A simplicial method for concave programming. Ph.D. dissertation, Harvard Business School, Boston (1963)
Fukushima, M.: A successive quadratic programming algorithm with global and superlinear convergence properties. Math. Program. 35(3), 253–264 (1986)
Solodov, M.V.: Global convergence of an SQP method without boundedness assumptions on any of the iterative sequences. Math. Program. Ser. A 118(1), 1–12 (2009)
Panier, E.R., Tits, A.L.: A superlinearly convergent feasible method for the solution of inequality constrained optimization problems. SIAM J. Control Optim. 25(4), 934–950 (1987)
Zhu, Z.B., Jian, J.B.: An efficient feasible SQP algorithm for inequality constrained optimization. Nonlinear Anal. Real World Appl. 10(2), 1220–1228 (2009)
Jian, J.B., Tang, C.M., Hu, Q.J., Zheng, H.Y.: A new superlinearly convergent strongly subfeasible sequential quadratic programming algorithm for inequality constrained optimization. Numer. Funct. Anal. Optim. 29(3–4), 376–409 (2008)
Börgens, E., Kanzow, C.: Regularized Jacobi-type ADMM-methods for a class of separable convex optimization problems in Hilbert spaces. Comput. Optim. Appl. 73(3), 755–790 (2019)
Powell, M.J.D.: A fast algorithm for nonlinearly constrained optimization calculations. In: Watson, G.A. (ed.) Numerical Analysis, Dundee, 1977, Lecture Notes in Mathematics 630, pp. 144–157. Springer, Berlin (1978)
Jian, J.B.: Fast Algorithms for Smoothth Constrained Optimization-Theoretical Analysis and Mumerical Experiments. Science Press, Beijing (2010)
Wood, A.J., Wollenberg, B.F., Sheblé, G.B.: Power Generation, Operation, and Control. Wiley, New York (2014)
Theerthamalai, A., Maheswarapu, S.: An effective non-iterative “\(\lambda \)-logic based” algorithm for economic dispatch of generators with cubic fuel cost function. Int. J. Electr. Power Energy Syst. 32(5), 539–542 (2010)
Ziane, I., Benhamida, F., Graa, A.: Simulated annealing algorithm for combined economic and emission power dispatch using max/max price penalty factor. Neural Comput. Appl. 28(1), 197–205 (2017)
Walters, D., Sheble, G.: Genetic algorithm solution of economic dispatch with valve point loading. IEEE Trans. Power Syst. 8(3), 1325–1332 (1993)
Zhan, J., Wu, Q.H., Guo, C., Zhou, X.: Economic dispatch with non-smooth objectives–part I: local minimum analysis. IEEE Trans. Power Syst. 30(2), 710–721 (2015)
Wang, H., Banerjee, A.: Bregman alternating direction method of multipliers. In: Advances in Neural Information Processing Systems 27 (NIPS 2014), pp. 2816–2824. Curran Associates (2014)
Wang, F.H., Xu, Z.B., Xu, H.K.: Convergence of Bregman alternating direction method with multipliers for nonconvex composite problems. arXiv:1410.8625 (2014)
OPTI Toolbok—a free MATLAB toolbox for optimization. https://www.inverseproblem.co.nz/OPTI/index.php/Main/HomePage
Acknowledgements
The authors wish to thank the Editor-in-Chief and the two anonymous referees for their very professional reviews and quite useful suggestions, which greatly helped us to improve the original version of this paper. This work was supported by the Natural Science Foundation of China, Grants 11771383 and 11601095, and the Natural Science Foundation of Guangxi Province, Grants 2016GXNSFDA380019 and 2016GXNSFBA380185, as well as the Middle-aged and Young Teachers’ Basic Ability Promotion Project of Guangxi Province, Grant 2017KY0537.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Jyh-Horng Chou.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Jian, J., Zhang, C., Yin, J. et al. Monotone Splitting Sequential Quadratic Optimization Algorithm with Applications in Electric Power Systems. J Optim Theory Appl 186, 226–247 (2020). https://doi.org/10.1007/s10957-020-01697-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-020-01697-8
Keywords
- Linear equality and box constraints
- Two-block nonconvex optimization
- Sequential quadratic optimization
- Splitting algorithm
- Electric power systems