Abstract
In this paper, by combining the logarithmic-quadratic proximal (LQP) method and alternating direction method, we proposed an LQP alternating direction method for solving structured variational inequalities. The new iterate is generated by searching the optimal step size along a descent direction with a new step size αk. The choice of the descent direction and the step size selection strategies are important for the algorithm’s efficiency. The O(1/t) convergence rate of the proposed method is studied, and its efficiency is also verified by some numerical experiments.
Similar content being viewed by others
References
Auslender, A., Teboulle, M., Ben-Tiba, S.: A logarithmic-quadratic proximal method for variational inequalities. Comput. Optim. Appl. 12, 31–40 (1999)
Auslender, A., Teboulle, M.: Entropic proximal decomposition methods for convex programs and variational inequalities. Math. Program. 91, 33–47 (2001)
Auslender, A., Teboulle, M.: Interior gradient and epsilon-subgradient descent methods for constrained convex minimization. Math. Oper. Res. 29, 1–26 (2004)
Auslender, A., Teboulle, M.: Interior gradient and proximal methods for convex and conic optimization. SIAM J. Optim. 16, 697–725 (2006)
Auslender, A., Teboulle, M.: Lagrangian duality and related multiplier methods for variational inequality problems. SIAM J. Optim. 10, 1097–1115 (2000)
Bertsekas, D.P., Gafni, E.M.: Projection method for variational inequalities with applications to the traffic assignment problem. Math. Program. Study 17 (1982)
Bertsekas, D.P., Tsitsiklis, J.N.: Parallel and Distributed Computation: Numerical Methods. Athena Scientific, Belmont (1997)
Bnouhachem, A., Benazza, H., Khalfaoui, M.: An inexact alternating direction method for solving a class of structured variational inequalities. Appl. Math. Comput. 219, 7837–7846 (2013)
Bnouhachem, A.: On LQP alternating direction method for solving variational inequality problems with separable structure. J. Inequal. Appl. 2014(80), 1–15 (2014)
Bnouhachem, A., Xu, M.H.: An inexact LQP alternating direction method for solving a class of structured variational inequalities. Comput. Math. Appl. 67, 671–680 (2014)
Bnouhachem, A., Ansari, Q.H.: A descent LQP alternating direction method for solving variational inequality problems with separable structure. Appl. Math. Comput. 246, 519–532 (2014)
Bnouhachem, A., Hamdi, A.: Parallel LQP alternating direction method for solving variational inequality problems with separable structure. J. Inequal. Appl. 2014(392), 1–14 (2014)
Bnouhachem, A., Hamdi, A.: A hybrid LQP alternating direction method for solving variational inequality problems with separable structure. Appl. Math. Inf. Sci. 9(3), 1259–1264 (2015)
Bnouhachem, A., Al-Homidan, S., Ansari, Q.H.: New descent LQP alternating direction methods for solving a class of structured variational inequalities. Fixed Point Theory Appl. 2015(137), 1–11 (2015)
Bnouhachem, A., Latif, A., Ansari, Q.H.: On the O(1/t) convergence rate of the alternating direction method with LQP regularization for solving structured variational inequality problems. J. Inequal. Appl. 2016(297), 1–14 (2016)
Bnouhachem, A., Bensi, F., Hamdi, A.: On alternating direction method for solving variational inequality problems with separable structure. J. Nonlin. Sci. Apps. 10(1), 175–185 (2017)
Bnouhachem, A., Ansari, Q.H., Al-Homidan, S.: SQP Alternating direction for structured vriational inequality. J. Nonlinear Convex Anal. 19(3), 461–476 (2018)
Bnouhachem, A., Rassias, T.M.: A new descent alternating direction method with LQP regularization for the structured variational inequalities. Optim. Lett. 13 (1), 175–192 (2018)
Bnouhachem, A., Rassias, T.M.: On descent alternating direction method with LQP regularization for the structured variational inequalities, Optim. Lett., in press (2019)
Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3, 1–122 (2010)
Chan, T.F., Glowinski, R.: Finite Element Approximation and Iterative Solution of a Class of Mildly Non-Linear Elliptic Equations. Stanford University, Technical Report (1978)
Chen, Z., Wan, L., Yang, Y.: An inexact alternating direction method for structured variational inequalities. J. Optim. Theory Appl. 163(2), 439–459 (2014)
Facchinei, F., Pang, J.S.: Finite-Dimensional Variational Inequalities and Complementarity Problems, vol. I and II. Springer Series in Operations Research. Springer, New York (2003)
Fukushima, M.: Application of the alternating directions method of multipliers to separable convex programming problems. Comput. Optim. Appl. 1(1), 93–111 (1992)
Glowinski, R., Marrocco, A.: Sur l’approximation par éléments finis d’ordre un et la résolution par pénalisation-dualité d’une classe de problémes de Dirichlet non linéaires. Revue Fr. Autom. Inform. Rech. opér. Anal. Numé,r. 2, 41–76 (1975)
Glowinski, R.: Numerical Methods for Nonlinear Variational Problems. Springer, New York (1984)
Glowinski, R., Tallec, P.L.: Augmented Lagrangian and Operator-Splitting Methods in Nonlinear Mechanics. Society for Industrial and Applied Mathematics, Philadelphia (1989)
He, B.S., Liao, L.Z., Han, D.R., Yang, H.: A new inexact alternating directions method for monotone variational inequalities. Math. Program. 92, 103–118 (2002)
He, B.S., Liao, L.-Z., Yuan, X.M.: A LQP based interior prediction-correction method for nonlinear complementarity problems. J. Comput. Math. 24(1), 33–44 (2006)
He, B.S.: Parallel splitting augmented Lagrangian methods for monotone structured variational inequalities. Comput. Optim. Appl. 42, 195–212 (2009)
He, B.S., Tao, M., Yuan, X.M.: Alternating direction method with Gaussian back substitution for separable convex programming. SIAM J. Optim. 22, 313–340 (2012)
Hou, L.S.: On the O(1/t) convergence rate of the parallel descent-like method and parallel splitting augmented Lagrangian method for solving a class of variational inequalities. Appl. Math. Comput. 219, 5862–5869 (2013)
Jiang, Z.K., Bnouhachem, A.: A projection-based prediction-correction method for structured monotone variational inequalities. Appl. Math Comput. 202, 747–759 (2008)
Jiang, Z.K., Yuan, X.M.: New parallel descent-like method for sloving a class of variational inequalities. J. Optim. TheoryAppl. 145, 311–323 (2010)
Kontogiorgis, S., Meyer, R.R.: A variable-penalty alternating directions method for convex optimization. Math. Program. 83, 29–53 (1998)
Li, M.: A hybrid LQP-based method for structured variational inequalities. Int. J. Comput. Math. 89(10), 1412–1425 (2012)
Tao, M., Yuan, X.M.: On the O(1/t) convergence rate of alternating direction method with Logarithmic-quadratic proximal regularization. SIAM J. Optim. 22(4), 1431–1448 (2012)
Tseng, P.: Applications of a splitting algorithm to decomposition in convex programming and variational inequalities. SIAM J. Con. Optim. 29, 119–138 (1991)
Tseng, P.: Alternating projection-proximal methods for convex programming and variational inequalities. SIAM J. Optim. 7, 951–965 (1997)
Wang, K., Xu, L.L., Han, D.R.: A new parallel splitting descent method for structured variational inequalities. J. IndustrialMan. Optim. 10(2), 461–476 (2014)
Yuan, X.M., Li, M.: An LQP-based decomposition method for solving a class of variational inequalities. SIAM J. Optim. 21(4), 1309–1318 (2011)
Zhang, W., Han, D., Jiang, S.: A modified alternating projection based prediction-correction method for structured variational inequalities. Appl. Numer. Math. 83, 12–21 (2014)
Author information
Authors and Affiliations
Corresponding author
Additional information
This paper is dedicated to Mohamed Bnouhachem and Mohamed Khalfaoui
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Bnouhachem, A. A self-adaptive descent LQP alternating direction method for the structured variational inequalities. Numer Algor 86, 303–324 (2021). https://doi.org/10.1007/s11075-020-00890-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11075-020-00890-0
Keywords
- Variational inequalities
- Monotone operator
- Logarithmic-quadratic proximal method
- Projection method
- Alternating direction method