Abstract
The purpose of this work is to present, using the n-mode product, a new approach to generalize, for tensor sequences, the well-known vector extrapolation methods MPE (minimal polynomial extrapolation method) and RRE (reduced rank extrapolation method). We define the notion of the n-mode minimal polynomial of a matrix with respect to a tensor. This polynomial will be used, through the iterative solution of some tensor linear systems, to introduce the tensor version of MPE and RRE. These methods involve only the terms of sequences that result from the used iterative methods. The implementation of these methods on some sequences of tensors confirms the effectiveness and applicability of our approach.
Similar content being viewed by others
Data Availability
Data sharing is not applicable to this article as no data sets were generated or analyzed during the current study.
References
Wynn, P. : Acceleration techniques for iterated vector and matrix problems: Math. Comput. 16, 301–322 (1962)
Aitken, A.: On Bernoulli’s numerical solution of algebraic equations. Proc. R. Soc. Edinb. 46, 289–305 (1927)
Benchettou, O., Bentbib, A. H., Bouhamidi, A.: An accelerated tensorial double proximal gradient method for total variaitional regularization problem. J. Optim. Theory Appl. 1573–2878 (2023)
Brazell, M., Li, N., Navasca, C.: Tamon, Solving multilinear systems via tensor inversion. SIAM J. Matrix Anal. Appl. 34, 542–570 (2013)
Brezinski, C.: Redivo Zaglia. M.: Extrapolation methods. Theory and Practice; North Holland Publishing, Amsterdam, The Netherlands (1991)
Brezinski, C.: G\(\acute{e}\)n\(\acute{e}\)ralisations de la transformation de Shanks, de la table de \(Pad\acute{e}\), et de l’\(\epsilon \)-algorithme. Calcolo. 12, 317–360 (1975)
Brezinski, C., Redivo Zaglia, M., Serra-Capizzano, S.: Extrapolation methods for PageRank computation. Comptes Rendus Math. 340, 393–397 (2005)
Burrow, M.D.: The minimal polynomial of a linear transformation. Amer. Math. Monthly. 80, 1129–113 (1973)
Cabay, S., Jackson, L.W.: A polynomial extrapolation method for finding limits and antilimits for vector sequences. SIAM J. Numer. Anal. 13, 734–752 (1976)
Candes, E.J., Tao, T.: The power of convex relaxation near-optimal matrix completion. IEEE Trans. Inf. Theory 56, 2053–2080 (2010)
Chen, J., Saad, Y.: On the tensor SVD and the optimal low rank orthogonal approximation of tensors. SIAM J. Matrix Anal. Appl. https://doi.org/10.1137/070711621 (2009)
Combettes, P.L., Pesquet, J.C.: Proximal splitting methods in signal processing. In: Fixed-Point Algorithms for Inverse Problems in Science and Engineering, pp. 185–212. Springer. (2011)
De Lathauwer, L., De Moor, B., Vandewalle, J.A.: Multilinear singular value decomposition. SIAM J Matrix Anal. Appl. 21, 1253–1278 (2000)
Duminil, S., Sadok, H., Silvester, D.: Fast solvers for discretized Navier-Stokes problems using vector extrapolation. Numer. Algorithms. 66, 89–104 (2014)
El Ichi, A., Jbilou, K., Sadaka, R.: Tensor global extrapolation methods using the n-mode and the Einstein products. Mathematics. 8, 1298 (2020)
Jbilou, K., Messaoudi, A.: Block extrapolation methods with applications. Appl. Numer. Math. 106, 154–164 (2016)
Jbilou, K., Sadok, H.: Analysis of some vector extrapolation methods for linear systems. Numer. Math. 70(1), 73–89 (1995)
Jbilou, K., Sadok, H.: LU-implementation of the modified minimal polynomial extrapolation method. IMA J. Numer. Anal. 19(4), 549–561 (1999)
Jbilou, K., Sadok, H.: Vector extrapolation methods. Appl. Numer. Comparison, J. Comput. Appl. Math. 122(1–2), 149–165 (2000)
Jbilou, K., Sadok, H.: Matrix polynomial and epsilon-type extrapolation methods with applications. Numer. Algorithms 68(1), 107–119 (2015)
Kaniel, S., Stein, J.: Least-square acceleration of iterative methods for linear equations. J. Optim. Theory Appl. 14, 431–437 (1974)
Kolda, T.G., Bader, B.W.: Tensor decompositions and applications. SIAM Rev. 3, 455–500 (2009)
Mešina, M.: Convergence Acceleration for the Iterative Solution of the Equations X = AX + f. Comput. Methods Appl. Mech. Eng. 10, 165–173 (1977)
Nesterov, Y.: Gradient methods for minimizing composite functions. Math Program. 140(1), 125–161 (2013)
Pugachev, B.P.: Acceleration of the convergence of iterative processes and a method of solving systems of nonlinear equations. USSR Comput. Math. Math. Phys. 17, 199–207 (1978)
Qing-Wen, W., Xiangjian, X.: Iterative algorithms for solving some tensor equations. Linear and Multilinear Algebra. 67(7), 1325–1349 (2019)
Ragnarsson, S., Van Loan, C.F.: Block tensor unfoldings. SIAM J. Matrix Anal. Appl. 33, 149–169 (2012)
Shanks, D.: Nonlinear transformations of divergent and slowly convergent sequences. J. Math. Phys. 34, 1–42 (1955)
Sidi, A., Ford, W.F., Smith, D.A.: Acceleration of convergence of vector sequences. SIAM J. Numer. Anal. 23, 178–196 (1986)
Sidi, A.: Vector extrapolation methods with applications. Soc. Ind. Appl. Math.https://doi.org/10.1137/1.9781611974966.ch1 31–64 (2017)
Sridevi, G., Kumar, S.S.: Image inpainting based on fractional order nonlinear diffusion for image reconstruction, pp. 3802–381. Circuits, Systems and Signal Processing (2019)
Wynn, P.: On a device for computing the \(e_m(S_n)\) transformation. Math. Tables Other Aids Comput. 10, 91–96 (1956)
Author information
Authors and Affiliations
Contributions
The contribution of the third author is major in this work.
Corresponding author
Ethics declarations
Consent for publication
The authors certify that the general content of the manuscript, in whole or in part, is not submitted, accepted, or published elsewhere, including conference proceedings.
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The contribution of the third author is major in this work.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Bentbib, A.H., Jbilou, K. & Tahiri, R. N-mode minimal tensor extrapolation methods. Numer Algor 95, 665–691 (2024). https://doi.org/10.1007/s11075-023-01585-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11075-023-01585-y