Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Sum-of-squares hierarchies for binary polynomial optimization

Published: 07 January 2022 Publication History

Abstract

We consider the sum-of-squares hierarchy of approximations for the problem of minimizing a polynomial f over the boolean hypercube Bn={0,1}n. This hierarchy provides for each integer rN a lower bound f(r) on the minimum fmin of f, given by the largest scalar λ for which the polynomial f-λ is a sum-of-squares on Bn with degree at most 2r. We analyze the quality of these bounds by estimating the worst-case error fmin-f(r) in terms of the least roots of the Krawtchouk polynomials. As a consequence, for fixed t[0,1/2], we can show that this worst-case error in the regime rt·n is of the order 1/2-t(1-t) as n tends to . Our proof combines classical Fourier analysis on Bn with the polynomial kernel technique and existing results on the extremal roots of Krawtchouk polynomials. This link to roots of orthogonal polynomials relies on a connection between the hierarchy of lower bounds f(r) and another hierarchy of upper bounds f(r), for which we are also able to establish the same error analysis. Our analysis extends to the minimization of a polynomial over the q-ary cube (Z/qZ)n. Furthermore, our results apply to the setting of matrix-valued polynomials.

References

[1]
Alon, N., Naor, A.: Approximating the cut-norm via Grothendieck’s inequality. In: 36th Annual ACM Symposium on Theory of Computing, pp. 72–80 (2004)
[2]
Arora, S., Berger, E., Hazan, E., Kindler, G., Safra, M.: On non-approximability for quadratic programs. In: Proceedings of the 46th Annual IEEE Symposium on Foundations of Computer Science, pp. 206–215 (2005)
[3]
Balas E, Ceria S, and Cornuéjols G A lift-and-project cutting plane algorithm for mixed 0–1 programs Math. Program. 1993 58 295-324
[4]
Bansal N, Blum A, and Chawla S Correlation clustering Mach. Learn. 2004 46 1–3 89-113
[5]
Barak, B., Steurer, D.: Sum-of-squares proofs and the quest toward optimal algorithms. In Proceedings of International Congress of Mathematicians (ICM) (2014)
[6]
Charikar, M., Wirth, A.: Maximizing quadratic programs: Extending Grothendieck’s inequality. In: Proceedings of the 45th Annual IEEE Symposium on Foundations of Computer Science, pp. 54–60 (2004)
[7]
de Klerk, E., Laurent, M.: A survey of semidefinite programming approaches to the generalized problem of moments and their error analysis. In: Araujo C., Benkart G., Praeger C., Tanbay B. (eds), World Women in Mathematics 2018. Association for Women in Mathematics Series, vol. 20, pp. 17–56. Springer, Cham (2019)
[8]
de Klerk E and Laurent M Convergence analysis of a Lasserre hierarchy of upper bounds for polynomial minimization on the sphere Math. Program. 2020
[9]
de Klerk, E., Laurent, M.: Worst-case examples for Lasserre’s measure based hierarchy for polynomial optimization on the hypercube. Math. Oper. Res. 45(1), 86–98 (2020)
[10]
Doherty, A.C., Wehner, S.: Convergence of SDP hierarchies for polynomial optimization on the hypersphere (2012). arXiv:1210.5048
[11]
Fang K and Fawzi H The sum-of-squares hierarchy on the sphere, and applications in quantum information theory Math. Program. 2020
[12]
Fawzi H, Saunderson J, and Parrilo PA Sparse sums of squares on finite abelian groups and improved semidefinite lifts Math. Program. 2016 160 1–2 149-191
[13]
Goemans M and Williamson D Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming J. Assoc. Comput. Mach. 1995 42 6 1115-1145
[14]
Karlin, A.R., Mathieu, C., Nguyen, C.T.: Integrality gaps of linear and semi-definite programming relaxations for knapsack. In: Günlük, O., Woeginger, G.J. (eds.) Integer Programming and Combinatoral Optimization, pp. 301–314. Springer, Berlin, Heidelberg (2011)
[15]
Kurpisz, A., Leppänen, S., Mastrolilli, M.: Tight Sum-of-Squares lower bounds for binary polynomial optimization problems. In: Chatzigiannakis, I., et al. (eds) 43rd International Colloquium on Automata, Languages, and Programming (ICALP 2016) vol. 78, pp. 1–14 (2016)
[16]
Lasserre JB Global optimization with polynomials and the problem of moments SIAM J. Optim. 2001 11 3 796-817
[17]
Lasserre JB A max-cut formulation of 0/1 programs Oper. Res. Lett. 2016 44 158-164
[18]
Lasserre, J.B.: An explicit exact sdp relaxation for nonlinear 0–1 programs. In: Aardal, K., Gerards, B. (eds.) Integer Programming and Combinatorial Optimization, pp. 293–303, Springer, Berlin, Heidelberg (2001)
[19]
Lasserre JB Moments. Positive Polynomials and Their Applications 2009 London Imperial College Press
[20]
Lasserre JB A new look at nonnegativity on closed sets and polynomial optimization SIAM J. Optim. 2010 21 3 864-885
[21]
Laurent, M.: A comparison of the Sherali–Adams, Lovász-Schrijver and Lasserre relaxations for 0-1 programming. Math. Oper. Res., 28(3):470–496 (2003)
[22]
Laurent M Lower bound for the number of iterations in semidefinite hierarchies for the cut polytope Math. Oper. Res. 2003 28 4 871-883
[23]
Laurent M Semidefinite representations for finite varieties Math. Program. 2007 109 1-26
[24]
Laurent, M.: Sums of squares, moment matrices and optimization over polynomials. In: Putinar, M., Sullivant, S. (eds.) Emerging Applications of Algebraic Geometry, Vol. 149 of IMA Volumes in Mathematics and its Applications, pp. 157–270. Springer (2009)
[25]
Lee, J.R., Raghavendra, P., Steurer, D.: Lower bounds on the size of semidefinite programming relaxations. In: STOC ’15: Proceedings of the Forty-Seventh Annual ACM Symposium on Theory of Computing, pp. 567–576 (2015)
[26]
Levenshtein, V.I.: Universal bounds for codes and designs. In: Handbook of Coding Theory, vol. 9, pp. 499–648. North-Holland, Amsterdam (1998)
[27]
Lovász L and Schrijver A Cones of matrices and set-functions and 0–1 optimization SIAM J. Optim. 1991 1 166-190
[28]
Macwilliams, F., Sloane, N.: The Theory of Error Correcting Codes, volume 16 of North-Holland Mathematical Library. Elsevier (1983)
[29]
Natanson, I.P.: Constructive Function Theory, Vol. I Uniform Approximation (1964)
[30]
Nie, J., Schweighofer, M.: On the complexity of Putinar’s positivstellensatz. J. Complex. 23(1), 135–150 (2007)
[31]
O’Donnell, R.: SOS is not obviously automatizable, even approximately. In: 8th Innovations in Theoretical Computer Science Conference vol. 59, pp. 1–10 (2017)
[32]
Parrilo, P.A.: Structured semidefinite programs and semialgebraic geometry methods in robustness and optimization. Ph.D thesis, California Institure of Technology (2000)
[33]
Raghavendra, P., Weitz, B.: On the bit complexity of sum-of-squares proofs. In: 44th International Colloquium on Automata, Languages, and Programming, vol. 80, pp. 1–13 (2017)
[34]
Reznick, B.: Uniform denominators in Hilbert’s seventeenth problem. Math. Z. 220(1), 75–97 (1995)
[35]
Rothvoss, T.: The Lasserre hierarchy in approximation algorithms. Lecture Notes for the MAPSP 2013 Tutorial (2013)
[36]
Sakaue S, Takeda A, Kim S, and Ito N Exact semidefinite programming relaxations with truncated moment matrix for binary polynomial optimization problems SIAM J. Optim. 2017 27 1 565-582
[37]
Scherer CW and Hol CWJ Matrix sum-of-squares relaxations for robust semi-definite programs Math. Program. 2006 107 189-211
[38]
Schweighofer, M.: On the complexity of Schmüdgen’s positivstellensatz. J. Complex. 20(4), 529–543 (2004)
[39]
Sherali HD and Adams WP A hierarchy of relaxations between the continuous and convex hull representations for zero-one programming problems SIAM J. Discret. Math. 1990 3 411-430
[40]
Slot, L., Laurent, M.: Improved convergence analysis of Lasserre’s measure-based upper bounds for polynomial minimization on compact sets. Math. Program. (2020). https://doi.org/10.1007/s10107-020-01468-3
[41]
Szegö, G.: Orthogonal Polynomials. vol. 23 in American Mathematical Society colloquium publications. American Mathematical Society (1959)
[42]
Slot, L., Laurent, M.: Near-optimal analysis of of Lasserre’s univariate measure-based bounds for multivariate polynomial optimization. Math. Program. (2020). https://doi.org/10.1007/s10107-020-01586-y
[43]
Terras A Fourier Analysis on Finite Groups and Applications 1999 Cambridge Cambridge University Press
[44]
Tunçel, L.: Polyhedral and Semidefinite Programming Methods in Combinatorial Optimization. Fields Institute Monograph (2010)
[45]
Vallentin, F.: Semidefinite programs and harmonic analysis. arXiv:0809.2017 (2008)

Cited By

View all
  • (2023)Sum of Squares Bounds for the Empty Integral Hull ProblemProceedings of the 2023 International Symposium on Symbolic and Algebraic Computation10.1145/3597066.3597098(443-451)Online publication date: 24-Jul-2023
  • (2023)Lower Bounds of Functions on Finite Abelian GroupsComputing and Combinatorics10.1007/978-3-031-49193-1_12(157-170)Online publication date: 15-Dec-2023

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Mathematical Programming: Series A and B
Mathematical Programming: Series A and B  Volume 197, Issue 2
Feb 2023
844 pages

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 07 January 2022
Accepted: 17 November 2021
Received: 29 May 2021

Author Tags

  1. Binary polynomial optimization
  2. Lasserre hierarchy
  3. Sum-of-squares polynomials
  4. Fourier analysis
  5. Krawtchouk polynomials
  6. Polynomial kernels
  7. Semidefinite programming
  8. Polynomial matrices

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 30 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Sum of Squares Bounds for the Empty Integral Hull ProblemProceedings of the 2023 International Symposium on Symbolic and Algebraic Computation10.1145/3597066.3597098(443-451)Online publication date: 24-Jul-2023
  • (2023)Lower Bounds of Functions on Finite Abelian GroupsComputing and Combinatorics10.1007/978-3-031-49193-1_12(157-170)Online publication date: 15-Dec-2023

View Options

View options

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media