Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/1007352.1007409acmconferencesArticle/Chapter ViewAbstractPublication PagesstocConference Proceedingsconference-collections
Article

Typical properties of winners and losers in discrete optimization

Published: 13 June 2004 Publication History

Abstract

We present a probabilistic analysis for a large class of combinatorial optimization problems containing, e. g., all binary optimization problems defined by linear constraints and a linear objective function over (0,1)n. By parameterizing which constraints are of stochastic and which are of adversarial nature, we obtain a semi-random input model that enables us to do a general average-case analysis for a large class of optimization problems while at the same time taking care for the combinatorial structure of individual problems. Our analysis covers various probability distributions for the choice of the stochastic numbers and includes smoothed analysis with Gaussian and other kinds of perturbation models as a special case. In fact, we can exactly characterize the smoothed complexity of optimization problems in terms of their random worst-case complexity.A binary optimization problem has a polynomial smoothed complexity if and only if it has a pseudopolynomial complexity. Our analysis is centered around structural properties of binary optimization problems, called winner, loser, and feasibility gaps. We show, when the coefficients of the objective function and/or some of the constraints are stochastic, then there usually exist a polynomial n-Ω(1) gap between the best and the second best solution as well as a polynomial slack to the boundary of the constraints. Similar to the condition number for linear programming, these gaps describe the sensitivity of the optimal solution to slight perturbations of the input and can be used to bound the necessary accuracy as well as the complexity for solving an instance. We exploit the gaps in form of an adaptive rounding scheme increasing the accuracy of calculation until the optimal solution is found. The strength of our techniques is illustrated by applications to various NP-hard optimization problems from mathematical programming, network design, and scheduling for which we obtain the the first algorithms with polynomial average-case/smoothed complexity.

References

[1]
C. Banderier, R. Beier and K. Mehlhorn. Smoothed Analysis of three combinatorial problems. Proc. 28th MFCS, 198-207, 2003.]]
[2]
A. Blum and J. Dunagan. Smoothed Analysis of the Perceptron Algorithm. Proc. of the 13th SODA, 905-914, 2003.]]
[3]
L. Becchetti, S. Leonardi, A. Marchetti-Spaccamela, G. Schafer and T. Vredeveld. Average Case and Smoothed Competitive Analysis of the Multi-Level Feedback Algorithm. Proc. of the 44th FOCS, 462-471, 2003.]]
[4]
F. Barahona and W. R. Pulleyblank. Exact arborescences, matchings and cycles. Discrete Applied Mathematics, 16, 617--630, 1998.]]
[5]
R. Beier and B. Vocking. Random knapsack in expected polynomial time. Proc. of the 35th STOC, 232--241, 2003.]]
[6]
R. Beier and B. Vocking. Probabilistic analysis of knapsack core algorithms. Proc. of the 14th SODA, 2004.]]
[7]
J. Dunagan, D. A. Spielman, and S. -H. Teng. Smoothed analysis of Renegar's condition number for linear programming. Available at http://arxiv. org/abs/cs. DS/0302011, 2002.]]
[8]
V. Damerow, F. Meyer auf der Heide, H. Racke, C. Scheideler and C. Sohler. Smoothed motion complexity. Proc. of the 11th ESA, 2003.]]
[9]
M. E. Dyer and A. M. Frieze. Probabilistic analysis of the multidimensional knapsack problem. Mathematics of Operations Research 14(1), 162--176, 1989.]]
[10]
M. R. Garey and D. S Johnson. Computers and Intractability: A Guide to the Theory of NP-completeness. Freeman, 1979.]]
[11]
M. X. Goemans and R. Ravi. The Constrained Minimum Spanning Tree Problem. Fifth Scandinavian Workshop on Algorithm Theory, 66--75, 1996.]]
[12]
A. Goldberg and A. Marchetti-Spaccamela. On finding the exact solution to a Zero-One Knapsack Problem. Proc. of the 16th STOC, 359--368, 1984.]]
[13]
L. A. Levin. Average Case Complete Problems. SIAM J. Cornput., 15(1):285--286, 1986.]]
[14]
G. S. Lueker. On the average difference between the solutions to linear and integer Knapsack Problems. Applied Probability - Computer Science, the Interface, 1, Birkhauser, 1982.]]
[15]
G. S. Lueker. Average-case analysis of Off-Line and On-Line Knapsack Problems. J. of Algorithms, 19, 277--305, 1998.]]
[16]
G. S. Lueker. Exponentially small bounds on the expected optimum of the Partition and Subset Sum Problems. Random Structures and Algorithms, 12, 51--62, 1998.]]
[17]
K. Mehlhorn and M. Ziegelmann. Resource Constrained Shortest Paths. Proc. 8th ESA, 326--337, 2000.]]
[18]
K. Mulmuley, U. Vazirani and V. V. Vazirani. Matching is as easy as matrix inversion. Combinatorica 7(1):105--113, 1987.]]
[19]
C. H. Papadimitriou and M. Yannakakis. The complexity of tradeoffs, and optimal access of web sources. Proc. of the 41st FOCS, 86--92, 2000.]]
[20]
J. Renegar. Some perturbation theory for linear programming. Math. Programming, 65(1, Series A), 73--91, 1994.]]
[21]
J. Renegar. Incorporating condition measures into the complexity of linear programming. SIAM J. Optim., 5(3):506--524, 1995.]]
[22]
J. Renegar. Linear programming, complexity theory and elementary functional analysis. Math. Programming, 70(3, Series A), 279--351, 1995.]]
[23]
H. M. Salkin. Integer Programming. Addison-Wesley, Reading, Mass., 1975.]]
[24]
D. A. Spielman and S. -H. Teng. Smoothed Analysis of algorithms: why the Simplex Algorithm usually takes polynomial time. Proc. of the 33rd STOC, 296--305, 2001.]]
[25]
D. A. Spielman and S. -H. Teng. Smoothed Analysis: Motivation and discrete models. Proc. of WADS 2003, 256--270, 2003.]]

Cited By

View all
  • (2023)“Intelligent Heuristics Are the Future of Computing”ACM Transactions on Intelligent Systems and Technology10.1145/362770814:6(1-39)Online publication date: 14-Nov-2023
  • (2015)An integrated framework for adapting WS-BPEL scenario execution using QoS and collaborative filtering techniquesScience of Computer Programming10.1016/j.scico.2014.10.00798:P4(707-734)Online publication date: 1-Feb-2015
  • (2011)Settling the complexity of local max-cut (almost) completelyProceedings of the 38th international colloquim conference on Automata, languages and programming - Volume Part I10.5555/2027127.2027146(171-182)Online publication date: 4-Jul-2011
  • Show More Cited By

Index Terms

  1. Typical properties of winners and losers in discrete optimization

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    STOC '04: Proceedings of the thirty-sixth annual ACM symposium on Theory of computing
    June 2004
    660 pages
    ISBN:1581138520
    DOI:10.1145/1007352
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 June 2004

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. average-case analysis
    2. optimization problems
    3. smoothed analysis

    Qualifiers

    • Article

    Conference

    STOC04
    Sponsor:
    STOC04: Symposium of Theory of Computing 2004
    June 13 - 16, 2004
    IL, Chicago, USA

    Acceptance Rates

    Overall Acceptance Rate 1,469 of 4,586 submissions, 32%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)10
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 28 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)“Intelligent Heuristics Are the Future of Computing”ACM Transactions on Intelligent Systems and Technology10.1145/362770814:6(1-39)Online publication date: 14-Nov-2023
    • (2015)An integrated framework for adapting WS-BPEL scenario execution using QoS and collaborative filtering techniquesScience of Computer Programming10.1016/j.scico.2014.10.00798:P4(707-734)Online publication date: 1-Feb-2015
    • (2011)Settling the complexity of local max-cut (almost) completelyProceedings of the 38th international colloquim conference on Automata, languages and programming - Volume Part I10.5555/2027127.2027146(171-182)Online publication date: 4-Jul-2011
    • (2011)Settling the Complexity of Local Max-Cut (Almost) CompletelyAutomata, Languages and Programming10.1007/978-3-642-22006-7_15(171-182)Online publication date: 2011
    • (2009)Smoothed analysisCommunications of the ACM10.1145/1562764.156278552:10(76-84)Online publication date: 1-Oct-2009
    • (2009)Algorithm Engineering --- An Attempt at a DefinitionEfficient Algorithms10.1007/978-3-642-03456-5_22(321-340)Online publication date: 1-Sep-2009
    • (2007)Decision-making based on approximate and smoothed Pareto curvesTheoretical Computer Science10.1016/j.tcs.2007.02.034378:3(253-270)Online publication date: 20-Jun-2007
    • (2007)The diameter of randomly perturbed digraphs and some applicationsRandom Structures & Algorithms10.1002/rsa.2017230:4(484-504)Online publication date: 26-Mar-2007
    • (2006)Average-Case and Smoothed Competitive Analysis of the Multilevel Feedback AlgorithmMathematics of Operations Research10.1287/moor.1050.017031:1(85-108)Online publication date: 1-Feb-2006
    • (2005)Smoothed Analysis of Algorithms and HeuristicsProceedings of the 11th Annual International Conference on Computing and Combinatorics - Volume 359510.5555/2958119.2958123(10-11)Online publication date: 16-Aug-2005
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media