Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3393691.3394224acmconferencesArticle/Chapter ViewAbstractPublication PagesmetricsConference Proceedingsconference-collections
abstract
Public Access

Uniform Loss Algorithms for Online Stochastic Decision-Making With Applications to Bin Packing

Published: 08 June 2020 Publication History

Abstract

We consider a general class of finite-horizon online decision-making problems, where in each period a controller is presented a stochastic arrival and must choose an action from a set of permissible actions, and the final objective depends only on the aggregate type-action counts. Such a framework encapsulates many online stochastic variants of common optimization problems including bin packing, generalized assignment, and network revenue management. In such settings, we study a natural model-predictive control algorithm that in each period, acts greedily based on an updated certainty-equivalent optimization problem. We introduce a simple, yet general, condition under which this algorithm obtains uniform additive loss (independent of the horizon) compared to an optimal solution with full knowledge of arrivals. Our condition is fulfilled by the above-mentioned problems, as well as more general settings involving piece-wise linear objectives and offline index policies, including an airline overbooking problem.

Supplementary Material

MP4 File (3393691.3394224.mp4)
We consider a general class of finite-horizon online decision-making problems, where in each period, a controller is presented a stochastic arrival and needs to choose one of a set of permissible actions, and the objective measured at the end of the horizon depends only on the aggregate type-action counts. Such a framework encapsulates many online stochastic variants of common optimization problems including bin packing, generalized assignment, and network revenue management. In such settings, we study a natural model-predictive control algorithm that acts greedily based on an updated certainty-equivalent optimization problem in each period. We introduce a simple, yet general, condition under which this algorithm obtains uniform additive loss (independent of the horizon) compared to an optimal solution with full knowledge of arrivals. Our condition is fulfilled by the above-mentioned problems, as well as more general settings involving piece-wise linear objectives and offline index policies.

References

[1]
Alessandro Arlotto and Itai Gurvich. Uniformly bounded regret in the multisecretary problem. Stochastic Systems, 2019.
[2]
Janos Csirik, David S Johnson, Claire Kenyon, James B Orlin, Peter W Shor, and Richard R Weber. On the sum-of-squares algorithm for bin packing. Journal of the ACM (JACM), 53(1):1--65, 2006.
[3]
Varun Gupta and Ana Radovanovic. Lagrangian-based online stochastic bin packing. In ACM SIGMETRICS Performance Evaluation Review, volume 43, pages 467--468. ACM, 2015.
[4]
Alberto Vera and Siddhartha Banerjee. The bayesian prophet: A low-regret framework for online decision making. In Abstracts of the 2019 SIGMETRICS/Performance Joint International Conference on Measurement and Modeling of Computer Systems, pages 81--82. ACM, 2019.

Cited By

View all
  • (2023)Hindsight learning for MDPs with exogenous inputsProceedings of the 40th International Conference on Machine Learning10.5555/3618408.3619730(31877-31914)Online publication date: 23-Jul-2023
  • (2023)Robust budget pacing with a single sampleProceedings of the 40th International Conference on Machine Learning10.5555/3618408.3618478(1636-1659)Online publication date: 23-Jul-2023
  • (2023)Near-Optimal Packet Scheduling in Multihop Networks with End-to-End Deadline ConstraintsProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/36267817:3(1-32)Online publication date: 7-Dec-2023
  • Show More Cited By

Index Terms

  1. Uniform Loss Algorithms for Online Stochastic Decision-Making With Applications to Bin Packing

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGMETRICS '20: Abstracts of the 2020 SIGMETRICS/Performance Joint International Conference on Measurement and Modeling of Computer Systems
    June 2020
    124 pages
    ISBN:9781450379854
    DOI:10.1145/3393691
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 June 2020

    Check for updates

    Author Tags

    1. approximate dynamic programming
    2. model-predictive control
    3. online bin packing
    4. online stochastic decision-making

    Qualifiers

    • Abstract

    Funding Sources

    Conference

    SIGMETRICS '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 459 of 2,691 submissions, 17%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)116
    • Downloads (Last 6 weeks)20
    Reflects downloads up to 02 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Hindsight learning for MDPs with exogenous inputsProceedings of the 40th International Conference on Machine Learning10.5555/3618408.3619730(31877-31914)Online publication date: 23-Jul-2023
    • (2023)Robust budget pacing with a single sampleProceedings of the 40th International Conference on Machine Learning10.5555/3618408.3618478(1636-1659)Online publication date: 23-Jul-2023
    • (2023)Near-Optimal Packet Scheduling in Multihop Networks with End-to-End Deadline ConstraintsProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/36267817:3(1-32)Online publication date: 7-Dec-2023
    • (2023)Allocating with Priorities and Quotas: Algorithms, Complexity, and DynamicsProceedings of the 24th ACM Conference on Economics and Computation10.1145/3580507.3597733(209-240)Online publication date: 9-Jul-2023
    • (2021)Metaheuristic algorithms for one-dimensional bin-packing problems: A survey of recent advances and applicationsJournal of Intelligent Systems10.1515/jisys-2020-011730:1(636-663)Online publication date: 23-Apr-2021
    • (2021)Online Allocation and PricingOperations Research10.1287/opre.2020.206169:3(821-840)Online publication date: 1-May-2021
    • (undefined)Assign-to-Seat: Dynamic Capacity Control for Selling Train TicketsSSRN Electronic Journal10.2139/ssrn.3477339

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media