Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Expected Values Estimated via Mean-Field Approximation are 1/N-Accurate

Published: 13 June 2017 Publication History

Abstract

Mean-field approximation is a powerful tool to study large-scale stochastic systems such as data-centers -- one example being the famous power of two-choice paradigm. It is shown in the literature that under quite general conditions, the empirical measure of a system of N interacting objects converges at rate O(1√N) to a deterministic dynamical system, called its mean-field approximation.
In this paper, we revisit the accuracy of mean-field approximation by focusing on expected values. We show that, under almost the same general conditions, the expectation of any performance functional converges at rate O(1/N) to its mean-field approximation. Our result applies for finite and infinite-dimensional mean-field models. We also develop a new perturbation theory argument that shows that the result holds for the stationary regime if the dynamical system is asymptotically exponentially stable. We provide numerical experiments that demonstrate that this rate of convergence is tight and that illustrate the necessity of our conditions. As an example, we apply our result to the classical two-choice model. By combining our theory with numerical experiments, we claim that, as the load rho goes to 1, the average queue length of a two-choice system with N servers is log2 1/(1--ρ) + 1/(2N(1-ρ) +O(1/N2).

References

[1]
F Baccelli, FI Karpelevich, M Ya Kelbert, AA Puhalskii, AN Rybko, and Yu M Suhov. 1992. A mean-field limit for a class of queueing networks. Journal of statistical physics 66, 3--4 (1992), 803--825.
[2]
Michel Benaim and Jean-Yves Le Boudec. 2008. A class of mean field interaction models for computer and communication systems. Performance Evaluation 65, 11 (2008), 823--838.
[3]
Luca Bortolussi and Richard A Hayden. 2013. Bounds on the deviation of discrete-time Markov chains from their mean-field model. Performance Evaluation 70, 10 (2013), 736--749.
[4]
Henri Cartan. 1977. Cours de calcul différentiel. Hermann.
[5]
F Cecchi, SC Borst, and JSH van Leeuwaarden. 2015. Mean-field analysis of ultra-dense csma networks. ACM SIGMETRICS Performance Evaluation Review 43, 2 (2015), 13--15.
[6]
Augustin Chaintreau, Jean-Yves Le Boudec, and Nikodin Ristanovic. 2009. The Age of Gossip: Spatial Mean Field Regime. SIGMETRICS Perform. Eval. Rev. 37, 1 (June 2009), 109--120.
[7]
Jeong-woo Cho, Jean-Yves Le Boudec, and Yuming Jiang. 2010. On the validity of the fixed point equation and decoupling assumption for analyzing the 802.11 mac protocol. ACM SIGMETRICS Performance Evaluation Review 38, 2 (2010), 36--38.
[8]
Jaap Eldering. 2013. Normally Hyperbolic Invariant Manifolds-the Noncompact Case (Atlantis Series in Dynamical Systems vol 2). Berlin: Springer.
[9]
Patrick Eschenfeldt and David Gamarnik. 2016. Supermarket queueing system in the heavy traffic regime. Short queue dynamics. arXiv preprint arXiv:1610.03522 (2016).
[10]
Nicolas Gast and Gaujal Bruno. 2010. A Mean Field Model of Work Stealing in Large-scale Systems. SIGMETRICS Perform. Eval. Rev. 38, 1 (June 2010), 13--24.
[11]
Nicolas Gast and Bruno Gaujal. 2012. Markov chains with discontinuous drifts have differential inclusion limits. Performance Evaluation 69, 12 (2012), 623--642.
[12]
Nicolas Gast and Benny Van Houdt. 2015. Transient and steady-state regime of a family of list-based cache replacement algorithms. In Proceedings of the 2015 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems. ACM, 123--136.
[13]
Carl Graham. 2000. Chaoticity on path space for a queueing network with selection of the shortest queue among several. Journal of Applied Probability 37, 01 (2000), 198--211.
[14]
Vassili N Kolokoltsov, Jiajie Li, and Wei Yang. 2011. Mean field games and nonlinear Markov processes. arXiv preprint arXiv:1112.3744 (2011).
[15]
Thomas G Kurtz. 1970. Solutions of Ordinary Differential Equations as Limits of Pure Jump Markov Processes. Journal of Applied Probability 7 (1970), 49--58.
[16]
Thomas G Kurtz. 1978. Strong approximation theorems for density dependent Markov chains. Stochastic Processes and Their Applications 6, 3 (1978), 223--240.
[17]
Yi Lu, Qiaomin Xie, Gabriel Kliot, Alan Geller, James R Larus, and Albert Greenberg. 2011. Join-Idle-Queue: A novel load balancing algorithm for dynamically scalable web services. Performance Evaluation 68, 11 (2011), 1056--1071.
[18]
Malwina J Luczak and Colin McDiarmid. 2007. Asymptotic distributions and chaos for the supermarket model. arXiv preprint arXiv:0712.2091 (2007).
[19]
Wouter Minnebo and Benny Van Houdt. 2014. A fair comparison of pull and push strategies in large distributed networks. IEEE/ACM Transactions on Networking (TON) 22, 3 (2014), 996--1006.
[20]
Michael David Mitzenmacher. 1996. The Power of Two Random Choices in Randomized Load Balancing. Ph.D. Dissertation. PhD thesis, Graduate Division of the University of California at Berkley.
[21]
Charles Stein. 1986. Approximate computation of expectations. Lecture Notes-Monograph Series 7 (1986), i--164.
[22]
John N Tsitsiklis and Kuang Xu. 2011. On the power of (even a little) centralization in distributed processing. ACM SIGMETRICS Performance Evaluation Review 39, 1 (2011), 121--132.
[23]
Stephen RE Turner. 1998. The effect of increasing routing choice on resource pooling. Probability in the Engineering and Informational Sciences 12, 01 (1998), 109--124.
[24]
Benny Van Houdt. 2013. A mean field model for a class of garbage collection algorithms in flash-based solid state drives. In ACM SIGMETRICS Performance Evaluation Review, Vol. 41. ACM, 191--202.
[25]
Nikita Dmitrievna Vvedenskaya, Roland L'vovich Dobrushin, and Fridrikh Izrailevich Karpelevich. 1996. Queueing system with selection of the shortest of two queues: An asymptotic approach. Problemy Peredachi Informatsii 32, 1 (1996), 20--34.
[26]
Lei Ying. 2016. On the Approximation Error of Mean-Field Models. In Proceedings of the 2016 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Science. ACM, 285--297.
[27]
Lei Ying. 2016. On the Rate of Convergence of the Power-of-Two-Choices to its Mean-Field Limit. CoRR abs/1605.06581 (2016). http://arxiv.org/abs/1605.06581

Cited By

View all
  • (2024)Age of Information in Ultra-Dense IoT Systems: Performance and Mean-Field Game AnalysisIEEE Transactions on Mobile Computing10.1109/TMC.2023.3292515(1-14)Online publication date: 2024
  • (2024)An Incentive Algorithm for a Closed Stochastic Network: Data and Mean-Field AnalysisLa Matematica10.1007/s44007-024-00098-x3:2(651-676)Online publication date: 8-Apr-2024
  • (2023)The Join-the-Shortest-Queue System in the Halfin-Whitt Regime: Rates of Convergence to the Diffusion LimitStochastic Systems10.1287/stsy.2022.010213:1(1-39)Online publication date: Mar-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Measurement and Analysis of Computing Systems
Proceedings of the ACM on Measurement and Analysis of Computing Systems  Volume 1, Issue 1
June 2017
712 pages
EISSN:2476-1249
DOI:10.1145/3107080
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2017
Published in POMACS Volume 1, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. accuracy of approximation
  2. mean-field approximation
  3. power-of-two-choice
  4. queueing theory
  5. supermarket model

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)39
  • Downloads (Last 6 weeks)8
Reflects downloads up to 25 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Age of Information in Ultra-Dense IoT Systems: Performance and Mean-Field Game AnalysisIEEE Transactions on Mobile Computing10.1109/TMC.2023.3292515(1-14)Online publication date: 2024
  • (2024)An Incentive Algorithm for a Closed Stochastic Network: Data and Mean-Field AnalysisLa Matematica10.1007/s44007-024-00098-x3:2(651-676)Online publication date: 8-Apr-2024
  • (2023)The Join-the-Shortest-Queue System in the Halfin-Whitt Regime: Rates of Convergence to the Diffusion LimitStochastic Systems10.1287/stsy.2022.010213:1(1-39)Online publication date: Mar-2023
  • (2023)Bias and Refinement of Multiscale Mean Field ModelsACM SIGMETRICS Performance Evaluation Review10.1145/3606376.359352751:1(29-30)Online publication date: 27-Jun-2023
  • (2023)Performance Analysis of Work Stealing Strategies in Large-Scale Multithreaded ComputingACM Transactions on Modeling and Computer Simulation10.1145/358418633:4(1-23)Online publication date: 26-Oct-2023
  • (2023)Bias and Refinement of Multiscale Mean Field ModelsProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/35793367:1(1-29)Online publication date: 2-Mar-2023
  • (2023)Bias and Refinement of Multiscale Mean Field ModelsAbstract Proceedings of the 2023 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems10.1145/3578338.3593527(29-30)Online publication date: 19-Jun-2023
  • (2023)Age-Dependent Distributed MAC for Ultra-Dense Wireless NetworksIEEE/ACM Transactions on Networking10.1109/TNET.2022.322817331:4(1674-1687)Online publication date: Aug-2023
  • (2023)Mean-field fluctuations at diffusion scale in threshold-based randomized routing for processor sharing systems and applicationsStochastic Models10.1080/15326349.2023.225041840:2(296-339)Online publication date: 4-Sep-2023
  • (2023)Join-Up-To(m): improved hyperscalable load balancingQueueing Systems: Theory and Applications10.1007/s11134-023-09897-5105:3-4(291-316)Online publication date: 1-Dec-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media