Inverse uncertainty propagation for demand driven data acquisition
Abstract
When using simulations for decision making, no matter the domain, the uncertainty of the simulations' output is an important concern. This uncertainty is traditionally estimated by propagating input uncertainties forward through the simulation model. However, this approach requires extensive data collection before the output uncertainty can be estimated. In the worst case scenario, the output may even prove too uncertain to be usable, possibly requiring multiple revisions of the data collection step. To reduce this expensive process, we propose a method for inverse uncertainty propagation using Gaussian processes. For a given bound on the output uncertainty, we estimate the input uncertainties that minimize the cost of data collection and satisfy said bound. That way, uncertainty requirements for the simulation output can be used for demand driven data acquisition. We evaluate the efficiency and accuracy of our approach with several examples.
References
[1]
Ankenman, B., and B. Nelson. 2012. "A Quick Assessment of Input Uncertainty". In Proceedings of the 2012 Winter Simulation Conference, edited by C. Laroque, J. Himmelspach, R. Pasupathy, O. Rose, and A. Uhrmacher, 241--250. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[2]
Ankenman, B., B. L. Nelson, and J. Staum. 2010, March. "Stochastic Kriging for Simulation Metamodeling". Oper. Res. 58 (2): 371--382.
[3]
Arendt, P. D., W. Chen, and D. W. Apley. 2011. "Improving Identifiability in Model Calibration Using Multiple Responses". ASME Conference Proceedings 2011 (54822): 1213--1222.
[4]
Barton, R. 2012. "Tutorial: Input Uncertainty in Output Analysis". In Proceedings of the 2012 Winter Simulation Conference, edited by C. Laroque, J. Himmelspach, R. Pasupathy, O. Rose, and A. Uhrmacher, 67--78. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[5]
Barton, R., B. Nelson, and W. Xie. 2010. "A Framework for Input Uncertainty Analysis". In Proceedings of the 2010 Winter Simulation Conference, edited by B. Johansson, S. Jain, J. Montoya-Torres, J. Hugan, and E. Yücesan, 1189--1198. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[6]
Baumgärtel, P., and R. Lenz. 2012. "Towards Data and Data Quality Management for Large Scale Healthcare Simulations". In Proceedings of the International Conference on Health Informatics, 275--280: SciTePress - Science and Technology Publications.
[7]
Biller, B., and C. Gunes. 2010. "Introduction to Simulation Input Modeling". In Proceedings of the 2010 Winter Simulation Conference, edited by B. Johansson, S. Jain, J. Montoya-Torres, J. Hugan, and E. Yücesan, 49--58. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
[8]
Chantrasmi, T., and G. Iaccarino. 2012. "Forward and Backward Uncertainty Propagation for Discontinuous System Response Using the Padé-Legendre Method". International Journal for Uncertainty Quantification 2 (2): 125--143.
[9]
Cramér, H. 1946. Mathematical Methods of Statistics. Princeton University Press.
[10]
Fischer, T., A. M. Wahl, and R. Lenz. 2014. "Automated QoS-Aware Configuration of Publish-Subscribe Systems at Design-Time". In Proceedings of the 8th ACM International Conference on Distributed Event-Based Systems.
[11]
Fonseca, J. R., M. I. Friswell, J. E. Mottershead, and A. W. Lees. 2005. "Uncertainty Identification by the Maximum Likelihood Method". Journal of Sound and Vibration 288 (3): 587--599.
[12]
Genz, A., and B. Keister. 1996. "Fully Symmetric Interpolatory Rules for Multiple Integrals Over Infinite Regions with Gaussian Weight". Journal of Computational and Applied Mathematics 71 (2): 299--309.
[13]
Girard, A., and R. Murray-Smith. 2005. "Gaussian Processes: Prediction at a Noisy Input and Application to Iterative Multiple-Step Ahead Forecasting of Time-Series". In Switching and Learning in Feedback Systems, edited by R. Murray-Smith and R. Shorten, Volume 3355 of Lecture Notes in Computer Science, 158--184. Springer Berlin Heidelberg.
[14]
Groot, P., P. Lucas, and P. van den Bosch. 2011. "Multiple-Step Time Series Forecasting with Sparse Gaussian Processes". In Proceedings of the 23rd Benelux Conference on Artificial Intelligence (BNAIC 2011), Ghent, 105--112.
[15]
Jeffreys, S. H. 1961. Theory of Probability. 3rd ed. Oxford University Press.
[16]
Law, A. M. 2007. Simulation Modeling and Analysis. 4th ed. McGraw Hill.
[17]
Lee, S. H., and W. Chen. 2007. "A Comparative Study of Uncertainty Propagation Methods for Black-Box Type Functions". ASME Conference Proceedings 2007 (48078): 1275--1284.
[18]
Mares, C., J. Mottershead, and M. Friswell. 2006. "Stochastic Model Updating: Part 1 - Theory and Simulated Example". Mechanical Systems and Signal Processing 20 (7): 1674--1695.
[19]
Novak, E., and K. Ritter. 1999. "Simple Cubature Formulas with High Polynomial Exactness". Constructive Approximation 15 (4): 499--522.
[20]
O'Hagan, A. 2006. "Bayesian Analysis of Computer Code Outputs: A Tutorial". Reliability Engineering & System Safety 91 (10-11): 1290--1300. The Fourth International Conference on Sensitivity Analysis of Model Output (SAMO 2004) - SAMO 2004.
[21]
Powell, M. 1994. "A Direct Search Optimization Method That Models the Objective and Constraint Functions by Linear Interpolation". In Advances in Optimization and Numerical Analysis, edited by S. Gomez and J.-P. Hennart, Volume 275 of Mathematics and Its Applications, 51--67. Springer Netherlands.
[22]
Quinonero-Candela, J., C. E. Rasmussen, and C. K. Williams. 2007. Large-Scale Kernel Machines, Chapter Approximation Methods for Gaussian Process Regression, 203--224. Cambridge, MA: MIT Press.
[23]
Rasmussen, C. 2004. Gaussian Processes in Machine Learning, Volume 3176 of Lecture Notes in Computer Science, 63--71. Heidelberg: Springer-Verlag. Copyright by Springer.
[24]
Rasmussen, C. E. 1996. Evaluation of Gaussian Processes and Other Methods for Non-Linear Regression. Ph. D. thesis, University of Toronto.
[25]
Santner, T., B. Williams, and W. Notz. 2003. The Design and Analysis of Computer Experiments. Springer Series in Statistics. Springer.
[26]
Snelson, E. 2006. "Variable Noise and Dimensionality Reduction for Sparse Gaussian Processes". In Proceedings of the 22nd Annual Conference on Uncertainty in AI: AUAI Press.
[27]
Snelson, E., and Z. Ghahramani. 2006. "Sparse Gaussian Processes Using Pseudo-Inputs". Advances in Neural Information Processing Systems 18.
[28]
Song, E., and B. L. Nelson. 2013. "A Quicker Assessment of Input Uncertainty". In Proceedings of the 2013 Winter Simulation Conference, edited by R. Pasupathy, S.-H. Kim, A. Tolk, R. Hill, and M. E. Kuhl, 474--485. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers, Inc.
Recommendations
Uncertainty Propagation through Software Dependability Models
ISSRE '11: Proceedings of the 2011 IEEE 22nd International Symposium on Software Reliability EngineeringStochastic models are often employed to study dependability of critical systems and assess various hardware and software fault-tolerance techniques. These models take into account the randomness in the events of interest (aleatory uncertainty) and are ...
Uncertainty Propagation in Data Processing Systems
SoCC '18: Proceedings of the ACM Symposium on Cloud ComputingWe are seeing an explosion of uncertain data---i.e., data that is more properly represented by probability distributions or estimated values with error bounds rather than exact values---from sensors in IoT, sampling-based approximate computations and ...
Patterns for Implementing Uncertainty Propagation
EuroPLoP '18: Proceedings of the 23rd European Conference on Pattern Languages of ProgramsIn this paper, the design patterns Uncertain Number and Propagation Strategy are presented. They are useful for storing uncertainties of values and propagating them throughout calculations in an application. Uncertain Number represents a numerical value ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Sponsors
Publisher
IEEE Press
Publication History
Published: 07 December 2014
Check for updates
Qualifiers
- Research-article
Conference
WSC '14
Sponsor:
Acceptance Rates
WSC '14 Paper Acceptance Rate 205 of 320 submissions, 64%;
Overall Acceptance Rate 3,413 of 5,075 submissions, 67%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 59Total Downloads
- Downloads (Last 12 months)7
- Downloads (Last 6 weeks)0
Reflects downloads up to 21 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in