A unified offline-online learning paradigm via simulation for scenario-dependent selection
Article No.: 259, Pages 1 - 12
Abstract
Simulation has primarily been used for offline static system design problems, and the simulation-based online decision making has been a weakness as the online decision epoch is tight. This work extends the scenario-dependent ranking and selection model by considering online scenario and budget. We propose a unified offline-online learning (UOOL) paradigm via simulation to find the best alternative conditional on the online scenario. The idea is to offline learn the relationship between scenarios and mean performance, and then dynamically allocates the online simulation budget based on the learned predictive model and online scenario information. The superior performance of UOOL paradigm is validated on four test functions by comparing it with artificial neural networks and decision tree.
References
[1]
Brantley, M. W., L. H. Lee, C.-H. Chen, and A. Chen. 2013. "Efficient simulation budget allocation with regression". IISE Transactions 45(3):291--308.
[2]
Ding, L., L. J. Hong, H. Shen, and X. Zhang. 2019. "Knowledge gradient for selection with covariates: Consistency and computation". arXiv preprint arXiv:1906.05098.
[3]
Frazier, P., W. Powell, and S. Dayanik. 2009. "The knowledge-gradient policy for correlated normal beliefs". INFORMS Journal on Computing 21(4):599--613.
[4]
Gao, S., J. Du, and C.-H. Chen. 2019. "Selecting the optimal system design under covariates". In 2019 IEEE 15th International Conference on Automation Science and Engineering, 547--552. Institute of Electrical and Electronics Engineers, Inc.
[5]
Hong, L. J., and G. Jiang. 2019. "Offline simulation online application: A new framework of simulation-based decision making". Asia-Pacific Journal of Operational Research 36(06):1940015.
[6]
Jones, D. R., M. Schonlau, and W. J. Welch. 1998. "Efficient global optimization of expensive black-box functions". Journal of Global optimization 13(4):455--492.
[7]
Li, H., H. Lam, Z. Liang, and Y. Peng. 2020. "Context-dependent ranking and selection under a bayesian framework". In 2020 Winter Simulation Conference, 2060--2070: Institute of Electrical and Electronics Engineers, Inc.
[8]
Pedrielli, G., K. Selcuk Candan, X. Chen, L. Mathesen, A. Inanalouganji, J. Xu, C.-H. Chen, and L. H. Lee. 2019. "Generalized Ordinal Learning Framework (GOLF) for Decision Making with Future Simulated Data". Asia-Pacific Journal of Operational Research 36(06):1940011.
[9]
Scott, W., P. Frazier, and W. Powell. 2011. "The correlated knowledge gradient for simulation optimization of continuous parameters using gaussian process regression". SIAM Journal on Optimization 21(3):996--1026.
[10]
Shen, H., L. J. Hong, and X. Zhang. 2021. "Ranking and selection with covariates for personalized decision making". INFORMS Journal on Computing.
[11]
Williams, C. K., and C. E. Rasmussen. 2006. Gaussian processes for machine learning. Cambridge: Massachusetts Institute of Technology press.
[12]
Xiao, H., L. H. Lee, and C.-H. Chen. 2015. "Optimal budget allocation rule for simulation optimization using quadratic regression in partitioned domains". IEEE Transactions on Systems, Man, and Cybernetics: Systems 45(7):1047--1062.
[13]
Xiao, H., L. H. Lee, D. Morrice, C.-H. Chen, and X. Hu. 2021. "Ranking and selection for terminating simulation under sequential sampling". IISE Transactions 53(7):735--750.
Recommendations
Online effects of offline ads
ADKDD '08: Proceedings of the 2nd International Workshop on Data Mining and Audience Intelligence for AdvertisingWe propose a methodology for assessing how ad campaigns in offline media such as print, audio and TV affect online interest in the advertiser's brand. Online interest can be measured by daily counts of the number of search queries that contain brand ...
From Online Behaviors to Offline Retailing
KDD '16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data MiningTo combat the ease of online shopping in pajamas, offline mall owners focus increasingly on driving satisfaction and improving retention by identifying customers' preferences. However, most of these studies are based on customers' offline consuming ...
Understanding Physicians’ Online-Offline Behavior Dynamics: An Empirical Study
Online healthcare platforms allow physicians and patients to communicate in a timely manner. Yet little is known about how physicians’ online and offline activities affect each other and, consequently, the healthcare system. We collected data from both ...
Physicians’ participation in online healthcare platforms serves to integrate online healthcare resources with the offline medical system. This integration brings opportunities for reshaping healthcare delivery systems. In the field of telemedicine, there ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
December 2021
2971 pages
Sponsors
In-Cooperation
- IIE: Institute of Industrial Engineers
- INFORMS-SIM: Institute for Operations Research and the Management Sciences: Simulation Society
- SCS: Shanghai Computer Society
Publisher
IEEE Press
Publication History
Published: 28 February 2022
Check for updates
Qualifiers
- Research-article
Conference
WSC '21
Sponsor:
Acceptance Rates
Overall Acceptance Rate 3,413 of 5,075 submissions, 67%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 13Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)1
Reflects downloads up to 22 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in