Selecting a selection procedure

J Branke, SE Chick, C Schmidt - Management Science, 2007 - pubsonline.informs.org
J Branke, SE Chick, C Schmidt
Management Science, 2007pubsonline.informs.org
Selection procedures are used in a variety of applications to select the best of a finite set of
alternatives.“Best” is defined with respect to the largest mean, but the mean is inferred with
statistical sampling, as in simulation optimization. There are a wide variety of procedures,
which begs the question of which selection procedure to select. The main contribution of this
paper is to identify, through extensive experimentation, the most effective selection
procedures when samples are independent and normally distributed. We also (a) …
Selection procedures are used in a variety of applications to select the best of a finite set of alternatives. “Best” is defined with respect to the largest mean, but the mean is inferred with statistical sampling, as in simulation optimization. There are a wide variety of procedures, which begs the question of which selection procedure to select. The main contribution of this paper is to identify, through extensive experimentation, the most effective selection procedures when samples are independent and normally distributed. We also (a) summarize the main structural approaches to deriving selection procedures, (b) formalize new sampling allocations and stopping rules, (c) identify strengths and weaknesses of the procedures, (d) identify some theoretical links between them, and (e) present an innovative empirical test bed with the most extensive numerical comparison of selection procedures to date. The most efficient and easiest to control procedures allocate samples with a Bayesian model for uncertainty about the means and use new adaptive stopping rules proposed here.
INFORMS