The impact of initial designs on the performance of MATSuMoTo on the noiseless BBOB-2015 testbed: A preliminary study

Most surrogate-assisted algorithms for expensive optimization follow the same framework: After an initial design phase in which the true objective function is evaluated for a few search points, an iterative process builds a surrogate model of the expensive function and, based on the current model, a so-called infill criterion suggests one or more points to be evaluated on the true problem. The evaluations are used to successively update and refine the model. Implementing surrogate-assisted algorithms requires several design choices to be made. It is practically relevant to understand their impact on the algorithms' performance. Here, we start to look at the initial design phase and experimentally investigate the performance of the freely available MATLAB Surrogate Model Toolbox (MATSuMoTo) with regard to the initial design. The results are preliminary in the sense that not all possible choices are investigated, but we can make first well-founded statements about whether Latin Hypercube or uniform random sampling should be preferred and about the effect of the size of the initial design on the performance of MATSuMoTo on the 24 noiseless test functions of the BBOB-2015 test suite.